NEW An update to this has been made here:
Part II
By Basil Copeland and Anthony Watts
In Part I, we presented evidence of a noticeable periodicity in globally averaged temperatures when filtered with Hodrick-Prescott smoothing. Using a default value of lambda of 100, we saw a bidecadal pattern in the rate of change in the smoothed temperature series that appears closely related to 22 year Hale solar cycles. There was also evidence of a longer climate cycle of ~66 years, or three Hale solar cycles, corresponding to slightly higher peaks of cycles 11 to 17 and 17 to 23 shown in Figure 4B. But how much of this is attributable to value of lambda (λ). Here is where lambda (λ) is used in the Hodrick-Prescott filter equation:
The first term of the equation is the sum of the squared deviations dt = yt − τt which penalizes the cyclical component. The second term is a multiple λ of the sum of the squares of the trend component’s second differences. This second term penalizes variations in the growth rate of the trend component. The larger the value of λ, the higher is the penalty.
For the layman reader, this equation is much like a tunable bandpass filter used in radio communications, where lambda (λ) is the tuning knob used to determine the what band of frequencies are passed and which are excluded. The low frequency component of the HadCRUT surface data (the multidecadal trend) looks almost like a DC signal with a complex AC wave superimposed on it. Tuning the waves with a period we wish to see is the basis for use of this filter in this excercise.
Given an appropriately chosen, positive value of λ, the low frequency trend component will minimize. This can be seen in Figure 2 presented in part I, where the value of lambda was set to 100.
Figure 2 – click for a larger image
A lower value of lambda would result in much less smoothing. To test the sensitivity of the findings reported in Part I, we refiltered with a lambda of 7. The results are shown in Figures 3 and 4.
Figure 3 – click for a larger image
As expected, the smoothed trend line, represented by the blue line in the upper panel of Figure 3, is no longer as smooth as the trend in the upper panel of Figure 1 from Part I. And when we look at the first differences of the less smoothed trend line, shown in Figure 4, they too are no longer as smooth as in Figure 2 from Part I. Nevertheless, in Figure 4, the correlation to the 22 year Hale cycle peaks is still there, and we can now see the 11 year Schwabe cycle as well.
Figure 4 – click for a larger image
The strong degree of correspondence between the solar cycle peaks and the peak rate of change in the smoothed temperature trend from HadCRUT surface temperature data is seen in Figure 5.
Figure 5 – click for a larger image
The pattern in Figure 4, while not as eye-catching, perhaps, as the pattern in Figure 2 is still quite revealing. There is a notable tendency for amplitude of the peak rate of change to alternate between even and odd numbered solar cycles, being higher with the odd numbered solar cycles, and lower in even numbered cycles. This is consistent with a known feature of the Hale cycle in which the 22 year cycle is composed of alternating 11 year phases, referred to as parallel and antiparallel phases, with transitions occurring near solar peaks.
Even cycles lead to an open heliosphere where GCR reaches the earth more easily. Mavromichalaki, et. al. (1997), and Orgutsov, et al. (2003) contend that during solar cycles with positive polarity, the GCR flux is doubled. This strongly implicates Galactic Cosmic Ray (GCR) flux in modulating global temperature trends. The lower peak amplitudes for even solar cycles and the higher peak amplitudes for odd solar cycles shown in Figure 4 appears to directly confirm the kind of influence on terrestrial climate postulated by Svensmark in Influence of Cosmic Rays on Earth’s Climate (1998)From the pattern indicated in Figure 4, the implication is that the “warming” of the late 20th century was not so much warming as it was less cooling than in each preceding solar cycle, perhaps relating to the rise in geomagnetic activity.
It is thus notable that at the end of the chart, the rate of change after the peak associated with solar cycle 23 is already in the negative range, and is below the troughs of the preceding two solar cycles. Again, it is purely speculative at this point, but the implication is that the underlying rate of change in globally averaged temperature trends is moderating, and that the core rate of change has turned negative.It is important to understand that the smoothed series, and the implied rates of change from the first differences, in figures 2 and 4, even if they could be projected, are not indications of what the global temperature trend will be.
There is a cyclical component to the change in global temperature that will impose itself over the underlying trend. The cyclical component is probably dominated by terrestrial dynamics, while the smoothed series seems to be evidence of a solar connection. So it is possible for the underlying trend to be declining, or even negative, while actual global temperature increases because of positive cyclical factors. But by design, there is no trend in the cyclical component, so that over time, if the trends indicated in Figures 2 and 4 hold, global warming will moderate, and we may be entering a phase of global cooling.
Some are probably wondering which view of the historical correspondence between globally averaged temperatures and solar cycles is the “correct” one: Figure 2 or 4?
Such a question misconstrues the role of lambda in filtering the data. Here lambda is somewhat like the magnification factor “X” in a telescope or microscope. A low lambda (less smoothing) allows us to “focus in” on the data, and see something we might miss with a high lambda (more smoothing). A high lambda, precisely because it filters out more, is like a macroscopic view which by filtering out lower level patterns in the data, reveals larger, longer lived processes more clearly. Both approaches yield valuable insights. In Figure 2, we don’t see the influence of the Schwabe cycle, just the Hale cycle. In Figure 4, were it not for what we see in Figure 2, we’d probably miss some similarities between solar cycles 15, 16, and 17 and solar cycles 21, 22, and 23.In either case, we are seeing strong evidence of a solar imprint in the globally averaged temperature trend, when filtered to remove short term periodicities, and then differenced to reveal secular trends in the rate of change in the underlying long term tend in globally averaged temperatures.
At one level we see clear evidence of bidecadal oscillations associated with the Hale cycle, and which appear to corroborate the role of GCR’s in modulating terrestrial climate. At the other, in figure 4B, we see a longer periodicity on the order of 60 to 70 years, correspondingly closely to three bidecadal oscillations. If this longer pattern holds, we have just come out of the peak of the longer cycle, and can expect globally average temperature trends to moderate, and increased likelihood of a cooling phase similar that experienced during the mid 20th century.
In Lockwood and Fröhlich 2007 they state: “Our results show that the observed rapid rise in global mean temperatures seen after 1985 cannot be ascribed to solar variability, whichever of the mechanisms is invoked and no matter how much the solar variation is amplified.” . Yet, as Figure 5 demonstrates, there is a strong correlation between the solar cycle peaks and the peak rate of change in the smoothed surface temperature trend.
The periodicity revealed in the data, along with the strong correlation of solar cycles to HadCRUT surface data, suggests that the rapid increase in globally averaged temperatures in the second half of 20th century was not unusual, but part of a ~66 year climate cycle that has a long history of influencing terrestrial climate. While the longer cycle itself may be strongly influenced by long term oceanic oscillations, it is ultimately related to bidecadal oscillations that have an origin in impact of solar activity on terrestrial climate.
We are continuing to look at different methods of demonstrating a correlation. Please watch for future posts on the subject.
NEW An update to this has been made here:
References:
Demetrescu, C., and V. Dobrica (2008), Signature of Hale and Gleissberg solar cycles in the geomagnetic activity, Journal of Geophysical Research, 113, A02103, doi:10.1029/2007JA012570.
Hadley Climate Research Unit Temperature (HadCRUT) monthly averaged global temperature data set (description of columns here)
J. Javaraiah, Indian Institute of Astrophysics, 22 Year Periodicity in the Solar Differential Rotation, Journal of Astrophysics and Astronomy. (2000) 21, 167-170
Katsakina, et al., On periodicities in long term climatic variations near 68° N, 30° E, Advances in Geoscience, August 7, 2007
Kim, Hyeongwoo, Auburn University, “Hodrick-Prescott Filter” March 12, 2004
M. Lockwood and C. Fröhlich, Recent oppositely directed trends in solar climate forcings and the global mean surface air temperature, Proceedings of the Royal Society of Astronomy doi:10.1098/rspa.2007.1880; 2007, 10th July
Mavromichalaki, et. al. 1997 Simulated effects at neutron monitor energies: evidence for a 22-year cosmic-ray variation, Astronomy and Astrophysics. 330, 764-772 (1998)
from Chile (AD 1587–1994)
, Planetary and Space Science 55 (2007) 158–164Svensmark, Henrik, Danish Metorological Institute, Influence of Cosmic Rays on Earth’s Climate, Physical Review Letters 15th Oct. 98
Wikipedia, Hodrick-Prescott Filter January 20, 2008





Anthony, I had asked for tabular data for your figure 4 on an earlier post. But I instead took by hand 1 Yr data points off your graph and used the EXCEL Fourier analysis tool.
REPLY: Check your email.
Anthony: Unless you use a ridiculously low sampling rate you are going to have to loop anyway, and it’ll move the decadal cycles out of musical frequencies. Using CD rate is (a) highly convenient for simple generation and (b) has a good auditory rationale (Nyquist = 22Khz, limit of human hearing)
I too would love to know how Bob B gets his great spectrum plot; clearest evidence yet, I’d say… Bob, did you replicate Basils/Anthony’s algorithm from scratch or somehow reverse engineer it from the graph? Then how did you get this plot from the raw FFT? It’s something I’ve been struggling with myself…
Mickeys – this is a model of how not to debate with people constructively. It relieves or indulges one’s feelings, but it does not help or convince them, and this should be the aim of debate. To put matters which one understands better in terms which the other party can both understand and accept. Anything else is self indulgent and counterproductive,
Bob B: Oh, I just noticed you asking for the raw data earlier – that explains it. But I’m still interested to know how you derive the wavelength plot from the raw FFT frequency domain output. I’ve been struggling with the fact that there aren’t enough harmonics to get that level of precision in the wavelength domain – e.g. harmonic 7 of 158 years is a wavelength of 22.5 years, harmonic 8 is 19.75. How do you interpolate the values for 20 and 21 years? Did you vastly pad the data first to get closer harmonics, and then sort the magnitudes into annual buckets?
I’m clearly missing something obvious here…
Anthony writes: RE: Jay, we recognize that we need to do a better job with figure 5. We are taking a new approach.
Actually, I don’t think the problem is just with figure 5. If you take each of your Hadcru peaks from Fig. 4 and calculate the actual phase of the solar cycle, they’re more or less randomly distributed. There doesn’t seem to be any significant clustering around the peaks, when you analyze the actual numbers.
I’m afraid that a lot of the commentary in this thread is missing the point.
REPLY: We are going through different methodologies to evaluate more rigorously. If you have suggestions, feel free to pass them along.
Paul Clark, thank you for appreciating my suggestion. Further to it, what I had in mind was even simpler than you suggested and that was to use an ordinary amplifier system and feed in a voltage scaled to the monthly or yearly data, without smoothing or messing about with it, maybe using a digital to analogue converter. I figured that if looking for a 22 year then you would want to vary the signal at a rate which would produce, say a 22 hertz signal for the 22 year cycle, so, apply the voltage at a 22 year per second and you would get a song 6/7 seconds long. This might actually be long enough to provide hearable sounds. Maybe quicker would be better, but that would reduce the listening time. I’d try it if I had any gear like that, but those days are 40 years ago. I hope something comes of it.
Das lied von der erde?
You’ll have to eliminate noise from volcanoes. The oceanic oscillations may or may not be in phase with the solar cycles, and we have poor historical data about them, so how to treat them is problematical. I’m almost certain that if there is lag in the oceans, it may vary, further compounding your search for correlations. But I believe there is a survivor, lost in the fog, and it’ll be found, eventually, if there.
===============================================
Thinking further on the Rayleigh R and the angle of the SS cycle. 0 to pi is 0.382 of the cycle, pi to 2pi 0.618, on the average. The cycle is not a true sinoid. Each cycle calculation needs separate treatment.
I’m living apart from my library but I’ll wildly guess polar coordinates might be more convenient.
If Tamino (or his Svengali) got the significance criteria right, I’ll bet the method, competently applied, gives roughly confirming results to Basil’s simpler, original approach at a cost of multiplied doubts (the eyeball method).
Hi Gary,
Last night before your private email, I found a method that would evaluate each cycle separately. We are in sync. Thanks very much for the ideas.
“Thinking further on the Rayleigh R and the angle of the SS cycle. 0 to pi is 0.382 of the cycle, pi to 2pi 0.618, on the average. The cycle is not a true sinoid. Each cycle calculation needs separate treatment.
I’m living apart from my library but I’ll wildly guess polar coordinates might be more convenient.
If Tamino (or his Svengali) got the significance criteria right, I’ll bet the method, competently applied, gives roughly confirming results to Basil’s simpler, original approach at a cost of multiplied doubts (the eyeball method).”
No it won’t, it’s quite clear from Fig 5 that there is a considerable variation in phase shift between the points. For example look at the shift for the first 4 points (allowing for the error on series 11) it’s opposite to the shift on the last three! Proper analysis will show no correlation between the two series, hopefully you’ll post this comment this time.
Anthony – thanks for posting Tamino’s comment with the link to his analysis. He has done some interesting work, as you acknowledge in your comments regarding the shortcomings of figure 5. I appreciate your willingness to take the criticism seriously, even if it wasn’t offered in the most constructive fashion. Once this hurdle is cleared, I’m sure the filter selection question will again arise. I’ve done some work comparing the impulse response of numerous filtering methods and the effect on the data. Upon completion, I’ll forward it if you are interested.
REPLY: Yes by alll means I’d love to look at it.
I have been looking at solar flare data: numbers and magnitude on a monthly basis. Nice wave pattern to it. There are peaks, slopes and troughs with an overall decline since spring of 06. I have eye-balled noticed that when flares drop below “M” class, so does the temperature data. When flares have risen to “M” and “X” classes in the same month, so does the temperature. Since M and X class solar flares eject material at near light speed, the time it takes to reach earth’s upper atmosphere is quite short but can be calculated.
Based on the wave pattern I am seeing in just a year’s worth of data, I am wondering if this data has long-term cycles as in decadel or even bidecadel, ultra long-term cycles as in millenial, and short term cycles as in seasonal, that can be filtered to show these patterns.
I am also wondering if this data has a mathematical predictive nature to temperature fluctuations and change patterns. I like things I can measure in time from signal onset to effect. Maybe that is why I am seeing a possible pattern.
REPLY: I ahve no idea about flare data, I have not studied it at all – Anthony
re: flares
There was a spike to X class flares in Dec 06 and then a spike in global temp around Jan 07. There were M class flare spikes in Apr 06 and in July 06, and then there were two temp spikes around the same time (I am only eyeballing graphs, not data tables).
hmmmmm
In terms of a different analysis for Figure 5, I would just start with the time each temperature cycle and each solar cycle peaks and the difference between the two.
Tamino’s analysis is specifically chosen to appeal to his readers (as always). It is not designed to see if there is a real correlation between the two. it is designed to throw you off (as always.)
If the average difference is less than 2 years (preferably closer to less than 1 year), then you really have something.
Plot the average difference in time between the two maximums versus time. If it is a scattergram congregating around a zero difference over time (with very few outliers above +/-2 years) then you have something. If the scatter shows a trend over time (2 cycles above zero, then 2 cycles below zero) then you have another thing.
Add the solar and temperature minimum correlations to the mix and you really, really have something.
Note that there will be outliers caused by the ENSO given its large impact (unless the trade winds and Kelvin waves are also driven by the solar cycle which will result in even the ENSO outliers matching up.) Volcanoes wil also impact the outliers, specifically Tambora in 1815, Krakatoa in 1893, and possibly El Chichon in 1984 and Pinatuba in 1991.
Have you guys looked at the Scafetta and West paper on solar and climate correlation; they seem to think there is a match for very short periods, not just the Schwabe and Hale cycles; they have developed a methodology specifically to counter random and non-gaussian accusations like Tamino has thrown at you. The link is: http://www.fel.duke.edu/~scafetta/pdf/opinion0308.pdf
REPLY: Yes we are all over that paper, thanks
To all of you posting on this blog,a million thanks for what you do.I am a truck driver from Southern California with only a highschool education but lots of curiosity.As I watch all the lemmings run off into the nonexistant Global warming sea,I am astonished at their religious like zeal in ignoring the plain truth in front of them.My only wish is for a layman’s paper explaining all this so that I can better communicate the truth to all who will take five minutes and listen to reason.Again thank you so very much for all your effort.Sincerely,
Bob Kendall
REPLY: Thanks Bob, here is one I can recommend for you done by a friend, Warren Meyer.
http://www.climate-skeptic.com/2008/01/my-best-skeptic.html
Bob, this link also is worth reading for a simplified view of the controversy:
http://www.middlebury.net/op-ed/global-warming-01.html
re: the paper you are all over
Solar flare data in table format (including plottable format) can be had at http://www.ngdc.noaa.gov/stp/SOLAR/ftpsolarflares.html
Average global temperature data can be had at
http://www.data360.org/dsg.aspx?Data_Set_Group_Id=1655
I wonder if solar flares are like God pointing a big finger at the source and cause of Earth’s temperature fluctuations. God even has a neon sign called the Northern Lights advertising the damned thing.
By the way, that big spike in temperature in Jan of 07 was preceded by 4 HUGE flares (X class), all in Dec 06.
Anthony
re: the Duke paper you are all over
Solar flare data is VERY interesting. I assume you know where to find the plottable formatted data?
REPLY: We’ve only been concentrating on SSN’s Thanks for the suggestion and for the link in the prior post. It ended up in the spam filter due to the embedded URL’s
Cohenite:
What about Taminos post is “random and non-gaussian accusations”? Didn’t you understand it, or did it simply go against your belief even if it is mathematically rigid? The whole point is that it shred the correlation between solar cycles and temp. rise to pieces. And that was what this post was all about.
Having said that, I appreciate that Watts has acknowledged that they are off the mark and currently try to improve their methodology. I guess they have already stumbled across it, but if not, what about using wavelets? It accounts for frequency change in time, as do not Fourier analysis.
Sorry to be a pest, but I presume you guys are familiar with Tung and Camp’s model-independent approach to climate sensitivity to solar fluctuations; that being the case, how do you think this non-model approach marries with Miskolczi’s realistic atmospheric model? I first considered Miskolczi as a complement to CO2 saturation processes, but on reflection Miskolczi seems to add something to feedback chronology, which is an issue that Real Climate base their critique of Scafetta’s paper. In respect of climate relaxation times, Stephen Schwartz has taken a, in retrospect, self-evident approach to planetary climate equilibrium sensitivity as a means of isolating temperature rises due to increased CO2 forcing. Do you guys have an opinion on this?
Could you comment on the attached from the UK’s Daily Telegraph ?
It seems to be concentrating mostly on the Svensmark hypothesis but goes on to include some standard AGW stuff, the IPCC states that………
http://www.telegraph.co.uk/earth/main.jhtml?xml=/earth/2008/04/03/scisolar103.xml
Phil,
There is no pertinence to the term ‘phase shift’ in the present context, Basil and Anthony are measuring the departure in time at SSN max of DT/dt^2 = 0 at the positive extrema. In no way are they attempting to measure, in their present study, phase relations between the solar cycle and any terrestrial cycle.
Obviously that correlation might be estimated by any number of methods and interested observers are grateful Tamino passed on on one, Raleigh’s R, that, though difficult to implement accurately here, might be useful.
What interests me in the short run is a visual comparison of the solar cycle, PDO/AMO cycles, and ‘global temperature’, the last being the most problematic data set for what it might imply about the actual energy being delivered over the past 200 years, a Gleissberg cycle.
One should be careful to analyze for oneself and not depend too closely on gadflies like Hansen’s Bulldog; his enthusiasm outstrips his talent.
Onanym:
I think you might start a blog devoted to ‘Dadaism and the discipline of automatic writing’ and find more Tamino fans than encountered here.
Oh, my DT/dt^2 above is supposed to mean second derivative of global Temperature with respect to time.