The Effect of Gleissberg's "Secular Smoothing"

Guest Post by Willis Eschenbach

sft full sunspot and just maximaABSTRACT: Slow Fourier Transform (SFT) periodograms reveal the strength of the cycles in the full sunspot dataset (n=314), in the sunspot cycle maxima data alone (n=28), and the sunspot cycle maxima after they have been “secularly smoothed” using the method of Gleissberg (n = 24). In all three datasets, there is no sign of the purported 80-year “Gleissberg Cycle”. In addition, the effect on the periodograms of missing data is investigated.

Continuing my investigations of the non-existence of the purported “Gleissberg Cycle”, at the suggestion of a commenter I’ve now done periodograms of the full sunspot dataset, the maxima only, and the “secular smoothed” maxima using Gleissberg’s method. I’ve also re-written the code for my “slow Fourier transform” so that it deals properly with irregularly spaced data. To get started, let’s look at the data itself, including the maxima (red line) and the minima (blue line):

full sunspot maxima and secular smoothedFigure 1. SIDC sunspot data since 1700. Red line shows the maximum value of each cycle. Blue line shows the cycle maxima after smoothing with Gleissberg’s “secular smooth”, a 1-2-2-2-1 trapezoidal filter.

For one thing, this would serve as the first real-world test for how well my “slow Fourier transform” performs when using a dataset that is both greatly reduced, and also irregular in time. So without further introduction, here are the periodograms of the sunspot data itself, and of the irregularly-spaced cycle peaks.

sft full sunspot and just maximaFigure 2. Periodograms of the total sunspot dataset (gold) and of the cycle maxima (red).

To begin with, let me say that I am amazed at how much information is contained in just the cycle peaks alone. Remember, the red line represents a mere 9% of the data, 91% of the data has been removed.

Next, looking at the full three centuries of sunspot data (gold), there are three main peaks, at 11 years, 102 years, and 52 years. There is no sign of Gleissberg’s 80-year cycle.

So how does using just the cycle peaks affect the results? Well, everything but the size of the main 11-year cycle has seen an increase in the reported strength of the cycle. This is because there is less data to constrain the fitting of the various lengths of sine waves, so they almost invariably end up larger than the corresponding cycle strength of the full dataset.

Despite all of that, however, the correlation between the two (red and gold) is impressively high, at 0.88. And it suggests that I should be able to further improve the results … more on that later, once I actually try it …

In any case, for purposes of investigating long-term results, there is little difference between using the full dataset and just the cycle peaks. Both of them, for example, show that rather than there being any strong “Gleissberg Cycle”, in fact 80 years is near the bottom of a dip in the cycle strength … and both the cycle peaks and the full dataset put the peak in the long-term cycles at about 100 years …

Having seen the results for the full data and the cycle maxima, what happens when we do the same analysis of Gleissberg’s “secularly smoothed” cycle maxima data? Figure 3 shows that result …

sft full sunspot maxima and secular smoothedFigure 3. Periodograms of the total sunspot dataset (gold), of the cycle maxima (red, grayed out), and of the “secularly smoothed” cycle maxima).

Like I said, I had no idea what the periodogram of the “secularly smoothed” data would look like. One real surprise was that it totally wiped out the peak that exists at around 55 years in both the full and cycle maxima periodograms. It has also knocked out almost all of the power in the cycles from about 15-50 years. I wouldn’t have guessed either of those.

Curiously, the part that the “secular averaging” didn’t affect are the cycles of 70 years and longer. Well, it pushed the peak back to about 99 years instead of 102 years, but other than that all three tell the same tale.

And the tale they are all telling is that there is no such thing as an 80-year “Gleissberg Cycle”. Doesn’t exist in the sunspot data, even using Gleissberg’s crazy method.

Now, I’m sure people will jump up and down and say “but, but, but there are 80-year cycles in the Nile river data” or some other dataset … but so what? There is no 80-year cycle in the sunspot data, so if anything, your 80-year cycles in the Nile river data show that the sunspot cycles don’t affect the Nile river levels.

That’s what I started out to do regarding the lack of the Gleissberg Cycle, so I’ll leave the story there …

However, having seen how well my slow Fourier transform (SFT) performs when using the cycle maxima data, I’ve got to try randomly knocking out parts of the sunspot data to see how well the SFT performs … hang on while I go do that. … OK, here’s what happens when I randomly knock out 10% of the sunspot data.

periodogram sidc sunspot data monte 10 percentFigure 4. Periodogram of the sunspot data, along with 30 instances of periodograms of the sunspot data with 10% of the data removed.

As can be seen, the loss of 10% of the data makes little practical difference to the results. This is quite encouraging. Next, here’s the same situation but with 50% of the data removed instead of 10% …

periodogram sidc sunspot data monte 50 percentFigure 5. Periodogram of the sunspot data, along with 30 instances of periodograms of the sunspot data with 50% of the data removed.

Obviously, there’s much more variation with half of the data being missing, it’s getting sketchier, but the results still might be useable.

My final conclusion is that my method deals quite well with missing data. My next project? Well, now that I’ve modified my code to not require regular dates for the time series, I want to take a look at the ice core records …

Onwards … always more to learn.

w.

Like I’ve Said Before: If you disagree with something I or someone else has said, please quote the exact words you disagree with. This avoids many misunderstandings.

Data: The adjusted SIDC data, along with the R slow Fourier transform functions to do the periodograms, are both available in a zipped folder here. In accordance with the advice of Leif Svalgaard, all sunspot values before 1947 have been increased by 20% to account for the change in sunspot counting methods. It makes little difference to this analysis. I believe the R code to be complete and turnkey. I’ve included an example with the functions.

 

0 0 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

54 Comments
Inline Feedbacks
View all comments
May 19, 2014 3:36 pm

Henry, to understand my point see what leif says. Im not saying that spots are not important.
Im suggesting that people not forget what the real physical units are at the bottom.
It aint spots, its flux.
“The SSN shows 98% correlation with the microwave flux from the Sun and therefore can be trusted to give a very close measure of real solar activity. ”
flux gives you real units. units with a physical meaning — that is a meaning within the laws of physics..
Why is that important?
well when people talk about taking the sq root of sunspot numbers.. you really want to check does taking the square root of flux make any sense. maybe it does, dunno. If it doesnt then you are potentially fooling yourself by doing data manipulations.

Greg Goodman
May 19, 2014 3:59 pm

It’s all a question of what causes the flux, or causes the change in flux.
Perhaps Lief could clarify whether he means flux density or total flux. He also suggested there were some hypotheses about the cause of centennial scale modulation.

May 19, 2014 5:46 pm

from: http://arxiv.org/pdf/math/0305364v3.pdf (frequency analysis of quasi-periodic signals)
“The Nyquist aliasing constraint means that to recover a given period, one needs
to sample the data with at least two points per period. On the opposite, in order
to determine precisely the long periods, one needs that the total interval length T
is several time larger than these periods, in order to reach the asymptotic
rates of theorems 1 and 2, or to be able to separate properly close frequencies.”
Your cutoff for analysis is at 100 years, which is only 3 cycles on your 300 year data length. I don’t think you have enough data especially for a quasi-periodic signal of 80 years. (the varying cycle for 10-12 years shows it’s quasiperiodic). You are close though. Can you get another 100 years of data?
Also I believe you are still failing to apply a window to the dataset, which means in the the actual math you’ve got a step function every 300 years from about 0 to 75 sunspots. That’s going to smear sinx/x of that step function over your frequency domain, and unfortunately the worst of that is going to appear right in the 80-150 year region which you were trying to analyze…

May 19, 2014 9:53 pm

Greg Goodman says:
May 19, 2014 at 3:59 pm
It’s all a question of what causes the flux, or causes the change in flux.
Perhaps Lief could clarify whether he means flux density or total flux.

The microwave flux is causes by the solar magnetism. Since the microwaves is radiated in all directions they have to cross a surface of 4 pi around the Sun, so the flux density and the total flux are just different by a constant factor [the area of the surface].

Greg Goodman
May 19, 2014 11:19 pm

Agreed, Peter, The long term part of the spectrum is unreliable. I think Willis would agree, he has made similar comments about >3x being required. What I’m not sure he appreciates is the effect of a long term rise. This will particularly effect periods that are a sub-multiple of the window length.
A way to see this would be to fit a “linear trend” to the data and do the SFT of just that trend for the 300 years sample period.
This site shows the FFT of a sawtooth. I think the 102y peak is largely a result of this, as is the circa 50y pk. Below that, the amplitudes make it small enough to ignore.
http://acad.carleton.edu/courses/musc108-00-w13/pages/11-MTPresentation2/11SynthesizedWaveforms.html
Windowing and detrending are classic solutions to reduce these artefacts but do themselves introduce distortions. So is diffing to remove autocorrelation. It’s not a simple situation with one correct solution. Like in most trades, this is where a bit of experience comes in.
Gleissberg’s last peak was 1938 so his running average “secular” filter would have started in 1728 stopped in 1917. That shows two peaks and two minima in his filtered series. Really insufficient to draw conclusions about the long periods in such noisy data with so few data points.
Willis is using all the data currently available .Willis’ 100y is 300/3 . What does the SFT look like if the data is cut off after the 1938 peak, as Gleissberg had it ?

May 19, 2014 11:38 pm


Don’t forget that after that, (leif will know when) they “corrected” the SSN data. So, if we hope to see what he had we must get the data and paper that he actually wrote.

Greg Goodman
May 19, 2014 11:39 pm

Lief: “The microwave flux is causes by the solar magnetism. Since the microwaves is radiated in all directions they have to cross a surface of 4 pi around the Sun, so the flux density and the total flux are just different by a constant factor [the area of the surface].”
That makes the rather unwarranted assumption that the microwave radiation is spherically symmetric in all directions and at all times, if you are going to extrapolate from point measurements to the whole sphere. IFAIK, we do not have the means to measure all directions from the sun.
My question was about the measured quantities you said matched to within 98% . Now SSN is an Earth-based observation. We do not have a cloud of satellites around the sun measuring the flux, so presumably that is primarily Earth or Earth orbit measurements too.
You made a specific comment that must relate to specific measurements in specific units. My guess is that these are flux density measurements. Could you clarify what the point of measurement was? Ground based, Earth orbit satellites, other?
It is very useful to know SSN ties into hard unit measurements. But to be informative it needs to be a bit more specific than “flux”. Could you provide a bit more info about exactly what measurements were compared to SSN?
Thanks.

May 19, 2014 11:59 pm

Greg Goodman says:
May 19, 2014 at 11:39 pm
That makes the rather unwarranted assumption that the microwave radiation is spherically symmetric in all directions and at all times, if you are going to extrapolate from point measurements to the whole sphere.
To the approximations involved the assumption is a good one. For once the F10.7 flux is measured on the ground as the total radiation received from visible part of the solar disk in narrow region around a wavelength of 10.7 cm. I don’t make ‘unwarranted assumptions’. You can learn about the flux here:
http://www.leif.org/EOS/1994SoPh-Tapping.pdf

May 20, 2014 12:31 am

@Steven Mosher @all
I will share with you that I know that a lower solar field strength allows more of the shortest wave particles to escape (UV-C), which react TOA to form ozone, peroxides and nitrogenous oxides. In turn, the increase in these compounds TOA deflect more sunlight to space. This is basiccally how the wolf-gleiszberg cycle works. Paradoxically, a somewhat “brighter”-, “lighter” sun causes cooling on earth. It is a defence system that earth has, to stop UV-C reaching earth./
So the important graph to watch is this one here:
http://ice-period.com/wp-content/uploads/2013/03/sun2013.png
Now, if anyone of you can tell me or guess what the next 44 or 46 years of that graph will look like, you are on your way to understand a big (important) part of the climate
as witnessed in the tables 2 and 3 here:
http://virtualacademia.com/pdf/cli267_293.pdf
best wishes
Henry

Greg Goodman
May 20, 2014 3:03 am

Lief, thanks for the reply. but…
404 Error File Not Found

May 20, 2014 10:18 am

HenryP says:
May 20, 2014 at 12:31 am
I will share with you that I know that a lower solar field strength allows more of the shortest wave particles to escape (UV-C)
No, HentyP that is absolutely positively wrong. You have several misconceptions about this and are totally confused. The graph you show is my graph of the polar fields of the Sun which have nothing to do with the ‘escape’ of UV waves [not particles]. What you ‘know’ is ‘not even wrong’.
Greg Goodman says:
May 20, 2014 at 3:03 am
Lief, thanks for the reply. but…404 Error File Not Found
Try now.

May 20, 2014 10:36 am

leif says
The graph you show is my graph of the polar fields of the Sun
henry says
I am using your graph? that’s funny. Then you are brilliant except for not interpreting it correctly yourself.
The declining magnetic fields allows more energetic particles to escape from the sun. Note the binomial you can draw from the top (hyperbolic) and the bottom (parabolic) showing that we must come to the bottom of the field strengths somewhere in 2016 or 2017.
Have you thought about that? Come to think about it myself, if anything were to happen to the planets in our solar system so that they do not arrive in time (2016), we are all buggered here. We will all freeze to death……
Anyway, I am not really interested in having an argument with you. You can ignore whatever I say if you think “it is not even wrong”

May 20, 2014 12:10 pm

HenryP says:
May 20, 2014 at 10:36 am
I am using your graph? that’s funny. Then you are brilliant except for not interpreting it correctly yourself.
Perhaps you can accept that you are confused. If not, I have tried to tell you that you are, but it is for you to realize it for yourself. If not, just carry on as usual in your own private world without interference from the truth.

May 20, 2014 1:09 pm

henry said
So the important graph to watch is this one here:
http://ice-period.com/wp-content/uploads/2013/03/sun2013.png
Now, if anyone of you can tell me or guess what the next 44 or 46 years of that graph will look like, you are on your way to understand a big (important) part of the climate
as witnessed in the tables 2 and 3 here:
http://virtualacademia.com/pdf/cli267_293.pdf
henry says
nobody even going to try and guess?

ren
May 21, 2014 12:00 am

HenryP, you’re right that the sun is brighter.

Reply to  ren
May 21, 2014 12:31 am

@ren
I am glad you agree.
Have figured out yet what the next 44-46 years of that solar polar fields strength graph will look like?

Dinostratus
May 21, 2014 2:34 am

I didn’t get to comment to the first SFT post before it got to hundreds of responses but now I just want to say, I really like seeing the phrase SFT. I see people write FFT like it is somehow better than a Fourier Transform, like it provides more or better information, like it’s an FT turned up to eleven. They have no idea that the FFT is just an algorithm for giving the results of an FT.
So I cheer the SFT. Let those noobs suck on their fastiness and pooh pooh the SFT not knowing that it’s just a means to the same end.

ren
May 21, 2014 6:58 am

HenryP judging from this chart, we have a very sharp decline in solar activity. At least the next cycle will be very weak in terms of of magnetic activity.
http://oi59.tinypic.com/2qumddx.jpg
The amount of magnetic storms shows a well scale changes in cycle 24.

ren
May 21, 2014 7:43 am

Taking into account that the magnetic storms are associated with CME (not with the amount of spots) you can see how weak the solar magnetic activity cycle 24.

May 21, 2014 10:54 am

ren says:
May 21, 2014 at 7:43 am
>i?Taking into account that the magnetic storms are associated with CME (not with the amount of spots) you can see how weak the solar magnetic activity cycle 24.
The number of CMEs in cycle 24 is not lower than that in cycle 23.

May 21, 2014 11:01 am

ren says:
May 21, 2014 at 7:43 am
Taking into account that the magnetic storms are associated with CME (not with the amount of spots) you can see how weak the solar magnetic activity cycle 24.
The number of CMEs in cycle 24 is not lower than that in cycle 23.

Bernie Hutchins
May 21, 2014 12:22 pm

Dinostratus said in part May 21, 2014 at 2:34 am:
“I didn’t get to comment to the first SFT post before it got to hundreds of responses but now I just want to say, I really like seeing the phrase SFT. I see people write FFT like it is somehow better than a Fourier Transform, like it provides more or better information, like it’s an FT turned up to eleven. They have no idea that the FFT is just an algorithm for giving the results of an FT…..”
NOPE! The FFT is a fast algorithm for EXACTLY computing the DFT (Discrete Fourier Transform). Because we can do very few integrals, the FT (better called CTFT or Continuous-Time Fourier Transform) is largely incomputable. Except numerically. (Many times we don’t even have a functional expression for a signal.) This numerical computation leads to the DFT. But because of sampling in both domains, the DFT pairs become periodic (aliased). With proper precautions (such as appropriate zero padding) we can interpret an FFT (DFT) as approximating a CTFT. In general, if you start with actual data (not a functional expression) you can’t compute a CTFT; only interpret an FFT as a CTFT approximation. The FFT is “superior” to the CTFT in the sense that you can always do it. The CTFT of actual data is generally not available.

ren
May 21, 2014 12:22 pm

Leif Svalgaard ,does the amount of magnetic storms is the same? The graph shows the number of magnetic storms. Is the graph is false?
On the 50 the strongest storms in cycle 23 and 24, just 5 of in the cycle of 24.
http://www.spaceweatherlive.com/en/solar-activity/top-50-solar-flares
I did not write about the number of CME, but the amount of magnetic storms.

ren
May 21, 2014 12:30 pm

Leif Svalgaard, do I have to explain? Not every CME cause magnetic storm on Earth.

ren
May 21, 2014 1:14 pm

Number of spots is 126 but they are not magnetically active. Right? There will be no magnetic storm on Earth.
Region Number of
sunspots Class
Magn. Class
Spot
2061 1 α HSX
2065 2 β BXO
2066 5 β DAO
2069 1 α AXX
2070 4 β BXO
2071 4 β CRO
2072 2 α AXX
2073 1 α HSX

May 22, 2014 10:23 am

The AP index proves your point REN.