Mending Fences

Guest Post by Willis Eschenbach

Recently there have been a number of accusations and bad blood involving myself, David Evans, Joanne Nova, Lord Christopher Monckton, and Leif Svalgaard. Now, I cannot speak for any of them, but on my part, my own blood ended up mightily angrified, and I fear I waxed wroth.

However, I see no point in rehashing the past. What I want to do is to return to the underlying scientific questions. In that spirit, I apologize sincerely and completely for wherever I put in “something extra” in the previous discussion. In Buddhism, there’s a concept called “something extra”, and one is enjoined to avoid putting in “something extra”.

It is explained in the following way:

If I say “I am angry” that is simply a true statement.

But if I say “You made me angry”, that is something extra.

So I ask any and all of you to please accept my sincere apologies for whatever what I said that was something extra, so that we can move past this difficult time and get back to discussing the science. Both sides have legitimate grievances, and I am happy to make the first move to get past all of them by apologizing to all of you for whatever my part was in the bad blood. I hope that the other participants accept my apology in the spirit of reconciliation in which it is offered, and that we can move forwards without rancor or recriminations.

Regarding the science, let me go back to the original question, and see what I can do in the way of making my claims in a more Canadian manner. I’ll start by looking at the recent record of the “TSI”, the total solar irradiance:

total solar irradiation ceres dataFigure 1. Monthly total solar irradiance as measured by the CERES satellite. Vertical blue line shows mid-2004.

Now, if you don’t like the data from the CERES satellite, here’s the SORCE satellite data:

sorce daily tsi 2003 2014Figure 2. Daily total solar irradiance as measured by the SORCE satellite. Vertical red line indicates mid-2004.  SOURCE

Note what is happening in both graphs after mid-2004 (vertical lines in both plots). As in every solar cycle, the TSI declines somewhat, and bottoms out. Then, it starts to rise again. And by the end of the datasets, in both cases the TSI is higher that it was in 2004.

So what was the scientific dispute all about, the discussion that underlies all of the bad feelings?

It revolved around the following graph from David Evans, referenced by both Leif Svalgaard and Lord Monckton, showing the basis of his predicted upcoming global cooling :

total solar irradiance david evansFigure 3. David Evan’s graph of TSI (gold line), along with a centered 11-year moving average of the TSI data (red, with dotted blue extension), and a 25 year unspecified smooth of temperature, presumably a trailing average (blue line). (Click to enlarge)

Now, as you can see, the bright red line basically falls off the edge of the earth around 2004. The note says “The recent falloff in solar radiation started somewhere in 2003-2005″.

However, a look at both the SORCE and the CERES data shows no such “falloff in solar radiation”, neither precipitous nor otherwise. In fact, both datasets agree that by 2013 the TSI was well above the level in mid-2004.

Since there is no fall in the underlying data of any kind, why does the red 11-year average line show abrupt cooling starting around 2004?

The answer lies in the various problems with the graph.

• The TSI data is a splice of three datasets, with two of them showing the post-2000 period. This is a huge source of potential error in itself. However, it gets worse.

• One of the spliced datasets is the Lean TSI reconstruction, an outdated dataset that the authors of the reconstruction themselves admit is inaccurate.

• Another is the PMOD dataset. It is known to be reading low by 0.2 W/ms at the solar minimum, introducing a spurious apparently strong recent “cooling” where none exists.

• The 11-year centered average is an extremely bad choice for a filter for sunspot/TSI data. Because the solar cycle varies both longer and shorter than 11 years, at times the 11-year average actually reverses the sense of the data, converting peaks into valleys and valleys into peaks. Look at the period from 1760-1800 in Figure 3, for example. What is happening is that the frequency data is getting strongly aliased into the amplitude data. As a result, the average can end up far from the reality, particularly at the ends of the dataset.

For another example, look at the period just after 1740 in Figure 3. The 11-year average takes a huge vertical jump … but meanwhile back in the real word, the TSI itself is not rising at all. It is falling. Clearly, the large vertical jump in the red line is totally spurious.

• The TSI data has had about 900 days of “data” added to it using an arbitrarily chosen value. This is shown by the blue dots which indicate a continuing drop in the temperature.

So regarding the question of why the red line is acting so strangely, the answer is that we have a perfect storm of spliced data, bad data, arbitrary “data” added to the spliced bad data, and an extremely poor filter choice.

And as a result, the red line doesn’t represent reality in any shape or form. There is no precipitous drop in TSI starting around 2004. It doesn’t exist. Sure, the 11-year average says clearly that there is a huge drop starting around that time … but the actual data says something entirely different, as shown in Figures 1 and 2.

Now, in the heat of the moment Leif described the red line as being “almost fraudulent”. I think this was an over-reaction, but perhaps an understandable one. After all, if the red line were flipped over vertically it would make a lovely hockeystick, and if someone claimed warming was coming based on that hockeystick, people would call them alarmists … and calling someone an alarmist is certainly a close relative of calling them “almost fraudulent”.

However, my guideline is, never ascribe to malice what is adequately explained by error and misunderstanding. So I do not call their red line fraudulent, nor did I do so in the original discussion. Instead, I say that it is an error resulting from a misunderstanding. In any case, let me suggest that we leave out all ascription of motive and intent, that goes nowhere, and that we return to the science.

A more scientifically neutral description of the red line is that it is highly inaccurate and potentially misleading, because the apparent drop starting in 2003-2005 is simply an artifact of a combination of bad data and bad filtering.

Finally, to the degree that David Evans’ model predicts future cooling based on the red line, it is already falsified.

That is what I was trying to say, and I believe (subject to correction) that was what Leif was pointing out as well.

In closing, I will endeavor in this thread to keep my comments on as scientific a basis as possible, to avoid any personal references, and to not ascribe motive or intent. I request that everyone do the same. Many toes have already been stepped on in this discussion. Let’s see if we can simply discuss the science.

My best to all,

w.

VERY IMPORTANT: It is important in general, and in this discussion in particular, that you QUOTE THE EXACT WORDS THAT YOU DISAGREE WITH. Note that this doesn’t mean just referencing their entire comment. Quote the exact words of their comment that you think are in error, and tell us why you think those words are wrong. If you do not quote the exact words that you disagree with, none of us will know what you are referring to … and out of such misunderstandings grows animosity and misunderstanding.

Finally, please don’t delve into the rights and wrongs of what has happened in the previous discussions. I am not interested in the slightest in ascribing blame or responsibility. I have accepted my own responsibility for my own actions and apologized for wherever I was over the line. What I or the others did in the past is a blind alley, so please confine your comments to the science, and as the saying goes, “Let the dead past bury its dead”.

The climate data they don't want you to find — free, to your inbox.
Join readers who get 5–8 new articles daily — no algorithms, no shadow bans.
0 0 votes
Article Rating
611 Comments
Chris
July 17, 2014 10:58 am

Willis,
“Many toes have already been stepped on in this discussion.”
I rarely contribute, but in this I feel compelled. I think Jo and David were very clear in their hypothesis and its parameters. Whether it explains a natural occurrence or not, it is a fascinating observation that I agree is worthy of debate and deeper analysis.
I appreciate your efforts to debate and analyze (and I generally enjoy your posts – though I think you are often unfair with critical commenters), but it seems to me you made a mistake in your interpretation of their data and assumptions. It also seems clear to me that you are deliberately turning that error into the central theme of your argument against the stated hypothesis. Your apology, and the obfuscation that follows, is both confounding and disappointing. Apologies to Jeff Id, above, but I do not think you are acting like “the adult in the room.” If you were my son acting thus, I would advise you to apologize directly for all of this:
Eschenbach 1: “I begged David Evans, begged him please, please, to release the hidden code, to stop keeping the model equation a secret, to reveal the data, to expose the numbers of tunable parameters, to show the results of the out-of-sample tests that Jo says he’s already done …”
Eschenbach 2:“I begged Jo and David to publish, and I got the same answer we’ve gotten from every other pseudo-scientist, that for me to ask was wrong, wrong, wrong, and that they’d publish the code and data and out-of-sample tests when they damn well felt like it … science at its finest.”
Eschenbach 3: “…and admit that (at least according to their graph) they have made a wildly incorrect claim that the TSI has fallen precipitously since about 2004. It is on the basis of this supposed fall that they are predicting falling temperatures.”
Eschenbach 4: “But neither of us owe David Evans an apology. He’s the one that made the horrendous newbie mistake, not us.”
Eschenbach 5: “That quote from the graph itself clearly says that they have invented the data from March of 2013 to December of 2015, which is the 900 days of data that Leif mentions. Now, I’ve used the word “invented” for that data. The graph itself uses the word “assumed” for that data. And Leif used the word “fabricated” for that data.”
Eschenbach 6: “Next, David Evans has not released the data, the model, the model results, the equations, the out-of-sample tests, or any of the details. This is the same garbage we got from Michael Mann and Phil Jones. And now, here you are cluttering up WUWT with the same kind of garbage. There is no transparency. There is no data. There is no code. In what alternate universe does this pass for science?”
Eschenbach 7: “Christopher, I have a simple rule that has never failed me. When a man is hiding something, it’s because he’s got something to hide.”
Eschenbach 8: “I’m sad to see you and David Evans and Joanne taking up the habits of Mann and Jones, David. I’d thought y’all were scientists. Ah, well, live and learn.”
ask for forgiveness, and present your argument against Dr. Evans’s use of smoothing as respectfully as possible. You have not done that with this post, rather you have attempted, with impressive rigor, by the way, to rationalize and excuse your behavior. That negates the apology. (As to number 8 above, there is no excuse. For that statement alone you should be ashamed of yourself, or at the very least embarrassed.) I do not believe in moral relativism. Your behavior is wrong, Jo’s and David’s is not. Your criticism may have merit, but that does not excuse the personal attacks. Jo’s posts on this very thing – the way to debate with respect – are wonderful to read. Given how deeply she cares about the way the scientific debate is conducted, I imagine your posts and those from Dr. Svalgaard must have been particularly upsetting. You should apologize to both of them – directly and privately – if you haven’t already.
If your toes were stepped on, it is only because you placed them knowingly and willingly in front of the elephant.
I do not expect you to take this post from me, another anonymous commenter, seriously (though Anthony may pass along my email to you if you care to discuss directly or want to know my full name). My intent is not to attack you at all, but only to offer one man’s opinion of this bitter exchange. I know it can be difficult to accept our mistakes and shortcomings, but with honest self-reflection we all have the opportunity to better ourselves.
Thanks for reading, Willis. I hope you are enjoying Big Sky Country.
Chris

Mary Brown
July 17, 2014 11:01 am

Skeptics are skeptical and should fight about most everything. If everyone agreed and acted like cheerleaders, then we would start to look just like those…other people.

July 17, 2014 11:02 am

John West says:
July 17, 2014 at 10:43 am
1) The graph linked is titled:
“Total Solar Irradiance over a Solar Cycle”
Most people would consider a solar cycle the Sun’s 11 year (or so) cycle not our annual trip around the Sun.

The graph shows a full solar cycle [12 years]. Each year is plotted separately, so there are 12 curves [on top of each other].
3) Note that Northern Hemisphere Summer is during the lower TSI values… Now consider how this effect is amplified / negated as the orbital cycle moves through Milankovitch cycles
Actually not, the difference is enormous [almost 100 W/m2] as the date where we are farthest from the Sun varies from July [now] to January [during a glaciation].

AJB
July 17, 2014 11:04 am

Chris4692 says July 17, 2014 at 8:45 am
Mr. Evans’ graph (Figure 3) is not a running mean, it is a centered average.
What’s the difference? It uses a weighting scheme determined by SSN peak and trough metadata (either official max/min times from an input table or derived) to suppress variable frequency edge distortion that results from using a fixed averaging window. Read the code.

Andy Krause
July 17, 2014 11:13 am

Geronimo – “Above all else in life the way you interact with strangers is the most important. ” And then you go ahead with “self-serving”, “very clever” self-convinced” , you could try your own advice sometime.

DirkH
July 17, 2014 11:22 am

Chris says:
July 17, 2014 at 10:58 am
“Eschenbach 2:“I begged Jo and David to publish, and I got the same answer we’ve gotten from every other pseudo-scientist, that for me to ask was wrong, wrong, wrong,”
Weird. Those where their exact words?

July 17, 2014 11:30 am

An apology like this is no apology, but an apologia. Like Winston Churchill on Gallipoli. Jo is right.

July 17, 2014 11:46 am

Typically I enjoy your work Willis but in this post I have a problem. Now with any running average the beginning and end will be ‘not exactly’ the truth. The reason being, as you have pointed out in the past the newest data is highly influential. This being said, that precipitate drop off is probably an artifact of ‘the end’ of the data.
Now a couple of things stand out, first your two graphs of CERES and SOURCE are approx 11-12 years long. You then compare them to a graph demonstrating 400+ years. The biggest thing here is stretching the X axis, in your chosen graphs a small change cannot possible be demonstrated when compared to a 400+ yr x Axis. I do not have half the escritorial talent that you have so what I am attempting to get at is your Y-axis or at least your chosen data sets, show a range of 6W/M^2 while the 400+ yr graph shows a 1.8 W/M^2. Huge difference here, in fact if you look at the CERES data, it shows clearly a drop in .2W/M^2 the same exact drop (visually, I have not independently run numbers) as the longer range 400yr graph. The SOURCE data shows a minor drop to possibly no drop, then again the graph is not long enough to actually catch a change, nor is the Y-axis sensitive enough to demonstrate said change.
Finally, do not apologize… We all enjoy your posts.
Brian

gnomish
July 17, 2014 11:47 am

willis, really, using wuwt as a forum for slandering folks is just not called for.
everything good about wuwt is made a mockery.
the worst troll here, lately, is you, homie.

Magic Turtle
July 17, 2014 11:58 am

I have not been following this argument from its beginning and I cannot tell from the discussion here what the central points of the disagreement are or even whether the two sides agree about what they are. I only know – from what Willis has written in the article above – that although the disagreement has arisen over a purely intellectual-academic topic it has generated some angry, hostile emotions too. I think Willis has taken a courageous step in publicly owning his angry emotions and of apologising for them, which has earned him much respect in my eyes. I hope his magnanimous gesture of a willingness for reconciliation will be reciprocated by the other side in some fashion, although after reading the other side’s comments above I won’t hold my breath because they still sound pretty outraged and indignant to me. Perhaps Willis’s apology has not addressed the issue that is concerning them and therefore they remain aggrieved?
I think it would be helpful towards the settlement of this dispute if the other side could say at this stage whether they are satisfied by Willis’s apology and if not then what it is that they are still aggrieved about. Willis appears to have sought to address the issue that he thought they were aggrieved over. I think the ball is in their court now to say whether or not he has done so to their satisfaction.

Jon
July 17, 2014 12:01 pm

Isvalgard said:
“Solar activity is also visible: the tiny, tiny wiggles you sometimes can see on top of the curve due to varying distance. Bottom line: the Sun is very stable.”
http://www.leif.org/research/TSI-through-a-year.png
So SH summer should be warmer and NH should be milder?
Our star, The Sun, is stable but our planet, Earth, is unstable?

Jon
July 17, 2014 12:02 pm

Correction : So SH summer should be warmer and NH winter should be milder?

John A. Fleming
July 17, 2014 12:09 pm

The way you guys were behaving, I just about swore off this website for good.

DirkH
July 17, 2014 12:13 pm

Greg Goodman says:
July 17, 2014 at 4:55 am
“If you filter out the high frequencies, how can you have a sudden change ?!”
Low pass filters do not remove all high frequencies; they dampen them.
Here is the spectrum of a moving average.
http://demonstrations.wolfram.com/MovingAverageDiscreteFilters/
The remaining high frequency energy can therefore still create steep changes in the output signal even after it has been damped; depending on how big its amplitude was before dampening, and by how much it was dampened.

Mac the Knife
July 17, 2014 12:15 pm

Spliced data sets from different sources, different instruments, and even different proxies…. is seldom ‘a good idea’.
Many a slip betwixt cup and lip is too often the result.

July 17, 2014 12:16 pm

I think Willis is correct in that a boxcar 11 year smooth is bad; finite impulse response filters are easy to implement and can be offset to allow “instant” response, but can have bad aliasing effects. I routinely use infinite impulse response filters that exhibit lag, but have no frequency peak of their own to cause aliasing. I think that Jo Nova and the others using “11 year filters” would see less dramatic (but inherently partially lagged) results with an IIR filter.

Mark Bofill
July 17, 2014 12:20 pm

All right, I’ll try it and see what happens.
Beetlejuice, Beetlejuice, Beetlejuice!

nope, nothing.

T Control
July 17, 2014 12:23 pm

Anthony, Willis is running this blog into the ground. He’s a crank. He could have apologized personally like any normal person would do, but he’s turned it into this huge drama on your blog with his non-apology apology, and constantly telling commenters he doesn’t give a FF what they think. He has everyone all riled up and upset. You’re starting to sound snippy yourself. What’s happened over here? It’s sounding like Real Climate.
[Sorry you think that way, I don’t think it’s as bad as you dramatically describe. From my position, I’m damned if I do, damned if I don’t. So, let’s just consider me universally damned and carry on. If you have an issue with Willis, make it clear to him. – Anthony]

Jon
July 17, 2014 12:25 pm

Hmmm, according to this the Earth, with up to 100 W/m2 more sun energy, during 6 months during Winter(Oct to March), should be much much warmer?
http://www.leif.org/research/TSI-through-a-year.png
Why does not the extra 100W/m2 show up in the data?
http://wps.prenhall.com/wps/media/objects/2513/2574258/pdfs/E17.9.pdf
?

July 17, 2014 12:26 pm

Monckton of Brenchley says:
July 17, 2014 at 3:56 am
There are plenty of fraudsters in the climate scam,
Like this one: http://bbickmore.wordpress.com/lord-moncktons-rap-sheet/
or this one: http://www.realclimate.org/index.php/archives/2009/05/moncktons-deliberate-manipulation/comment-page-11/?wpmp_switcher=mobile&wpmp_tp=0
my comments stand.

1 7 8 9 10 11 25