More on the Bombshell David Rose Article: Instability in the Global Historical Climate Network

There has been a visceral reaction by the defenders of the climate faith to the Mail on Sunday article by David Rose…

mail-on-sunday-rose1

…where the Karl et al. 2015 “pausebuster” was not just called into question by a NOAA whistleblower, who [says] procedures weren’t followed, and that the authors “played fast and loose with the figures”, but basically called fraudulent on the face of it because it appears to have been done for political gain. In my opinion the lead authors, Thomas Karl and Thomas Petersen both retired from NOAA in the last two years, made this their “last big push”, so they didn’t fear any retribution.

Having met both of these people, and seen their zealotry, none of the shenanigans brought out by the David Rose article surprised me.

The faithful have been claiming that there’s no difference between the NOAA and HadCRUT temperature datasets depicted in the Rose article, saying it’s a baseline error that gives the offset. I’ll give them that, and that may have simply been a mistake by the Mail on Sunday graphics department, I don’t know.

MoS2 Template Master

When the baselines for anomalies are matched, the offset goes away:

Comparison of HadCRUT4 and NOAA global land/ocean monthly temperature anomalies put on a common 1961-1990 baseline.
Comparison of HadCRUT4 and NOAA global land/ocean monthly temperature anomalies put on a common 1961-1990 baseline. h/t The CarbonBrief

BUT….there’s other serious problems in global climate data.

Despite what you might think, NOAA and HadCRUT data are not entirely “independent”. They both use Global Historical Climate Network (GHCN) data, and the GHCN was administered by ….drum roll… Thomas Peterson of NOAA, one of the co-authors of the Karl et al. 2015 “pausebuster” paper.

It’s the fox guarding the henhouse, and as you can see below, the data is seriously shonky.

 writes at the website CliScep:


The purpose of this post is to confirm one detail of Bates’s complaint. The Mail article says that “The land temperature dataset used by the study was afflicted by devastating bugs in its software that rendered its findings ‘unstable’.” and later on in the article, “Moreover, the GHCN software was afflicted by serious bugs. They caused it to become so ‘unstable’ that every time the raw temperature readings were run through the computer, it gave different results.”

Bates is quite correct about this. I first noticed the instability of the GHCN (Global Historical Climatology Network) adjustment algorithm in 2012. Paul Homewood at his blog has been querying the adjustments for many years, particularly in Iceland, see here, here, here and here for example. Often, these adjustments cool the past to make warming appear greater than it is in the raw data. When looking at the adjustments made for Alice Springs in Australia, I noticed (see my comment in this post in 2012) that the adjustments made to past temperatures changed, often quite dramatically, every few weeks. I think Paul Homewood also commented on this himself somewhere at his blog. When we first observed these changes, we thought that perhaps the algorithm itself had been changed. But it became clear that the adjustments were changing so often, that this couldn’t be the case, and it was the algorithm itself that was unstable. In other words, when new data was added to the system every week or so and the algorithm was re-run, the resulting past temperatures came out quite differently each time.

Here is a graph that I produced at the time, using data that can be downloaded from the GHCN ftp site (the unadjusted and adjusted files are ghcnm.tavg.latest.qcu.tar.gz and ghcnm.tavg.latest.qca.tar.gz respectively) illustrating the instability of the adjustment algorithm:

alice

The dark blue line shows the raw, unadjusted temperature record for Alice Springs. The green line shows the adjusted data as reported by GHCN in January 2012. You can see that the adjustments are quite small. The red line shows the adjusted temperature after being put the through the GHCN  algorithm, as reported by GHCN in March 2012. In this case, past temperatures have been cooled by about 2 degrees. In May, the adjustment algorithm actually warmed the past, leading to adjusted past temperatures that were about three degrees warmer than what they had reported in March! Note that all the graphs converge together at the right hand end, since the adjustment algorithm starts from the present and works backwards. The divergence of the lines as they go back in time illustrates the instability.

There is a blog post by Peter O’Neill, Wanderings of a Marseille January 1978 temperature, according to GHCN-M, showing the same instability of the algorithm.  He looks at adjusted temperatures in Marseille, that illustrate the same  apparently random jumping around, although the amplitude of the instability is a bit lower than the Alice Springs case shown here.  His post also shows that more recent versions of the GHCN code have not resolved the problem, as his graphs go up to 2016. You can find several similar posts at his blog.

There is a lot more to be said about the temperature adjustments, but I’ll keep this post fixed on this one point. The GHCN adjustment algorithm is unstable, as stated by Bates, and produces virtually meaningless adjusted past temperature data.  The graphs shown here and by Peter O’Neill show this.  No serious scientist should make use of such an unstable algorithm. Note that this spurious adjusted data is then used as the input for widely reported data sets such as GISTEMP. Even more absurdly, GISS carry out a further adjustment themselves on the already adjusted GHCN data. It is inconceivable that the climate scientists at GHCN and GISS are unaware of this serious problem with their methods.

Finally, I just downloaded the latest raw and adjusted temperature datasets from GHCN as of Feb 5 2017. Here are the plots for Alice Springs. There are no prizes for guessing which is raw and which is adjusted. You can see a very similar graph at GISS.

alicefeb17

Full post: https://cliscep.com/2017/02/06/instability-of-ghcn-adjustment-algorithm/

Get notified when a new post is published.
Subscribe today!
0 0 votes
Article Rating
311 Comments
Inline Feedbacks
View all comments
TomRude
February 7, 2017 8:46 am

Yep, Heller posts this stuff all the time… So he’s right.

Johann Wundersamer
February 7, 2017 8:46 am

who saus procedures weren’t followed
-> who said procedures weren’t followed

François
February 7, 2017 8:48 am

I have not been to Alice Springs lately, so I can’t comment, but it just so happens that I spent my youth in Marseille (add an “s” if you so wish, the way the Brits do), ’twas sixty years ago. The last time I was there, I felt like it was a bit warmer but then again, I may be mistaken. Some trumpified alernative fact.

François
Reply to  François
February 7, 2017 9:15 am

Alternative.

john harmsworth
Reply to  François
February 7, 2017 3:25 pm

Be Alert! The world needs more lerts!

Schrodinger's Cat
February 7, 2017 8:49 am

It’s worse than we thought!

The Great Walrus
February 7, 2017 8:50 am

In terms of social issues, birth control and the rhythm method were replaced in the 1990s by climate control and the al-gore-rithm method. Popes have praised both.

Schrodinger's Cat
February 7, 2017 8:52 am

So the world’s global climate temperature records are created by an out of control algorithm that functions as a random number generator? And we spend billions on climate science. Wow.

Patrick Hrushowy
Reply to  Schrodinger's Cat
February 7, 2017 11:12 am

Spot on!

February 7, 2017 8:56 am

Assuming (despite some objections raised in the past) that the MetOffice CET data might be less manipulated than the various versions of the NOAA’s global temperature, it can be seen that both the coldest (February) and the warmest (August) months of the year show cooling trend since the beginning of this century
http://www.vukcevic.talktalk.net/CET-F-A.gif
The observed cooling trend is entirely consistent with decline in the solar activity since the apparent ending of Grand Solar Maximum.

gofigure560
Reply to  vukcevic
February 7, 2017 1:42 pm

Looks as if you didn’t include the 2015/16 temperatures which happens to be an el Nino. Since the trend starts at the end of the 97/98 el Nino, perhaps it should be run again including this time the current el Nino. (That tends to remove the claim of “cherry-picked’ start date, although it still depends on which el Nino (both natural events ) was stronger.

Reply to  gofigure560
February 7, 2017 1:52 pm

If you look carefully at the graph you will see that the temperatures for both 2015 (Feb = 4C, Aug = 15.9C) and 2016 (Feb = 4.9C, Aug = 17C) are included.

February 7, 2017 8:57 am

Please Sir. Can we now use the “F” word?

MarkW
Reply to  Jimmy Haigh
February 7, 2017 9:11 am

Fraulein?

john harmsworth
Reply to  MarkW
February 7, 2017 3:27 pm

Fraulein Freudulent!

kim
February 7, 2017 8:57 am

See Ken Fritsch deep in the second Bates’ post judithcurry.com
===============

Johann Wundersamer
February 7, 2017 9:00 am

There is a lot more to be said about the temperature adjustments, but I’ll keep this post fixed on this one point. The GHCN adjustment algorithm is unstable, as stated by Bates, and produces virtually meaningless adjusted past temperature data. The graphs shown here and by Peter O’Neill show this. No serious scientist should make use of such an unstable algorithm. Note that this spurious adjusted data is then used as the input for widely reported data sets such as GISTEMP. Even more absurdly, GISS carry out a further adjustment themselves on the already adjusted GHCN data. It is inconceivable that the climate scientists at GHCN and GISS are unaware of this serious problem with their methods.
____________________________________
So the positive feedback resonance in Catastrophic Climate Change doesn’t come from real world experience.
But from superfunded climate swindle computer models.
Ain’t that good news.
Man ain’t that news.

A C Osborn
Reply to  Johann Wundersamer
February 7, 2017 9:43 am

Just think of all the other real scientific work that has been done over the last 25 years where they have used said Temperature data.
None of it can be believed, if it was written 20 years ago when the past was much hotter and we belive the current data, it makes all their work useless.
If on the other hand the work was done in the last 5 or 10 years and we do not believe the current data, it then makes all their current work useless.
The real Scientists should hate the Climate Brigade, but because they always include the word “climate” in their papers they still get published, granted and paid, so that makes it all allright.
Science in total disrepute.

RobW
Reply to  A C Osborn
February 7, 2017 12:30 pm

I have said for years, “All of science will end up paying for this.”
Unfortunately when science is not to be trusted, the snake oil salesman take over. dark times ahaed for science ans society.

Wim Röst
February 7, 2017 9:15 am

The temperature adjustments have a high impact. Someone must be responsible.

Oatley
February 7, 2017 9:17 am

The only way to change this behavior is to administer consequence. And yes, I am suggesting legal and financial consequences for purposely manipulating data. We can start with Congressional subpoenas, questions under oath and perp walks…

CheshireRed
Reply to  Oatley
February 7, 2017 10:11 am

Oatley.
Exactly. Evidence that drives policy should be unimpeachable, replicable, archived and available for public analysis. Cook the books and you lose your licence, job or maybe even your liberty. This swamp needs a LOT of draining.

john harmsworth
Reply to  Oatley
February 7, 2017 3:31 pm

100% correct! A message needs to be sent regarding political abuse of science and the public trust. No one who studies this can even doubt that there is boatloads of deliberate and premeditated deception in all this. Mann, Karl, the whole damn hockey team and many others absolutely knew that what they were doing was misrepresenting data. Lock ’em up and take away their pensions!

February 7, 2017 9:19 am

comment image
Goodness gracious that’s some serious cooked bookery …. you absolutely NEED an independent audit otherwise there is ZERO credibility

Gerald Machnee
Reply to  Knute
February 7, 2017 10:02 am

As Griff says that adjustment above must be legitimate, and \i must try to understand it. Yes, now I understand, but why was the decrease in the 1880’s only 3 degrees. Oops, I forget, it is LEGITIMATE!
No further questions, your honor.

Reply to  Gerald Machnee
February 7, 2017 11:27 am

Also, degrees are like dollars — there’s an inflation factor that has to be figured in. It’s really quite complex, but take my word for it, … it is a legitimate practice.

Reply to  Knute
February 7, 2017 11:25 am

What if doctors fiddled with your blood pressure readings like this?

nn
February 7, 2017 9:21 am

The past has an uncertainty associated with it. The future is unpredictable. And even the present is malleable to conform with human expectations. The scientific domain is established with the observation and self-evident knowledge that accuracy is inversely proportional to time and space offsets from an observer’s frame of reference.

MarkW
Reply to  nn
February 7, 2017 11:33 am

What he said.

Bob Kutz
February 7, 2017 9:26 am

Looks a lot like an admission of guilt to me.

February 7, 2017 9:27 am

Its a shame there was a mistake in the Daily Mail article.
The faithful will now claim the whole thing is fake, Guardian readers will lap it up.

Janice Moore
Reply to  Owen Martin
February 7, 2017 10:53 am

Maybe so, Mr. Martin.
I think, however, they will still see the elephant…comment image

Reply to  Janice Moore
February 7, 2017 3:33 pm

Nice watercolor Janice!
I like it.

Janice Moore
Reply to  Janice Moore
February 7, 2017 4:25 pm

Glad you liked that, Mr. Theo. 🙂 Thank you for saying so.

Roger Knights
Reply to  Owen Martin
February 7, 2017 12:49 pm

Owen Martin February 7, 2017 at 9:27 am
Its a shame there was a mistake in the Daily Mail article.
The faithful will now claim the whole thing is fake, Guardian readers will lap it up.

They will follow Schopenhauer’s cynical advice:

Should your opponent be in the right, but, luckily for your contention, choose a faulty proof, you can easily manage to refute it, and then claim that you have thus refuted his whole position.
—Schopenhauer, The Art of Controversy, #37

Reply to  Owen Martin
February 7, 2017 3:25 pm

The Daily Mail suffers from being rubbish.
NOAA is meant to be respectable.
They shouldn’t hold themselves down to the level of the Daily Mail. That they are struggling to even reach that level is particularly incriminating.
Yet it matters not.
If all they can argue with is the illustration then people will notice they don’t mention the actual complaint.
This is about dodgy data archiving and manipulation and interpretation. Baselines on pictures are not relevant.

tony mcleod
Reply to  Owen Martin
February 7, 2017 3:46 pm

Calling it a “mistake” is being very generous.
Here is another squirrel for Janice. I know she likes pretty pictures.
http://iwantsomeproof.com/extimg/siv_annual_polar_graph.png
Taking bets on 2017 or 2018 being the first ‘blue-water Arctic in 10,000 years. Good luck with the AMOC and the PJS after that.

Janice Moore
Reply to  tony mcleod
February 7, 2017 4:37 pm

Dear Tony,
How sweet of you to send me that little homemade Valentine. I didn’t know you cared.
Now, Tony, this will be hard for you to hear and your admiration is flattering, but, I must make something very plain: you and I are not ever going to go on a date. If I have done anything to give you hope in that direction, please forgive me. It was not intentional.
Try Griff. You and she have a lot in common, you know. Just be sure to put lots of ice in her root beer and she will be happy.
Good luck.
Sincerely,
Janice

myNym
Reply to  tony mcleod
February 7, 2017 5:17 pm

There were predictions of an ice-free arctic starting in the late 1930s. Didn’t happen.
What are your predictions re: Antarctic ice extents?

Reply to  tony mcleod
February 8, 2017 2:23 pm

Past performance is no guarantee of future returns. Ie. The money has been spent.

Reply to  tony mcleod
February 9, 2017 8:29 pm

tony mclode:
Nice volume chart you present.
How did they determine the ice volume? In an age where most of the ice area charts are also modeled…
Just another pathetic model pumping out data for their climate alarmist fellow parasites.
Cutting off funds paying for trick data sites and researchers pumping out CO2 climate twaddle; 10. 9. 8.
PS mclode, the house of Representatives drives the budget legislation and they are solidly Republican. They will be so happy to pull a number of alarmist financial plugs.
PPS Perhaps you should get your employers to pay you in advance. Then when we deny you ever posted here, they’ll send collectors to talk to you.
PPPS Those alarmists don’t play nice.

David C, Greene
February 7, 2017 9:28 am

Will the AAAS’s Science now do a retraction of the “pause buster” paper?

Resourceguy
February 7, 2017 9:34 am

The real crime is in ignoring the senior scientist whistleblower now.

Resourceguy
February 7, 2017 9:36 am

Call in the FBI, when they are done over at EPA, IRS, VA, DoE, and State Dept.

Johann Wundersamer
February 7, 2017 9:45 am
AGW is not Science
February 7, 2017 9:45 am

In any genuine empirical science such a thing would be shocking. But then this is “Climate (as in psuedo) Science,” so it is hardly shocking.
Bottom line is the data that supposedly “supports” warming “caused by CO2” [which has never been observed to drive temperature in the past (but they like to ignore that inconvenient fact)] is at best crap and at worst outright [word that shall not be spoken here].

Troe
February 7, 2017 9:48 am

The existence of a pause in warming was denied publicly even when the consensus science could not explain it. Recall the admission of “no statistically significant warming” for over a decade by Phil Jones when asked by Parliament. Prior to that moment the pause was called a ruse of climate change denial.
Eventually the pause was accepted but a furious effort was under way to discredit it. Karl, et al is part of that effort. As with the IPCC it cannot find what it was designed not to find. This is the real meaning of science fit for purpose. Hockey sticks are manufactured the same way.

Roy Spencer
February 7, 2017 9:52 am

Chaotic Homogenization Algorithm

Reply to  Roy Spencer
February 7, 2017 12:59 pm

Chaotic Homoginization Algorithm … CHA for short, … or the later version, CHA CHA, … or the latest version, CHA CHA CHA.
Sounds like a dance around the truth to me.

john harmsworth
Reply to  Roy Spencer
February 7, 2017 3:35 pm

Hah! The Panic in Temperature Needle Park!

O R
Reply to  Roy Spencer
February 9, 2017 12:37 am

I think Dr Roy prefers “CCC” (Cadillac Calibration Cherrypick). A divine intervention that sets uncertainties straight…
The scientific equivalent of Maradona’s infamous “God’s hand” in FIFA World Cup 1986…

Bloke down the pub
February 7, 2017 9:53 am

The GHCN adjustment algorithm is unstable, as stated by Bates, and produces virtually meaningless adjusted past temperature data.
Or to use the technical term , gibberish.

Rob Dawg
February 7, 2017 10:10 am

I may not win anything for picking the correct temperaturecrecord but if enough of us “guess” the right one don’t we collectively win trillions of dollars?