Guest Post by Willis Eschenbach
Recapping the story begun at WUWT here and continued at WUWT here, data from the temperature station Darwin Zero in northern Australia was found to be radically adjusted and showing huge warming (red line, adjusted temperature) compared to the unadjusted data (blue line). The unadjusted data showed that Darwin Zero was actually cooling over the period of the record. Here is the adjustment to Darwin Zero:
Figure 1. The GHCN adjustments to the Darwin Zero temperature record.
Many people have written in with questions about my analysis. I thank everyone for their interest. I’m answering them as fast as I can. I cannot answer them all, so I am trying to pick the relevant ones. This post is to answer a few.
• First, there has been some confusion about the data. I am using solely GHCN numbers and methods. They will not match the GISS or the CRU or the HadCRUT numbers.
• Next, some people have said that these are not separate temperature stations. However, GHCN adjusts them and uses them as separate temperature stations, so you’ll have to take that question up with GHCN.
• Next, a number of people have claimed that the reason for the Darwin adjustment was that it is simply the result of the standard homogenization done by GHCN based on comparison with other neighboring station records. This homogenization procedure is described here (PDF).
While it sounds plausible that Darwin was adjusted as the GHCN claims, if that were the case the GHCN algorithm would have adjusted all five of the Darwin records in the same way. Instead they have adjusted them differently (see below). This argues strongly that they were not done by the listed GHCN homogenization process. Any process that changed one of them would change all of them in the same way, as they are nearly identical.
• Next, there are no “neighboring records” for a number of the Darwin adjustments simply because in the early part of the century there were no suitable neighboring stations. It’s not enough to have a random reference station somewhere a thousand km away from Darwin in the middle of the desert. You can’t adjust Darwin based on that. The GHCN homogenization method requires five well correlated neighboring “reference stations” to work.
From the reference cited above:
“In creating each year’s first difference reference series, we used the five most highly correlated neighboring stations that had enough data to accurately model the candidate station.”
and “Also, not all stations could be adjusted. Remote stations for which we could not produce an adequate reference series (the correlation between first-difference station time series and its reference time series must be 0.80 or greater) were not adjusted.”
As I mentioned in my original article, the hard part is not to find five neighboring stations, particularly if you consider a station 1,500 km away as “neighboring”. The hard part is to find similar stations within that distance. We need those stations whose first difference has an 0.80 correlation with the Darwin station first difference.
(A “first difference” is a list of the changes from year to year of the data. For example, if the data is “31, 32, 33, 35, 34”, the first differences are “1, 1, 2, -1”. It is often useful to examine first differences rather than the actual data. See Peterson (PDF) for a discussion of the use of the “first-difference method” in climate science.)
Accordingly, I’ve been looking at the candidate stations. For the 1920 adjustment we need stations starting in 1915 or earlier. Here are all of the candidate stations within 1,500 km of Darwin that start in 1915 or before, along with the correlation of their first difference with the Darwin first difference:
WYNDHAM_(WYNDHAM_PORT) = -0.14
DERBY = -0.10
BURKETOWN = -0.40
CAMOOWEAL = -0.21
NORMANTON = 0.35
DONORS_HILL = 0.35
MT_ISA_AIRPORT = -0.20
ALICE_SPRINGS = 0.06
COEN_(POST_OFFICE) = -0.01
CROYDON = -0.23
CLONCURRY = -0.2
MUSGRAVE_STATION = -0.43
FAIRVIEW = -0.29
As you can see, not one of them is even remotely like Darwin. None of them are adequate for inclusion in a “first-difference reference time series” according to the GHCN. The Economist excoriated me for not including Wyndham in the “neighboring stations” (I had overlooked it in the list). However, the problem is that even if we include Wyndham, Derby, and every other station out to 1,500 km, we still don’t have a single station with a high enough correlation to use the GHCN method for the 1920 adjustment.
Now I suppose you could argue that you can adjust 1920 Darwin records based on stations 2,000 km away, but even 1,500 km seems too far away to do a reliable job. So while it is theoretically possible that the GHCN described method was used on Darwin, you’ll be a long, long ways from Darwin before you find your five candidates.
• Next, the GHCN does use a good method to detect inhomogeneities. Here’s their description of their method.
To look for such a change point, a simple linear regression was fitted to the part of the difference series before the year being tested and another after the year being tested. This test is repeated for all years of the time series (with a minimum of 5 yr in each section), and the year with the lowest residual sum of the squares was considered the year with a potential discontinuity.
This is a valid method, so I applied it to the Darwin data itself. Here’s that result:
Figure 2. Possible inhomogeneities in the Darwin Zero record, as indicated by the GHCN algorithm.
As you can see by the upper thin red line, the method indicates a possible discontinuity centered at 1939. However, once that discontinuity is removed, the rest of the record does not indicate any discontinuity (thick red line). By contrast, the GHCN adjusted data (see Fig. 1 above) do not find any discontinuity in 1941. Instead, they claim that there are discontinuities around 1920, 1930, 1950, 1960, and 1980 … doubtful.
• Finally, the main recurring question is, why do I think the adjustments were made manually rather than by the procedure described by the GHCN? There are a number of totally independent lines of evidence that all lead to my conclusion:
1. It is highly improbability that a station would suddenly start warming at 6 C per century for fifty years, no matter what legitimate adjustment method were used (see Fig. 1).
2. There are no neighboring stations that are sufficiently similar to the Darwin station to be used in the listed GHCN homogenization procedure (see above).
3. The Darwin Zero raw data does not contain visible inhomogeneities (as determined by the GHCN’s own algorithm) other than the 1936-1941 drop (see Fig. 2).
4. There are a number of adjustments to individual years. The listed GHCN method does not make individual year adjustments (see Fig. 1).
5. The “Before” and “After” pictures of the adjustment don’t make any sense at all. Here are those pictures:
Figure 3. Darwin station data before and after GHCN adjustments. Upper panel shows unadjusted Darwin data, lower panel shows the same data after adjustments.
Before the adjustments we had the station Darwin Zero (blue line line with diamonds), along with four other nearby temperature records from Darwin. They all agreed with each other quite closely. Hardly a whisper of dissent among them, only small differences.
While GHCN were making the adjustment, two stations (Unadj 3 and 4, green and purple) vanished. I don’t know why. GHCN says they don’t use records under 20 years in length, which applies to Darwin 4, but Darwin 3 is twenty years in length. In any case, after removing those two series, the remaining three temperature records were then adjusted into submission.
In the “after” picture, Darwin Zero looks like it was adjusted with Sildenafil. Darwin 2 gets bent down almost to match Darwin Zero. Strangely, Darwin 1 is mostly untouched. It loses the low 1967 temperature, which seems odd, and the central section is moved up a little.
Call me crazy, but from where I stand, that looks like an un-adjustment of the data. They take five very similar datasets, throw two away, wrench the remainder apart, and then average them to get back to the “adjusted” value? Seems to me you’d be better off picking any one of the originals, because they all agree with each other.
The reason you adjust is because records don’t agree, not to make them disagree. And in particular, if you apply an adjustment algorithm to nearly identical datasets, the results should be nearly identical as well.
So that’s why I don’t believe the Darwin records were adjusted in the way that GHCN claims. I’m happy to be proven wrong, and I hope that someone from the GHCN shows up to post whatever method that they actually used, the method that could produce such an unusual result.
Until someone can point out that mystery method, however, I maintain that the Darwin Zero record was adjusted manually, and that it is not a coincidence that it shows (highly improbable) warming.
Sponsored IT training links:
Want to pass HP0-J33 at first try? Gets certified 000-377 study material including 199-01 dumps to pass real exam on time.



Willis Eschenbach (20:27:37) :
Thank you.
I just don’t see how any rational person can look at what was done at Darwin and defend the results.
Perhaps its too late for a quick “oops, we’ll fix it”. It does kind of amaze me that they circled the wagons with the Economist article. This will just end up making looking even stupider.
Rural Beeville 1895 – 2005
NOAA adjustments add a +2.8°F / Century Trend.
I will post a link to a graph tommorrow.
evanmjones (20:27:01) :
You are correct. According to Petersen the “first order” stations use a calendar day, midnite to midnite. Understandably, some people don’t want to use that interval. So a number of the stations don’t use midnite to midnite. But as long as you are not taking the observation near the time of min or max, it shouldn’t be a problem. Your suggestion of 11 AM is a good one.
However, all of this is really a subject for another thread.
tokyoboy (20:54:32) :
The data is plain text, compressed using “Z”. There are also .zip versions available at
www1.ncdc.noaa.gov/pub/data/ghcn/vw/zipd/
You could try those.
Can someone explain to me why in the top graph the temp. anomaly scale is different on the right side from the left side?
Seems to me that there is no way they could accidentally get that result.
The methodology seems to be striving towards a warming bias…. and deliberately so.
….There. I’ve said it.
My bad, one letter wrong
www1.ncdc.noaa.gov/pub/data/ghcn/v2/zipd/
There must be people who have lived, and more importantly, farmed in Darwin for fifty years. Have these people noticed the climate changing that rapidly?There must be some evidence, such as that they have to farm different things. Anyone from that part of the world here that has noticed things are 3° warmer?
Similarly, I find it hard to look at the figures shown for New Zealand and reconcile that with the actual weather we have. NIWA allege very rapid recent warming, yet there is no discernable difference. I’ve seen no actual evidence presented that our farmers are having to adapt, for example. My parents are keep gardeners, but haven’t noticed that frosts are any lighter and different plants will now grow.
Does this not bother the warming scientists? How do they reconcile their evidence with what they see with their own eyes?
Clive, I made a similar comment on another thread. yes, eventually the disparity between reality and official will be so obvious one would have to be a lunatic not to notice something smells in climate science. What’s worse is the disparity between the computer model predictions and even the fudged temperature data is already too significant. The computer models must now be dumped. Anyone who still relies on them are fools.
Hi Anthony,
As an engineer with a lifetime of experience in electrical measurement I cannot understand that in all the discussion I
have not seen the words Quality Assurance mentioned. All of our measurements and instruments had to have traceability and customers would full access to inspect our labs and our measurements. Every engineering firm dealing with Government of Semi-Government had to have similar QA procedures. Now while I can understand
that it would be difficult to apply QA to scientific theory it appears to me that the measurement of temperature should definitely have QA procedures and documentation. These should be available on request from the authorities concerned as no Government purchasing body in Australia or other Western countries will accept product from firms without QA. It is totally inconcievable to me that Anthony Watts and his crew of amateurs should be required to perform basic site QA .
The fact that not only do we have measurement without any quality assurance, the very processes used are not divulged.
I think all the climate warmists need is a detailed independent Quality Audit and most global warming will disappear!
REPLY: Agreed. I’ve been saying this for years. For example, why doesn’t climate data have an ISO-8000 certificate? Why doesn’t NCDC have an ISO-9000 rating? Private industry does these things, yet goevrnment seems to do everything haphazardly. – Anthony
Nothing going on in Gove, It’s at the same latitude as Darwin, roughly. It needs Homer Geneizing.
http://www.bom.gov.au/jsp/ncc/cdio/weatherData/av?p_nccObsCode=36&p_display_type=dataFile&p_startYear=&p_stn_num=014508
May have answered my own question.
This is from the Australian BOM site http://www.bom.gov.au/climate/cdo/about/definitionstemp.shtml They measure at 9am and it seems that the minimum measured is for that day (the reasonable assumption is that the 9am temp is past the morning minimum on a midnight to midnight cycle) and the maximum recorded is that registered on the previous day. So on these thermometers max/mins are recorded whenever they occur during the day and 9am is a convenient way of reading min. on that day and max. the previous day.
Was this always the case ? as it may effect the recorded temp.
Thanks Willis, for your thoughtful analysis.
Scott of Melb Australia (20:58:57) said:
Hmmm, is that a new unit of measure for temperature data that I am not aware of or did you mean microfiche?
Using the link Willis provided, I found this:
ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/daily/ghcnd-stations.txt
Listed in there are Canadian stations with serious errors. [I took the time to have a few of my concerns acknowledged by government officials (just to see if they would admit to quality issues – & they did without hesitation).]
hey Willis, petersons say the TOBS code can be purchased for a fee
[snip -waaayyy off topic, sorry]
Willis, I do not understand the two different scales on the left verticla axis and the right vertical axis. They don’t match, should they?
Willis,
Glad to see you sticking to your guns.
Clarification about 1940. The year 1940 is in my official data as the year the station moved from the Post Office to the airport (014016 to 014015).
Other official BOM data show a comparison which, unless mislabelled by them compares these 2 sites (lats and longs given) from Jan 1967 to Dec 1973. There is inconsequential change in the average temperature, though there is a bigger range in monthly data at one station, particularly in min temp.
Although this study was done after the shift, it seems to be compelling evidence that no significant correction needed to be applied to the long term data because of the station shift.
It is an unresolved matter if there were problems at the older PO station before 1940. I have never seen any explanation. I do not know why people make a correction in the few years before the station shift. Until a reason is given, I cannot see cause for anyone to make a step change before 1940, or more specifically, because of the station change in 1940 (which some people report was 1941, but then…). An algorith that makes a step change for no explained reason is hardly trustworthy.
Willis,
You still haven’t recognised the most cogent criticism of Giorgio Gilestro, who showed that if you looked at the whole distribution of GHCN adjustments, and not just one station, the distribution is fairly symmetric, with stations almost as likely to have the trend adjusted down than up. The average upward adjustment to trend was 0.0175 C/decade; much less than the Darwin figure.
You say that it is improbable that a station would show an apparent gradient change to a late rise of 6C/century. You give no basis for this statement. Giorgio’s kind of analysis does not help with that figure, but it does indicate how often an adjustment can produce a rise comparable to Darwin’s. The result is more meaningful when restricted to longer series, since a small change to a short series can too easily produce a large trend change. So looking at stations with more than 80 years in the adjusted record, this histogram shows the position of Darwin 0. It is an outlier – 31’st in a list of 2074 stations, ordered by change in gradient. But not so improbable as to say that it had to be adjusted manually. And 17 stations were adjusted downward by the same amount or more that Darwin was adjusted upwards.
You are wrong in saying that the GHCN algorithm would have adjusted the duplicates equally. The algorithm identifies changepoints by looking at whether the difference in slope between the sections on each side is over a certain limit. That slope depends on the length of sample.
Do you still maintain your underlined charge that
“Those, dear friends, are the clumsy fingerprints of someone messing with the data Egyptian style … they are indisputable evidence that the “homogenized” data has been changed to fit someone’s preconceptions about whether the earth is warming.??
“Santa makes his rounds later this week, but I’ve already received one of the best gifts ever: the complete unmasking of one of the most insidious movements of recent history – the radical effort to force reckless and needless constraints onto the human race in an attempt to change the planet’s climate.”
Mark Davis: The Gift of ‘Climategate’ is a Fresh Start
http://www.dallasnews.com/sharedcontent/dws/dn/opinion/viewpoints/stories/DN-markdavis_1220edi.State.Edition1.1d27b2e.html
JP Miller (22:39:57) :
“Willis, I do not understand the two different scales on the left verticla axis and the right vertical axis. They don’t match, should they?”
Read the legend for the heavy black line, at the bottom of the graph.
Dan Martin (21:42:09) :
Merely for clarity, so the black line (adjustments) doesn’t obstruct the view of what’s been done.
Back to Darwin Zero … If that upward trend continues at some point it would start to look actually silly … nonsensical and YET they could not reverse it could they? Because THAT would be a cooling trend. Gotcha!! ☺ Are “they” LOCKED into this big lie? They cannot reverse it now. Ohoh.
I think they want Copenhagen agreed ASAP because they probably see the temperatures declining in the near future and want to be able to claim that CO2 reduction is the reason. Hence the panic to start CO2 reduction ASAP, before the temperatures drop while CO2 continues to rise. I’m not sure how they would manage to record CO2 dropping enough to make a difference, unless they manipulate the data, but they’d never do that; or they claim the positive multiplier effect also works as a negative multiplier effect in reverse so that a teeny drop could save the world.
“Global warming has of late been a very hot topic in social media, and last week it was hotter than ever. Much of the added fuel came from climate change believers who engaged in the debate that had been dominated by skeptics.”
No Denying the Heat of Global Warming Debate in the Blogosphere
http://pewresearch.org/pubs/1446/global-warming-debate-on-blogs