Guest Post by Willis Eschenbach
With altogether far too much fanfare for my taste, the Berkeley Earth Surface Temperature (BEST) project has not released its preliminary results.
Or at least I can’t find them. I just wanted the month-by-month data that their hotrod new computer program spits out at the end of its run. The results they’re all hot and bothered about.
But despite releasing a massive database, 39,000 stations, along with the code in Matlab (which does me no good at all), I can’t find anywhere their freakin’ results. You know, the actual results of their work? The monthly average global temperature, the stuff that they mangled to produce things like their PR graph shown in Figure 1:
Figure 1. Purports to show that the BEST temperature record, and all the others as well, are all going “in one direction”, nowhere but up. I’m sure you remember the Climategate mantra, “hide the decline”? Keep that in mind as we proceed.
So … that will show those shifty skeptics, even BEST says it’s warming nonstop, evidence is right there before your eyes.
What’s not to like? How can you argue with that? The science is in.
Since I couldn’t get their results, I did the next best thing, and digitized their results. Even then, I was frunstrated. As far as I could tell, they never showed their actual results. The closest I found is in Figure 1 of their paper here:
Figure 2. Figure 1 of BEST’s “Decadal Variations” paper. Everybody’s going up, up, up, although you can’t really see what anyone is doing.
I blew that Figure up, and digitized it. Sixty years, 720 data points, boooring. Plus I hate it that they’ve smoothed the data, that makes it useless for statistical work. But it could have given us an idea of what’s going on in each of the records … if they hadn’t printed them atop one another in confusing colors. Enough of the spaghetti graphs already, you mad scientist persons, they show nothing! Figure 3 shows the BEST dataset along with the other datasets, this time displaced from each other so that we can actually see what’s happening:
Figure 3. The BEST land-only temperature record, compared to other surface and satellite land-only temperature records. 12 month moving average data, sadly. Note the decline.
[UPDATE: An alert reader noticed what I did not, that this is a subset of the BEST dataset that does not contain the stations used by the other groups (NOAA, etc). He points out that the full dataset is again different, in that it in fact rises more than the partial dataset. I have updated the figure and struck out some text to include that.
However, this doesn’t fix the questions. The post 1998 record from all of the BEST data is much more poorly correlated with the current records (~0.65) than prior to 1998 (~0.90). So this does not verify or validate the current groups datasets.
Hmmm … that gives a very different picture than Figure 1. Even with the bizarre 12-month moving average, the BEST record is clearly the outlier since 1998. You would think that in the modern era, the BEST would agree more closely with the other records. And indeed, from about 1975 to 1998 they were moving in something like lockstep.
But both before and after that time period, the BEST results are a clear outlier. And since 1998, BEST has been in a slow decline … funny how that didn’t show up in Figure 1. Yes, I know, a ten-year moving average shouldn’t show anything within five years from the end of the dataset. And I’m sure folks will argue that it’s just coincidence that they chose that exact smoothing length, and that it was the chance selection of colors that jumbled up the spaghetti graph so it’s unreadable … but y’know, after a while “coincidence” wears thin. I’m going with a more nuanced explanation, that it was a “deliberately unconscious choice to hide the decline”, although certainly you are welcome to stick to the story that it’s all just an unfortunate chain of events …
CONCLUSIONS:
Conclusion 1. It is extremely sneaky to send a truncated, smoothed result like Figure 1 out to the media to announce your results. That’s advocacy disguised as science. They did it to make it look like the temperature was headed for the sky and that BEST agreed. Instead, BEST actually disagrees with the other datasets by claiming that over the last decade, land temperatures are dropping, not staying stable or rising as per the other datasets. Using a graph that didn’t show that is … curious. As Gollum would say … “Oooooh, tricksy”. Including you, Judith. Figure 1 was nothing but “hide the decline” PR spin. Bad scientists, no cookies.
Conclusion 1. The correlation between the old data points used by the current groups, and the new data used only by BEST, is quite poor after 1998. This is visible in the plots of both the partial and full BEST datasets. The reasons for this are not clear, but it provides no support for the current datasets.
Conclusion 2. First point. The raw terror point, the thought that has the AGW alarmists changing their shorts, is the dreaded 2°C rise that is forecast from CO2. That is supposed to be the mythical “tipping point”. Second point. If we look at the 10-year smoothed data in Figure 1, BEST says that in the last two centuries, the temperature has risen about two degrees.
Let me note that over that two-century time period there have been:
a) No known increase in extreme weather events.
b) No known increase in catastrophes (other than from increased populations and property in vulnerable areas).
c) No major costs, deaths or damage from sea level rise. And don’t bother me with Katrina. A Category 3 hurricane took down ancient poorly maintained levees on a city below sea level. Absent that, no problem.
d) No climate-related spread of various infectious diseases.
e) No known increase in droughts or floods.
f) No loss of Tuvalu or other coral atolls.
g) Actually, none of the horrendous outcomes or biblical plagues of frogs and the like which are supposed to accompany the Thermageddon™ of a two degree temperature rise occurred over the last two centuries. To the contrary, the increased warming seems to have been a net gain for most humans, animals, and plants. Nobody likes freezing their asterisk off, after all, and the warming has mostly been in extra-tropical winter nights. That’s the theory, at least, although the BEST data should be able to tell us more.
Conclusion 3. BEST has done the world a huge service by collating and collecting all the data in one place, and deserves credit for that.
But they have done the world a huge disservice by becoming media whores, by putting out a shabby imitation of science in Figure 1, and by making a host of claims before peer review is complete.
This last one astounds me, that they’ve done it before peer review is finished. Doug Keenan and William Briggs have both raised separate and cogent arguments that the BEST analysis contains flaws. That would make me nervous, they’re kinda heavyweights, although any man can be wrong … but no, the BEST folks are making a host of claims as though their paper has already passed peer review. It’s the same publicity circus that Muller put on for Congress. And what three-ring media circus would be complete without their own brand new personalized “hide the decline” poster?
Since they have held out for extreme transparency, or at least given lip-service to the idea, I would be very interested to find out the names of the reviewers.
Because certainly, one possible explanation of their brazen trumpeting of their results before the peer review process is finished is that the fix is in. Why else the confidence that the reviewers will not find fault with their work? It is extreme hubris at a minimum, which is reputed historically to have unpleasant sequelae involving wax and feathers …
w.
PS—The world is warming. It has been for centuries. Rather than saying anything about anthropogenic global warming, all the BEST dataset does is confirms that. How that’s gotten twisted into some supposed “victory” for the AGW crowd escapes me.

Theo Godwin, thanks for your posts.
Willis, thanks for following Scientific Method (with allowable human errors openly, promptly, fully and courteously corrected, as per real Scientific Method)
Harry Dale Huffman says: October 23, 2011 at 6:34 am
Peer review is thoroughly broken… THROUGHOUT THE SYSTEM. Only public transparency, not “back room review”, can save climate science.
The joy of blogs is the capacity of crowd-sourced review to regain the “Renaissance Man” holistic balance of good scientific knowledge AND clarity – when moderated for fairness courtesy and relevance, as generally happens here.
I would curious to know what would happen to BEST’s result if only the most reliable, least badly sited stations were used.
“DocMartyn says:
October 23, 2011 at 1:59 pm
Can anyone supply a reason for a 2:1 distribution of increasing/decreasing temperature, in the same continent……”
Whatever the cause, it has to be some local changing characteristics to get contrasting trends. It would be interesting to understand the characteristics of the positioning of the stations with contrasting trends. Gradual urbanisation (UHI) / decreasing aerosols will support a positive trend. Increasing aerosols, changing land use could cause a negative trend. But changes that last for 60 years would be rarer eg UHI would have a longer effective influence as say growth of population then central heating/aircon/traffic whereas land use change would be quicker and not an ongoing trend. Does the Berkeley study analyse the 33/66 split in any detail? I haven’t got there then.
Given there is this disparity and given that temperatures would be corrected for UHI is it reasonable to assume the correct adjustment has been made, as I assume they are not talking about raw data trends. The statement that UHI has little influence on overall trend is not necessariy applicable to the affect on individual stations. eg if 10% of stations were not adjusted down adequately to account for individual UHI the 33/66 could become 43/56. If the data were raw then only 66% positive trend would surprise me as removal of UHI would make a significant change in the split as I read that 27% sites have UHI as part of their trend.
Otherwise I have no idea how to answer your question.
Garrett says:
“Willis, I agree with Joel Shore and LazyTeenager here. This is not a victory for AGW per se. It’s a defeat to those who were trying to discredit the AGW theory by implying that the temperature data was tampered with and that the Earth probably wasn’t even warming. Maybe you didn’t think that way, but many of your fellow AGW critics did. There is still a large proportion of the US population (I believe of the order of 30%) who think that the Earth may not be warming. If these BEST results help to finally lay to rest the issue of whether the Earth is warming or not, i.e. if the large majority of AGW critics can all stop questioning the rise in temperature, then this will be an indirect victory for the AGW advocates. Why you may ask? Because trying to debate whether GW is man-made or not is next to impossible if the opposing side doesn’t even acknowledge the warming!”
• • •
Deconstruction follows:
1. Temperature data was tampered with, and such tampering continues, as this article by Willis clearly shows.
2. AGW is not a “theory”, it is an hypothesis with no verifiable, testable evidence supporting it. There may well be some minor warming due to the increase in CO2, but empirical evidence is lacking. That said, on balance the rise in CO2 has been harmless and beneficial.
3. Very few skeptics state that there has been “no” warming. If you can find such a statement, link to it, or cut and paste it along with the article title and the time and date it was posted.
4. The global warming we have experienced is extremely minor. The planet has warmed from 288K to 288.8K over a century and a half. Natural temperature fluctuations have routinely been many times that, and have occured over much shorter time scales.
5. Only computer models show AGW. Those models are programmed by people who stand to financially benefit by alarming the public. There is no empirical [real world] evidence of any global harm due to the rise in CO2. But there is ample evidence that more CO2 is very beneficial to the biosphere, and has caused increased agricultural production. Citations on request.
The entire “carbon” scare is based on a repeatedly falsified conjecture. Skeptics are simply asking for testable, empirical evidence, per the scientific method, showing that CO2 causes global harm. So far, no one has been able to produce any such evidence. What does that tell you?
anna v @ur momisugly here
The point is, too many armchair critics post in ignorance, adding heat rather than light. If one is going to criticise the IPCC or BEST whatever, one should at least read the material, as you have. Painfully ignorant commentary is no help to the skeptical viewpoint, and the best antidote is to have skeptics step in immediately and rectify simple misconceptions, rather than leaving it to others. Silence is tacit approval given to any garbage that agitates in the right direction, which results in a loss of credibility. The free-for-all criticism is nicely democratic, but ultimately incoherent.
I would dearly love to see a poll or any effort where the skeptical movement firms up around a set of non-contradictory views. .. actually, I’ll post on that in the new open thread.
So, BEST find even more warming than GISS? That it’s even worse than we thought? What a surprise.
Just like another confidence trick of the general populace, when the EU set up a working group to look at how to streamline the EU and return powers to a more local level, which then came up with the Lisbon Treaty and ever-more central unaccountable control.
It’s the same old same old.
Smokey says:
October 23, 2011 at 4:15 pm
————————————————
Smokey my old friend I hesitate to correct you but AGW is not a hypothesis.
Rather it is chain of suppositions of the if this then that kind leading to some assertion, in this case that mankind is warming the globe.
Physics is at it’s heart the science of measurement and a hypothesis can be tested either by experiment or observation only provided that it is possible to measure to an appropriate degree of precision the results thereof.
It is true AGW is much titivated with calculation most of which can neither be verified nor would have any meaning even if they could be. To this is added observation to spurious levels of precision and so on and so forth.
This is not hard science rather whole idea of AGW belongs to the realm of metaphysics, literally beyond or after physics, one discipline of which specialises in trying to consider whether any useful meaning can be got from such chains or pyramids of unsupported supposition.
So please do not dignify AGW with the title of hypothesis, which gives it an air of scientific authority and respectability which it entirely lacks.
Kindest Regards
a jones,
You’re correct, AGW is a conjecture because it is not testable.
Lucy Skywalker says:
Spencer and Christy’s UAH satellite data set show about 1.5X as much warming over land as over the oceans since its inception in 1979 : http://vortex.nsstc.uah.edu/data/msu/t2lt/uahncdc.lt Is that affected by UHI too?
a jones says:
October 23, 2011 at 5:37 pm
“Rather it is chain of suppositions of the if this then that kind leading to some assertion, in this case that mankind is warming the globe.”
Actually, it is a collection of hunches. They are very good hunches but they do not amount to science.
Smokey says:
It tells me that organizations such as the National Academy of Sciences are much, much better able to judge and weigh scientific evidence than ideologues on the web.
Lucy Skywalker says:
October 23, 2011 at 3:12 pm
“Theo Godwin, thanks for your posts.”
Lucy, thanks for the high-five. I am always pleased to see your contributions.
It is Goodwin, not Godwin. If it were Godwin, I would change it to Godwinson and claim to be heir to King Harold who lost the Battle of Hastings in 1066.
Richard Muller has been a true believer in CAGW since the early 1980s. He resigned from the Sierra Club over it. He is no converted sceptic. Although this has no direct bearing on the BEST analysis we are now less likely to believe what Muller says without greater scrutiny. If he has told a porky about his position in the debate, what else of what he says is suspect?
See http://blogs.dailymail.com/donsurber/archives/44855
The AMO is topping out and already causing a flat line in mean global ocean temp in the presence of declining PDO. The doomsday science, get rich quick crowd is running out of time to deep six the developed world with nightmare policy fail.
Joel Heinrich says:
October 23, 2011 at 2:35 am
Has anyone looked at the actual data that can be downloaded, the data.txt files? And I don’t mean plotted it with a program, but looked at it.
The BEST site states: “We mistakenly posted the wrong text data file (TMAX instead of TAVG). We apologize for any inconvenience or confusion this may have caused. The correct files are now in place and may be downloaded below.”
I got both versions. The first version, that was headed as Tmax has LOWER temperatures than the new version that is headed as Tavg. WTF? And the data still doesn’t make any sense. Like Chicago University Tavg in Dec 1982 of 13.3°C and Tavg in Jul and Aug 1983 of 13.1°C (Station ID 110766). Or Tmax in Feb 1984 of 3.5°C but Tavg of 7.8°C.
If they really used this data then it is no more than GIGO.
_______________________________________________________________________
I’m flabbergasted, you mean up is now down …. surely that can’t be.
“c) No major costs, deaths or damage from sea level rise. And don’t bother me with Katrina. A Category 3 hurricane took down ancient poorly maintained levees on a city below sea level. Absent that, no problem.”
I’m getting sick of hearing about Katrina. Katrina passed right over me in Florida before it went up and hit New Orleans….and at the same strength. We were up and running again inside 48hours with little problems and no looting or whining…. but then we prepare and get on with our lives and don’t wait for the FEMA handouts.
PS—The world is warming. It has been for centuries. Rather than saying anything about anthropogenic global warming, all the BEST dataset does is confirms that. How that’s gotten twisted into some supposed “victory” for the AGW crowd escapes me.
************************************************************************************************************
I think some skeptics heads are exploding because the BEST results re-confirm what most people already know. That the NASA, NOAA and HADCrut temperature reconstructions are robust and scientifically credible. And BEST was conducted by scientists who were sympathetic to skeptics, and indeed had the support of prominent skeptics.
Didn’t skeptics spend years claiming that the temperature reconstructions had been faked, fabricated, or manipulated to show a significant warming trend??? I’m sure if you did a cursory search on this blog, or other skeptic blogs, you would find that to be the case.
peter stone says:
October 23, 2011 at 8:28 pm
“Didn’t skeptics spend years claiming that the temperature reconstructions had been faked, fabricated, or manipulated to show a significant warming trend???”
You ask the right question. Anthony Watts had collected 30 years of metadata about weather stations and that data strongly suggests that the stations are unreliable. Anthony made this data available to Muller and BEST with the expectation that they were going to address the quality of the stations. They played Bait and Switch on him, violating his trust. They did not use his 30 year data but switched to a 60 year period. Thus, they chose not to address the question of station quality and that question remains as hot as it has been for years. If we wait for Warmista to do that empirical work, the question will remain hot forever.
Why is it that Warmista will do anything to avoid addressing empirical questions, including insulting people like Anthony? Can you explain the fierce fear of the empirical manifested by all Warmista?
kadaka (KD Knoebel) says:
October 23, 2011 at 12:59 pm
“From anna v on October 23, 2011 at 11:39 am:
Too true but climate scientists take that in their stride. That is why they invented anomalies. Their GCM models do not give good absolute temperatures, have a look at an analysis by Lucia.”
404 Not Found error. Site problem? Old link, article moved? Lucia flipped out after losing the battle with Lord Monckton, gave herself completely over to the Dark Side, and did a SkepSci rework of her site?
Mea maxima culpa, though I cannot see what is wrong with the link above. Here explicitly:
http://rankexploits.com/musings/2009/fact-6a-model-simulations-dont-match-average-surface-temperature-of-the-earth
Even though the link with greasemonkey and the explicit http/ are the same, the link in the previous post does not work . I hope the explicit works.
Lucia is a real lukewarmer.
I’m not sure whether to take the choice of the too-clever pseudonym “Chase Stoudt” as wishful-martyr thinking or self-fulfilling prophecy. Perhaps both? I suppose it might be his actual given name, but that would make his parents semantic child-molesters.
[REPLY: That is his real name. Do a Google search. it will be most enlightening. By the way, at WUWT we do give credit to those who use real names. -REP]
Perhaps BEST should have employed Peter..
@joel Shore, land-based CRUTEM is still twice as steep as MSU over land:
http://blog.sme.sk/blog/560/252537/uhi_glob.jpg
Joel Shore says: October 23, 2011 at 6:08 pm
Juraj V. says: October 23, 2011 at 11:39 pm
Joel
Maybe Juraj has your answer. I don’t know. And I’m not going to research this right now, just keep it filed at the back of my mind. There are already enough other factors to make me keep my suspicions (that should also make you keep yours), and since UAH is from 1979, the start of the most recent global warming episode, the difference could be nothing more than the normal sea/land differential – sea both warms less and cools less.
I’d like to know (a) what the land/sea differentials are doing now (b) how UAH satellite data is calibrated ie is its calibration free of possible UHI distortions?
Joel
How do you explain all these humungously clear UHI effects – whose size far exceeds that implied by BEST?
From anna v on October 23, 2011 at 9:48 pm:
First link has a single little space between “average-” and “surface”. Barely found it when comparing them, noticed a length change and moved the cursor through the URL to locate the gap. Very easy to miss.
Thanks for the link.