What the BEST data actually says

Guest Post by Willis Eschenbach

My theory is that the BEST folks must have eaten at a Hollywood Chinese restaurant. You can tell because when you eat there, an hour later you find you’re hungry for stardom.

Now that the BEST folks have demanded and received their fifteen minutes of fame before their results have gone through peer review, now that they have succeeded in deceiving many people into thinking that Muller is a skeptic and that somehow BEST has ‘proven the skeptics wrong’, now that they’ve returned to the wilds of their natural scientific habitat far from the reach of National Geographic photographers and people asking real questions, I thought I might take a look at the data itself. Media whores are always predictable and boring, but data always contains surprises. It can be downloaded from the bottom of this page, but please note that they do not show the actual results on that page, they show smoothed results. Here’s their actual un-smoothed monthly data:

Figure 1. BEST global surface temperature estimates. Gray bars show what BEST says are the 95% confidence intervals (95%CI) for each datapoint.

I don’t know about you, but Figure 1 immediately made me think of the repeated claim by Michael Mann that the temperatures of the 1990s were the warmest in a thousand years.

WHAT I FIND IN THE BEST DATA

Uncertainty

I agree with William Briggs and Doug Keenan that “the uncertainty bands are too narrow”. Please read the two authors to see why.

I thought of Mann’s claim because, even with BEST’s narrow uncertainty figures, their results show we know very little about relative temperatures over the last two centuries. For example, we certainly cannot say that the current temperatures are greater than anything before about 1945. The uncertainty bands overlap, and so we simply don’t know if e.g. 2010 was warmer than 1910. Seems likely, to be sure … but we do not have the evidence to back that up.

And that, of course, means that Mann’s claims of ‘warmest in a mill-yun years’ or whatever he has ramped it up to by now are not sustainable. We can’t tell, using actual thermometer records, if we’re warmer than a mere century ago. How can a few trees and clamshells tell us more than dozens of thermometers?

Disagreement with satellite observations

The BEST folks say that there is no urban heat island (UHI) effect detectable in their analysis. Their actual claim is that “urban warming does not unduly bias estimates of recent global temperature change”. Here’s a comment from NASA, which indicates that, well, there might be a bias. Emphasis mine.

The compact city of Providence, R.I., for example, has surface temperatures that are about 12.2 °C (21.9 °F) warmer than the surrounding countryside, while similarly-sized but spread-out Buffalo, N.Y., produces a heat island of only about 7.2 °C (12.9 °F), according to satellite data. SOURCE

A 22°F (12°C) UHI warming in Providence, and BEST says no UHI effect … and that’s just a couple cities.

If there were no UHI, then (per the generally accepted theories) the atmosphere should be warming more than the ground. If there is UHI, on the other hand, the ground station records would have an upwards bias and might even indicate more warming than the atmosphere.

After a number of adjustments, the two satellite records, from RSS and UAH, are pretty similar. Figure 2 shows their records for global land-only lower tropospheric temperatures:

Figure 2. UAH and RSS satellite temperature records. Anomaly period 1979-1984 = 0.

Since they are so close, I have averaged them together in Figure 3 to avoid disputes. You can substitute either one if you wish. Figure three shows a three-year centered Gaussian average of the data. The final 1.5 years are truncated to avoid end effects.

Remember what we would expect to find if all of the ground records were correct. They’d all lie on or near the same line, and the satellite temperatures would be rising faster than the ground temperatures. Here are the actual results, showing BEST, satellite, GISS, CRUTEM, and GHCN land temperatures:

Figure 3. BEST, average satellite, and other estimates of the global land temperature over the satellite era. Anomaly period 1979-1984 = 0.

In Figure 3, we find the opposite of what we expected. The land temperatures are rising faster than the atmospheric temperatures, contrary to theory. In addition, the BEST data is the worst of the lot in this regard.

Disagreement with other ground-based records.

The disagreement between the four ground-based results also begs for an explanation. Note that the records diverge at the rate of about 0.2°C in thirty years, which is 0.7° per century. Since this is the approximate amount of the last century’s warming, this is by no means a trivial difference.

My conclusion? We still have not resolved the UHI issue, in any of the land datasets. I’m happy to discuss other alternative explanations for what we find in Figure 3. I just can’t think of too many. With the ground records, nobody has looked at the other guys’ analysis and algorithms harshly, aggressively, and critically. They’ve all taken their own paths, and they haven’t disputed much with each other. The satellite data algorithms, on the other hand, has been examined minutely by two very competitive groups, UAH and RSS, in a strongly adversarial scientific manner. As is common in science, the two groups have each found errors in the other’s work, and when corrected the two records agree quite well. It’s possible they’re both wrong, but that doesn’t seem likely. If the ground-based folks did that, we might get better agreement. But as with the climate models and modelers, they’re all far too well-mannered to critically examine each other’s work in any serious fashion. Because heck, if they did that to the other guy, he might return the favor and point out flaws in their work, don’t want that kind of ugliness to intrude on their genteel, collegiate relationship, can’t we just be friends and not look too deeply? …

w.

PS—I remind folks again that the hype about BEST showing skeptics are wrong is just that. Most folks knew already that the world has been generally warming for hundreds of years, and BEST’s results in that regard were no surprise. BEST showed nothing about whether humans are affecting the climate, nor could it have done so. There are still large unresolved issues in the land temperature record which BEST has not clarified or solved. The jury is out on the BEST results, and it is only in part because they haven’t even gone through peer review.

PPS—

Oh, yeah, one more thing. At the top of the BEST dataset there’s a note that says:

Estimated 1950-1980 absolute temperature: 7.11 +/- 0.50

Seven degrees C? The GISS folks don’t even give an average, they just say it’s globally about 14°C.

The HadCRUT data gives a global temperature about the same, 13.9°C, using a gridded absolute temperature dataset. Finally, the Kiehl/Trenberth global budget gives a black-body radiation value of 390 W/m2, which converts to 14.8°. So I figured that was kind of settled, that the earth’s average temperature (an elusive concept to be sure) was around fourteen or fifteen degrees C.

Now, without a single word of comment that I can find, BEST says it’s only 7.1 degrees … say what? Anyone have an explanation for that? I know that the BEST figure is just the land. But if the globe is at say 14° to make it easy, and the land is at 7°, that means that on average the ocean is at 17°.

And I’m just not buying that on a global average the ocean is ten degrees C, or 18 degrees F, warmer than the land. It sets off my bad number detector.

0 0 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

191 Comments
Inline Feedbacks
View all comments
Brian H
October 24, 2011 4:39 pm

And long-duration stations with continuous records show no or negative change over the 20th Century:
http://wattsupwiththat.com/2011/10/24/unadjusted-data-of-long-period-stations-in-giss-show-a-virtually-flat-century-scale-trend/#comment-776101

The slight upward temperature trend observed in the average temperature of all stations disappears entirely if the input data is restricted to long-running stations only, that is those stations that have reported monthly averages for at least one month in every year from 1900 to 2000. This discrepancy remains to be explained.

October 24, 2011 4:46 pm

For shame, Willis.
Demanding “evidence” of a religious cult on a matter of faith.

October 24, 2011 4:46 pm

And Mueller and the BEST team (outside of Youknowwhodat) say to their critics ……..
That’s what I thought.

October 24, 2011 4:52 pm

The Koch brothers should demand their money back. What garbage.

oMan
October 24, 2011 4:53 pm

Willis: very helpful and it highlights how much work still needs to be done on what should be foundational datasets. I know the following is a little off-topic but it flows out of the assessment you offer. Namely, I will be interested to see how, if at all, the BEST papers evolve with “peer review.” I don’t understand why the authors took on the reputational risk (and some possible risk to good relations with the publishers) by issuing press releases and drafts of their papers before peer review and final publisher acceptance. There is a good reason for doing things the other way around: not wasting the public’s time for one thing, not looking like a fool for another. Now to mitigate or manage those risks the authors will be tempted to externalize the cost by suppressing corrections that might be advisable or vital. There will be enormous pressure on the reviewers not to change anything important. If the reviewers insist on such changes, there will be enormous pressure on the publishers to ignore or fudge them. If that doesn’t work, then the authors will be forced to eat very public crow, and so will everyone who ran down the hill with them. What induced them to assume that risk? What was the magic of their being able to issue press releases now?

October 24, 2011 5:01 pm

Willis,
The only stunning thing about the BEST results is that they don’t help in any way to resolve the issue. They simply add additional uncertainty, as is clearly reproduced in your fig.1, showing that anything might have happened to the mean global average temperature over the past 210 years from 3degC warming to 2degC cooling. 
In other words the BEST results are useless for making any useful prediction whatsoever over whether the world has warmed or not, alarmingly or otherwise. This is the true conclusion which, of course, the alarmists will be entirely incapable of seeing.

kramer
October 24, 2011 5:01 pm

I emailed the BEST team a while ago asking if they could just plot the rural, unadjusted data. I got an email a few days ago saying it’s done.
My question is, if the rural data unadjusted data agrees with the adjusted and unadjusted data, why bother to adjust the data at all?

moptop
October 24, 2011 5:05 pm

They did a pairwise comparison for 500K pairs of series and over 4K miles, I think, they found no correlation between stations. If there is a long term global trend, shouldn’t that correlation show up?

Al Gored
October 24, 2011 5:14 pm

You must hand it to them on one PR front. Coming up with the ‘BEST’ acronym no doubt fools some people, and will continue to do so even if it turns out to be the worst data set.
In any case, seems like they have done a fine enough job of confirming the rebound out of the Little Ice Age which, for me, says it all.

mpaul
October 24, 2011 5:17 pm

Willis, there’s a lot of good work here, but I think it will be obscured by all of the ad hom is your opening paragraphs. If we are going to persuade the persuadable (as opposed to preach to the choir) then I think we need to dial it back a bit.

October 24, 2011 5:21 pm

I’m convinced. I’m changing my position as a skeptic who thinks the world is warmer than it was to a skeptic who thinks the world is warmer than it was. Thanks, BEST!

Alex Heyworth
October 24, 2011 5:24 pm

oMan says:
October 24, 2011 at 4:53 pm
What induced them to assume that risk? What was the magic of their being able to issue press releases now?
http://www.cop17-cmp7durban.com/

DocMartyn
October 24, 2011 5:37 pm

I always though a 95% CI was the area under a curve which showed 95% of the data when N was large.
Have a look at figure 3 of the UHI paper; the 95% of the slope is +/- about 1.5 degrees.

HaroldW
October 24, 2011 5:46 pm

Willis,
Klotzbach et al. 2009 ( here and correction here) suggests several possibilities for bias in the land record other than UHI. I don’t think that any of the other possible factors have been quantified though.

ImranCan
October 24, 2011 5:49 pm

I do not understand why the “land” temperature data set is of relevance at all. The earth’s surface is 70% water and this body of water contains ~ 1000 times the energy of the atmosphere, Indeed the temperature of the atmosphere is totally dictated by the sea temperatures – one only has to notice the effect of the Gulf stream on Western Europe to see that.
So if we want to see real earth warming or cooling and the magnitude of it, we must just look at ocean temperatures. Why is there this fixation on the land ?

wobble
October 24, 2011 5:58 pm

Excellent post, Willis.

Media whores are always predictable and boring, but data always contains surprises.

Ironic, isn’t it?

October 24, 2011 5:58 pm

You suspect BEST are not serious when their numerical data are posted only in Text format, to judge from their site at WE’s link above. At least GISS and ESRL-NOAA provide data in formats eaily brought into Excel etc.

pwl
October 24, 2011 6:00 pm

The BEST page says
“The Berkeley Earth Surface Temperature Study has created a preliminary merged data set by combining 1.6 billion temperature reports from 15 preexisting data archives.”
Yet when I download the alleged data file it is only a mere 57KB zipped and only consists of two uncompressed files of 243KB and 14KB… and certainly do not contain 1.6 billion temperature reports!!!
“% This file contains a detailed summary of the land-surface average
% results produced by the Berkeley Averaging method. Temperatures are
% in Celsius and reported as anomalies relative to the 1950-1980 average.
% Uncertainties represent the 95% confidence interval for statistical
% and spatial undersampling effects.
%
% The current dataset presented here is described as:
%
% The preliminary version of the complete Berkeley Earth dataset
%
%
% This analysis was run on 27-Sep-2011 16:42:54
%
% Results are based on 37633 time series
% with 14502771 data points
%
% Estimated 1950-1980 absolute temperature: 7.11 +/- 0.50
%
%
% For each month, we report the estimated land-surface average for that
% month and its uncertainty. We also report the corresponding values for
% year, five-year, ten-year, and twenty-year moving averages CENTERED about
% that month (rounding down if the center is in between months). For example,
% the annual average from January to December 1950 is reported at June 1950.
%
% Monthly Annual Five-year Ten-year Twenty-year
% Year, Month, Anomaly, Unc., Anomaly, Unc., Anomaly, Unc., Anomaly, Unc., Anomaly, Unc.
1800 1 -1.447 2.505 -0.890 0.766 -0.461 0.524 -0.424 0.512 -0.477 0.475
1800 2 -2.132 2.928 -0.898 0.735 -0.463 0.523 -0.425 0.508 -0.481 0.474

2010 4 -1.035 2.763 NaN NaN NaN NaN NaN NaN NaN NaN
2010 5 1.098 2.928 NaN NaN NaN NaN NaN NaN NaN NaN”
This is bogus since it is not the raw data but once more mysteriously processed data.
BEST where is the raw data please? ALL OF IT!!! Please provide the download link. Thank you.

moptop
October 24, 2011 6:06 pm

Thank you for that Willis.
Now another point. Figure 6
http://www.berkeleyearth.org/Resources/Berkeley_Earth_Averaging_Process
Doesn’t this show that, at least in the northern hemisphere, where all of the thermometers were, that it was pretty warm about 1800?

DirkH
October 24, 2011 6:06 pm

Recently the BBC started to use the word “skeptic”, even acknowledging that some exist. Maybe this was preparation for Muller’s PR blitzkrieg; and maybe they will continue to use the word “skeptic” for the Mullerite opportunists / GISS imitators; and you-know-what for us. So maybe this was simply an exercise in “improving the communication” of science a la “skepticalscience”; i.e. by claiming a word and redefining it. Wouldn’t surprise me at all; they did it with the words “liberal” and “progressive” before.
Some fun: Google trends for the words “climate” and “Al Gore”.
http://www.google.com/trends?q=climate%2C+al+gore&ctab=0&geo=us&geor=all&date=all&sort=0
Notice
– the seasonal dependency in the chart for “climate” (looks like people are more worried in Winter)
– the long term decline of “climate”
– the non-event that Al Gore’s CRP was
– the 2010 spike for Al Gore (hint: not climate-related)

Richard M
October 24, 2011 6:16 pm

BEST’s denial of the UHI effect will get them into trouble.
The one climate related thing an unscientific person can do is read the thermometers in their cars. They have seen the UHI effect with their own eyes. When BEST tells them they are crazy they will have doubts about BEST’s credibility.

Brian D
October 24, 2011 6:17 pm

And this is how it is being reported in NZ:
http://www.scoop.co.nz/stories/SC1110/S00058/experts-respond-analysis-confirms-global-warming-data.htm
Interesting to see the potential reviewers comments in advance. And whom they choose to ask for a view.

philip Bradley
October 24, 2011 6:28 pm

I’d be cautious about drawing UHI conclusions from Buffalo, NY.
Buffalo and its surrounding area has a very unusual winter micro-climate due to prevailing winds and the proximity of lakes Erie and Ontario.
Its common to encounter a raging blizzard near Buffalo and have bright sunshine a couple Ks down the road.

1 2 3 8