What the BEST data actually says

Guest Post by Willis Eschenbach

My theory is that the BEST folks must have eaten at a Hollywood Chinese restaurant. You can tell because when you eat there, an hour later you find you’re hungry for stardom.

Now that the BEST folks have demanded and received their fifteen minutes of fame before their results have gone through peer review, now that they have succeeded in deceiving many people into thinking that Muller is a skeptic and that somehow BEST has ‘proven the skeptics wrong’, now that they’ve returned to the wilds of their natural scientific habitat far from the reach of National Geographic photographers and people asking real questions, I thought I might take a look at the data itself. Media whores are always predictable and boring, but data always contains surprises. It can be downloaded from the bottom of this page, but please note that they do not show the actual results on that page, they show smoothed results. Here’s their actual un-smoothed monthly data:

Figure 1. BEST global surface temperature estimates. Gray bars show what BEST says are the 95% confidence intervals (95%CI) for each datapoint.

I don’t know about you, but Figure 1 immediately made me think of the repeated claim by Michael Mann that the temperatures of the 1990s were the warmest in a thousand years.

WHAT I FIND IN THE BEST DATA

Uncertainty

I agree with William Briggs and Doug Keenan that “the uncertainty bands are too narrow”. Please read the two authors to see why.

I thought of Mann’s claim because, even with BEST’s narrow uncertainty figures, their results show we know very little about relative temperatures over the last two centuries. For example, we certainly cannot say that the current temperatures are greater than anything before about 1945. The uncertainty bands overlap, and so we simply don’t know if e.g. 2010 was warmer than 1910. Seems likely, to be sure … but we do not have the evidence to back that up.

And that, of course, means that Mann’s claims of ‘warmest in a mill-yun years’ or whatever he has ramped it up to by now are not sustainable. We can’t tell, using actual thermometer records, if we’re warmer than a mere century ago. How can a few trees and clamshells tell us more than dozens of thermometers?

Disagreement with satellite observations

The BEST folks say that there is no urban heat island (UHI) effect detectable in their analysis. Their actual claim is that “urban warming does not unduly bias estimates of recent global temperature change”. Here’s a comment from NASA, which indicates that, well, there might be a bias. Emphasis mine.

The compact city of Providence, R.I., for example, has surface temperatures that are about 12.2 °C (21.9 °F) warmer than the surrounding countryside, while similarly-sized but spread-out Buffalo, N.Y., produces a heat island of only about 7.2 °C (12.9 °F), according to satellite data. SOURCE

A 22°F (12°C) UHI warming in Providence, and BEST says no UHI effect … and that’s just a couple cities.

If there were no UHI, then (per the generally accepted theories) the atmosphere should be warming more than the ground. If there is UHI, on the other hand, the ground station records would have an upwards bias and might even indicate more warming than the atmosphere.

After a number of adjustments, the two satellite records, from RSS and UAH, are pretty similar. Figure 2 shows their records for global land-only lower tropospheric temperatures:

Figure 2. UAH and RSS satellite temperature records. Anomaly period 1979-1984 = 0.

Since they are so close, I have averaged them together in Figure 3 to avoid disputes. You can substitute either one if you wish. Figure three shows a three-year centered Gaussian average of the data. The final 1.5 years are truncated to avoid end effects.

Remember what we would expect to find if all of the ground records were correct. They’d all lie on or near the same line, and the satellite temperatures would be rising faster than the ground temperatures. Here are the actual results, showing BEST, satellite, GISS, CRUTEM, and GHCN land temperatures:

Figure 3. BEST, average satellite, and other estimates of the global land temperature over the satellite era. Anomaly period 1979-1984 = 0.

In Figure 3, we find the opposite of what we expected. The land temperatures are rising faster than the atmospheric temperatures, contrary to theory. In addition, the BEST data is the worst of the lot in this regard.

Disagreement with other ground-based records.

The disagreement between the four ground-based results also begs for an explanation. Note that the records diverge at the rate of about 0.2°C in thirty years, which is 0.7° per century. Since this is the approximate amount of the last century’s warming, this is by no means a trivial difference.

My conclusion? We still have not resolved the UHI issue, in any of the land datasets. I’m happy to discuss other alternative explanations for what we find in Figure 3. I just can’t think of too many. With the ground records, nobody has looked at the other guys’ analysis and algorithms harshly, aggressively, and critically. They’ve all taken their own paths, and they haven’t disputed much with each other. The satellite data algorithms, on the other hand, has been examined minutely by two very competitive groups, UAH and RSS, in a strongly adversarial scientific manner. As is common in science, the two groups have each found errors in the other’s work, and when corrected the two records agree quite well. It’s possible they’re both wrong, but that doesn’t seem likely. If the ground-based folks did that, we might get better agreement. But as with the climate models and modelers, they’re all far too well-mannered to critically examine each other’s work in any serious fashion. Because heck, if they did that to the other guy, he might return the favor and point out flaws in their work, don’t want that kind of ugliness to intrude on their genteel, collegiate relationship, can’t we just be friends and not look too deeply? …

w.

PS—I remind folks again that the hype about BEST showing skeptics are wrong is just that. Most folks knew already that the world has been generally warming for hundreds of years, and BEST’s results in that regard were no surprise. BEST showed nothing about whether humans are affecting the climate, nor could it have done so. There are still large unresolved issues in the land temperature record which BEST has not clarified or solved. The jury is out on the BEST results, and it is only in part because they haven’t even gone through peer review.

PPS—

Oh, yeah, one more thing. At the top of the BEST dataset there’s a note that says:

Estimated 1950-1980 absolute temperature: 7.11 +/- 0.50

Seven degrees C? The GISS folks don’t even give an average, they just say it’s globally about 14°C.

The HadCRUT data gives a global temperature about the same, 13.9°C, using a gridded absolute temperature dataset. Finally, the Kiehl/Trenberth global budget gives a black-body radiation value of 390 W/m2, which converts to 14.8°. So I figured that was kind of settled, that the earth’s average temperature (an elusive concept to be sure) was around fourteen or fifteen degrees C.

Now, without a single word of comment that I can find, BEST says it’s only 7.1 degrees … say what? Anyone have an explanation for that? I know that the BEST figure is just the land. But if the globe is at say 14° to make it easy, and the land is at 7°, that means that on average the ocean is at 17°.

And I’m just not buying that on a global average the ocean is ten degrees C, or 18 degrees F, warmer than the land. It sets off my bad number detector.

0 0 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

191 Comments
Inline Feedbacks
View all comments
Paul Penrose
October 24, 2011 8:44 pm

How many times have we been told by the likes of Phil Jones that if it’s not peer reviewed it doesn’t matter. Well, none of these BEST papers have passed peer review yet, so why is everybody fawning over them. They could still have major revisions before the review process is finished. (OK, probably not, but let me have this little fantasy)
So I think we should all just stop hyperventilating over them and talk about some established science. And for the record, I tend to agree with Willis in this regard: the BEST team is much to preoccupied with attention getting stunts like this one. Real scientists crave not these things, as Yoda would say. (OK, I’m a Star Wars geek too)

Robert
October 24, 2011 8:46 pm

Mistake on the last post. Willis did use NOAA he just labelled it GHCN which I just assumed it meant just using the raw GHCN rather than NOAAs method (I only noticed when I saw it linked to NOAA). Point still stands on GISS. The only one that doesn’t fit is Hadley and we know why that is.

dixonstalbert
October 24, 2011 9:07 pm

Thank you for posting Willis.
I was not clear how you produced Figure 1 of ” their actual un-smoothed monthly data:”
Can you post step by step instructions?

Charlie Foxtrot
October 24, 2011 9:36 pm

The “best” data would be a compilation of stations that have not moved and that are still uncontaminated by changes in land use, structures, or any type of development. There would not be many such sites. The impact on temperature by land use changes would be difficult to see as it would happen slowly. BEST dealt with obvious step changes by starting a new series each time one cropped up, then looking only at the changes that occurred after the step change, which likely dealt pretty will with equipment changes or rapid development. Land use changes would likely not be addressed by this technique. I suspect that one of the largest error drivers in the data are those sites that went through land use changes, such as from forested to intensive farming.
In the end, all this bother about how much global temperatures have increased is meaningless. The real issue is what is causing it. As long as the warmists can make the public believe that all warming since 1950 or whatever is due to CO2, and that their models are infallible, they will be able to further their green agenda.
BEST will be peer reviewed by anonymous warmists and found to be perfect.

Louis
October 24, 2011 9:45 pm

The BEST press release makes the following claim about UHI:
“The urban heat island effect is locally large and real, but does not contribute significantly to the average land temperature rise. That’s because the urban regions of the Earth amount to less than 1% of the land area.”
Aren’t they shooting AGW in the head (or themselves in the foot) with that statement? I mean, if the urban regions of the Earth are not contributing significantly to the average temperature rise of the planet, how can they then turn around and claim that humans are the main cause of global warming? Aren’t the urban regions of the Earth where the people are? Doesn’t most energy use occur in urban regions? Are they saying that people in rural areas are somehow at fault for warming the earth even though they are not warming their local region? What am I missing here?

Reply to  Louis
October 24, 2011 10:26 pm

Louis – your point about UHI…
As I understand the thing about UHI is that it causes distortions to the temperature record by trending them upwards as urban areas overtake rural areas – not that it has an overall effect on climate. I think it is interesting that BEST acknowledges that the effect is ‘large’ and then does not appear to take this into account. Anthony, I believe is the world’s expert on this…

David
October 24, 2011 9:50 pm

“The disagreement between the four ground-based results also begs for an explanation. Note that the records diverge at the rate of about 0.2°C in thirty years, which is 0.7° per century. Since this is the approximate amount of the last century’s warming, this is by no means a trivial difference.”
Indeed!!. And why, after 1995 does the divergence widen considerably. It appears that the divergence of land based readings, from each other and the satelite record, is growing faster then any observed warming, which since 1995 is statistically not significant.

dscott
October 24, 2011 10:27 pm

Actually, is there unadjusted data on the percent of all stations showing a temp rise versus those that show no rise versus those that show a decline? Given the deceitfulness of averaging in the Southern Hemisphere (flat trend) with the Northern (increasing trend) to show an increasing GAT I get the distinct impression that the denial of the UHI effect is merely to cover up the fact that many or most of the non urban stations will show a declining trend and not an increasing trend.

October 24, 2011 10:31 pm

. Interestingly the BEST data show only a very small acceleration in the GMT trend from 1991 to 2000, and an actual deceleration from 2001 to 2009, which belies their claim “the world is warming fast”, which should have read “the world is warming more slowly” (according to BEST) – but then they don’t do calculus at Berkeley anymore do they?

October 24, 2011 10:56 pm

“Now that the BEST folks have… succeeded in deceiving many people into thinking that Muller is a skeptic…”
Perhaps an overly strong wording of a mistaken impression? As far as I can tell, Muller has long been a skeptical warmist. And an honest one.
Muller is so skeptical of those involved with “Mike’s trick to hide the decline”, that he won’t read any work by a Team member. So Hadley temps are out. And he doesn’t trust GISS either, hence BEST. He is skeptical of all proposed climate policies, seeing none as credible solutions to warming. Further, he is clear about the uncertainty of water vapor feedback in projected warming; he states (at 4:10) that although increased evaporation is not thought to result in more clouds, “if cloud cover were to increase by 2% over the next 50 years, we wouldn’t have global warming.”
That’s not to say that BEST’s papers will pass peer review without changes.

michael hammer
October 24, 2011 11:11 pm

Something I dont quite understand. In the early 1970’s the National Academy of Science published a climate reconstruction showing that temperatures fell by 0.7C ( about 1.3F) between 1940 and 1970. This was the basis for many articles in both science and environmental journals suggesting we were heading for dangerous global cooling (anthropogenic of course). The modern reconstructions now show no cooling over this period. Did the historical data change with time and if so, how does long documented historical data change with time? Was the highly accredited NAS incompetent in generating their climate record? Or is the change due to more recent “adjustments” to the historical data. If the latter, maybe the adjustments are valid, maybe not but lets not forget if the 0.7C fall was in fact correct it would wipe out the entire claimed anomolous warming. So the adjustments would be 100% of the effect being claimed. Would such a scenario be acecpted in any other branch of science, and almost without questioning or scrutiny?

kadaka (KD Knoebel)
October 24, 2011 11:30 pm

From dixonstalbert on October 24, 2011 at 9:07 pm:

I was not clear how you produced Figure 1 of ” their actual un-smoothed monthly data:”
Can you post step by step instructions?

1. Download and unzip the analysis chart data.
2. Prep the data for the spreadsheet with a word processor. Open Full_Database_Average_complete.txt, which has the monthly results. Copy just the numbers to a new text document. Using the Replace command, replace all double spaces with single spaces until only single spaces are left. That is a trick I taught myself, simplifies things tremendously.
3. In a new spreadsheet, do a “Paste Special” of the prepped data, Ctrl-Shift-V. (I use OpenOffice, YMMV.) When prompted, mark “space” as the delimiter. Voila, data fills in the correct rows and columns. If I do a “raw” copy without reducing the spaces then normally the data doesn’t stay in the correct columns, I get too many columns, etc.
4. For the X-axis, make a column that is the year + (month-1)/12. Close enough decimal value for this.
5. Add two columns. One is Monthly:Anomaly + Uncertainty (Unc.), one is -Unc.
6. Apply standard chart-fu, make a XY (scatter) graph, lines only. Graph Anomaly, +Unc., and -Unc. Make +/-Unc. the same shade of grey, give them enough width to blend into a grey mass.
7. After that it’s just Titles, Labels, labeling the spreadsheet columns, the usual nice touches for making it look pretty and legible.
Note: the last two months in the file, Months 4 and 5 of 2010, have something really screwed up, at least the copy I downloaded, might have changed. Uncertainty goes from around 0.1°C for previous months to around 2.8. Consider dropping off those months or perhaps all of 2010 to make your chart extra pretty.

Gras Albert
October 25, 2011 1:03 am

Willis
Are you sure about BEST’s motivation? I took Mann’s Hockey Stick, cropped everything but 1800-2000, re-scaled it to fit the BEST reconstruction graphic and constructed a blink gif. The first 50 years leaves one either doubting BEST or Mann, given their relative statistical clout, if I were Mann I would not want this graphic shown in the Ball case courtroom!
1800-2010 comparison, BEST-Hockey Stick

Peter Whale
October 25, 2011 1:39 am

Willis I liked your reply to MPaul. You and Lubos Motl way into the scientists playing politicians with exactly the scorn they deserve. Please keep it coming they need to be made to see their stupidity like Peter Gleick.

October 25, 2011 1:51 am

On checking through their monthly station data, I was surprised to find that BEST really don’t have anything but GHCN data pre-1850. So when they take the analysis back to 1800 when others don’t, they are presumably hoping that their statistical methods will reduce errors. I doubt hat they can make so much difference. I’ve listed the BEST and GHCN station records here

Mark
October 25, 2011 1:55 am

pwl says:
1800 1 -1.447 2.505 -0.890 0.766 -0.461 0.524 -0.424 0.512 -0.477 0.475
1800 2 -2.132 2.928 -0.898 0.735 -0.463 0.523 -0.425 0.508 -0.481 0.474

2010 4 -1.035 2.763 NaN NaN NaN NaN NaN NaN NaN NaN
2010 5 1.098 2.928 NaN NaN NaN NaN NaN NaN NaN NaN”
This is bogus since it is not the raw data but once more mysteriously processed data.

Is the data actually accurate to 3 decimal places in the first place. That would imply something capable of reading to a thousanth of a degree. Not sure such things existed in 2010, let alone 1800!

Ivor Ward
October 25, 2011 2:01 am

When it gets too hot in the city, people get into their cars and drive out to the country or the beach. Why?
How big was Los Angeles in 1811? How big is Los Angeles now?
UHI proven. Q.E.D.

mondo
October 25, 2011 2:35 am

Willis, I know you will think me a pedant (and probly I am) but I think it adds clarity to the UHI discussion to refer to Delta UHI over time, coz that is what affects the temperature records. Not the fact that urban environments can have a UHI effect.

Richard S Courtney
October 25, 2011 2:42 am

Willis:
At October 24, 2011 at 5:54 pm you say:
“… There is a commonly believed fallacy out there, which is that good correlation of data indicates good correlation of trends. I discussed this in a post called “GISScapades“.”
Yes!
I and a large group of others wrote a critique of the various surface global temperature reconstructions. Their data show good correlation but
(a) data for individual years differ by more than their stated accuracy
and
(b) the trends differ significantly between the data sets.
We then showed that the data sets are not valid indicators of mean global temperature (MGT) according to either of the possible understandings of what MGT is.
We failed to obtain publication of our paper because the data sets kept being altered by their compilers between submission of our paper and its acceptance for publication. I reported this to a UK Parliamentary Select Committee that was conducting an investigation (that became a ‘whitewash’) of the ‘climategate’ affair.
Although it seems very likely that MGT has risen over the last century, it is not possible to determine by how much MGT has changed over the last century. And the BEST data do not change this.
Richard

MikeA
October 25, 2011 3:21 am

mondo, if it’s any help I don’t think you’re a pedant as most pedants obsess about spelling ;-). On a broader cultural note I detect that Michael Mann might be from a poorer hick background from the use of the ‘Mill-yhun’ by Willis. Is he a rural type person regarded as lower class by the oligarchy?
I’m outside US and sometimes have trouble understanding the social mores of your culture

David
October 25, 2011 4:02 am

One more time, the money quote to me…
“The disagreement between the four ground-based results also begs for an explanation. Note that the records diverge at the rate of about 0.2°C in thirty years, which is 0.7° per century. Since this is the approximate amount of the last century’s warming, this is by no means a trivial difference.”
Indeed!!. And why, after 1998 does the divergence widen considerably. It appears that the divergence of land based readings, from each other and the satelite record, is growing faster then any observed warming, which since 1995 is statistically not significant. Take a look, via eye ball, the divergence swings between .1 amd .2 degrees untill about 1998 to 2000, then the divergence rapidly changes to .3 then .4 degreees. An divergent increase of about .2 degrees in 10 years during a period when three of the five data sets show a cooling from the 98 high!! Additionally the data sets no longer move in harmony in the last decade. So how do they claim that all the data sets agree when in one nine year period (98 to 07) some show cooling of about .15 degrees, and others show a warming of about .25 degrees?. Any thoughts anyone?
Also michael hammer says: October 24, 2011 at 11:11 pm, raises some serious questions over how the sets have changed over time.