What the BEST data actually says

Guest Post by Willis Eschenbach

My theory is that the BEST folks must have eaten at a Hollywood Chinese restaurant. You can tell because when you eat there, an hour later you find you’re hungry for stardom.

Now that the BEST folks have demanded and received their fifteen minutes of fame before their results have gone through peer review, now that they have succeeded in deceiving many people into thinking that Muller is a skeptic and that somehow BEST has ‘proven the skeptics wrong’, now that they’ve returned to the wilds of their natural scientific habitat far from the reach of National Geographic photographers and people asking real questions, I thought I might take a look at the data itself. Media whores are always predictable and boring, but data always contains surprises. It can be downloaded from the bottom of this page, but please note that they do not show the actual results on that page, they show smoothed results. Here’s their actual un-smoothed monthly data:

Figure 1. BEST global surface temperature estimates. Gray bars show what BEST says are the 95% confidence intervals (95%CI) for each datapoint.

I don’t know about you, but Figure 1 immediately made me think of the repeated claim by Michael Mann that the temperatures of the 1990s were the warmest in a thousand years.

WHAT I FIND IN THE BEST DATA

Uncertainty

I agree with William Briggs and Doug Keenan that “the uncertainty bands are too narrow”. Please read the two authors to see why.

I thought of Mann’s claim because, even with BEST’s narrow uncertainty figures, their results show we know very little about relative temperatures over the last two centuries. For example, we certainly cannot say that the current temperatures are greater than anything before about 1945. The uncertainty bands overlap, and so we simply don’t know if e.g. 2010 was warmer than 1910. Seems likely, to be sure … but we do not have the evidence to back that up.

And that, of course, means that Mann’s claims of ‘warmest in a mill-yun years’ or whatever he has ramped it up to by now are not sustainable. We can’t tell, using actual thermometer records, if we’re warmer than a mere century ago. How can a few trees and clamshells tell us more than dozens of thermometers?

Disagreement with satellite observations

The BEST folks say that there is no urban heat island (UHI) effect detectable in their analysis. Their actual claim is that “urban warming does not unduly bias estimates of recent global temperature change”. Here’s a comment from NASA, which indicates that, well, there might be a bias. Emphasis mine.

The compact city of Providence, R.I., for example, has surface temperatures that are about 12.2 °C (21.9 °F) warmer than the surrounding countryside, while similarly-sized but spread-out Buffalo, N.Y., produces a heat island of only about 7.2 °C (12.9 °F), according to satellite data. SOURCE

A 22°F (12°C) UHI warming in Providence, and BEST says no UHI effect … and that’s just a couple cities.

If there were no UHI, then (per the generally accepted theories) the atmosphere should be warming more than the ground. If there is UHI, on the other hand, the ground station records would have an upwards bias and might even indicate more warming than the atmosphere.

After a number of adjustments, the two satellite records, from RSS and UAH, are pretty similar. Figure 2 shows their records for global land-only lower tropospheric temperatures:

Figure 2. UAH and RSS satellite temperature records. Anomaly period 1979-1984 = 0.

Since they are so close, I have averaged them together in Figure 3 to avoid disputes. You can substitute either one if you wish. Figure three shows a three-year centered Gaussian average of the data. The final 1.5 years are truncated to avoid end effects.

Remember what we would expect to find if all of the ground records were correct. They’d all lie on or near the same line, and the satellite temperatures would be rising faster than the ground temperatures. Here are the actual results, showing BEST, satellite, GISS, CRUTEM, and GHCN land temperatures:

Figure 3. BEST, average satellite, and other estimates of the global land temperature over the satellite era. Anomaly period 1979-1984 = 0.

In Figure 3, we find the opposite of what we expected. The land temperatures are rising faster than the atmospheric temperatures, contrary to theory. In addition, the BEST data is the worst of the lot in this regard.

Disagreement with other ground-based records.

The disagreement between the four ground-based results also begs for an explanation. Note that the records diverge at the rate of about 0.2°C in thirty years, which is 0.7° per century. Since this is the approximate amount of the last century’s warming, this is by no means a trivial difference.

My conclusion? We still have not resolved the UHI issue, in any of the land datasets. I’m happy to discuss other alternative explanations for what we find in Figure 3. I just can’t think of too many. With the ground records, nobody has looked at the other guys’ analysis and algorithms harshly, aggressively, and critically. They’ve all taken their own paths, and they haven’t disputed much with each other. The satellite data algorithms, on the other hand, has been examined minutely by two very competitive groups, UAH and RSS, in a strongly adversarial scientific manner. As is common in science, the two groups have each found errors in the other’s work, and when corrected the two records agree quite well. It’s possible they’re both wrong, but that doesn’t seem likely. If the ground-based folks did that, we might get better agreement. But as with the climate models and modelers, they’re all far too well-mannered to critically examine each other’s work in any serious fashion. Because heck, if they did that to the other guy, he might return the favor and point out flaws in their work, don’t want that kind of ugliness to intrude on their genteel, collegiate relationship, can’t we just be friends and not look too deeply? …

w.

PS—I remind folks again that the hype about BEST showing skeptics are wrong is just that. Most folks knew already that the world has been generally warming for hundreds of years, and BEST’s results in that regard were no surprise. BEST showed nothing about whether humans are affecting the climate, nor could it have done so. There are still large unresolved issues in the land temperature record which BEST has not clarified or solved. The jury is out on the BEST results, and it is only in part because they haven’t even gone through peer review.

PPS—

Oh, yeah, one more thing. At the top of the BEST dataset there’s a note that says:

Estimated 1950-1980 absolute temperature: 7.11 +/- 0.50

Seven degrees C? The GISS folks don’t even give an average, they just say it’s globally about 14°C.

The HadCRUT data gives a global temperature about the same, 13.9°C, using a gridded absolute temperature dataset. Finally, the Kiehl/Trenberth global budget gives a black-body radiation value of 390 W/m2, which converts to 14.8°. So I figured that was kind of settled, that the earth’s average temperature (an elusive concept to be sure) was around fourteen or fifteen degrees C.

Now, without a single word of comment that I can find, BEST says it’s only 7.1 degrees … say what? Anyone have an explanation for that? I know that the BEST figure is just the land. But if the globe is at say 14° to make it easy, and the land is at 7°, that means that on average the ocean is at 17°.

And I’m just not buying that on a global average the ocean is ten degrees C, or 18 degrees F, warmer than the land. It sets off my bad number detector.

0 0 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

191 Comments
Inline Feedbacks
View all comments
kadaka (KD Knoebel)
October 25, 2011 4:05 am

From Willis Eschenbach on October 24, 2011 at 10:18 pm

(…) However, the GISS data set says:
sources: GHCN-v2 1880-09/2011 (meteorological stations only)
(…)
In addition, the URL says:
monthly.land.90S.90N.df_1901-2000mean.dat
(…)

Willis, that is an inaccurate sourcing note. NOAA-NCDC says here they moved on to GHCN-M version 3. They were updating v2 a while longer, according to the note at the section near the bottom where the summary sets are available. URL for that v3 set matches what you posted:
ftp://ftp.ncdc.noaa.gov/pub/data/anomalies/monthly.land.90S.90N.df_1901-2000mean.dat
At that note is a link to the ftp directory for v2, current “last modified” is July 20, last value in the indicated monthly file is June 2011.
GISS could not be using v2 for the most recent months, they should change the attribution. Someone better notify Hansen about the v2 set: It’s dead, Jim.

Septic Matthew
October 25, 2011 4:07 am

Me, I’ve had it up to here with being lied to by Muller, I’m fed up to my eye-teeth with his tricks and his whoring for the media. Sure, I could pretend Muller is an honest and honorable man like you recommend. But his actions have shown him to be a cunning snake. It is not my habit to address snakes as though they were honorable men.
You lost me.

Ask why is it so?
October 25, 2011 4:14 am

When did Dr Muller become a Skeptic? I seem to recall watching a lecture by Dr Muller in which he provides evidence that increasing CO2 in the atmosphere, because it is a greenhouse gas, will cause increased warming.
UHI and changes to land use/landscape cannot be ignored, e.g. soil, bitumen and concrete absorb more radiation than grass and trees.

October 25, 2011 4:15 am

In the first graph, are the data points connected by lines, or are the points that dense?
I’d like to see it without lines.

kadaka (KD Knoebel)
October 25, 2011 4:45 am

From aaron on October 25, 2011 at 4:15 am:

In the first graph, are the data points connected by lines, or are the points that dense?

Just lines.

I’d like to see it without lines.

I replicated that graph for this comment. Without lines, with the spreadsheet using little symbols for the points, it looks like a large air nozzle spewing confetti. There are more than 2500 points.

David
October 25, 2011 4:47 am

I also would love to see an oceans only graph layered into the five data sets chart to see which data set follows the ocean air temp chart the most accurately.

October 25, 2011 4:50 am

Ladies and Gentlemen, the International Panel on Climate Shenanigans is proud to announce the nominations for the golden Pacharan International Shenanigans Statues for 2011.
There are six nominations for the Creative Research And Publicity award.
From California: BEST Birks Earth Surface Tragedy
From East Anglia: CRUD Climate Research Universal Disambiguation
From Exeter: HASH Hardly Atmospheric Surface History
From Yorkshire: LUST Leeds Ultimate Surface Temperature
From Pennsylvania: MESS Mans Earth Surface Study
From Exeter again: MOST Metro Official Surface Temperature
Please submit your vote in the next 14 days using the Pal Approval Streamlined System.
The winner will be announced in Durban in early December.

kadaka (KD Knoebel)
October 25, 2011 4:54 am

Addendum to last post:
That’s more than 2500 anomaly points. Each has two uncertainty points with them (+ and – unc.). Thus over 7500 points total to graph.
It looks much better as only lines.

Smoking Frog
October 25, 2011 5:14 am

Louis October 24, 2011 at 9:45 pm
The BEST press release makes the following claim about UHI:
“The urban heat island effect is locally large and real, but does not contribute significantly to the average land temperature rise. That’s because the urban regions of the Earth amount to less than 1% of the land area.”
Aren’t they shooting AGW in the head (or themselves in the foot) with that statement? I mean, if the urban regions of the Earth are not contributing significantly to the average temperature rise of the planet, how can they then turn around and claim that humans are the main cause of global warming? Aren’t the urban regions of the Earth where the people are? Doesn’t most energy use occur in urban regions? Are they saying that people in rural areas are somehow at fault for warming the earth even though they are not warming their local region? What am I missing here?
You’re missing the fact that AGW is supposed to be due to the global average atmospheric concentration of greenhouse gases, esp. CO2. The UHI effect is primarily due to heat retention by construction materials in buildings, roads, etc., and waste heat from energy use.

Jessie
October 25, 2011 5:44 am

Septic Matthew says:
October 25, 2011 at 4:07 am
Me, I’ve had it up to here with being lied to by Muller, I’m fed up to my eye-teeth with his tricks and his whoring for the media. Sure, I could pretend Muller is an honest and honorable man like you recommend. But his actions have shown him to be a cunning snake. It is not my habit to address snakes as though they were honorable men.
You lost me.

Some education ………………….
Splendid hunting ground
Rikki Tikki Tavi, Rudyard Kipling (1894) Can skip to Part 3.

kadaka (KD Knoebel)
October 25, 2011 6:43 am

Where is the missing data used for the smoothing?
From Full_Database_Average_complete.txt, I can see the 20-yr running average ends 10 years before the end of the records. That makes sense, it’d use 10 yrs before and after. They’ve run out of data, the 20 yr smoothing stops.
But the records start at 1800, including the smoothed values. So they would need 10 yrs of data from before 1800 to start the 20 yr smoothing. Where is it? Same issue with the other shorter-length smoothed values. This is supposed to be the data, but 10 yrs are missing. Did they, identifying it with the appropriate scientific/mathematical/statistical terminology, just “make up” the starting data or initial smoothing results?

barryjo
October 25, 2011 6:45 am

In the final analysis, it appears to me that they wasted a perfectly good acronym.

Vince Causey
October 25, 2011 7:20 am

What exactly is the BEST temperature dataset? I had assumed it was some kind of average of GISS, HADCRUT and NOAA, but the graph labeled fig 3 has confused me. Here the BEST temperatures are higher than any of the others – not an average like I expected. How do they do it?

henrythethird
October 25, 2011 7:38 am

The first thing I thought of when I saw Fig 1 was a funnel.
So they’ve gone from beating us over the head with a hockey stick, to using a funnel to…
Never mind. Any further comment would just result in a ban.

Gary Swift
October 25, 2011 8:04 am

I would suggest moving the ‘normal’ for the satellite data down, thereby moving the anomoly for that record upwards. That would place it more in line with what you expect to see.

mpaul
October 25, 2011 8:06 am

Willis Eschenbach says:
October 24, 2011 at 6:31 pm
…Me, I’ve had it up to here with being lied to by Muller, I’m fed up to my eye-teeth with his tricks and his whoring for the media.

Willis, I understand that you and Anthony have been subjected to some pretty shoddy treatment by the BEST team. And I am not suggesting that people should not be angry. But I think that our side (the skeptics) is winning the battle of ideas. Our mission now is to convert the independent thinkers. And we do this by being on the side of reason. I think we can expose all of their dirty tricks and duplicitousness without calling them “media whores” — let the reader come to that conclusion for themselves. A little bit of mockery and ridicule is ok (“once again Muller has demonstrated that the most dangerous place to stand is between him and a microphone”) but I think if it goes too far it alienates new readers. Anyway, I’m not here to lecture. Its just my opinion — take it for what its worth.
I’m a big fan of your work.

william
October 25, 2011 8:20 am

‘then broke a confidentiality agreement’
surely a court case.

October 25, 2011 9:16 am

Willis, When considering Muller’s false persona it worth a review of “Operation Trust” used by the Soviets in the early days;
http://en.wikipedia.org/wiki/Trust_Operation
Fake and straw moderates are nothing new.