Guest Post by Willis Eschenbach
My theory is that the BEST folks must have eaten at a Hollywood Chinese restaurant. You can tell because when you eat there, an hour later you find you’re hungry for stardom.
Now that the BEST folks have demanded and received their fifteen minutes of fame before their results have gone through peer review, now that they have succeeded in deceiving many people into thinking that Muller is a skeptic and that somehow BEST has ‘proven the skeptics wrong’, now that they’ve returned to the wilds of their natural scientific habitat far from the reach of National Geographic photographers and people asking real questions, I thought I might take a look at the data itself. Media whores are always predictable and boring, but data always contains surprises. It can be downloaded from the bottom of this page, but please note that they do not show the actual results on that page, they show smoothed results. Here’s their actual un-smoothed monthly data:
Figure 1. BEST global surface temperature estimates. Gray bars show what BEST says are the 95% confidence intervals (95%CI) for each datapoint.
I don’t know about you, but Figure 1 immediately made me think of the repeated claim by Michael Mann that the temperatures of the 1990s were the warmest in a thousand years.
WHAT I FIND IN THE BEST DATA
Uncertainty
I agree with William Briggs and Doug Keenan that “the uncertainty bands are too narrow”. Please read the two authors to see why.
I thought of Mann’s claim because, even with BEST’s narrow uncertainty figures, their results show we know very little about relative temperatures over the last two centuries. For example, we certainly cannot say that the current temperatures are greater than anything before about 1945. The uncertainty bands overlap, and so we simply don’t know if e.g. 2010 was warmer than 1910. Seems likely, to be sure … but we do not have the evidence to back that up.
And that, of course, means that Mann’s claims of ‘warmest in a mill-yun years’ or whatever he has ramped it up to by now are not sustainable. We can’t tell, using actual thermometer records, if we’re warmer than a mere century ago. How can a few trees and clamshells tell us more than dozens of thermometers?
Disagreement with satellite observations
The BEST folks say that there is no urban heat island (UHI) effect detectable in their analysis. Their actual claim is that “urban warming does not unduly bias estimates of recent global temperature change”. Here’s a comment from NASA, which indicates that, well, there might be a bias. Emphasis mine.
The compact city of Providence, R.I., for example, has surface temperatures that are about 12.2 °C (21.9 °F) warmer than the surrounding countryside, while similarly-sized but spread-out Buffalo, N.Y., produces a heat island of only about 7.2 °C (12.9 °F), according to satellite data. SOURCE
A 22°F (12°C) UHI warming in Providence, and BEST says no UHI effect … and that’s just a couple cities.
If there were no UHI, then (per the generally accepted theories) the atmosphere should be warming more than the ground. If there is UHI, on the other hand, the ground station records would have an upwards bias and might even indicate more warming than the atmosphere.
After a number of adjustments, the two satellite records, from RSS and UAH, are pretty similar. Figure 2 shows their records for global land-only lower tropospheric temperatures:
Figure 2. UAH and RSS satellite temperature records. Anomaly period 1979-1984 = 0.
Since they are so close, I have averaged them together in Figure 3 to avoid disputes. You can substitute either one if you wish. Figure three shows a three-year centered Gaussian average of the data. The final 1.5 years are truncated to avoid end effects.
Remember what we would expect to find if all of the ground records were correct. They’d all lie on or near the same line, and the satellite temperatures would be rising faster than the ground temperatures. Here are the actual results, showing BEST, satellite, GISS, CRUTEM, and GHCN land temperatures:
Figure 3. BEST, average satellite, and other estimates of the global land temperature over the satellite era. Anomaly period 1979-1984 = 0.
In Figure 3, we find the opposite of what we expected. The land temperatures are rising faster than the atmospheric temperatures, contrary to theory. In addition, the BEST data is the worst of the lot in this regard.
Disagreement with other ground-based records.
The disagreement between the four ground-based results also begs for an explanation. Note that the records diverge at the rate of about 0.2°C in thirty years, which is 0.7° per century. Since this is the approximate amount of the last century’s warming, this is by no means a trivial difference.
My conclusion? We still have not resolved the UHI issue, in any of the land datasets. I’m happy to discuss other alternative explanations for what we find in Figure 3. I just can’t think of too many. With the ground records, nobody has looked at the other guys’ analysis and algorithms harshly, aggressively, and critically. They’ve all taken their own paths, and they haven’t disputed much with each other. The satellite data algorithms, on the other hand, has been examined minutely by two very competitive groups, UAH and RSS, in a strongly adversarial scientific manner. As is common in science, the two groups have each found errors in the other’s work, and when corrected the two records agree quite well. It’s possible they’re both wrong, but that doesn’t seem likely. If the ground-based folks did that, we might get better agreement. But as with the climate models and modelers, they’re all far too well-mannered to critically examine each other’s work in any serious fashion. Because heck, if they did that to the other guy, he might return the favor and point out flaws in their work, don’t want that kind of ugliness to intrude on their genteel, collegiate relationship, can’t we just be friends and not look too deeply? …
w.
PS—I remind folks again that the hype about BEST showing skeptics are wrong is just that. Most folks knew already that the world has been generally warming for hundreds of years, and BEST’s results in that regard were no surprise. BEST showed nothing about whether humans are affecting the climate, nor could it have done so. There are still large unresolved issues in the land temperature record which BEST has not clarified or solved. The jury is out on the BEST results, and it is only in part because they haven’t even gone through peer review.
PPS—
Oh, yeah, one more thing. At the top of the BEST dataset there’s a note that says:
Estimated 1950-1980 absolute temperature: 7.11 +/- 0.50
Seven degrees C? The GISS folks don’t even give an average, they just say it’s globally about 14°C.
The HadCRUT data gives a global temperature about the same, 13.9°C, using a gridded absolute temperature dataset. Finally, the Kiehl/Trenberth global budget gives a black-body radiation value of 390 W/m2, which converts to 14.8°. So I figured that was kind of settled, that the earth’s average temperature (an elusive concept to be sure) was around fourteen or fifteen degrees C.
Now, without a single word of comment that I can find, BEST says it’s only 7.1 degrees … say what? Anyone have an explanation for that? I know that the BEST figure is just the land. But if the globe is at say 14° to make it easy, and the land is at 7°, that means that on average the ocean is at 17°.
And I’m just not buying that on a global average the ocean is ten degrees C, or 18 degrees F, warmer than the land. It sets off my bad number detector.
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.
From Willis Eschenbach on October 24, 2011 at 10:18 pm
Willis, that is an inaccurate sourcing note. NOAA-NCDC says here they moved on to GHCN-M version 3. They were updating v2 a while longer, according to the note at the section near the bottom where the summary sets are available. URL for that v3 set matches what you posted:
ftp://ftp.ncdc.noaa.gov/pub/data/anomalies/monthly.land.90S.90N.df_1901-2000mean.dat
At that note is a link to the ftp directory for v2, current “last modified” is July 20, last value in the indicated monthly file is June 2011.
GISS could not be using v2 for the most recent months, they should change the attribution. Someone better notify Hansen about the v2 set: It’s dead, Jim.
Me, I’ve had it up to here with being lied to by Muller, I’m fed up to my eye-teeth with his tricks and his whoring for the media. Sure, I could pretend Muller is an honest and honorable man like you recommend. But his actions have shown him to be a cunning snake. It is not my habit to address snakes as though they were honorable men.
You lost me.
When did Dr Muller become a Skeptic? I seem to recall watching a lecture by Dr Muller in which he provides evidence that increasing CO2 in the atmosphere, because it is a greenhouse gas, will cause increased warming.
UHI and changes to land use/landscape cannot be ignored, e.g. soil, bitumen and concrete absorb more radiation than grass and trees.
In the first graph, are the data points connected by lines, or are the points that dense?
I’d like to see it without lines.
From aaron on October 25, 2011 at 4:15 am:
Just lines.
I replicated that graph for this comment. Without lines, with the spreadsheet using little symbols for the points, it looks like a large air nozzle spewing confetti. There are more than 2500 points.
I also would love to see an oceans only graph layered into the five data sets chart to see which data set follows the ocean air temp chart the most accurately.
Ladies and Gentlemen, the International Panel on Climate Shenanigans is proud to announce the nominations for the golden Pacharan International Shenanigans Statues for 2011.
There are six nominations for the Creative Research And Publicity award.
From California: BEST Birks Earth Surface Tragedy
From East Anglia: CRUD Climate Research Universal Disambiguation
From Exeter: HASH Hardly Atmospheric Surface History
From Yorkshire: LUST Leeds Ultimate Surface Temperature
From Pennsylvania: MESS Mans Earth Surface Study
From Exeter again: MOST Metro Official Surface Temperature
Please submit your vote in the next 14 days using the Pal Approval Streamlined System.
The winner will be announced in Durban in early December.
Addendum to last post:
That’s more than 2500 anomaly points. Each has two uncertainty points with them (+ and – unc.). Thus over 7500 points total to graph.
It looks much better as only lines.
Louis October 24, 2011 at 9:45 pm
The BEST press release makes the following claim about UHI:
“The urban heat island effect is locally large and real, but does not contribute significantly to the average land temperature rise. That’s because the urban regions of the Earth amount to less than 1% of the land area.”
Aren’t they shooting AGW in the head (or themselves in the foot) with that statement? I mean, if the urban regions of the Earth are not contributing significantly to the average temperature rise of the planet, how can they then turn around and claim that humans are the main cause of global warming? Aren’t the urban regions of the Earth where the people are? Doesn’t most energy use occur in urban regions? Are they saying that people in rural areas are somehow at fault for warming the earth even though they are not warming their local region? What am I missing here?
You’re missing the fact that AGW is supposed to be due to the global average atmospheric concentration of greenhouse gases, esp. CO2. The UHI effect is primarily due to heat retention by construction materials in buildings, roads, etc., and waste heat from energy use.
Septic Matthew says:
October 25, 2011 at 4:07 am
Me, I’ve had it up to here with being lied to by Muller, I’m fed up to my eye-teeth with his tricks and his whoring for the media. Sure, I could pretend Muller is an honest and honorable man like you recommend. But his actions have shown him to be a cunning snake. It is not my habit to address snakes as though they were honorable men.
You lost me.
Some education ………………….
Splendid hunting ground
Rikki Tikki Tavi, Rudyard Kipling (1894) Can skip to Part 3.
Where is the missing data used for the smoothing?
From Full_Database_Average_complete.txt, I can see the 20-yr running average ends 10 years before the end of the records. That makes sense, it’d use 10 yrs before and after. They’ve run out of data, the 20 yr smoothing stops.
But the records start at 1800, including the smoothed values. So they would need 10 yrs of data from before 1800 to start the 20 yr smoothing. Where is it? Same issue with the other shorter-length smoothed values. This is supposed to be the data, but 10 yrs are missing. Did they, identifying it with the appropriate scientific/mathematical/statistical terminology, just “make up” the starting data or initial smoothing results?
In the final analysis, it appears to me that they wasted a perfectly good acronym.
What exactly is the BEST temperature dataset? I had assumed it was some kind of average of GISS, HADCRUT and NOAA, but the graph labeled fig 3 has confused me. Here the BEST temperatures are higher than any of the others – not an average like I expected. How do they do it?
The first thing I thought of when I saw Fig 1 was a funnel.
So they’ve gone from beating us over the head with a hockey stick, to using a funnel to…
Never mind. Any further comment would just result in a ban.
I would suggest moving the ‘normal’ for the satellite data down, thereby moving the anomoly for that record upwards. That would place it more in line with what you expect to see.
Willis, I understand that you and Anthony have been subjected to some pretty shoddy treatment by the BEST team. And I am not suggesting that people should not be angry. But I think that our side (the skeptics) is winning the battle of ideas. Our mission now is to convert the independent thinkers. And we do this by being on the side of reason. I think we can expose all of their dirty tricks and duplicitousness without calling them “media whores” — let the reader come to that conclusion for themselves. A little bit of mockery and ridicule is ok (“once again Muller has demonstrated that the most dangerous place to stand is between him and a microphone”) but I think if it goes too far it alienates new readers. Anyway, I’m not here to lecture. Its just my opinion — take it for what its worth.
I’m a big fan of your work.
‘then broke a confidentiality agreement’
surely a court case.
BlueIce2HotSea says:
October 24, 2011 at 10:56 pm
Here’s Muller on the subject:
Me, I’m not worried about the decline. I’m worried about the “Nature trick”, as this refers to egregious scientific malfeasance. Here’s more about Muller (emphasis mine):
Parse it the way you want it, I call BS on a physicist who makes a statement like “Global warming is real”. There’s too many twists, too much deniability, too many bogus assumptions in that. From a physicist of Muller’s stature, that statement is as designedly deceptive as Mikes “Nature trick”.
In addition, his results are not “close to those published by prior groups”. They are diverging at 0.7°C per century, which is larger than last century’s purported warming … how is that “close” in any but the “Nature trick” sense of the word?
w.
Gras Albert says:
October 25, 2011 at 1:03 am
Their scientific motivation seems to be to get the best dataset and analyze it as best they can.
Their political motivation seems to be to use that dataset to prove that “global warming”, as Muller deceptively calls it, is real. He means Anthropogenic Global Warming by that term … or not, as the moment requires. He is quite willing (see my last post) to use “global warming” to mean just that the earth is warming, at times when he is being interviewed.
Of course, he must know that the media will take that to mean AGW is real, and yet he makes no attempt to stop them from that error. Then he can deny ever having said AGW is real, and at the same time the media are trumpeting “Skeptic Scientist Declares Global Warming is Real”. It’s what you call a “win-win situation”.
I don’t think Muller cares for Mann, he knows his science is way wonky. So I don’t think he cares if his work contradicts Mann’s work.
w.
Mark says:
October 25, 2011 at 1:55 am
That is the raw data. Column 1, year. Column 2, month. Column 3, monthly data. Column 4, uncertainty of monthly data. Column 5, annual average data. Column 6, uncertainty of annual data. Column 7, 5-year average data. … etc.
The averages are centered averages. As a result, at the end of the dataset, the averages are omitted, since there is not enough data to make the average. That’s why they say NaN, nothing underhanded at all.
The averages are to a thousandth of a degree, which seems like false accuracy to me, but doesn’t bother me, it’s just data.
w.
mondo says:
October 25, 2011 at 2:35 am
Yeah, probably you are, but that’s OK. You are right that it is a change in UHI (∆UHI) that affects the trends, not the UHI itself.
However, (presumably) the UHI is always changing, because in general the cities are always growing, new areas paved, more buildings built, more UHI. So in practice the difference doesn’t really make a difference.
w.
Richard S Courtney says:
October 25, 2011 at 2:42 am
Another way to hide the decline … just alter your data sets on a regular basis …
Thanks, Richard, keep pounding at the gates,
w.
Willis, When considering Muller’s false persona it worth a review of “Operation Trust” used by the Soviets in the early days;
http://en.wikipedia.org/wiki/Trust_Operation
Fake and straw moderates are nothing new.
David says:
October 25, 2011 at 4:47 am
The Berkeley dataset doesn’t cover the oceans, just the land.
w.
mpaul says:
October 25, 2011 at 8:06 am
mpaul, as I said before, you are likely right. And certainly, tactically you are right. As the old saw goes, “You catch more flies with honey than with vinegar”. And certainly humor is the best, as you say, “once again Muller has demonstrated that the most dangerous place to stand is between him and a microphone”.
However, I’m not really here to catch flies, or certainly not entirely here to catch flies. I’m here to tell the truth about what I see and what I think and feel about what I see, particularly regarding scientific malfeasance.
I’m one of the few scientists to do so. Most of them say nothing about anything bad or even slightly negative. Some of them use carefully parsed and chosen words to express their displeasure without ruffling a hair on their heads, and without mentioning a single name. See, e.g., the general response of the climate science community, skeptics and AGW supporters alike, to the Climategate revelations—a haunting silence, with occasional murmurings about the actions, and not one scientist’s name ever spoken.
So while it is tempting to take up the “mention your concerns gently and never name names” kind of approach, I just don’t like the feeling it leaves in my mouth. These guys are not agitating for something good, or even for something neutral. They are making a concerted effort to raise the price of energy for everyone, including the poorest of the poor. If they are successful they will keep the poor impoverished for generations.
And getting all “honey-words” about that, well, that is a very difficult thing for me to do. However, your advice is good, and I will strive to do that wherever I can do so without abating my desire to actually tell the truth. Humor is the best, as you point out … but somehow smart-but-brainless wealthy scientists working overtime to raise energy costs for people living on a dollar a day is not all that funny … odd how that works.
My thanks for returning with your thoughts, much appreciated, mpaul.
w.