by Roy W. Spencer, Ph. D.

INTRODUCTION
My last few posts have described a new method for quantifying the average Urban Heat Island (UHI) warming effect as a function of population density, using thousands of pairs of temperature measuring stations within 150 km of each other. The results supported previous work which had shown that UHI warming increases logarithmically with population, with the greatest rate of warming occurring at the lowest population densities as population density increases.
But how does this help us determine whether global warming trends have been spuriously inflated by such effects remaining in the leading surface temperature datasets, like those produced by Phil Jones (CRU) and Jim Hansen (NASA/GISS)?
While my quantifying the UHI effect is an interesting exercise, the existence of such an effect spatially (with distance between stations) does not necessarily prove that there has been a spurious warming in the thermometer measurements at those stations over time. The reason why it doesn’t is that, to the extent that the population density of each thermometer site does not change over time, then various levels of UHI contamination at different thermometer sites would probably have little influence on long-term temperature trends. Urbanized locations would indeed be warmer on average, but “global warming” would affect them in about the same way as the more rural locations.
This hypothetical situation seems unlikely, though, since population does indeed increase over time. If we had sufficient truly-rural stations to rely on, we could just throw all the other UHI-contaminated data away. Unfortunately, there are very few long-term records from thermometers that have not experienced some sort of change in their exposure…usually the addition of manmade structures and surfaces that lead to spurious warming.
Thus, we are forced to use data from sites with at least some level of UHI contamination. So the question becomes, how does one adjust for such effects?
As the provider of the officially-blessed GHCN temperature dataset that both Hansen and Jones depend upon, NOAA has chosen a rather painstaking approach where the long-term temperature records from individual thermometer sites have undergone homogeneity “corrections” to their data, mainly based upon (presumably spurious) abrupt temperature changes over time. The coming and going of some stations over the years further complicates the construction of temperature records back 100 years or more.
All of these problems (among others) have led to a hodgepodge of complex adjustments.
A SIMPLER TECHNIQUE TO LOOK FOR SPURIOUS WARMING
I like simplicity of analysis — whenever possible, anyway. Complexity in data analysis should only be added when it is required to elucidate something that is not obvious from a simpler analysis. And it turns out that a simple analysis of publicly available raw (not adjusted) temperature data from NOAA/NESDIS NOAA/NCDC, combined with high-resolution population density data for those temperature monitoring sites, shows clear evidence of UHI warming contaminating the GHCN data for the United States.
I will restrict the analysis to 1973 and later since (1) this is the primary period of warming allegedly due to anthropogenic greenhouse gas emissions; (2) the period having the largest number of monitoring sites has been since 1973; and (3) a relatively short 37-year record maximizes the number of continuously operating stations, avoiding the need to handle transitions as older stations stop operating and newer ones are added.
Similar to my previous posts, for each U.S. station I average together four temperature measurements per day (00, 06, 12, and 18 UTC) to get a daily average temperature (GHCN uses daily max/min data). There must be at least 20 days of such data for a monthly average to be computed. I then include only those stations having at least 90% complete monthly data from 1973 through 2009. Annual cycles in temperature and anomalies are computed from each station separately.
I then compute multi-station average anomalies in 5×5 deg. latitude/longitude boxes, and then compare the temperature trends for the represented regions to those in the CRUTem3 (Phil Jones’) dataset for the same regions. But to determine whether the CRUTem3 dataset has any spurious trends, I further divide my averages into 4 population density classes: 0 to 25; 25 to 100; 100 to 400; and greater than 400 persons per sq. km. The population density data is at a nominal 1 km resolution, available for 1990 and 2000…I use the 2000 data.
All of these restrictions then result in thirteen 24 to 26 5-deg grid boxes over the U.S. having all population classes represented over the 37-year period of record. In comparison, the entire U.S. covers about 31 40 grid boxes in the CRUTem3 dataset. While the following results are therefore for a regional subset (at least 60%) of the U.S., we will see that the CRUTem3 temperature variations for the entire U.S. do not change substantially when all 31 40 grids are included in the CRUTem3 averaging.
EVIDENCE OF A LARGE SPURIOUS WARMING TREND IN THE U.S. GHCN DATA
The following chart shows yearly area-averaged temperature anomalies from 1973 through 2009 for the 13 24 to 26 5-deg. grid squares over the U.S. having all four population classes represented (as well as a CRUTem3 average temperature measurement). All anomalies have been recomputed relative to the 30-year period, 1973-2002.
The heavy red line is from the CRUTem3 dataset, and so might be considered one of the “official” estimates. The heavy blue curve is the lowest population class. (The other 3 population classes clutter the figure too much to show, but we will soon see those results in a more useful form.)
Significantly, the warming trend in the lowest population class is only 47% of the CRUTem3 trend, a factor of two difference.
Also interesting is that in the CRUTem3 data, 1998 and 2006 would be the two warmest years during this period of record. But in the lowest population class data, the two warmest years are 1987 and 1990. When the CRUTem3 data for the whole U.S. are analyzed (the lighter red line) the two warmest years are swapped, 2006 is 1st and then 1998 2nd.
From looking at the warmest years in the CRUTem3 data, one gets the impression that each new high-temperature year supersedes the previous one in intensity. But the low-population stations show just the opposite: the intensity of the warmest years is actually decreasing over time.
To get a better idea of how the calculated warming trend depends upon population density for all 4 classes, the following graph shows – just like the spatial UHI effect on temperatures I have previously reported on – that the warming trend goes down nonlinearly as population density of the stations decrease. In fact, extrapolation of these results to zero population density might produce little warming at all!
This is a very significant result. It suggests the possibility that there has been essentially no warming in the U.S. since the 1970s.
Also, note that the highest population class actually exhibits slightly more warming than that seen in the CRUTem3 dataset. This provides additional confidence that the effects demonstrated here are real.
Finally, the next graph shows the difference between the lowest population density class results seen in the first graph above. This provides a better idea of which years contribute to the large difference in warming trends.
Taken together, I believe these results provide powerful and direct evidence that the GHCN data still has a substantial spurious warming component, at least for the period (since 1973) and region (U.S.) addressed here.
There is a clear need for new, independent analyses of the global temperature data…the raw data, that is. As I have mentioned before, we need independent groups doing new and independent global temperature analyses — not international committees of Nobel laureates passing down opinions on tablets of stone.
But, as always, the analysis presented above is meant more for stimulating thought and discussion, and does not equal a peer-reviewed paper. Caveat emptor.



OT. I do not understand statistics. But there’s a commentator (VS) who is leaving Tamino crazy. He even forgot you Anthony.
Our knowledge has been built on sand. And of sand. And in comes the tide.
=========================
“This is a very significant result. It suggests the possibility that there has been essentially no warming in the U.S. since the 1970s.”
Tell this to the pope, will ya:
http://news.bbc.co.uk/2/hi/uk_news/scotland/glasgow_and_west/8570294.stm
Scottish Secretary Jim Murphy, who is leading UK government preparations for the tour, said it was “an historic visit at an important time”.
“The Papal visit represents an unprecedented opportunity to strengthen ties between the UK and the Holy See on action to tackle poverty and climate change as well as the important role of faith in creating strong and cohesive communities,” he said.
===
Is the Vatican invested heavily in carbon emissions trading?
Dr. Spencer,
Please provide graphical geographic maps (images) of your grid boxes. Something as simple as a 4-color map (a different color, depending on the population level in the grid) would be adequate. Even better would use a different shape or shape size to denote the level of warming in that grid box.
Alternately, if you could provide a link to your data as a text file, I could put such a map together myself.
Could we use the Surfaces Station Survey approach by organizing regional teams to collect and review the raw data. I visit the Western Regional Climate Center on line and down load the raw data when studying local climate issues. In some cases there are big gaps in the collected data. I have visited some stations and copied the paper records to resolve the missing information. We would need some standard method for dealing with this missing data, so all the teams would be using the same techniques. I am available to work on a team.
Thank you Dr. Spencer for injecting some sanity into a field of science that seems to be fraught with emotion.
Caveat Emptor indeed. Reproducible, understandable, process and limitations explained, this work certainly doesn’t sink to the low quality we have seen in peer reviewed papers on this subject.
OT…but the Gore disinformation comes thick and fast in this 3/15 sound bite:
http://www.eyeblast.tv/public/video.aspx?v=Xd8zSUkU4z
From a Gore strategy conference call for supporters.
sorry all, I meant “NOAA/NCDC”, not “NOAA/NESDIS”. Must be that age thing.
I would query your statement: “…to the extent that the population density of each thermometer site does not change over time, then various levels of UHI contamination at different thermometer sites would probably have little influence on long-term temperature trends.”
It seems to me that the UHI effect is a combination of several factors:
1. Population density.
2. Ambient extra energy (heated buildings etc.)
3. Different heat storage/release and albedo characteristics of the built environment.
Items 2 and 3 can change over time with the population density remaining constant.
I would also like to postulate a fourth factor – petro-chemical smog. I have just come back from Almaty (Kazakhstan) where this a recognised and very visible problem. In effect vehicles are increasing temperatures by a local ‘greenhouse’ effect. It might be interesting to examine whether the effect of atmospheric fuel residues depends on smog being formed or whether they increase in levels water vapour short of forming smog.
I once had a poster showing a satellite picture of the lights at night over North America similar to the one you show.
However, mine showed an almost incredible amount of lights extending half way INTO the Golf of Mexico. It took me a wile to realize that these were not ships or island but probably oil rigs! It made the Golf of Mexico seem to be as populated as the land next to it!
That surely also contributes to heat in that area.
REPLY: Compared to the heat sink of the ocean though, minimal. -A
One more arrow in the elephant. Keep ’em coming.
What is the average population density of the US? Based on the graph that shows CRU temp versus pop. density, I would guess 400.
paulo arruda (07:56:49)
If it’s the same VS that was commenting here: http://wattsupwiththat.com/2010/02/14/new-paper-on/
…he’s a very sharp one indeed. Might be an econometrician, or at least has studied it. I could see how someone like him could destroy Tamino. I’m not sure if he’s using it on Tamino, but economic statistical methods are appropriate and much more advanced than the… errhh… stuff that’s used in climate science
Disclaimer: In this OT comment I am not talking about Dr. Spencer. What I’m getting at is the attribution of statistically significant causal relationships through statistical analysis and all the gaming the RC crowd, Hockey Team, etc do to highlight what is in their favor and “debunk” what’s not
Why is the blue line sometimes higher than the red line?
It suggests the possibility that there has been essentially no warming in the U.S. since the 1970s.
More precise should be, that the linear trend 1973-2009 is close to zero, since there was warming between 1973-1990 and flat trend/decrease since then. Excellent analysis overall. PS Gif format for the graphs should be much better.
does anyone have faith in the homogenizing methods actually removing UHI ? From what I see in the GISS dataset they have adjusted old data (60’s, 70’s)DOWN and recent data has been unadjusted … basically a stepped adjustment in the WRONG direction, it should show lower adjustments to older data and greater negative adjustments to recent data.
OK. But what about the rest of the world?
I think it would be in one sense harder to duplicate the same analysis with the collected stations in, say South America, as the data gathering there has never been so constant as in the US. That said. I expect you would get an even stronger effect due to some of the rapid growth of major cities in the developing world.
How good is Russian population density data over time? I want this analysis done on Siberia!
Gro Harlem Brundtland?
Bruntland? That name bells a ring.
Is he UNabomber Mao Strong’s good buddy? Or, is she the other Bruntland?
“Of course, in the wake of Climate-gate, growing public skepticism of manmade global warming and dim prospects for big emissions cuts by the U.S. or China, a streamlined process may not get very far either.”
…-
“U.N. Climate Envoy: Shift Climate Talks From U.N.
The United Nations may not be the best forum for global climate treaty talks after the Copenhagen collapse, said a top U.N. climate envoy.
After failing for years to reach a deal among 200 countries, negotiations will shift to more informal talks among a smaller number of key nations in a “double-track system,” said special U.N. envoy Gro Harlem Brundtland on Tuesday.
Copenhagen concluded with a nonbinding three-page paper hammered out in an all-night private meeting among President Barack Obama and a handful of leaders, most importantly from China, India, Brazil and South Africa. It fell far short of the summit’s original objective, a full-fledged and legally binding accord setting emission reduction targets for major countries.
The Copenhagen experience “will serve as a base for discussions going on this year. It’s not only going to be focused on the United Nations framework, but more on what these emerging economies and big economies are committing to,” said Brundtland, speaking on the sidelines of a world conference on biofuels.
***
Brundtland’s comments reflect a growing admission that the U.N. process has proven dysfunctional. They add weight because of her 20-year involvement in climate issues and her current role as Secretary General Ban Ki-moon’s special climate envoy.”
http://blogs.investors.com/capitalhill/index.php/home/35-politics/1513-un-climate-envoy-shift-climate-talks-from-un
Thank you once again Dr. Spencer, for another excellent post. Any light shed on the badly done UHI modifications by GISS, CRU, and NOAA is welcome.
Ron (08:38:38) :
Your post reminds me of something that I read recently (I think it was Phil Jones in his BBC interview from last month): he said that they don’t do a UHI correction for London because the population hadn’t changed significantly since the late 1800’s. While the population has only grown from 6.5 million to 7.5 million, this ignores any effects due to modernization–horse-drawn carriages to cars, dirt roads to asphalt and concrete, fewer trees in general, increase in transportation/number of vehicles on the roads, etc. This would be another good area to study.
Population density of the USA, according to area and population figures provided in the CIA World Factbook, is about 31.3 people per km^2.
Dr. Spencer,
Thanks for the analysis; I’ve been doing some similar work lately:
http://i81.photobucket.com/albums/j237/hausfath/USHCNUHIPairwise.png
It might be a bit more interesting to compare your ISH dataset to raw USHCN data, since the CRUTemp GHCN stations you use have both TOB and inhomogeniety adjustments applied, and the magnitude of those adjustments for the U.S. are reasonably well known.
One possibly confounding factor is that TOB adjustments tend to be much greater for rural stations than urban ones, since rural stations are more likely to be co-op stations with irregular reporting times (whereas non co-op stations tend not to need TOB adjustments).
Dr. Spencer
Terrific work. Thanks!
I can imagine that many of the AGW “scientists” are beginning to doubt the reliablity of their data, but the politicos will go on and on and on, denying the facts.
I think that it goes something like this:
Global warming = 49% UHI – 25% “tricks” – 25% natural increase – 1% AGW
Not exact numbers obviously, but something like that.