Contribution of USHCN and GISS bias in long-term temperature records for a well-sited rural weather station

Guest post by David W. Schnare, Esq. Ph.D.

When Phil Jones suggested that if folks didn’t like his surface temperature reconstructions, then perhaps they should do their own, he was right. The SPPI analysis of rural versus urban trends demonstrates the nature of the overall problem. It does not, however, go into sufficient detail. A close examination of the data suggests three areas needing address. Two involve the adjustments made by NCDC (NOAA) and by GISS (NASA). Each made their own adjustments and typically these are serial, the GISS done on top of the NCDC. The third problem is organic to the raw data and has been highlighted by Anthony Watts in his Surface Stations project. That involves the “micro-climate” biases in the raw data.

As Watts points out, while there are far too many biased weather station locations, there remain some properly sited ones. Examination of the data representing those stations provides a clean basis by which to demonstrate the peculiarities in the adjustments made by NCDC and GISS.

One such station is Dale Enterprise, Virginia. The Weather Bureau has reported raw observations and summary monthly and annual data from this station since 1891 through the present, a 119 year record. From 1892 to 2008, there are only 9 months of missing data during this 1,404 month period, a missing data rate of less than 0.64 percent. The analysis below interpolates for this missing data by using an average of the 10 years surrounding the missing value, rather than basing any back-filling from other sites. This correction method minimizes the inherent uncertainties associated with other sites for which there is not micro-climate guarantee of unbiased data.

The site itself is in a field on a farm, well away from buildings or hard surfaces. The original thermometer remains at the site as a back-up to the electronic temperature sensor that was installed in 1994.

The Dale Enterprise station site is situated in the rolling hills east of the Shenandoah Valley, more than a mile from the nearest suburban style subdivision and over three miles from the center of the nearest “urban” development, Harrisonburg, Virginia, a town of 44,000 population.

Other than the shift to an electronic sensor in 1994, and the need to fill in the 9 months of missing reports, there is no reason to adjust the raw temperature data as reported by the Weather Bureau.

Here is a plot of the raw data from the Dale Enterprise station.

There may be a step-wise drop in reported temperature in the post-1994 period. Virginia does not provide other rural stations that operated electronic sensors over a meaningful period before and after the equipment change at Dale Enterprise, nor is there publicly available data comparing the thermometer and electronic sensor data for this station. Comparison with urban stations introduces a potentially large warm bias over the 20 year period from 1984 to 2004. This is especially true in Virginia as most such urban sites are typically at airports where aircraft equipment in use and the pace of operations changed dramatically over this period.

Notably, neither NCDC nor GISS adjusts for this equipment change. Thus, any bias due to the 1994 equipment change remains in the record for the original data as well as the NCDC and GISS adjusted data.

The NCDC adjustment

Although many have focused on the changes GISS made from the NCDC data, the NCDC “homogenization” is equally interesting, and as shown in this example, far more difficult to understand.

NCDC takes the originally reported data and adjusts it into a data set that becomes a part of the United States Historical Climatology Network (USHCN). Most researchers, including GISS and the East Anglia University Climate Research Center (CRU) begin with the USHCN data set. Figure 2 documents the changes NCDC made to the original observations and suggests why, perhaps, one ought begin with the original data.

The red line in the graph shows the changes made in the original data. Considering the location of the Dale Enterprise station and the lack of micro-climate bias, one has to wonder why NCDC would make any adjustment whatever. The shape of the red delta line indicates these are not adjustments made for purposes of correcting missing data, or for any obvious other bias. Indeed, with the exception of 1998 and 1999, NCDC adjusts the original data in every year! [Note, when a 62 year old Ph.D. scientist uses an exclamation point, their statement is rather to be taken with some extraordinary attention.]

This graphic makes clear the need to “push the reset button” on the USHCN. Based on this station, alone, one can argue the USHCN data set is inappropriate for use as a starting point for other investigators, and fails to earn the self-applied moniker as a “high quality data set.”

The GISS Adjustment

GISS states that their adjustments reflect corrections for the urban heat island bias in station records. In theory, they adjust stations based on the night time luminosity of the area within which the station is located. This broad-brush approach appears to have failed with regard to the Dale Enterprise station. There is no credible basis for adjusting station data with no micro-climate bias conditions and located on a farm more than a mile from the nearest suburban community, more than three miles from a town and more than 80 miles from a population center of greater than 50,000, the standard definition of a city. Harrisonburg, the nearest town, has a single large industrial operation, a quarry, and is home to a medium sized (but hard drinking) university (James Madison University). Without question, the students at JMU have never learned to turn the lights out at night. Based on personal experience, I’m not sure most of them even go to bed at night. This raises the potential for a luminosity error we might call the “hard drinking, hard partying, college kids” bias. Whether it is possible to correct for that in the luminosity calculations I leave to others. In any case, the lay out of the town is traditional small town America, dominated by single family homes and two and three story buildings. The true urban core of the town is approximately six square blocks and other than the grain tower, there are fewer than ten buildings taller than five stories. Even within this “urban core” there are numerous parks. The rest of the town is quarter-acre and half-acre residential, except for the University, which has copious previous open ground (for when the student union and the bars are closed).

Despite the lack of a basis for suggesting the Dale Enterprise weather station is biased by urban heat island conditions, GISS has adjusted the station data as shown below. Note, this is an adjustment to the USHCN data set. I show this adjustment as it discloses the basic nature of the adjustments, rather than their effect on the actual temperature data.

While only the USHCN and GISS data are plotted, the graph includes the (blue) trend line of the unadjusted actual temperatures.

The GISS adjustments to the USHCN data at Dale Enterprise follow a well recognized pattern. GISS pulls the early part of the record down and mimics the most recent USHCN records, thus imposing an artificial warming bias. Comparison of the trend lines is somewhat difficult to see in the graphic. The trends for the original data, the USHCN data and the GISS data are: 0.24,

-0.32, and 0.43 degrees C. per Century, respectively.

If one presumes the USHCN data reflect a “high quality data set”, then the GISS adjustment does more than produce a faster rate of warming, it actually reverses the sign of the trend of this “high quality” data. Notably, compared to the true temperature record, the GISS trend doubles the actual observed warming.

This data presentation constitutes only the beginning analysis of Virginia temperature records. The Center for Environmental Stewardship of the Thomas Jefferson Institute for Public Policy plans to examine the entire data record for rural Virginia in order to identify which rural stations can serve as the basis for estimating long-term temperature trends, whether local or global. Only a similar effort nationwide can produce a true “high quality” data set upon which the scientific community can rely, whether for use in modeling or to assess the contribution of human activities to climate change.

David W. Schnare, Esq. Ph.D.

Director

Center for Environmental Stewardship

Thomas Jefferson Institute for Public Policy

Springfield Virginia

===================================

UPDATE: readers might be interested in the writeup NOAA did on this station back in 2002 here (PDF, second story). I point this out because initially NCDC tried to block the surfacestations project saying that I would compromise “observer privacy” by taking photos of the stations. Of course I took them to task on it when we found personally descriptive stories like the one referenced above and they relented. – Anthony

0 0 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

196 Comments
Inline Feedbacks
View all comments
Basil
Editor
February 26, 2010 8:10 pm

I’m confused. Where is the “raw” data coming from here? Can you point me to a .gov source where you get your “raw” data?

February 26, 2010 8:16 pm

Rural Beeville, Texas (Class 1 or 2) 1896 – 2005
NOAA adds 2.8°F / Century to Tmean raw data linear trend.

u.k.(us)
February 26, 2010 8:19 pm

Steve Oregon (19:43:13) :
You just asked the 10 trillion dollar question.
Read Anthony’s archives, then you can tell us 🙂

February 26, 2010 8:20 pm


Claude Harvey (19:38:19) :
Now that the satellite data shows heating, dramatically so over the past nine months, the satellites are suddenly unreliable?

Asked and unanswered; what are they measuring ( ‘ looking at ‘ )?
(See also here: A statistically significant cooling trend in RSS and UAH satellite data)
.
.

February 26, 2010 8:22 pm

Link to Beeville graph:
http://tinypic.com/2mz0dqu/

February 26, 2010 8:24 pm

Sorry, new at this tinypic thingy: Try this:
http://tinypic.com/r/2mz0dqu/6

Eric Gamberg
February 26, 2010 8:27 pm

I’d just like to point out the Hay Springs 12S, NE station is NOT currently a well sited rural station.
I’d also note that NOAA has published an article about the numerous locations of the Academy, SD station in their COOP newsletter covering the early period of the station that is not included in the MMS database. The station volunteer operator had a copy that I quickly read before moving on that particular day.
Both of these stations are included in this study. Neither station’s state or history is addressed as to the selection criterion for this paper.

igloowhite
February 26, 2010 8:27 pm

Steve Oregon,
First Know thyself.
Yours true,
igloowhite

D. King
February 26, 2010 8:28 pm

David,
Here is NOAA talking about the new sensors.
Watch from 3:00 to 3:24

David Schnare
February 26, 2010 8:29 pm

Data sources for the analysis.
The “raw” data come through the NOAA Locate Station portal at:
http://www.ncdc.noaa.gov/oa/climate/stationlocator.html
I pulled from “Daily/Monthly/Annual Virginia Climatological Data” which are the original reports from the various weather stations, raw and unadjusted. As you work back in time, it is interesting to see who was in charge of this data. It all began in the Department of Agriculture where the “Weather Bureau” was located. The key data was about precipitation, not temperature. As my grandfather, an Iowa farmer, oft explained, water makes the crop. There will always be plenty of sun. Today the raw station data comes from NCDC reports which remain remarkable similar in form to the original efforts from the 1890s.
The USHCN adjusted data are pulled from the GISS site. GISS states that it uses the newest available data from USHCN data set. Here is Hanson’s (GISS) description:
“The current analysis uses surface air temperatures measurements from the following data sets: the unadjusted data of the Global Historical Climatology Network (Peterson and Vose, 1997 and 1998), United States Historical Climatology Network (USHCN) data, and SCAR (Scientific Committee on Antarctic Research) data from Antarctic stations. ”
You can find this quote and more at:
http://data.giss.nasa.gov/gistemp/
He does not state which version of the data he uses. I pulled directly from NCDC to compare with the GISS data and have not had time to compare them directly. The data are not in the same format and it requires many multiple data pulls from NCDC to get comparable data to that provided in text form from GISS. Our full report this summer will take a look at that and other similar issues. If you have suggestions on other issues, do let me know.
The GISS and USHCN data come through the GISS portal at:
http://data.giss.nasa.gov/gistemp/station_data/
I used the “raw GHCN data + and USHCN corrections” as the USHCN data, and used “after homogeneity adjustment” as the GISS data.
GISS offers a third option: “after combining sources at same location”. In the Dale Enterprise case study, this data was identical to the “raw GHCN data + and USHCN corrections”, which would be expected for a true rural data set, as there are no other sources at the same location in such a case.

February 26, 2010 8:37 pm


Eric Gamberg (19:47:25) :
Don’t forget that the surfacestations.org survey results are really only addressing the conditions at the site at the time of the survey. The history of the site and its locations and equipment are not rigorously examined.

Survey parties anxiously await the invention of/the discovery of/the release from EVT (Engineering Verification Testing) of the first time-travel machines available for rent or lease for prioritized civilian purposes …
.
.

Frank Schroeder
February 26, 2010 8:38 pm

“Notably, neither NCDC nor GISS adjusts for this equipment change. Thus, any bias due to the 1994 equipment change remains in the record for the original data as well as the NCDC and GISS adjusted data.”
Is this true? Does it not seem as if there is just such an adjustment in the NCDC data set? they have a step adjustment at a time point that looks to be early 90’s – perhaps related to the equipment chage?.

Roger Knights
February 26, 2010 8:43 pm

MODS: TYPO under the first chart in the article:
Change to “most” in: “as must such urban sites “

D. King
February 26, 2010 8:55 pm

Frank Schroeder (20:38:59) :
see the video here:
D. King (20:28:50) :

Mark C
February 26, 2010 9:20 pm

I’m presuming this nighttime luminosity data is from the DMSP satellites, which has (as far as I know) the only sensor measuring nighttime lights.
The OLS sensor uses a photo-multiplier tube, something like night vision goggles, to amplify the available light. Anyone who has seen this imagery can see considerable “bleeding” of bright areas into surrounding dark areas. Some of this can be removed with post-processing and long-term averaging, but it’s probably not enough in areas with sharp gradients from “urban” to “rural”. I suppose it serves as a gross filter mechanism between rural and urban sites, but it’s not good enough as it will probably misclassify sites that are near urban areas to be within the “bright” areas, but still far enough away that the thermometer record would be nearly unaffected.
I think the only proper way is a manual analysis using higher-resolution imagery such as what Google uses. Another substitute might be Landsat, using it to classify how well vegetated the surrounding area is. Urban desert vs. rural desert might be tougher, but I bet it’s doable.

pat
February 26, 2010 9:20 pm

This really evidences fraud at the highest levels of governmental science. I think an investigation must begin. There is something seriously wrong with scientific reportage. And i suspect it may span many more fields than climate.

jorgekafkazar
February 26, 2010 9:22 pm

Tom in Texas (20:16:05) : “Rural Beeville, Texas (Class 1 or 2) 1896 – 2005. NOAA adds 2.8°F / Century to Tmean raw data linear trend.”
Isn’t there some sort of airport there? Or an Air Force base? I had a pizza there about 1976, seem to recall something of the sort.

February 26, 2010 9:31 pm

Very interesting and informative post, Dr. Schnare. Thank you for posting this, and to Anthony for hosting it. I can only guess that the data-manipulators never imagined that one day their work would be exposed.
For those who may be interested, I posted some graphs of the U.S. cities’ temperature records that were made available from Hadley late in 2009, as their attempt to show they had nothing to hide after the Climate-gate fiasco.
There is only one city in that data for Virginia, and that is Richmond. It is not a rural site at all, but a large city, with monthly average temperatures going back to 1911.
http://sowellslawblog.blogspot.com/2010/02/usa-cities-hadcrut3-temperatures.html

Bruce of Newcastle
February 26, 2010 9:38 pm

I like to extrapolate the GISS corrections backwards. In this case Harrisonburg clearly reappeared from beneath its glacier around 1200 AD.
This is slightly later than the hitherto unrecognised ice age in tropical North Queensland, where the Mackay sugar mill emerged from under the ice in 900 AD:
http://kenskingdom.wordpress.com/2010/02/05/giss-manipulates-climate-data-in-mackay/
I can’t do better than Ken Stewart’s own words “Wow- when they adjust, they don’t muck around!”

Reed Coray
February 26, 2010 9:53 pm

Steve (19:43:13), here’s my answer to your question: How does the AGW alarm keep sounding with such a convoluted quagmire of stuff that’s supposed to be science?
Most people want to feel good about themselves–I know I do. One way to accomplish that goal is to participate in saving the world. Jumping on the CAGW bandwagon was a way to do your part to save the world. As a consequence, the main stream media and much of the populace climbed aboard. Once on the bandwagon, it’s hard to be one of the first people to jump off because to do so would be to admit not only that you haven’t been saving the world, but also to admit that you were duped. So an early bailout means you have to admit you were a dupe, not a world save. That’s a hard jump for anyone. However, as the number of jumpers increases (as I hope and believe it will), it becomes more palatable to bail out. If you don’t join the mass of jumpers, you become a “double dupe”–you got duped when you got on the bandwagon, you weren’t smart enough to get off before the wagon went over the cliff. IMO we’ve seen the start of the mass bailout-but only time will tell.

victor meldrew
February 26, 2010 9:56 pm

I really don`t believe what i`ve just seen on bbc news,
Our world
The rise of the sceptics,
So far ,well balanced informative and non-judgemental(i kid you not) .Exerpts from Lord Chris Monktons aussie tour, interviews with sceptical scientists and politicos, the whole lot, i suspect there will be some qualifiers and pro agw views before the end of the programme you may not be able to watch this outside the uk without a proxy,but,GOOD GRIEF the buggers have blinked!

hotrod ( Larry L )
February 26, 2010 10:05 pm

Very interesting — If you tried to screw up the data, you could hardly come up with a better method than to pile undocumented adjustment on top of undocumented adjustment. In addition to that in the examples we have see so far of these forensic examinations of a handful of rural stations they appear to be some what arbritrary adjustments (ie what happens in location x does not happen at location y even though they are both high quality long duration rural stations).
Given they are adjusting for UHI based on luminosity — Wouldn’t it be funny if the sudden move to high efficiency lighting is increasing luminosity of cities even though population is nearly stable. It could be a classic example of unintended consequences.
Folks used to put 100 w incandescent lights in their porch lights. As power costs went up the tended not to leave them on all night but turned them off. Then as security concerns increased, folks went out and bought high efficiency mercury vapor, low pressure sodium vapor and high pressure sodium vapor yard lights (even in very rural areas — many farms have poll mounted yard lights that are activated at sun set). Likewise you now have thousands of solar powered sidewalk lights. In homes people are now lighting patios with multiple 12w CFL bulbs that they think nothing of leaving on for hours, even though they individually have lower power consumption their luminosity has gone up. Cities and businesses have done the same thing for crime prevention. They have over the last few decades added hundreds of high power street and area lights using high efficiency sodium vapor lights in the name of improved citizen safety and traffic safety. Now we have a move underway to high intensity LED lighting.
It would be very interesting if the astronomy community interested in “Dark skies”, have collected data regarding local back scatter light levels in communities that can be compared to local population levels.
Larry

Cassandra King
February 26, 2010 10:10 pm

Climate science is a money making machine like any other, wholly dependent on lavish funding to find and quantify a link between human activity and climate these people were certain to find the link they were looking for whether it existed or not.
If your livihood depends on seeing something then chances are you see it whether it exists or not and if the funding stream contiuation is dependent on finding something then find it you will.
Science has always depended on financial support, control the grant bodies and you effectively control the scientists and the science, since those who demand to aquire proof of AGW/MMCC/AAM now control who gets funding it becomes clear that scientists will follow the funding stream and look to provide results that will allow the contiuation of that funding stream.
Climate science grew too big too fast fed with too much much money that was streamed to those scientists who could find evidence of warming and human involvement whether it existed or not, human nature was understood by the funding agencies and exploited with a ruthless determination.
Human nature is quantifiable and easily understood, the people who have used science for there own ends need to be unmasked and brought to book.

Robert Kral
February 26, 2010 10:10 pm

Bravo! This is exactly the kind of analysis we need to see repeated over and over. I work in a different field of science, in which arbitrary “adjustments” to perfectly credible raw data would result in, at best, failure and, at worst, criminal prosecution. This study begs the most essential question of all: what do the raw data records of truly rural weather stations around the world show? We have to begin there and figure out the rest. If the raw data show nothing outside the realm of known natural variation, then AGW immediately becomes a mythical construct devised by people who have an agenda that does not involve objective truth.

Ian H
February 26, 2010 10:18 pm

It seems to me that we are observing the birth of a new science, the scientific study of the methods of climate scientists.

Verified by MonsterInsights