USHCN National Weather Station Quality Plot

Early in the project, one of the criticisms heard against the surfacestations.org effort was that there had been “cherry picking” going on in the selections of stations to survey, and that the project wasn’t reaching a wide area. In this first map of it’s kind, one can clearly see the how the quality distribution of the 460 out of 1221  stations surveyed so far looks and that those claims weren’t valid. The results clearly show that the majority of USHCN stations surveyed so far have compromised measurement environments. The question then is this; have these mircosite biases been adequately accounted for in the surface temperature record?

As you can see below, there appears to be some clustering near population areas, and some east coast/west coast volume bias. There are sparse areas in the midwest that I hope can be surveyed soon. But, there is a nationwide distribution. The thing that really stands out though is that there are few sites that are CRN1/2 and many more that are CRN 3/4/5. This speaks to the concerns that our measurement network is broadly affected by microsite biases and urbanization encroachment.

Here is how this map came about; there was a suggestion made in comments by Henry, suggesting that a map showing distribution of the CRN rating would be useful. I agreed, but lamented that I’m overloaded with work at the moment. The beauty though of this project is it’s capable volunteers.

Volunteer Gary Boden came to the rescue, and provided the map below as a function of the Excel spreadsheet tracking the ratings that I’ve made publicly available for some time now. You can download my data set in Excel format at www.surfacestations.org See his plot below:

ushcn-crn-qualityplot2-small.png

Click picture for a larger image

Here is the same data presented in Pie Chart Form:

crn-rating460-2.png

For reference, as originally defined in the NOAA Climate Reference Network Handbook, here are the site quality rating descriptions:

Class 1 – Flat and horizontal ground surrounded by a clear surface with a slope below 1/3 (<19deg). Grass/low vegetation ground cover <10 centimeters high. Sensors located at least 100 meters from artificial heating or reflecting surfaces, such as buildings, concrete surfaces, and parking lots. Far from large bodies of water, except if it is representative of the area, and then located at least 100 meters away. No shading when the sun elevation >3 degrees.

 

Class 2 – Same as Class 1 with the following differences. Surrounding Vegetation <25 centimeters. No artificial heating sources within 30m. No shading for a sun elevation >5deg.

 

Class 3 (error >= 1C) – Same as Class 2, except no artificial heating sources within 10 meters.

Class 4 (error >= 2C) – Artificial heating sources <10 meters.

 

Class 5 (error >= 5C) – Temperature sensor located next to/above an artificial heating source, such as a building, roof top, parking lot, or concrete surface.

Given that the generally agreed upon rise in surface temperature over the last century is approximately 0.8 degrees Centigrade, and seeing that the majority of climate monitoring stations have errors that are nearly equal to or larger than that value, the microsite bias errors are a cause for concern.

We need more stations surveyed; this upcoming Christmas travel season would be a perfect opportunity to help us fill in the midwest. If you’d like to volunteer and survey a station or two, visit www.surfacestations.org and sign up.

0 0 votes
Article Rating
37 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
henry
December 6, 2007 1:24 pm

Anthony –
Thanks to you and Gary (and all the volunteers doing the surveys).
With this chart, people will now see what the whole “how not to measure” series is about. No cherry picking, but rather an overabundance of poor sites.
And the US is supposed to have the highest quality sites (makes you wonder what the ROW really looks like).
Let’s see how long it takes for THIS graphic to make the rounds…

henry
December 6, 2007 2:06 pm

BTW, I realize that you’re onmly doing the lower 48, but here’s a website showing some of the Alaskan COOP sites (just for fun).
http://ccc.atmos.colostate.edu/Alaskacoopsites.php

dscott
December 6, 2007 2:29 pm

Ok, so what is NOAA’s or GISS response to this so far??? Are they waiting for you to finish before doing anything or are they busy revising the numbers according to the ratings you are documenting? I see a big fight over the ratings issue versus what so called UHI adjustment Hansen made. In fact, in order to make any UHI adjustment Hansen of necessity would have had to had documentation on the level of compliance of each site. So when will his documentation be forth coming or is this another set of data that is off limits to the scientific community?????

henry
December 6, 2007 2:47 pm

Thought you’d get a kick out of the stations “up north”. There, they’re REALLY placed for observer convenience.
I suppose as long as you give proper credit, you could probably add an album to surfacestations.

Bob L.
December 6, 2007 6:25 pm

I have been struck over the months of your project Anthony with the complexity of the task Hensen has attempted. As I look at this graph, the temp. error is at best a guess.
I have been thinking for some time about how to quantify the errors your research (and researchers) have discovered. If you were able to find a large plot of land in the Midwest(relatively flat / large areas without trees) with a sizeable building on it. Multiple MMTS units could be sited and you could set up units at each of the CRN levels and determine the actual error induced. That would also introduce another level, ie: on the north side of the building, on the south side of the building, north by the ac, south by the ac. with asphalt or without..ad infinitium. By maintaining this over time(several years), you could get realistic level of error, one I believe would be higher then the conservative numbers you are using.
Now that my head is throbbing, I will go back to my private thoughts on how it was the Chinese who took advantage of the movement to disable GOES 12.

Bill in Vigo
December 6, 2007 7:01 pm

I agree with Henry, if one was to try to “adjust for microsite/uhi conditions” he would have to have for GISS alone 1221applicable algorithems alone. then what happens when something changes. Hansen can’t write programs that fast. I just don’t think that we can trust the numbers comming out of the system……………….
Nope the science isn’t even close to properly begun. we haven’t learned how to collect the data properly as yet.
Bill

December 6, 2007 9:22 pm

Anthony,
It is shocking to see how much red, orange and yellow there is on the US map. It is one thing to look at at the pie charts, but one does not get the real magnitude of the problem until, you and see the dots spread across all the states. How can anyone look at this chart and say, well there may be problems with individual stations but over all we have captured the global warming trend. No, what they have captured is the output of some very biased stations.

Clayton B
December 6, 2007 9:53 pm

As a suggestion to Gary:
Consider plotting all of the non-surveyed sites as empty circles to show that the distribution of all USHCN sites is not very even (show that it is not simply a “cherry-picked” distribution).

Stef
December 7, 2007 2:35 am

Any chance someone could email that map to the guys sunning themselves in Bali while they decide the fate of Mankind?

Dimitrios
December 7, 2007 4:58 am

Very interesting plots.
A small comment: the orange and yellow colors in the plot and the pie chart do not correspond to the same CRN.
REPLY I posted the older version of the pie chart graphic by mistake, that’s fixed now, thanks for pointing it out.

braddles
December 7, 2007 5:33 am

Have CRNs 3 and 4 been mixed up in either the map or the pie chart? The colours seem to have been swapped.
REPLY I posted the older version of the pie chart graphic by mistake, that’s fixed now, thanks for pointing it out.

henry
December 7, 2007 5:43 am

The other telling part is the following from the charts:
CRN5 = 55%
Error for CRN5 = 5C
More that half the USHCN stations have an error equal to or greater than 5C? And we’re only .6C above a 27 year old reference (NASA still using the period from 1951-1980 as a base period).
Try putting THAT error bar over the “surface record” line grafted to the charts…
It appears that what we have isn’t AGW, but DGW (Data Global Warming).
REPLY Henry, I think you mean CRN 4, there isn’t a 55% CRN 5 volume

Stan Needham
December 7, 2007 7:12 am

Anthony, I linked to this post at another blog I frequent, and I got the following response, (actually from a guy that I know and respect):

a couple of months ago one of McIntyre’s commenters on his ClimateAudit site did a study comparing the worst with the best sites, as graded by Watts, using data Watts posted. I’m pretty sure I posted it here at the time, but I didn’t keep a record of it. Did you see it? Or do I need to dig? As I recall, the conclusion was that once the corrections suggested by NASA were applied, the differences were negligible.

I scanned CA’s archives and couldn’t find any such reference. Any idea what he’s talking about?
REPLY Yes it’s John V’s analysis using opentemp, but it was done very early in the game when there were only 17 CRN1 stations and a lopsided survey distribution, and I don’t think there was a valid sample size to detect. I think he was a bit too eager. We’ll run it again when we get a better volume. Another problem is that he ran the test using data all the way back to 1920, and the CRN ratings are for our current time frame. A run of 10 years back might yield more relevant results.
I’ve made it a point not to do any analysis beyond the posting of census and distribution data because I think it’s premature to go looking for timeline divergence signatures until we get a significant majority of the network surveyed. Right now we are at 37.5%

papertiger
December 7, 2007 9:03 am

Looks like we need some people in Texas.
Iowa looks nekked too.
I’ll send out some feelers. Got family in Oklahoma.

henry
December 7, 2007 10:14 am

Stan –
John V’s website might get you more info/answers:
http://www.opentemp.org/main/

George M
December 7, 2007 10:18 am

I scrolled through the Alaska photos, and it occurred to me, those and the various CRNs are likely just fine for average civilian weather reporting and forecasting. Where the stupid occurs is when supposedly educated people think any of this data is useful for fractional degree analysis or prediction. Even with all the hand waving ‘adjustments’. Predicting temperature changes to the accuracy of a hundredth of a degree in time frames out to 2010, nevermind 2100 seem, well, just nonsensical. One problem with modern digital instrumentation is that the readout is often NOT indicative of the actual instrument accuracy. Old analog meters used to be the limiting factor, as were LIG thermometers. I have seen 0.1% readouts on digital instruments with 3% basic accuracy. Maybe the MMTS are better, nevertheless, this can lead to all sorts of numerical foolishness, and in this case, upon which gazillion dollar world policy is to be based? Gimmee a break!!!!

henry
December 7, 2007 12:27 pm

REPLY Henry, I think you mean CRN 4, there isn’t a 55% CRN 5 volume
Well, there WAS, before the chart changed…
If I was able to edit, I would.
But it still says that (including CRN4/5), that 69% of the stations could have an error greater than 2C, with 14% being greater than 5C.
It’s times like this, a statistician comes in handy.
Because a quick question is: Based on 37.5% of the network, with the percentages shown, and the errors listed for each percentage, what is the projected error for the network?
That NOAA US surface temp chart has never listed a +/- value. I’m beginning to see why not.
REPLY : Hi Henry I’m sorry but there was never a 55% percentage of CRN 5 stations. The WAS and IS a 55% percentage of CRN4. The only thing that has changed is the color scheme on the pie chart for CRN 3/4. Gary Boden made his colors reversed of what I normally used for CRN 3/4 and I initially posted the pie chart using the older color scheme. The colors changed, the numbers did not. Not trying to pick a fight, just trying to clarify.

December 7, 2007 1:17 pm

Anthony,
This is off-topic and I tried to e-mail you privately but it was chucked back. Anyway, I picked this up today and thought it might be of interest.
http://formerspook.blogspot.com/2007/11/when-tropical-storm-isnt-tropical-storm.html

Greg
December 7, 2007 1:39 pm

Regarding: Bob L. (18:25:18) :
That is an excellent idea. Taking one location, a few hundred yard radius, and place monitors over pavement, near buildings, AC exhaust, and other common violations, vs a properly placed monitor, and record data for a year. It should be done in several climate type areas, such as upper midwest, southeast, desert southwest, etc. It would be very interesting to see the differences in readings of proper vs improper measurements. Anthony, make it so!

Gary
December 7, 2007 2:26 pm

Clayton B:
Including the unsurveyed sites would clutter this plot. It’s intention is only to show the distribution of rankings so far. The surfacestations site has plots showing both surveyed and unsurveyed sites.

December 7, 2007 3:50 pm

I think it is already possible to make the conclusion that satellite (MSU) is our best available data for the last 28 years.
It would however be very interesting to sort out good stations and look at the combined trends at those. That would give us a reasonable measure on Hansens et als work on adjustments. Similar trends would strengthen Hansens case and vice versa.

Sam
December 7, 2007 3:54 pm

Anthony,
I live in Dallas, TX, have relatives in Tulsa, OK, and travel to Austin, TX from time to time. I would be willing to survey any nearby stations or stations between these locations you can identify. I would need instructions and and necessary equipment identified.

Mike Rankin
December 7, 2007 4:46 pm

I would like to volunteer to help in this project. I live in Houston, TX. It appears that most of the unsurveyed TX sites are for the most part outside my easy commute. May be able to get to a few. TX is a very large state and gasoline prices discourage longggg side trips. Santa Claus is bringing me the electronics.
I am planning a trip to Iowa in late April 2008. I could probably make it to seven of the sites in the SE quadrant of Iowa. Is this too late to help?

Evan Jones
Editor
December 7, 2007 5:00 pm

Cherrypicking, is it?
So quick to accuse!
So slow to check it out!
More dim bulbs from the “Lights=0” side of the aisle.
Especially as the original breakdown was much the same as the current lot.
One Freudian Word: PROJECTION

henry
December 7, 2007 11:47 pm

Anthony – No fight or arguement, sometimes it takes a while for the coffee to kick in.
Rikard said:
“I think it is already possible to make the conclusion that satellite (MSU) is our best available data for the last 28 years.”
The ony real problems with satellite data are as follows:
1. Still listed as an estimate.
2. At last count, there were at least 6 studies observing the same data, and there are just as many trends (from about .05 to .2 dC per decade). No real “consensus” yet. An average of the trends is still twice that of the surface station trend.
3. Still misses the poles, requires ground data to fill in the blanks.

papertiger
December 8, 2007 9:21 am

Sam & Mike –
Here’s a list of the stations in Texas that haven’t been surveyed.
Albany, Alice, Ballinger, BALMORHEA, BEEVILLE 5NE, BLANCO, BOERNE, BOYS RANCH, BROWNWOOD, CATARINA, CLARKSVILLE 2NE, CORSICANA, CROSBYTON, DANEVANG 1W, DUBLIN, EAGLE PASS, EL PASO WSO AP, ENCINAL, FALFURRIAS, FLATONIA, GAINESVILLE 5ENE, HALLETTSVILLE 2N, HASKELL, LAMPASAS, LLANO, LULING, MARSHALL, MCCAMEY, MEXIA, MIAMI, MULESHOE 1, PECOS, PLAINVIEW, QUANAH 5SE, RIO GRANDE CITY 3W, SEMINOLE, SNYDER, STRATFORD, TEMPLE.
(This is info from step one in the guide linked below)
Click here for details on how to locate the individual stations and what to do when you find them.
Thanks for stepping forward and I wish you good luck on the hunting!

Clayton B
December 8, 2007 11:34 am

Anthony,
I don’t think it’s premature at all do an analysis on the data collected. It IS premature to draw conclusions at this point but it would be shortsighted not to look at preliminary results.
JohnV is (hopefully) continuing to work on his program and may have a decent version going by the time surfacestations hits 50%, although he has been a little trigger happy to draw conclusions in my opinion.

Philip_B
December 8, 2007 2:12 pm

Someone posted a distribution of sites at Climate Audit by amount of warming per decade (as I recall) on the x axis. The distribution was skewed to the right and the mode was almost on zero (warming).
It was clear that the average (mean) reflected a small number of sites with a lot of warming and most sites showed no or almost no warming.
Combine this with the siting issues documented and the multiple adjustments to the data, and you have to wonder if the warming trend is even real.
Bill in vigo was spot on, the science starts when we measure properly.

December 8, 2007 7:27 pm

[…] USHCN National Weather Station Quality Plot […]

Evan Jones
Editor
December 9, 2007 12:07 pm

THIS JUST IN!
It is somewhat OT, and for that I apologize, but it is very big news in this debate, indeed. Straight from the Monck:
“The IPCC now says the combined contribution of the two great ice-sheets to sea-level rise will be less than seven centimeters after 100 years, not seven meters imminently, and that the Greenland ice sheet (which thickened by 50 cm between 1995 and 2005) might only melt after several millennia, probably by natural causes, just as it last did 850,000 years ago. ”
————————————————————-
Of course, we might point out (and not without justification), if the IPCC has screwed up this badly, one might also distrust he above results as well.
However, taken as it stands, it seems that the observations (i.e., knees-in-the-mud measurement) of That Most Wicked Witch of the Sea, ol’ Axe Moerner have prevailed over the prognostications of IPCC doom.
I had, of course, to account for the fact that Our Favorite Sea Witch had to resort to beastly Lyndon LaRouche for publication. I concluded, it appears correctly, that he was absolutely unable to obtain publication elsewhere. Also, not being an American himself, he was, perhaps, unaware of the radical nature of the beastly Double-L.
I do not see an equivalent objection to Lord M.. After all, he is an official peer reviewer of the IPCC (as was the Axe). The strength of confirmation is enhanced by the fact that Lord M.’s conclusions are reached by a different means of measurement than Axe M.’s. In the former case, the conclusion comes from revision of CO2 forcing calculations. In the latter case, we have direct surface measurements buttressed by rotational period calculations (the higher the sea level, the marginally slower the rotation of the earth).
Moerner also insisted that the IPCC satelllite measurements had been cherry-picked (in Hong Kong, IRRC) to measure areas that were subsiding while avoiding nearby areas that were geologically stable. That meant that either Moerner was lying through his teeth, had gone batty, or was correct. And that it was only a matter of time before someone actually eyeballed the situation.
One is forcibly reminded of the Rev and his efforts!
If the neo-conclusions of the IPCC are correct, it puts paid any and all the panic regarding climate change. My number one concern, and that of most others was sea level rise. (Secondary concerns involve the expansion of the Sahara, but the opposite is happening–the Sahel is spreading northward very rapidly.)
The retreat of non-Greenland/Antarctic glaciers (c. zero percent of land ice) was considered alarming from a symptomatic approach, but as direct effect, such retreat can only be regarded as an unmitigated blessing. It seems the prayers of those who traveled up the Alps and begged God for a cessation of the environmental horrors of glaciation have finally been answered.
The only problem I have with all this is that the white paper I have been preparing on the subject may become passe within the next couple of months. Other than that, I can only regard it as Christmas come early.

December 9, 2007 3:51 pm

Got a laugh out of the ‘cherry picking’ canard. I cna hear it now: “It’s a vast volunteer conspiracy!”.
PS: Hoping to fill in a string of West Texas stations in the next month. But if a critic of the project would like to float me the money I’ll take vacation and do it next week!

Evan Jones
Editor
December 9, 2007 8:32 pm

I would be proud to be considered a volunteer for the oil industry.

Evan Jones
Editor
December 17, 2007 6:48 pm

“It’s a vast volunteer conspiracy!”.
Hmm. Didn’t I see that SAME barbecue setup near every single site? That SAME air conditioner? That SAME Hummer? (That SAME Mig-29?)

December 20, 2007 11:44 am

[…] interested in my work on the http://www.surfacestations.org project, this set of preliminary data posted here pretty well sums it […]

Magee
December 21, 2007 2:43 pm

This is an outstanding graphic.
It would be interesting to know the location of the stations which have yet to be surveyed. Perhaps they could be represented by an open circle. These would serve several purposes:
– it would show where surveys were needed
– it would further address the issue of cherry-picking
– it would further address the point that the stations are concentrated in high-density population areas, such as the east and west coasts (as this may be attributable to the number of volunteers)

Christiane Maxwell
July 23, 2008 10:16 am

Because of the weather changes that seem to be changing from one
part of the world to another. The antartic, other parts of the earth
where glaciers are advancing, temperatures are hitting all time lowes,
yet in other parts of the world temperatures are higher.
Has anyone ever thought that the Earth Axis might have shifted
slightly because of tsunamies or other extreme weather events, which
has impacted on climates all over the world, and not as a result
of global warming.
Sincerely,
Christiane Maxwell