UPDATE: The “ghost author” has been identified, see the end of the article.
When I first saw it, I laughed.
When I saw the internal memo circulated to top managers at NOAA, I laughed even more.
Why? Because NOAA and NCDC are rebuking an analysis which I have not even written yet, using old data, and nobody at NOAA or NCDC had the professionalism to put their name to the document.
First let’s have a look at the National Climatic Data Center’s web page from a week ago:
I was quite surprised to find that my midterm census report on the surfacestations.org project evoked a response from NCDC. I suppose they are getting some heat from the citizenry and some congress critters over lack of quality control. I was even more surprised to see that they couldn’t even get the title right, particularly since the title of my report defines most of what NCDC is all about; Surface Temperature Measurement.
Here’s the title of my report released in March.
“Is The U.S. Surface Temperature Record Reliable?”
But NCDC calls it: “Is the U.S. Temperature Record Reliable?”
True, a small omission, the word “surface”. But remember, this is a scientific organization that writes papers for peer reviewed journals, where accuracy in citation is a job requirement. Plus, the director of NCDC is Thomas Karl, who is now president of the American Meteorological Society. The Bulletin of the American Meteorological Society is considered a premiere peer reviewed journal, and Karl has written several articles. For him to allow a botched citation like this is pretty embarrassing.
[NOTE: For those that just want to read my report, please feel free to download and read the free copy here PDF, 4 MB]
But the citation error is not just in the NCDC webpage, it is in the PDF document that NOAA and/or NCDC wrote up. I can’t be sure since they cite no named author.
You can download it here (PDF 91KB)
I had few people point out the existence of the NCDC rebuttal to me in the last week, and I’ve been biding my time. I wanted to see what they’d do with it.
Over the weekend I discovered that NOAA had widely circulated NCDC’s “talking points” document to top level division managers in NOAA. I was given this actual internal email, by someone whom appears not to agree with the current NOAA/NCDC thinking.
Date: Tue, 16 Jun 2009 16:26:48 -0600
From: Andrea Bair <Andrea.Bair@noaa.gov>
Subject: Talking Points on SurfaceStations.org
To: _NWS WR Climate Focal Points <WR.Climate.Focal.Points@noaa.gov>,
_NWS WR MICs HICs DivChiefs <wr.mics.hics.divchiefs@noaa.gov>,
_NWS WR DAPM-OPL <Wr.Dapm.Opl@noaa.gov>,
Susan A Nelson <Susan.A.Nelson@noaa.gov>,
Jeff Zimmerman <Jeff.Zimmerman@noaa.gov>, Matt Ocana <Matt.Ocana@noaa.gov>
User-Agent: Thunderbird 2.0.0.21 (Windows/20090302)
Recently I was asked if we had any official talking points on the surfacestations.org report that came out recently. Attached are some talking points from NOAA that we can use.
AB
Note the “NWS WR MICs HICs DivChiefs” It seems pretty much everyone in management at NOAA got this email, yet a week later the citation error remains. Nobody caught it.
I find it pretty humorous that NOAA felt that a booklet full of photographs that many said at the beginning “don’t matter” required an organization wide notice of rebuttal. Note also some big names there. Senior NOAA scientist Susan (1000 year CO2) Solomon got a copy. So did Matt Ocana, Western Region public affairs officer for the National Weather Service. Along with Jeff Zimmerman who appears to be with the NWS Southern Region HQ. The originator, Andrea Bair, is the Climate Services Program Manager, NWS Western Region HQ.
There are lots of other curious things about that NCDC “Talking Points” document.
1. They give no author for the talking points memo. An inquiry as to the author’s name I sent to my regular contact at NCDC a week ago when I first learned of this has gone unanswered. Usually I have gotten answers in a day.
2. They think they have the current data, they do not. They have data from when the network was about 40% surveyed. They cite 70 CRN1/2 stations when we actually have 92 now. Additionally, some of the ratings have been changed as new/better survey information has come to light. They did their talking points analysis with old data and apparently didn’t know it.
3. They never asked me for a current data set. They know how to contact me, in fact they invited me to give a presentation at NCDC last year, which you can read about here in part 1 and part 2
Normally when a scientific organization prepares a rebuttal, it is standard practice to at least ask the keeper of the data if they have the most current data set, and if any caveats or updates exist, and to make the person aware of the issues so that questions can be answered. I received no questions, no request for data and no notice of any kind.
This is not unlike NCDC’s absurd closing of my access to parts of their station meta database in the summer of 2007 without notice just a few weeks after I started the project:
http://wattsupwiththat.com/2007/07/07/noaa-and-ncdc-restore-data-access/
4. They cite USHCN2 data in their graph, but they can’t even get the the number of stations correct in USHCN2. The correct number from their AMS publication is 1218 stations, they list 1228 on the graph. While the error is a simple one, it shows the person doing the talking points was probably not fully familiar with the USHCN2.
On page 6 of Matthew J. Menne, Claude N. Williams, Jr. and Russell S. Vose, 2009: The United States Historical Climatology Network Monthly Temperature Data – Version 2.(PDF) Bulletin of the American Meteorological Society (in press) there is this sentence:
As a result, HCN version 2 contains 1218 stations, 208 of which are composites; relative to the 1996 release, there have been 62 station deletions and 59 additions.
Sure maybe it is a typo, but add the fact that they couldn’t get my report title correctly cited either, it looks pretty sloppy, especially when you can’t count your own stations.
When I was invited to speak at NCDC last year, I had a lengthy conversation with Matt Mennes, the lead author of the USHCN2 method and peer reviewed paper here:
http://wattsupwiththat.com/2009/05/12/ncdcs-ushcn2-paper-some-progress-some-duck-and-cover/
What I learned was this:
a) The USHCN2 is designed to catch station moves and other discontinuities. Such as we see in Lampasas, TX
b) It will NOT catch long term trend issues, like UHI encroachment. Low frequency/long period biases pass unobstructed/undetected. Thus a station that started out well sited, but has had concrete and asphalt built up around it over time (such as the poster child for badly sited stations Marysville, now closed by NOAA just 3 months after I made the world aware of it) would not be corrected or even noted in USHCN2.
5. They give no methodology or provenance for the data shown in their graph. For all I know, they could be comparing homogenized data from CRN1 and 2 (best stations) to homogenized data from CRN 345 (the worst stations), which of course would show nearly no difference. Our study is focusing on the raw data and the differences that changes after adjustments are applied by NCDC. Did they use 1228 stations or 1218 ? Who knows? There’s no work shown. You can’t even get away with not showing your work in high school algebra class. WUWT?
For NCDC not to cite the data and methodology for the graph is simply sloppy “public relations” driven science. But most importantly, it does not tell the story accurately. It is useful to me however, because it demonstrates what a simple analysis produces.
6. They cite 100 year trends in the data/graph they present. However, our survey most certainly cannot account for changes to the station locations or station siting quality any further back than about 30 years. By NCDC’s own admission, (see Quality Control of pre-1948 Cooperative Observer Network Data PDF) they have little or no metadata posted on station siting much further back than about 1948 on their MMS metadatabase. Further, as we’ve shown time and again, siting is not very static over time. More on the metadata issue here.
While we have examined 100 year trends also, our study focus is different in time scale and in scope. If I were to claim that the surfacestations.org survey represented siting conditions at a weather station 50 or 100 years ago, without supporting metadata or photographs, I would be roundly criticized by the scientific community, and rightly so.
We believe most of the effect has occurred in the last 30 years, much of it due to the introducing of the MMTS electronic thermometer into the network about 1985 with a gradual replacement since then. The cable issue has forced official temperature sensors closer to buildings and human habitation with that gradual change.
NCDC’s new USHCN2 method will not detect this long period signal change introduced by the gradual introduction of the MMTS electronic thermometer, nor do they even address the issue in their talking points, which is central to the surfacestations project.
7. In the references section they don’t even cite my publication!
References
Menne, Matthew J., Claude N. Williams, Jr. and Russell S. Vose, 2009: The United States Historical Climatology Network Monthly Temperature Data – Version 2. Bulletin of the American Meteorological Society, in press.
Peterson, Thomas C., 2006: Examination of Potential Biases in Air Temperature Caused by Poor Station Locations. Bulletin of the American Meteorological Society, 87, 1073-1080. It is available from http://ams.allenpress.com/archive/1520-0477/87/8/pdf/i1520-0477-87-8-1073.pdf.
Yet they cite Mennes USHCN2 publication where the 1218 USHCN2 station number is clearly found.
It seems as if this was a rush job, and in the process mistakes were made and common courtesy was tossed aside. I suppose I shouldn’t be upset at the backlash, after all bureaucrats don’t like to be embarrassed by people like me when it is pointed out what a lousy job has been done at temperature measurement nationwide.
I’m working on a data analysis publication with authors that have published in peer reviewed climate an meteorology journals. After learning from John V’s crash analysis in summer 2007 when we had about 30% of the network done, few CRN1/2 stations, and poor spatial distribution that people would try to analyze incomplete data anyway, I’ve kept the rating data and other data gathered private until such time a full analysis and publication can be written.
As NCDC demonstrated, it seems many people just aren’t willing to wait or to even respect he right to first publication of data analysis by the primary researcher.
By not even so much as giving me a courtesy notice or even requesting up to date data, it is clear to me that they don’t think I’m worthy of professional courtesy, yet they’ll gladly publish error laden and incomplete conclusions written by a ghost writer in an attempt to disparage my work before I’ve even had a chance to finish it.
This is the face of NCDC today.
UPDATE:
WUWT commenter Scott Finegan notes that Adobe PDF files have a “properties” section, and that the authors name was revealed there. Here is a screencap:
Thomas C. Peterson is the author.
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.
Hu McCulloch (13:27:37) :
“Anthony — The Talking Points memo at http://www.ncdc.noaa.gov/oa/about/response-v2.pdf now (7/1) clearly lists your study, with you as author, in its references. It’s still dated 6/9, however.”
Changing information without changing the issue date or version number is standard Government policy lately. The USDA uses it on farmers all the time and then states the farmers are spreading “disinformation”
Making copies of the original memos and putting them up on blogs has become standard self defense among those of us fighting the National Animal Identification System and other USDA/FDA idiocy. Seems overworked farmers are going to be expected to record and tell the US gov’t in minute detail everything they do on their farms or face million dollar fines but the government can’t do reasonable quality control over something as simple as a thermometer despite their fancy procedures and lofty PHds!
The US govenrment and their tame puppet scientists lost all credibility with me long ago. To bad Thomas C. Peterson: NOAA National Climatic Data Center, Asheville, North Carolina
and other government officials are not subject to the same type of million dollar fines they are aiming at farmers. http://www.opednews.com/articles/A-solemn-walk-through-HR-8-by-Linn-Cohen-Cole-090314-67.html
Perhaps we should find an honest congressman to sponsor a bill that subjects government officials to the same standards and fines they wish to subject farmers to….. No wait we will never be able to find an honest Congressman so scratch that idea.
I have waded through a lot of comments that are irrelevant to the issue here.
Lets put all of the ad hominem comments and copyright disputes aside and focus on the real issue here.
NOAA does not own the 1228 or so surface stations or have the staff to control them and do physical upgrades and resite them to meet the ideal standards.
It appears to me that they are using software to mak
e adjustments so that temperature trends can be derived from them, even though the absolute temperatures they are measuring are affected by the equipment and the siting.
By using their procedure for handling the data, they show that they can make the average US temperature trends for all the stations equivalent to the 70 good stations, and that the problems Anthony mentioned, do not really matter for the purpose of finding US average temperature trends. The graphs appear convincing to me.
No one has presented a cogent argument that says NOAA is wrong about this important point ,as far as I can glean, but there is so much chaff on this page, I can’t be sure that I didn’t miss something.
eric
The problem is they didn’t compare to 70 good stations. They compared to 70 data adjusted stations with the data strongly compromised and influenced by the surrounding network. They didn’t compare apples to apples. They compared one apple to itself.
Jeez,
Looking at what McIntyre said, he suspects that is what NOAA did, but he isn’t sure. You could be right. NOAA didn’t really specify what procedure they used to compare the good stations with the total.
It is also correct to point out that no difference doesn’t imply both series are going to be accurate if the data from the good stations has somehow been corrupted by the bad. On the other hand, even good stations can have anomalies. Good does not mean perfect.
It would certainly be worth determining what procedure was used.
It also seems to be the case that GISS uses a different procedure to adjust the raw data for anomalies.
eric,
Yeah, wouldn’t it be nice if NOAA actually disclosed what they did to make the graph. That might even be considered scientific.
It seems statistically dubious to me that the author of the graph plots a ‘good data’ curve vs. a ‘good data and bad data’ curve. Why confound both subsets into the 2nd curve? I think he should plot ‘good data’ vs. ‘bad data’.