NOAA and NCDC Restore data access

ncdc_noaa.gif

You may recall and entry about a week ago titled: NOAA/NCDC Throws a roadblack my way.

Good news! NCDC has decided to restore the access. I think this is a wise move on NCDC’s part not only because their initial argument was unsupportable as I demonstrated dozens of pages in various NOAA websites showing not only observer names, but also photos of the observers, but more importantly the timing made them look like they were actively hampering a science activity. Data sharing is a hallmark of science so that independent study and confirmation of observations and theories can occur.

I’m pleased that NCDC has changed their position. Its the right thing to do. I agree with their current position that provides the name of the observers, but keeps addresses and telephone numbers private.

For the purposes of the photographic investigation being done at www.surfacestations.org I point out that anyone in the project must agree to and follow rules of conduct, and respect the clearly spelled out privacy issues.

Here is the communication:

Dear Mr. Watts,

You made several inquiries recently regarding the availability of Cooperative observer names in the MMS system. I have received the clarification I needed in order to respond, and wanted to inform you of the results as well as to provide some background detail.

The names of observers participating the the National Weather Service’s (NWS) Cooperative (Coop) Observation Program have for many years been published state by state in both the Climatological Data (CD) and Hourly Precipitation Data (HPD) publications. Individual Coop observer names have also appeared from time to time on various NWS web sites, often in the context of award presentations. However, as a practice, NCDC has not intentionally made the names public as part of its station metadata systems.

While the Multi-network Metadata System (MMS) has always included security restrictions to prevent guest users from accessing observer details, including name, an oversight permitted observer names to be viewed on the Station Identity form along with managing party identifiers. Based on our accepted practice, NCDC immediately corrected the condition that permitted such visibility, but soon received user comments indicating that people were indeed accessing the names and requesting that the field be restored.

Those inquiries and requests prompted NCDC to revisit their practices for handling Cooperative observer names, and to formally address the issue of privacy as it relates to those names. NCDC began with a review of the Freedom of Information Act and Privacy Act statutes, a related court decision, NCDC practices and existing documents, systems and sites at NCDC and other sources. With this background, NCDC requested that the Department of Commerce’s Office of General Counsel (OGC) provide a legal opinion on the issue. That opinion follows:

“As you know, personal information can be withheld under FOIA Exemption (b)(6), which permits withholding of personnel and medical files and similar files the disclosure of which would constitute a clearly unwarranted invasion of personal privacy. A balancing test is employed to apply this exemption. Under this test, the privacy interest held by those identified in the records is weighed against the public interest in the information. In all cases, the public interest in disclosure of information about private individuals under the FOIA is limited to information that sheds light on an agency’s performance of its statutory duties.

For the names of weather observers that have been released, there can be no privacy interest because the information is already public. However, weather observers do have privacy interests in their home addresses. Release of this information could lead to unsolicited mail or even visitation by strangers. There is no public interest in this type of information because it does not shed light on NCDC’s performance of its statutory duties. Accordingly, I would conclude that the addresses of weather observers is withholdable under b(6).”

The OGC’s opinion is also the basis for a more concise NCDC policy regarding observer details, which is now posted on NCDC’s web site.

Based on the revised policy, Coop observer names will be displayed in the MMS station metadata system, but address, phone numbers and any other details will not. Should requests be made for paper copies of previously submitted paper station history forms, all observer details except for name must be manually obliterated from each form copy prior to delivery, with the requester responsible for the cost of that manual work.

Access to the station managing party field in the MMS Identity tab’s form view should be restored within one business day. In the long term, that information will probably be removed to a separate tab, but will continue to be available.

I hope this adequately addresses your concerns regarding NCDC’s Coop observer name policy and availability of that information.

Sincerely,

Jeff Arnfield

Jeff Arnfield

Station Metadata Project Manager

0 0 votes
Article Rating
10 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
David Walton
July 7, 2007 10:09 am

I have read both your comments and those from Jeff Arnfield and have a better understanding of the privacy and legal issues that NOAA has been wrestling with.
Thanks to NOAA and to you, Anthony, for doing the right thing.

July 7, 2007 10:32 am

But I thought you needed the contact details in order to ask for directions to the station. How are you going to find them from now on?

July 7, 2007 11:20 am

So you’re no longer convinced its all part of the big conspiracy?

Anthony Watts
July 7, 2007 11:24 am

Bishop,
The “Managing Parties” field that had been removed from NCDC’s MMS system contained two types of names:
– Private Observer Names
– Entity Names
The entity names were often things like Fire Stations, Park Service Headquarters, Waste Water Treatment Plants, etc., which have no expectation of privacy.
We can easily look up the addresses of those government entities. If the facility is open to the public, then a site survey is fair game at any time. If it is restricted in some way, then permission must be asked for and granted, unless the station is visible from a public street.
In the case of private observers at residences, they can also be looked up via various methods, then contacted by telephone to see if they would allow a site survey. If they do not, volunteers are bound by our privacy policy not to press further.
So far, no private observer has turned down such a request that I know of.

Anthony Watts
July 7, 2007 11:34 am

bigcitylib
“conspiracy” is not a word I ever used. It is your word.
Please see http://www.norcalblogs.com/watts/2007/06/noaa_throws_a_roadblock_my_way.html
Then from that page show me exactly where you claim I’ve used that word. Note that a third party commenter’s use of the word on my blog doesn’t count as me having used the word. That commenter Jeff Wood, said “It’s more a case of organisational embarrassment, than a conspiracy against the record. ” I agree with that.
What is clear is that NOAA reacted to complaints from some people over “possible” problems and pulled the data.
When they realized there weren’t any such problems, and that their position was unsupportable, they did the correct thing and put the data back.

Joel McDade
July 7, 2007 11:59 am

This is great news!
With the name in hand I can usually find a phone number thru 411 or, upon arrival in these small towns, by hunting down a local phone book.
Personally I was not really prepared to go banging on doors unannounced!

David Walton
July 7, 2007 4:08 pm

I am sure we are all relieved to hear that Joel McDade is not the bristling jack booted thug he appears to be.
😉

Tom T
July 7, 2007 4:34 pm

bigcitylib: Although this may not be a conspiracy, why would you imagine that conspirators would not change their ways once their conspiracy was found out. Just as a matter of logic, I don’t understand your point. It does say anything one way or another about NOAA and whether or not it is a conspiracy, and accept for the sake of argument that it isn’t a conspircy.

MikeW
July 7, 2007 10:27 pm

Hmm. Didn’t one of the volunteers recently say that a station observer was told to tell anyone arriving that pictures were not allowed?
I wonder if that has changed along with the name re-addition….

Jerry
July 8, 2007 9:04 am

Will the temperature history be provided with the NOAA data?
Also, on your Australian stations thread, a quick glance at a number of station photos seems to indicate that the folks Down Under have done a pretty good job of avoiding micro-site problems in positioning their thermometers. Is there data available on the weather history for those sites long-term? It would be interesting to see what the trend is, though IIRC, there is no long term warming trend in the southern hemisphere. Could that be because Australia’s stations are “clean” with no UHI issues?