Some correspondence from NCDC on that missing data from 2008 to the present:
Dear Anthony,
The problem was caused by a glitch in an IT hardware transition in
late July at NCDC. This affected the period of record files on the
USHCN version 2 ftp site, but not the USHCN data that is integrated
into GHCN-Monthly (version 3). The problem was rectified on Monday
Aug. 6, and the full USHCN v2 updates were available on our ftp site early
yesterday (Tuesday) morning.
Sorry for any inconvenience.
Best regards,
Matt
On Wed, Aug 8, 2012 at 12:35 PM, Anthony wrote:
> Hello Dr. Menne,
>
> It appears that USHCNv2 data from 2008 to the present has been deleted off
> the NCDC server. http://stevengoddard.wordpress.com/2012/08/07/the-disappearing-ushcn-data/
>
> ftp://ftp.ncdc.noaa.gov/pub/data/ushcn/v2/monthly/
>
> Although it “appears” it has been restored today.
>
> This may be a simple error, but better to make the reason known now before
> the conspiracy theories start. There is little trust of government in many
> political circles.
>
> If you wish, once you determine it, I’ll gladly post the reason why on WUWT.
> Silence on the matter won’t serve anyone well.
>
>
> Best Regards,
>
>
> Anthony Watts
Reblogged this on Climate Ponderings and commented:
THANK YOU! Mr Watts 🙂
What?! No FOIA needed?
What? No scandal? No misconduct? No FOI requests? Not even an upside down proxy?
All a bit dull, really. 🙂
Rests to explain what happened to the ghcn v1 and v2 data, here:
ftp://ftp.ncdc.noaa.gov/pub/data/ghcn
Anthony,
I am glad that you are giving them a chance to correct and public admit to these things. Openness will go a long way to restoring faith in their data and processes, but it will take a long time. I hope they continue to respond positively to your polite missives.
Owen
Owen, I agree. Now let them explain this: https://stevengoddard.wordpress.com/2012/08/09/how-does-this-madness-end/
A couple of one-offs I can understand if a correction is issued. But Steve is nailing these guys every day on major, multi-hundred% differences in changes between those “documented” and approved in the “literature” and what we see in the differences between USHCN Raw and Cooked. It is EASY to see the differences between raw, TOBS, all others combined, and the “mystery adjustment” which is now far larger than the claimed “signal”. Another difference I’ve noticed is between USHCN, and GHCN, which have overlapping data, with low “error”, yet if you take nearby pairs, they are so vastly different in some years, that it proves that the differences are not merely random, but systematic measurement errors in systems that share almost identical standards. It means that if both systems are “golden”, they’ve both been proven to be “not”.
This is going to become another case where no one counted on a good programmer’s capability to develop his own software like Steve has to “browse” in any dataset he chooses. And to compare, along any orthogonal he chooses. Combing and filtering the data in ways not forseen by those who choose to deceive. It is a recipe for disaster for the liars. This capability is going to seal the deal against NOAA, the deception is going to come apart, and as usual, no one will notice.
Better late than never. Is everyone happy now?
It is a conspiracy, Murphy conspiring against the system integrators!
BTW, The type of hardware change that NCDC did involves thousands of small details, critical timings, and almost no way to properly test until after change over. On top of that, managers grossly underestimate the magnitude of such tasks and fail to allocate appropriate resources. I am currently developing a system monitoring application for a team who’s job is to do platform migrations on active applications and websites.
[snip . . OT . . posted on the wrong thread? . . kbmod]