UPDATE: 08/07 2:PM PST MLO responds with improvements to the CO2 data reporting
Approximately 24 hours after I published my story on the January to July trend reversal of CO2 at Mauna Loa, the monthly mean graph that is displayed on the NOAA web page for Mauna Loa Observatory has changed. I’ve setup a blink comparator to show what has occurred:
For those who don’t know, a blink comparator is an animated GIF image with a 1 second delay consisting only of the two original images from NOAA MLO. Individual image URLS for: August 3rd ML CO2 graph | August 4th CO2 Graph
Now the there is no longer the dip I saw yesterday. Oddly the MLO CO2 dataset available by FTP still shows the timestamp from yesterday: File Creation: Sun Aug 3 02:55:42 2008, and the July monthly mean value is unchanged in it to reflect the change on the graph.
[UPDATE: a few minutes after I posted this entry, the data changed at the FTP site] here is the new data for 2008:
# decimal mean interpolated trend
# date (season corr)
2008 1 2008.042 385.37 385.37 385.18
2008 2 2008.125 385.69 385.69 384.77
2008 3 2008.208 385.94 385.94 384.50
2008 4 2008.292 387.21 387.21 384.46
2008 5 2008.375 388.47 388.47 385.46
2008 6 2008.458 387.87 387.87 385.51
2008 7 2008.542 385.60 385.60 385.25
and here is the 2008 data from Sunday, August 3rd:
2008 1 2008.042 385.35 385.35 385.11
2008 2 2008.125 385.70 385.70 384.85
2008 3 2008.208 385.92 385.92 384.38
2008 4 2008.292 387.21 387.21 384.59
2008 5 2008.375 388.48 388.48 385.33
2008 6 2008.458 387.99 387.99 385.76
2008 7 2008.542 384.93 384.93 384.54
Here is the MLO data file I saved yesterday (text converted to PDF) from their FTP site.
Here is the URL for the current data FTP:
ftp://ftp.cmdl.noaa.gov/ccg/co2/trends/co2_mm_mlo.txt
I have put in a query to Pieter Tans, the contact listed in the data file, asking for an explanation and change log if one exists.
UPDATE 08/05 8:55AM PST I have received a response from MLO:
Anthony,
We appreciate your interest in the CO2 data. The reason was simply that
we had a problem with the equipment for the first half of July, with the
result that the earlier monthly average consisted of only the last 10
days. Since CO2 always goes down fast during July the monthly average
came out low. I have now changed the program to take this effect into
account, and adjusting back to the middle of the month using the
multi-year average seasonal cycle. This change also affected the entire
record because there are missing days here and there. The other
adjustments were minor, typically less than 0.1 ppm.
Best regards,
Pieter Tans
UPDATE 08/05 4:03PM PST
I have been in dialog with Dr. Tans at MLO through the day and I’m now satisfied as to what has occurred and why. Look for a follow-up post on the subject. – Anthony
UPDATE 08/06 3:00PM PST
A post-mortem of the Mauna Loa issue has been posted here:
http://wattsupwiththat.wordpress.com/2008/08/06/post-mortem-on-the-mauna-loa-co2-data-eruption/
– Anthony
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.

Hmm, this could run and run over the next few months.
(given probable trends)
Or should that be change and change again.
“Jim where are you, we need you NOW..” – LOL …
GREAT SPOT.
It seems that almost every single data point in that diagram have been adjusted, not by much but still. What is interesting is that it happens within 24h after they release a result that shows a new record low for first 7 months.
If there is an error and they notice it, it must be corrected. In the process it lookes like they found errors on every month at least for the last 4 years. did they start that process yesterday also, reverifying those 4 years?
Did they actually manage to recalibrate, make new meassuremnents of all those samples from the last years in one day or is it a mathematical adjustment of the results?
It looks like that allmost all datapoints that sticks out a bit have been smoothed up AND down in order to create a straight line showing that there are less variability.
The adjustment does not seem to affect the overall CO2 trendline in any significant way though, just making it smoother.
So what errors did they find that gave both too high values when the CO2 level was above trendline and too low when it was below trendline?
ROFFFFL!!! It’s not like they adjusted this months data, they did it for years. And based on that data Anthony suggests some things to consider. [snip]
Perhaps [Tamino] can explain all of that ever changing data. Is it a mistake that was caught years later? Is it like the photo of a flooded house (let’s make the CO2 rise before some one gets the idea that residence time isn’t really hundreds of years)?
Damn the CO2 uptake of a cooling ocean! So is the annual downward slide of the sawtooth on the CO2 graph really all due to that northern hemisphere vegitation sucking CO2 out of the atmosphere? Or maybe it also has something to do with the annual cooling of them big ol’ oceans in the southern hemisphere cooling every southern winter?
Maybe someday this science will get settled, but one thing’s for sure; it sure as hell aint settled right now.
[…] STAY WARM, WORLD… Roger Carr (The quotation under the photo above comes from this paper by David Archibald) 05 August, 2008 One day later: Mauna Loa CO2 graph changes […]
I looked at random at the data of 2000 (outside the graph). I find similar changes, now in the 2. digit, for July aund August. Maybe you can run a difference program on all the data of the original files.
I think it is important to remember that NOAA did put a disclaimer that the data is provisional for up to one year. The tells me that the correction for the July value was justified and had nothing to do with the direction of the error. However, the changes to data over one year old are quite odd and require further explaination although I would assume that there is a good reason and people should not assume nefarious motives.
It also worth remembering that Ilinois Cryrosphere has had numerous data problems this year where they ended up dramtically reducing the amount of ice melt reported after the corrections.
The bottom line is we want these agencies to report their data in a timely fashion but they might stop doing that if they get beat up in the blogosphere every time their instrument has a hiccup.
REPLY: I give them the benefit of the doubt, which is why I sent a message asking for an explanation. At the same time, there doesn’t appear to be any valid reason to adjust data from 2004 and further back. If they publish data publicly, then change it with no notice (as they did today), then a public change log should exist, otherwise I think they are in violation of DQA.
It seems haphazard to publish preliminary data on a weekend, and then change it on a Monday, all with no public notice. While nefarious motives may not be there, its just damn sloppy IMHO, and given this is the crown jewel for CO2 data I expect far better. -Anthony
The changes go all the way back to 1974 (for those who haven’t seen the other thread).
I sometimes theorize that NOAA & GISS must have time machines that allow them to get new readings 34+ years after the fact. I can imagine no other reason that policy makers base decisions worth hundreds of billions on an ever-shifting chimera of data.
After looking at the data yesterday, I was a little surprised by the old July value (384.93) – 3.55 ppm less than May’s number (388.48).
I couldn’t find such a big 2-month drop anywhere in the records.
So maybe the new number is the correct one.
Looking now at the blink comparator, it appears all the data has been adjusted.
That’s weird.
It was a bright cold day in April, and the clocks were striking thirteen.
We’ve all become accustomed to the lies put out every month on inflation and other economic measures.
See http://www.tampabay.com/news/article473596.ece
Now it appears we can’t even get straight answers on temperatures and CO2 levels.
Lying is a lot like eating peanuts; it’s hard to stop with just one.
D. Quist,
1984
How far that seemed in the future.
How far it seems in the past.
How precious are our moments.
How quickly do they pass.
And what from a gov’ment poet
but some convoluted gas.
Thanks for the reminder, D. Quist. Oh well, down the memory hole.
There’s something odd at nsidc as well, where their graph suddenly bends downwards – it was updated just a couple of days ago. You can see it at:
http://nsidc.org/data/seaice_index/images/daily_images/N_timeseries.png
This seems completely at odds with the marginal increase in arctic sea ice shown at:
http://arctic.atmos.uiuc.edu/cryosphere/IMAGES/sea.ice.anomaly.timeseries.jpg
The first graphic is extent, the second is anomaly. They are not necessarily inconsistent depending on the baseline average. It is not good to see conspiracy in every new datapoint.
Anthony,
My comment was directed at other posters – not you.
I agree on your comments about undocumented changes and DQA. Even if there is a good reason for changing the historical data it should have been declared clearly in the header of the file.
I did a quick plot of the differences between the old and new means and originally posted it on the old thread.
http://tinyurl.com/6qb3sg
The data comparison is available here: http://tinyurl.com/6hhy3e
Other than July 2008, the adjustments seem to radiate out from 1994, each oscillation growing larger as time progresses in either direction.
I now wonder if NOAA had a calibration issue in 1994 that was corrected. This still not explain the change in July 2008.
I look forward to NOAA explaining the justification for this sort of adjustment.
Can I ask what is the point of putting out a new datapoint that is unadjusted and then putting out an adjusted one a few days later? Why not wait and just put out the adjusted one?
And why adjust the entire graph’s datapoints in retrospect? Very weird.
Right. They change the data the same day as the extent of the anomaly is pointed out. Have they _ever_ made such extensive changes in the past on the Mauna Loa data? And the change just _happens_ to make June-july 2008 now rank 3rd in greatest drop after 2004 by a hundredth of a ppm. How convenient. Unless there is a darn good explanation for these changes, the coincidence is just too close, especially with the changes happening right after Anthony Watts posts data. Pretty darn brazen. And scary. I always poo pooed the idea that true scientists would fudge data to match their preconceptions. Now I’m beginning to suspect I was too naive. Not only that, but these latest changes are being done between 12 am and 5 am east coast time. Why? Isn’t this the least bit suspicious for anyone?
I think a serious investigation needs to be done. Maybe even a special prosecutor. Anyone have access to a congresscritter?
jeez – isn’t anomaly just extent minus the 1979-2000 average? In which case extent and anomaly should be perfectly correlated.
Or, to put it another way, why doesn’t the nsidc data correlate with the cyrosphere data for sea ice area at the following link.
http://arctic.atmos.uiuc.edu/cryosphere/IMAGES/current.365.jpg
This doesn’t show the downward kink that the nsidc data shows. Or am I missing something? Is is area not the same as extent? Or is the anomaly calculated from a daily mean rather than the overall mean? If so, that is not obvious from the data presentation in the graphs.
Call it what you want. Bend over backwards to give them the benefit of a doubt which they have never extended the other way – even when the consequence of their lack of doubt is the condemnation of the whole humanity.
You can repudiate me if you want, but I’ll call it as I see it.
What they did there is the OJ Simpson defence. As the comedian Wanda Sykes would say ‘you’ve got to stick with your lie’ .
If there is data manipulation, it would not be a new phenomenon in the “scare” dynamic. In my studies of the first prominent UK scare – the “salmonella in eggs” scare in 1988-9, I caught out a leading government epidemiologist “reinterpreting” figures in a food poisoning outbreak to turn it from “unknown origin” into a definite egg case. Unfortunately for the man, he had already released the “uncorrected” data, to which we had access.
In my review of 60 official “egg” outbreaks – peer reviewed for my PhD – only four could be reliably attributed to eggs. In three of the “egg” outbreaks, there had been episodes of illness originating from the focal premises before the egg-based food attributed as the vehicle of infection had been consumed and, in one of these, the outbreak (in a hotel) had started before the eggs attributed to the outbreak had been delivered to the premises.
We also had enormous problems with determining sources of infection in poultry flocks, the official explanation being infected animal feed – despite multiple test results showing no such infection. When we reliably demonstrated airbone infection of poultry sheds from contaminated manure spread on adjoining fields, this was officially rejected because there was no provision for such category on the official epidemiology form and thus no mechanism for reporting it.
Yet, on the basis of wholly flawed data, the UK suffered a “scare” which cost many millions and put an estimated 9,000 poulty keepers out of business. The “scare dynamic”, it seems, is alive and well.
Of course, sometimes the data manipulation works the other way.
Anthony,
My last comment is inaccurate in terms of when the new data was posted. Turns out since I had accessed that ftp page earlier in the day, my computer was looking at a cached copy, not the new data set. Once I hit my refresh button, the new data file popped up.
The NOAA site is clear that they adjust data historically.
“These values are subject to change depending on quality control checks of the measured data, but any revisions are expected to be small.”
I think the important part is that there needs to be a public change log to keep the data credible as well as provide access to historical data sets so that comparisons can be made.
Trust but verify.
Now here is something odd that perhaps a statistician can address. Why should the difference between the old and new data sets be a specific pattern?
I compared the old and new data sets between July 2006 and July 2008. I looked at only the seasonal correction numbers. Here are the differences between the old, August 3rd dataset and the new, August 4th dataset in hundredths of a ppm.
Isn’t it pretty convenient that prior to 7/08 the pluses virtually cancel out the minuses? And what a nice pattern. Every plus is followed by a minus. Why?
This looks like the data was fudged, quite frankly.
comparing old versus new dataset
7/06 plus 3
8/06 minus 1
9/06 plus 6
10/06 minus 2
11/06 plus 3
12/06 minus 1
1/07 plus 1
2/07 minus 5
3/07 plus 11
4/07 minus 11
5/07 plus 14
6/07 minus 11
7/07 plus 3
8/07 minus 3
9/07 plus 6
10/07 minus 6
11/07 plus 3
12/07 minus 6
1/08 plus 7
2/08 minus 8
3/08 plus 12
4/08 minus 7
5/08 plus 13
6/08 minus 25
7/08 plus 71