Guest Post by Ira Glickstein.
Time machines are a staple of sci-fi. Someone travels back to the past and changes some momentous historical event, expecting his or her heroic action will improve the present and future, usually with disastrous results! Well, NASA GISS has a different type of time machine that does not actually go back to the past, but simply changes the historical temperature data to make the present Global Warming situation appear worse than it really is, and, by implication, lend credence to their CAGW (Catastrophic Anthropogenic Warming) theories.
This is the second of my Tale of the Global Warming Tiger series where I allocate the supposed 0.8ºC warming since 1880 to: (1) Data Bias, the subject of this posting, (2) Natural Cycles, and (3) AGW, which will be the subjects of subsequent postings. Click Tiger’s Tale (and Tail :^) to see my allocation and read the original story.
DATA BIAS
This posting is about how the official climate Team has (mis)adjusted past temperature data to exaggerate warming, and how the low quality of measurement stations and their encroachment by urban heat island (UHI) developments have distorted the historical record.
The above blink graphic alternates between two base charts of historical US Annual Mean Temperatures, both publicly posted by NASA GISS, the older one in 1999, and the most recent downloaded from NASA GISS this month (January 2011). The 1999 image is from a blink graphic comparing NASA GISS 1999 and 2008 data originated by a Netherlands website (zapruder.nl). I first discusssed that graphic in 2009.
Please note that both charts are to the same scale and that my annotations are fixed in place so viewers can see how the data has been changed. I have added a handy scale indicating that the large boxes on the NASA GISS charts are 0.5ºC high, along with a ladder showing 0.1ºC increments. The see-saw (with James Hansen juggling the Earth’s temperature data and our economic future :^) indicates the change between a peak in the early 1930’s and a trough in the mid 1990’s. Note how the slope changes between the 1999 version and that for 2011. In the 2011 version, the 1930’s get COOLER and the 1990’s get WARMER. If you add the changes together, you get somewhat more than the 0.3ºC I have allocated for Data Bias, so I am being quite conservative here.
I have used US data for my example because those sources are more under NASA GISS observation and control than most international data, which may be of poorer quaity. In an earlier post on WUWT I included a graphic with a copy of a NASA GISS email released pursuant to a FOIA request that indicates they felt a need to modify historical data seven times over a period of nearly a decade, until they got it right.
That means the previous six times they admit they got it wrong! Keep in mind that their mid-1990’s data has been in hand for over a decade and their mid-1930’s data is old enough to collect Social Security :^), yet they have made that old data work until they got it right, which, in this case, means more in line with their global warming models. CO2 is going up, therefore, temperatures MUST go up, OR ELSE. (Or else they will wiggle and wriggle and jiggle and juggle the data until it does what must be correct according to their theories, which, in turn, must be correct because real climate scientists thought them up and they are -or were- sincerely convinced they are -or were- saving the whole world.)
NASA GISS has been quite blatant in modifying the data even though they are aware that all the older versions exist in electronic archives. They have got away with it because no one in the major media or Congress seems interested in calling them on it. In my free online novel, set several decades in the future when virtually all data is in electronic storage, officials who control the worldwide data servers create what they call a máquina del tiempo (time machine in Inglañol, the then-prevalent version of US English peppered with Spanish words and phrases) that alters historical documents to further their plan for space travel. In the case of weather data, to cover their tracks, they would also have to alter the original hard-copy documents. This isn’t likely to happen since the NCDC keeps these paper records from COOP weather observers secure in a climate controlled vault in Asheville.
MEASUREMENT STATION QUALITY
The Surfacestations.org project has done a good job of surveying official US temperature measurement stations. I discussed some examples and showed some of their more interesting photos here.
NASA/NOAA specifies measurement sites in five classes, with the best at least 100 m (over 300 ft) from any source of artificial heating or land development and the worst located right on an occupied building (see my graphic). According to a 2009 survey, as of that year, only about 3% of official sites in the US were at Class 1. About 8% were in Class 2, at least 30 m from a source of artificial heat. About 20% were in Class 3, between 10 and 30 m. The remaining stations were closer than 10 m to an artificial heat source (58%) or right on a heat source (11%).
Thus, only about 3% + 8% = 11% were in the best two classes, reasonably distant from artificial sources of heat, while 58% + 11% = 69% were in the worst two classes, easily affected by nearby heat sources. Thus, over 2/3rds of the official reporting stations in the US were close enough to artificial heating sources to be affected. I do not know if the situation has improved much, or at all, over the past couple of years nor if the situation is better for foreign stations, but it may be even worse!
Of course, the Warmists will remind us, Global Warming has to do with changes in temperature. Thus, if a station has been at the same location for decades, any delta in reported temperature should be consistent with actual trends in that area, right?
WRONG!
Stations in urban areas, even if they have been in the exact same place, have been affected by development and lifestyle changes. This includes installation of air conditioning in buildings that had none fifty years ago, more auto and truck traffic, and construction of nearby buildings. But, many stations have been moved from time to time and thus have not been in the same place all this time, and most have been affected and encroached by civilization and changes in land use.
Why are the stations so close to artificial heat sources? Well, fifty or more years ago, all the readings were taken manually by volunteer observers once a day. Some volunteers were not about to walk the length of a football field to do so. Even as automatic reporting stations were introduced, the stations had to be close to buildings so the data cable could be run to the display. Even though the originally specified maximum cable distance was 1/4 mile, most automated COOP observer MMTS sensors ended up within 10 meters (33 feet) of the building, mostly due to the inability of the NWS to trench under driveways and sidewalks which acted as barriers to putting the temperature sensor in open spaces.
NASA GISS adjusts the data when they know that stations have been affected by local development or if they have been moved. However, the Metadata for this is often incomplete or simply missing. Those corrections are, of course, essential to maintaining the quality and integrity of the temperature data network so comparisons are meaningful over the period from 1880 to the present. No one knows if NASA GISS and their international equivalents have been doing that job as honest brokers or if they are using the wiggle room in their analysis to bias the data in the direction their managers would prefer. What do you think?
CONCLUSIONS
It seems to me that my estimate of 0.3ºC for Data Bias and Station Quality is fully justified, but I am open to hearing the opinions of WUWT readers who may think I have over- (or under-) estimated this component of the supposed 0.8ºC rise in global temperatures since 1880.
In my earlier posting in this Tale of the Global Warming Tiger series, I asked for comments on my allocations: to: (1) Data Bias 0.3ºC, (2) Natural Cycles 0.4ºC, and (3) AGW 0.1ºC. Several readers were kind enough to comment, either expressing general agreement or offering their own estimates. A few claim that AGW is ZERO (in other words, rising CO2 and land use changes due to human activities have no effect on temperatures or climate, due to the negative feedback from cloud albedo or other natural processes). I agree clouds have a net negative feedback (most official models assue a net positive feedback) but I do not believe this cancels out all the effects of CO2 on the Earth’s surface absorption of Solar radiation nor of albedo changes due to land use.
What do you think? I have been keeping a spreadsheet record of WUWT reader’s opinions, which I value, along with their screen names, and I plan to report the results later in this series.
This is what you may look forward to:
Normal Seasons of the Sun – How natural processes beyond human control, including Solar Cycles and Ocean Oscillations, are the actual cause of most climate change.
Some People Claim There’s a Human to Blame – Yes, human actions, mainly burning of fossil fuels and changes in land use, are responsible for some small amount of Global Warming.
Is the Global Warming Tiger a Pussy Cat? – If, as many of us expect, natural processes lead to stabilization of global temperatures over the coming decades, and perhaps a bit of cooling, we will realize the whole Global Warming uproar was like the boy who saw a pussy cat and cried tiger.
[UPDATED ~9PM 16 Jan 2011: Some readers don’t like the blinking graphs. We aim to please, Here are non-blinkers.]


Similar GISS-BoM curiosities for Australian temperature trends …
http://www.waclimate.net/bomhq-giss.html
http://www.waclimate.net/giss-adjustments.html
Has there been any warming at all? I wonder because I recall reading, possibly at Musing from the Cheifio some time last year, that the international convention for reading daily high and low temperatures was changed in the 1960s to avoid fractional readings with the following convention, temperatures above 0 degrees C rounded up to next whole number, temperatures below 0C also rounded up to nearest whole number. I may be mistaken but to me it sourced the approx 0.5C warming the panic seems to be all about. Coupled with the missing M for minus from the airport data it it certainly had me laughing. Now if I understood E.M.s musing ,the ineptitude of our agencies knows no bounds. This curious insight was soon followed by Environment Canada’s response as to the state of Canadian weather data and ever more interesting relevations. Every time I find myself staggered by the incompetence revealed.Why in this climatology field is it always worse than a cynic could imagine?The phrase, you could not make this s**t up, keeps running thro my mind.
Tom_R says:
January 16, 2011 at 8:00 pm
>> steven mosher says:
January 16, 2011 at 6:10 pm
WRT 3C of warming being Bias
Do not forget that the land is 30% of the total. Do not forget that for the most part the land temps are largely in line with SST. they are slightly warmer and more noisy. <<
Are the SST before satellite data anything more than garbage?
###############
anything more than garbage? Well, If one had the truth to compare the SSt measures to, then one could say with confidence whether they are garbage with conviction. But thn one would have access to the truth and the SST measures would be unnecessary.
So, they best we can do is make careful note of of the various factors that may bias measures. When we make careful note of all these caveats, then we can begin to understand if the biases are symetrical about zero or not. And we can gain some insight into the overall accuracy. we can also, calibrate. So, only if we we have access to the truth OR if we careless can we conclude that they are "garbage". In short, calling them garbage is a hypothesis, test that.
"And what is the effect of measuring air temperatures over land and then combining them with water temperatures? Aren't they adding apples and oranges? Far from large land masses I'd guess that the air temperature is the same as the ocean temperature, but there's a lot of sea area where that wouldn't be true"
If yu were trying to measure "the temperature", then combining air temps and SST temps would be problematic. But the global series are INDEXES. that is, they are "proxies" for the "average" temperature. What matters is that you have a consistent method over time. The primary measure folks are interesting in is the trend.
If you are really interesting in a physical quantity that makes sense, OHC would be the measure to look at.
Ira,
Your 1999 graphic is still wrong. I have no idea where you got it but it is nothing like what Hansen Published in 1999. I think you might want to check your sources.
Ideally, what people should do is request the data for H99. I say this because the stations used in 1999 DIFFER from the stations used after 1999. So, its quite unfair to make this comparison without reconciling the data first. As I noted after 1999 Hansen removed at least 5 US stations. This is noted in his text. These 5 stations all had severe quality issues. As I noted I got interested in getting the code partly to address this issue.
Next, you have to realize that the algorithms for identifying Rural stations have improved. They still need work, but the 1999 approach was very crude. Also, the urban adjust algorithm changed. Again, the change was for the better.
The GHCN data that is used for the GISS is going to get worse with version 3 that is out there in beta form. It clearly further reduces the temperature from 1904-1954 and then shows additional warming from 1954 onwards.
It isn’t much, but it is significant. There is no visibility as to why the additional corrections were made to temperature data that is 100 years old.
http://theinconvenientskeptic.com/2010/11/ghcn-v3-update-and-comparison/
Can anyone possibly believe there is no conflict of interest with Hansen keeping and manipulating the data while being an absolute 200% Warmist? Talk about re-writing history.
One question please, if the earth is getting warmer, and UHI is increasing why are the recent temperatures adjusted up instead of down?
If I can raise a minor quibble about the blink-comparison graphs, it would be that they are subtly misleading. For obvious reasons, one graph has ten years more data than the other, but the inclusion of that data on the second graph in the same style gives a visual impression of a much larger change between the two than is actually the case. If the additional section were de-emphasised, it would be better, particularly in the interests of avoiding accusations of deliberate deception or some such.
I am not going to say that there might or might not be issues with Dr. Hansen’s data. At the least he is guilty of observer bias and is in the wrong position as a scientist. Whether he can keep that straight or not is not the issue, this bias happens regardless and this is why scientists should not have positions on what is happening. The bias leads to incorrect assumptions, and I am just saying that this tends to tell people that “Dr Hansen is involved in a conpsiracy.” He might be, but the most likely explanation is that he is not looking at things clearly due to the aforementioned observer bias.
I think the best way to look at this is to figure out whether the adjustments were done incorrectly or not. Find the errors in the procedure, not in changes in the data. You might be onto something here, and I won’t stop you in that regard…but GISS is now mostly in the public arena with very little code and adjustments not being documented.
From what I can tell, there are explanations in every adjustment that I might question, but from a scientific point of view its not incorrect persae. The points to question I think come from assumptions he makes that are weak. This goes into the actual models (GCM’s) and not really into the actual data.
The data could possibly be off by .3 C as you suggest. I would hazard to guess that its lower then that despite serious issues with UHI effects which to put lightly are not done very well…which makes the error fairly high. I just caution that the data itself might have issues in the adjustments, but that overall its going to be a far lesser issue then the real issues which goes into the GCM’s which make assumption about natural variability….
Real issue is still what part of the warming is natural, and what is from man.
But to cut this comment somewhat short: I will say this as my guess’s:
+/- .1 C from data bias/error. I would guess that its more then likely in the positive direction due to the aforementioned observer bias….but that is an assumption to on my part.
+.6 Natural variation.
+/- .1 From human effects. I don’t think we understand climate enough to find such a signal in the data from our impact. Someday we might, but today I believe it is somewhere in this range. The negative is from negative feedbacks just to be clear from CO2/land-use changes.
As a note, I would guess a lot less then .1 for human effects…just that I do think its possible we have effected the climate up to .1 C
John Kerr
“It isn’t much, but it is significant. There is no visibility as to why the additional corrections were made to temperature data that is 100 years old.”
you have comparison charts for every station. start looking
It is not only a matter of words that data bias, as used here, should be called data manipulation. There is a more impressive kind of bias in ground temperature measurements, resulting from non-random inclusion and drop out of stations. On an annual basis hundreds or even one thousand stations may appear or disappear. Compute the mean of the included or dropped stations and compare it with the population mean and variance of that moment. You will find 10, 30 or 60 sigma effects. In the GHCN data base you will find effects of 10 sigma or more in the years 1878, 1891, 1907, 1931, 1936, 1941, 1949, 1950, 1951, 1952, 1957, 1960, 1961, 1970, 1971, 1975, 1980, 1981, 1986, 1987, 1989, 1990, 1992, 1994, 2004, 2006. According to my estimates the station drift is good for an increase of 1.6 degrees Celsius per century. Don’t take this figure too seriously but it suggests a bias which is not under control and may completely overrule the manipulations.
“most automated COOP observer MMTS sensors ended up within 10 meters (33 feet) of the building, mostly due to the inability of the NWS to trench under driveways and sidewalks which acted as barriers to putting the temperature sensor in open spaces.”
Somehow I knew the automation of temperature stations was just too coincidental to the rise from 1970-2000 (the time most automation occurred in all areas of life) for this not to have affected the reading. At first I thought it might have been that manual readings were done at a specified time …. and people being what they are, they didn’t do them exactly on the time tending to the colder periods.
But what a simple explanation trenching is! It’s so bl**dy obvious! You’ve had a station positioned well away from buildings, the order to automate comes in, no one wants their prestine lawn, flowerbeds and paths torn up, so the order goes to move the station closer to the building to avoid hassle.
Individually, the effect is negligible — less than a degree, and as they are all averaged out that individual move won’t be noticed. But when all the stations are under pressure to move closer to heat sources.
Add to that the clean air acts which e.g. totally removed the London Smogs, the move away from open air fires to more efficient/clean power stations. The modern fad with putting out every single natural blaze which used to burn, putting smoke into the atmosphere with its cooling effect.
Is there a version of the warmer/cooler GIF without a picture of Hansen photoshopped onto it?
In my earlier posting in this Tale of the Global Warming Tiger series, I asked for comments on my allocations: to: (1) Data Bias 0.3ºC, (2) Natural Cycles 0.4ºC, and (3) AGW 0.1ºC
Starting with 2) The size of the natural cycle is consistent with the signal we have. That is to say, the signal is “normal” and so 0.8C could be due to natural cycles. From recollection around 10-20% of simulations based on the noise produced something that the hysterics would have thought was manmade warming. As I’m not familiar with that statistics of 1/f noise, I’m going to have to guess that 1/3 to 1/2 of the 0.8C would make us fairly confident that in the majority scenarios that change was natural. So, I think I’d estimate natural around the 0.3-0.4 with a range of perhaps -0.3 – +1C
1) Data bias. For all that has been said, the local position of stations probably doesn’t amount to a lot of bias: a couple of degrees the day the wind blows from the wrong direction once a week. Obviously there are really bad stations, and a lot of really good ones. This bias could easily by 0.1C, I’d doubt it could be 0.5C because even the kind of idiots we saw in Climategate would spot that! So, probably I’d go with a smaller figure (everyone estimates high) for the local effects. I think I’d maybe add on something for regional effects (the change of land use). On top of that I’d add on something for the intrinsic bias of the “scientists” which I’d guess is at least 0.1 but could easily be 0.3C.
3) Manmade warming. Take away all the fictional multipliers and just use the raw based on CO2 IR warming (although I still maintain CO2 is also a cooling gas, but I’d have to get off my arse to prove it before it would be appropriate to use it)
4) In addition I would add a contribution for the reduction in global dimming since the 1970s. There’s no doubt in my mind (and it used to be in Wikipedia before the team got their hands on it) that there has been significant change in global dimming with a reduction in particulates leading to measurable increase in temperature (just look at the graph … joke that’s how the post-modernist climategate team doit!)
5) Solar affects. Still a bit of an “elephant in the room” as no one knows just how big this component is.
So, with the proviso, someone has to pay me if they want serious numbers, if I were making a bet I’d go with:
(1a) Local Instrument placing bias 0.1ºC,
(1b) Upjustments by “scientists” 0.1C (cherry picking of the warmist stations, etc.)
(1c) Larger scale urban heating bias 0.1C
(2) Natural Cycles 0.3ºC,
(3) AGW 0.1ºC
(4) reduction in global dimming 0.1C
You ask for impressions of data from contributors for your files.
1. The doubling of CO2 will have in my calculations the catastrophic effect on the world of at least 0.001C
2. The effect of man on the temperature of the planet has possibly given us a .003C increase or decrease depending on the prevailing industrial processes at the time.
3. The measured increases and decreases of temperature are natural.
4. The thermometer measurements of recent times show an anomaly that is a figment of imagination of some.
5. Unadjusted,unmoved and long term rural thermometers show no warming?
6. The warming anomaly thus shown by the gurus is fictional, as the record would show if all fudges were removed.
7. Warming and cooling of the earth are processes not understood and the science is still in stone age.
8. When the gurus of climate can show falsifiable reasons for ice ages and interglacials they shall gain respect.
9. When they can show falsifiable reasons for fluctuations of warm and cold periods in the interglacials. their understanding of climate may give them enough cudos to pontificate.
10. Until that time arrives they are soothsayers and carpetbaggers.
fredT says: “the hansen et al 2001 paper shows very clearly that the TOBS adjustments intoduced into USHCN2 are the biggest component of the change and b) all the Gistemp code and data is online and replicated.
When does omission of important details become equivalent to simply lying?”
FredT, first I think there are far too few warmists who post here so thanks because we believe open and honest debate is the only way forward … so I look forward to more from you in the future. But, please put forward the evidence. “Hansen et al” isn’t evidence here, it is a swear word!
Oh … and when is simple omission equivalent to lying? When you have a Wikipedia article that talks about present warming, when we all know there has been no warming in the last decade.
Mindert Eiting says:
January 17, 2011 at 2:04 am
You will find 10, 30 or 60 sigma effects. In the GHCN data base you will find effects of 10 sigma or more in the years 1878, 1891, 1907, 1931, 1936, 1941, 1949, 1950, 1951, 1952, 1957, 1960, 1961, 1970, 1971, 1975, 1980, 1981, 1986, 1987, 1989, 1990, 1992, 1994, 2004, 2006. According to my estimates the station drift is good for an increase of 1.6 degrees Celsius per century. Don’t take this figure too seriously but it suggests a bias which is not under control and may completely overrule the manipulations.
10 sigma is only significant in climate science if the result produces warming…
Just kidding, but this sounds very interesting. If you’ve gone that far, please produce a guest post and put it up!
steven mosher says:
January 17, 2011 at 1:39 am
John Kerr
“It isn’t much, but it is significant. There is no visibility as to why the additional corrections were made to temperature data that is 100 years old.”
“you have comparison charts for every station. start looking”
Why the h e double hockey stick should someone, anyone have to LOOK. The changes should be clearly marked and explained each and every time they happen. This is not a magicians game.
steven mosher says:
January 16, 2011 at 9:55 pm
Ira,
Your 1999 graphic is still wrong. I have no idea where you got it but it is nothing like what Hansen Published in 1999. I think you might want to check your sources.
Mr Mosher, it looks very similar to this one.
http://climateaudit.org/2007/08/11/lights-out-upstairs/
Sorta OT: A blast from the past, from the last time the weather started a 33-year cooling phase after 33 years of warming up. The surprise of early snow in 1942 was salient enough to be worth recording in an unexpected place:
http://www.shorpy.com/node/9733#comment-113335
Steven, my source was http://wattsupwiththat.com/2008/11/14/the-evolution-of-the-giss-temperature-product/, “Questions on the evolution of the GISS temperature product, Posted on November 14, 2008 by Anthony Watts”, where credit for the 1999/2008 blink comparator is given to zapruder.nl.
I’d appreciate it if you have an online link that shows different US Annual and five-year mean temps from 1880 to 1999 published by NASA GISS in 1999. Since my source is a contemporary (2008) WUWT posting, and there are over 500 comments to that posting, and Anthony did not update his original posting based on any challenge to the base 1999 chart from GISS, I have no reason to doubt the data source.
Data are. Each datum is a reading taken from an instrument, which measures a specific condition at a specific location at a specific time. Period.
Good data are taken from properly selected, sited, calibrated instruments, read timely. Data which do not meet the criteria above are either bad data or missing data. Period.
Adjusting bad data does not make it good data; it makes it adjusted bad (“fudged”) “undata”. Missing data is just that – missing. Data cannot be “infilled”. If a specific datum is important, properly site an instrument to measure it; if not, acknowledge that it is unimportant. If a sensor fails, replace it. That is neither rocket surgery nor brain science.
Data are immutable. They are not the “stuff” of blink comparators.
A mixture of data, adjusted “data”, infilled “data”, homogenized “data”, etc. is not data. It should not be treated as such.
If knowing what the temperature is and how it is changing is important, we certainly have the skills and the equipment to to measure it accurately. One wonders why we have not chosen to do so.
Thanks for your comment, but I think it is best to reproduce the base charts from NASA GISS exactly as they were published, to avoid charges of deliberate deception. Please note that my annotations point to peaks and troughs in the 1930’s and mid 1990’s that are common to both the 1999 and 2011 charts, and further than 5 years from the ends where the 5-year mean might be distorted. You might cover the years after 1999 with a piece of paper to avoid the distraction of the additional data in the 2011 chart.
Thanks Mike for your thoughtful and detailed comment on your estimates. Since my spreadsheet for this exercise only has three categories, I’m in a quandry about what to do with your item (4) . There are two interpretations I can think of: (a) the Sun is becoming less bright as it makes its way along the main sequence that stars follow on their way to becoming Red Giants, or (b) reduction of airborne particles as a result of cleaner energy production and so on has made the atmosphere more transparent and therefore the Sun is brighter. (a), being natural, would subtract 0.1ºC from (2) and (b), caused by human actions, would subtract 0.1ºC from (3). In either case, there would be a deficit of 0.1ºC in accounting for the supposed 0.8ºC temperature rise since 1880. I am pretty sure you intended (b), so I am putting you down for (1)= 0.2ºC [your 1a + 1b +1c – 4] , (2)=0.3ºC, (3)=0.1ºC. That all adds up to 0.6ºC, which is shy of the claimed 0.8ºC net warming since 1880.
Please comment again if I misinterpreted your intentions.
THANKS David. I traced your link back to GISS where I found the original from the horse’s mouth. http://www.giss.nasa.gov/research/briefs/hansen_07/fig1x.gif. Looks like identical data except for some minor relocation of annotation.
Note that the version I found at GISS today is apparently from a Hansen 2007 paper. It seems they replotted the 1999 data using the newer annotation on the graph axes. Therefore, I believe that the image I used, from zapruder.nl, is a more contemporary version of what GISS actually published in 1999.
Pity us poor engineers, having to make bad science work in the real world. (sarc off)