A question for Zeke Hausfather

Zeke is upset that I made this statement in a story at Fox news:

Is history malleable? Can temperature data of the past be molded to fit a purpose? It certainly seems to be the case here, where the temperature for July 1936 reported … changes with the moment. In the business and trading world, people go to jail for such manipulations of data.

he says:

In the spirit of civility, I would ask Anthony to retract his remarks. He may well disagree with NCDC’s approach and results, but accusing them of fraud is one step too far.

I’d point out that Zeke has his interpretation but nowhere did I say “fraud”. He’s mad, and people don’t often think clearly when they are mad. That’s OK.

Without getting into semantics, I’d like to ask Zeke these simple questions:

  1. What is the CONUS average temperature for July 1936 today?
  2. What was it a year ago?
  3. What was it ten years ago? Twenty years ago?
  4. What was it in late 1936, when all the data had been first compiled?

We already know the answers to questions 1 and 2 from my posting here, and they are 76.43°F and  77.4°F respectively, so Zeke really only needs to answer questions 3 and 4.

The answers to these questions will be telling, and I welcome them. We don’t need broad analyses or justifications for processes, just the simple numbers in Fahrenheit will do.

The climate data they don't want you to find — free, to your inbox.
Join readers who get 5–8 new articles daily — no algorithms, no shadow bans.
0 0 votes
Article Rating
197 Comments
Inline Feedbacks
View all comments
Mindert Eiting
January 24, 2013 12:15 am

If there are reasons to assume that bias is involved in a comparison, you should introduce a bias term in your analysis. No one considers this fraud because it is part of a procedure that can be criticized. Take sun spot counts. Should we believe that astronomers in the seventeenth century were as accurate as their colleagues today? So, add to the counts by old German astronomers G points because of their fuzzy telescopes. Subtract from the values of French astronomers F points because they exaggerated their observations for obvious reasons. Let’s hope that the original data do not get lost in this circus. The question is of whether you do this in your analysis or in your data. When you do it in your data, it’s called fraud.

RACookPE1978
Editor
January 24, 2013 12:20 am

Hmmmn.
Zeke:
How did you “generate” your (assumed-ever-so-accurate) “anomalies” that are the source of your continued processing … if you can’t tell us what the original early-century, middle-of-century, and end-of-century minimum and maximum temperatures actually were every day?
Are you not admitting blatantly that you don’t know what the basis of your anomalies is if you can’t tell us what the ACTUAL temperatures were each day at at each location?
Sure – using anomalies is correct. Its the right way to generate long-term trends. BUT HOW DID YOU GET THE ANOMALY RIGHT if you can’t tell us the temperatures?

GabrielHBay
January 24, 2013 1:11 am

A most valuable thread. I have often mused to myself that I must be a real d****r, not just a skeptic, for not even accepting the commonly accepted (even by skeptics) line of 20th century (meaningful) warming. I have consistentently taken the view that, based on what I have seen explained and presented, there is no way I can make even that little concession to the warmists. Ups and downs, yes. Systematic warming, no. We just do not know. The official data is crap. I feel vindicated.

Stephen Richards
January 24, 2013 1:49 am

What is it about climate scientists that they alone think it is normal scientific practise to manipulate pre-validated data. I don’t know how many times I have said this BUT UNDER NO CIRCUMSTANCES IS IT RIGHT TO MANIPULATE VALIDATED DATA. You can call it manipulation if you wish but it appear, to all intents and purposes, to be fraud.
AND what the [snip . . no need . . mod] is the problem with Mosher? Is he looking for work in NASA GISS.?

richardscourtney
January 24, 2013 3:04 am

E.M.Smith:
You conclude your post at January 24, 2013 at 12:11 am saying

Here is the graph of ONLY anomaly vs anomaly for the “same” data set (GHCN) for the same period of time:comment image
The past cools, the present warms, and about the same amount as “global warming”.
All comparison done ONLY as anomalies. A thermometer ONLY compared to itself.
The anomaly dodge is just that, a dodge. The data contents are being tilted toward a warming trend. Why? Is it valid? Those are left unanswered…

Yes!
I again point to a Parliamentary Submission I made which is linked at
http://www.publications.parliament.uk/pa/cm200910/cmselect/cmsctech/memo/climatedata/uc0102.htm
and
I draw your attention to the draft paper which is it Appendix B.
In the Parliamentary Submission I said of mean global temperature (MGT)

9.
It should also be noted that there is no possible calibration for the estimates of MGT.
The data sets keep changing for unknown (and unpublished) reasons although there is no obvious reason to change a datum for MGT that is for decades in the past. It seems that – in the absence of any possibility of calibration – the compilers of the data sets adjust their data in attempts to agree with each other. Furthermore, they seem to adjust their recent data (i.e. since 1979) to agree with the truly global measurements of MGT obtained using measurements obtained using microwave sounding units(MSU) mounted on orbital satelites since 1979. This adjustment to agree with the MSU data may contribute to the fact that the Jones et al., GISS and GHCN data sets each show no statistically significant rise in MGT since 1995 (i.e. for the last 15 years). However, the Jones et al., GISS and GHCN data sets keep lowering their MGT values for temperatures decades ago.

Richard

chinook
January 24, 2013 3:05 am

Zeke posted the GISS link that explains their methodology for surface temp analysis:http://data.giss.nasa.gov/gistemp/abs_temp.html
But, this paragraph raises some questions and eyebrows at what they’re implying:
‘Q. If the reported SATs are not the true SATs, why are they still useful ?
A. The reported temperature is truly meaningful only to a person who happens to visit the weather station at the precise moment when the reported temperature is measured, in other words, to nobody. However, in addition to the SAT the reports usually also mention whether the current temperature is unusually high or unusually low, how much it differs from the normal temperature, and that information (the anomaly) is meaningful for the whole region. Also, if we hear a temperature (say 70°F), we instinctively translate it into hot or cold, but our translation key depends on the season and region, the same temperature may be ‘hot’ in winter and ‘cold’ in July, since by ‘hot’ we always mean ‘hotter than normal’, i.e. we all translate absolute temperatures automatically into anomalies whether we are aware of it or not.’

I’m trying to understand their explanation how on one hand the SAT is meaningful to nobody, but the anomalies
are extremely meaningful, esp in light of the admitted inaccuracies of local measurements. And so even though or because the SAT’s are meaningless, they use an average of anomalies and suddenly meaningless data is meaningful. And they admit that public perception of anomalies is an easily manipulated thing. I only have a year of college statistics, but something here just isn’t passing the smell test. And how can making changes to past SAT’s that are meaningless which result in new anomalies that are meaningful, esp to public perception, possibly result in an honest and actually meaningful conclusion? Perhaps I’m missing something very obvious. If so, my apologies.

richardscourtney
January 24, 2013 3:50 am

chinook:
In your post at January 24, 2013 at 3:05 am you explain your view and ask

Perhaps I’m missing something very obvious. If so, my apologies.

You have no need to apologise because you have “missed” nothing. You have independently discovered what some of us have been complaining about for years.
I commend you to scroll up to my post which is immediately above yours and to read Appendix B in the link I provide there.
Richard

Venter
January 24, 2013 4:10 am

Chinook, it doesn’t pass your or anybody’s smell test [ except the AGW clique ] as it is a pile of steaming BS.
And the people promoting and accepting such BS as gold standard have the nerve to be offended if someone names what they are doing. For them, it seems like their activity is not wrong but the act of naming it truthfully is wrong.

Joe Public
January 24, 2013 4:41 am

Zeke Hausfather claims that “LIG thermometers record too high on max temps vs electronic”.
But a “max” temperature at one location will be well below “min” temperature at many other locations.

mpainter
January 24, 2013 4:54 am

Zeke Hausfather:
Half of the science of the global-warmers is meant to obliterate knowledge that has been obtained by past studies. That is what Michael Mann’s hockey stick was meant to do- eradicate the MWP.
The adulteration of data that is seen at the NOAA, by Hansen and GISS, is more of the same.
It is certain that if such adulterated data were used to promote investment schemes, that the promoters would face prison terms. What sort of person defends such pratices? Well, you for one.

mycroft
January 24, 2013 4:57 am

“In the spirit of civility”!!!!?? beggers belief! after all the uncivil words used against skeptics perhaps this young man should take time to see who is civil and who is not…think he will find Anthony and WUWT at the top end of civility scale and warmist and their sycophants at the other end of the scale..

Theodore
January 24, 2013 4:59 am

“Zeke Hausfather says:
January 23, 2013 at 4:19 pm
Anthony,
There is a good reason why all the major groups (NCDC, GISS, UAH, RSS, Hadley) primarily report anomalies. Absolute temperatures are tricky things, at least when you aren’t able to sample the full field.
GISS has a rather good explanation: http://data.giss.nasa.gov/gistemp/abs_temp.html
We skeptics agree absolute temperatures are tricky things, which is why we have little faith in databases that continue to adjust them. However Zeke, if you don’t know what the absolute temperature is for a station, you can’t calculate its anomaly.
I know you are trying to calculate the trend in anomolies, but without faith in the accuracy of the measurements and adjustments there is no faith in the accuracy of the trend. Sure you can measure a change in the trend with your methodology. What you can not do is determine if that trend is the result of several factors not related to global warming or actual temperature trends. So you are comparing an anomoly trend, but the anomolies are caused by trends in UHI, station siting, land use changes, station moves, cherry picking of stations, and trends in climate scientist adjustments to the data base.
You claim it is hard to know the absolute temperatures from 1936, but without knowing that then the trend data is pretty worthless. And pronouncements that such and such month or year was the hottest ever are absolute garbage out and not of any scientific value.
We know temperature was measured differently in 1936 and that it may require some adjustment to compare directly to todays stations. However, there is little faith that those adjustments are accurate, based on hard measurements of the difference in measuring tools, that they use appropriate statistical techniques, and a host of other reasons the data is considered untrustworthy.
This is further confirmed when the temperature (and thus the anomaly trend based upon it) changes from year to year and version to version. The equipment used in 1936 has not changed between 2011 and 2012, or 1998. Yet each time a new database is produced, those years are adjusted downward to exagerate the anomaly trend. What new information discovered between 2011 and 2012 caused you to adjust 1936 by 1 degree? If you can’t point that out, then how can we trust that it was not just fudged to make sure the trend is moving in the direction that CAGW proponents want it to move?
“Zeke Hausfather says:
January 23, 2013 at 3:45 pm
Hi Anthony,
Unfortunately, calculating the absolute temperature for the entire contiguous U.S. in July of 1936 is a non-trivial matter. I could download the raw absolute average temperatures from all stations available July of 1936. However, many of those stations were located on the rooftops of city buildings (this was the pre-airport age, after all). These stations also used liquid-in-glass thermometers which produce notably higher maximum temperature readings than modern electronic instruments. All of these things mean that a simple average of instruments available at that time would tell us something interesting about the conditions at the locations of those instruments, but not necessarily produce an unbiased estimate of CONUS temperatures.

Mark Bofill
January 24, 2013 6:30 am

jkivoire says:
January 23, 2013 at 5:43 pm
Mr Watts, Doubt all you want, I now get “Access Denied The owner of this website (rankexploits.com) has banned your IP address (207.200.116.13). (Ref. 1006)”
This is the result of the previous “obnoxious” page.
————————–
If this is Lucia’s page (the Blackboard) you’re probably being shot down by her anti-bot defenses. Happens to me once in a while too. She periodically posts about her tweaks to identify and prevent bot access and posts apologies for false rejects, for example:
http://rankexploits.com/musings/2012/how-constant-are-hacking-attempts/
…not that you’ll be able to read this link if you’re being blocked as a bot…

pochas
January 24, 2013 6:36 am

Its fraud. So why are we inclined not to prosecute, to “let it slide?” Because the admission shows what fools we have been.

climatebeagle
January 24, 2013 6:38 am

Even more confusing that Steven Mosher also said adding data does change the answer, but dropping stations doesn’t. That’s one cool algorithm.
http://wattsupwiththat.com/2012/03/19/crus-new-hadcrut4-hiding-the-decline-yet-again-2/#comment-928684

January 24, 2013 6:48 am

In engineering school we took lots of data. We had to report the accuracy of the instrument, every time. This is the definition of “taking data.” The debate about CO2 and its effects involves data from years and years ago, taken with instruments with varying accuracy. The people involved in attempting to prove that CO2 has harmful effects are attempting to prove this to the public, who did not go to engineering school, would not know even what the word “accuracy” means, and believe what they read in the papers. “Never argue with a man who buys ink by the barrel.”
People like Zeke and Steven live by raising red herrings, statements that don’t actually have to BE true, they just have to SOUND true to the uninformed. As long as they still are able to get away with it, they will. As long as the Obamanation continues, and as long as academic and government administrators have a liberal bent, this will continue. There is nothing for it, as these people believe that the modern lifestyle is evil, and they will do anything to make it stop. This, despite the fact that they all LEAD the modern lifestyle. This AGW myth will continue until the general public notices that the weather seems about the same as it has always been, and then there will be no story, no publicity, and the libs will move on to something else.
Life goes on…

RockyRoad
January 24, 2013 6:59 am

So what Zeke is telling us (and defending, I might add) is that the various temperature datasets are actually MODELS of the temperature. I say this because they all use algorithms that adjust the raw data using sets of algorithms–many of which do not withstand logical scrutiny and justification. They’re all just “educated guesses”.
But taking a step back from the temperature models, as a student of sampling theory I would assert that meaningful sample density is not sufficient for the temperature phenomena being studied; that “fudging” is the best term to describe the method(s) used to project point data to large segments of the earth’s surface; and that these projections have no bearing on the true temperature of said regions. Additional mathematical gyrations foisted on the data try to address these issues (and by doing so admit to my allegations) but are no substitute for the real thing.
Subjective models based on insufficient sampling gives anything but accurate results. And until these problems are addressed, discussion will continue ad nauseum with no resolution in sight.
(Still, kudos to Mr. Hausfather for joining the discussion.)

Matt Skaggs
January 24, 2013 7:20 am

davidmhoffer wrote:
“I’ve challenged several scientists to take their precious temperature data, convert it to w/m2, THEN average it and THEN trend it. If we;re trying to detect a change in w/m2 at surface due to increases in CO2, then why the BLEEP are we not measuring changes in w/m2 at surface?”
Thanks David, that had not occurred to me, you are absolutely right. The answer is of course not willful misdirection, but the fact that no one is driving the AGW bus. Clearly climate scientists should be formally pursuing whether W/m2 is tracking CO2. I’m adding this to my list of explicit predictions made by AGW theory that no one is really pursuing in any formal manner, such as polar amplification and the mid-troposphere hot spot. The fact that these cats won’t herd means that we are unlikely to see any of the specific, non-trivial AGW predictions (the true yardstick of “settled science” being the number of non-trivial and non-obvious predictions conclusively shown to be true) resolved in the near future.

rilfeld
January 24, 2013 7:30 am

“Steven haney:
At January 23, 2013 at 4:40 pm you ask
Zeke, Anthony and Richard, Why is there no longer any discussion of temp. data prior to 1850?
My answer is that there were few temperature measurement sites prior to 1850 so the methods used to compile e.g. global temperature are not applicable for then.
Which is not to say I think the methods used are applicable for times after 1850. I don’t, but I think they could be.
Richard”
It would be of great benefit if we had temperature measure from outside the arena of instrumentation to provide checkpoints. Though unable to provide a ‘hard’ confirmation or denial of instruments, we do have a few. The freezing (or not) of the river Thames. The range patterns of various species of winter wheat. The temperature related yields of the citrus and strawberry crops. Extreme anomolies of this sort are usually reported contemperaneously. Granted, very imprecise, but in the ‘hottest year on record’ I’d expect to see a lot of such confirming reports outside of climate political correctness and sheepishness. The wheat doesn’t know how the thermometer is sited (or cited). … like continuing tree ring studies through the present to ‘validate the natural instrument’ or are we htiting a sore spot there?

January 24, 2013 7:30 am

davidmhoffer says January 23, 2013 at 7:41 pm

What could possibly be a simpler concept? If CO2 changes the w/m2 at the surface, then why aren’t we measuring and trending w/m2 at the surface?

Better yet, how about measuring the LWIR radiated back into space? Or both?
BUT WAIT … we have something comparable: UAH and RSS sat msmts …
.

January 24, 2013 7:48 am

Now let’s see if I’ve comprehended
How temperature data gets “mended.”
They make the past cooler,
Then they take a ruler,
Et voilȁ! The warming’s not ended.

January 24, 2013 7:57 am

Couple of points.
I’ve been studying how much of the days temp rise is lost that night, think of it as a Daily anomaly. then averaging that across all stations, since the temps used are from the same station in the same 24 hr period it seems to me to more immune to station errors. I further filter stations out that don’t provide records over most of the year, I’ve used anywhere from 240 days/year to 365 days/year with no significant difference in results. That result is there’s no loss of the ability to cool the days temps, when the daily averages are looked at by latitude range, you can see the effect of the change in length of day.
I’ve also recently gotten a IR thermometer, looking for some reflection of IR off the atm overhead. While gives an interesting result, it either reads below scale (-40F which is ir out to ~12.5u), or it reads max scale (608F), the interesting part is that it seems to read 608 in the opposite direction of the Sun as well as when near the Sun, as if Solar IR (<~5u) is being reflected by the atm. All of this was on a 35F day with clear skys. There is no other IR signal coming from the atm. On the other hand it will read clouds just fine.
Lastly, there's no government agency I've ever worked with, that doesn't calibrate their instruments on a regular basis. They always use calibrated standards traceable to some other calibrated instrument. Are we suppose to believe that the NWS neglected this important step for decades, yet were so interested in the data, it was recorded and saved for decades?

richardscourtney
January 24, 2013 8:24 am

rilfeld:
At January 24, 2013 at 7:30 am you say to me

It would be of great benefit if we had temperature measure from outside the arena of instrumentation to provide checkpoints. Though unable to provide a ‘hard’ confirmation or denial of instruments, we do have a few. The freezing (or not) of the river Thames. The range patterns of various species of winter wheat. The temperature related yields of the citrus and strawberry crops. Extreme anomolies of this sort are usually reported contemperaneously. Granted, very imprecise, but in the ‘hottest year on record’ I’d expect to see a lot of such confirming reports outside of climate political correctness and sheepishness. The wheat doesn’t know how the thermometer is sited (or cited). … like continuing tree ring studies through the present to ‘validate the natural instrument’ or are we htiting a sore spot there?

It is not a “sore spot” with me.
Such proxies are used; e.g. Soon & Baliunas
http://www.int-res.com/articles/cr2003/23/c023p089.pdf
Incidentally, please ignore the wicki comments on this excellent paper: the wicki comments have been given the ‘Connelley Treatment’ so read it an evaluate it for yourself.
Of much more direct use are British Admiralty ships’ log temperature records.
http://badc.nerc.ac.uk/view/badc.nerc.ac.uk__ATOM__dataent_1239019538627371
TonyB is the person you really need to question about this subject. He often posts on WUWT and has probably given it more study than any other person or organisation.
Richard

davidmhoffer
January 24, 2013 8:33 am

_Jim
Better yet, how about measuring the LWIR radiated back into space? Or both?
BUT WAIT … we have something comparable: UAH and RSS sat msmts …
>>>>>>>>
I thought so at one time as well. Turns out not. They measure a specific frequency of a specific isotope of something or other (I forget) which is directly proportional to temperature. So even THEY are measuring temperature. Of course, they are measuring it at millions of points in time and space and they COULD turn it into w/m2 before averaging it… but they don’t.
Then there is ERBE which actually DOES measure what we’re after Earth Radiation Budget Experiment, but they don’t publish the data or trends in any useful manner. I started looking at their raw data download once and gave up in short order.

davidmhoffer
January 24, 2013 8:40 am

Zeke Hausfather;
Well Zeke, you complained about the way Anthony leveled his criticisms, and in attempting to defend yourself from them the following becomes obvious:
1. You cannot justify the changes to the temperature record that Anthony pointed out.
2. You cannot justify the methods by which average temperatures at any given point and time are calculated.
3. You cannot justify the manner in which anomalies are calculated from the temperatures.
4. You cannot justify averaging the anomalies together for any purpose at all.
Your silence speaks volumes.