"Thorough, not thoroughly fabricated: The truth about global temperature data"… Well, not *thoroughly* fabricated.

Guest post by David Middleton

Featured image borrowed from here.

ARS Tecn

If you can set aside the smug, snide remarks of the author, this article does a fairly good job in explaining why the surface station temperature data have to be adjusted and homogenized.

There is just one huge problem…

US Adjusted
“In the US, a couple systematic changes to weather stations caused a cooling bias—most notably the time of observation bias corrected in the blue line.
Zeke Hausfather/Berkeley Earth”… I added the the natural variability box and annotation.  All of the anomalous warming ince 1960 is the result of the adjustments.

 

Without the adjustments and homogenization, the post-1960 US temperatures would be indistinguishable from the early 20th century.

I’m not saying that I know the adjustments are wrong; however anytime that an anomaly is entirely due to data adjustments, it raises a red flag with me.  In my line of work, oil & gas exploration, we often have to homogenize seismic surveys which were shot and processed with different parameters.  This was particularly true in the “good old days” before 3d became the norm.  The mistie corrections could often be substantial.  However, if someone came to me with a prospect and the height of the structural closure wasn’t substantially larger than the mistie corrections used to “close the loop,” I would pass on that prospect.

 

Just for grins, I plotted the UAH and RSS satellite time series on top of the Hausfather graph…

 

US Adjusted_wSat
US raw, TOBs-adjusted and homogenized temperatures plotted along with UAH and RSS global satellite temperatures.  Apples and oranges? Sort of… But still very revealing.

 

I think I can see why the so-called consensus has become so obsessed recently with destroying the credibility of the satellite data.

 

Addendum

In light of some of the comments, particularly those from Zeke Hausfather, I downloaded the UAH v5.6 “USA48” temperature anomaly series and plotted it on Zeke’s graph of US raw, TOBs-adjusted and fully homogenized temperatures.  I shifted the UAH series up by about 0.6 °C to account for the different reference periods (datum differences)…

USA48

I used a centered 61-month average for a 5-yr running average.  Since there appears to be a time shift, I also shifted the UAH ahead a few months to match the peaks and troughs…

USA48x.png

The UAH USA48 data do barely exceed the pre-1960 natural variability box and track close to the TOBs-adjusted temperatures, but well below the fully homogenized temperatures.

 

The climate data they don't want you to find — free, to your inbox.
Join readers who get 5–8 new articles daily — no algorithms, no shadow bans.
0 0 votes
Article Rating
212 Comments
Inline Feedbacks
View all comments
January 21, 2016 5:17 pm

Your figure with RSS and UAH data look quite odd; are those their U.S. lower 48-only numbers?
UAH doesn’t seem to have U.S.-only processed data available for their new beta version; for the current operational version (5.6) they do, and they are available here: http://vortex.nsstc.uah.edu/data/msu/t2lt/uahncdc_lt_5.6.txt
If I plot UAH 5-year averages on my graph (which gives me from 1983-present, since prior to 1983 there isn’t 5 years of UAH to average, as it begins in 1979) for all the series from 1983 to present, aligning all series to the 1983 5-year average, I get this. UAH at least (version 5.6) seems to agree much more with adjusted data than raw data, and looks nothing like you graph.
http://s24.postimg.org/pb575mexx/tavg_ushcn_raw_tobs_adj_v3.png
If you know where I might find U.S. data for UAH v6, I’d be happy to plot that as well.
Also, you neglected to show the figure featuring global adjustments. Turns out you actually get less warming in the adjusted data, not more. Funny that.
http://cdn.arstechnica.net/wp-content/uploads/2016/01/noaa_world_rawadj_annual.png

Reply to  Zeke Hausfather
January 21, 2016 5:28 pm

Ahh, looks like you are actually comparing global land/ocean UAH and RSS data to land-only U.S. lower 48 temperatures. That would explain it.
Oddly enough, the U.S. is not the entire globe (we are a measly 2% of it), so comparing a global land/ocean record to a U.S. land record is not very useful or revealing. Since UAH actually produces a U.S. 48 land record (which I linked above), I’d suggest using it. It seems to agree significantly better with the adjusted data than with the raw data.

AndyG55
Reply to  Zeke Hausfather
January 21, 2016 5:34 pm

Hey Zeke, can you find and put pictures up for the GHCN station in Addis Ababa,
Thanks.

AndyG55
Reply to  Zeke Hausfather
January 21, 2016 5:36 pm

“UAH doesn’t seem to have U.S.-only processed data available for their new beta version; ”
Yes they do.

AndyG55
Reply to  AndyG55
January 21, 2016 5:38 pm

And UAH USA48 and 49 trends are almost an exact match for USCRN trend.

AndyG55
Reply to  AndyG55
January 21, 2016 5:40 pm

Here is UAH USA48 (V6) this century.
http://s19.postimg.org/bbw6r5lwz/USA48_land.jpg

Reply to  AndyG55
January 21, 2016 5:45 pm

You are right; I snooped around the FTP site a bit more and found it.
http://s12.postimg.org/y1sf7avbx/tavg_ushcn_raw_tobs_adj_v4.png
Turns out that the new version of UAH (6.0) is closer to the raw data, while the older version (5.6) is quite similar to the adjusted data.
So you could use the recently-adjusted UAH data to argue against the adjustments in U.S. temperature data. However, there is more than a little irony in that given the size of the adjustments that were made this year to UAH data. As Carl Mears has shown, you can get a wide range of trends for satellite data depending on the parameters you choose for orbital decay and diurnal cycle adjustments, much wider than the range of uncertainty in the surface record:
http://skepticalscience.com//pics/rss_ensemble_box.png

AndyG55
Reply to  AndyG55
January 21, 2016 5:49 pm
AndyG55
Reply to  AndyG55
January 21, 2016 5:51 pm
Reply to  AndyG55
January 21, 2016 5:52 pm

Also, being “an exact match for USCRN trends” doesn’t tell you much. USCRN trends are actually slightly higher than USHCN trends (though not significantly so in the mean) during the period of overlap:
http://s11.postimg.org/o4fdmuls3/CONUS_average_combined.png

AndyG55
Reply to  AndyG55
January 21, 2016 5:56 pm

Seriously zeke.. two totally different measuring regimes, and you think that the almost exact match is just a coincidence.? roflmao.
I thought you were a mathematician. !!!!
I’ve been waiting for someone to start playing that game, it was so obvious from the start.

Just some guy
Reply to  AndyG55
January 21, 2016 5:59 pm

Carl Mears graph of “uncertainty” is astonishing. Does this teeny tiny little sliver of uncertainty in his graph include uncertainty from UHI, poor station siting, and in-filling of the data for the massive parts of the globe with no record? They must have God-like powers of divination to be that certain of the global average temperature to such accuracy.

Brandon Gates
Reply to  AndyG55
January 22, 2016 12:08 pm

Just some guy,

Carl Mears graph of “uncertainty” is astonishing. Does this teeny tiny little sliver of uncertainty in his graph include uncertainty from UHI, poor station siting, and in-filling of the data for the massive parts of the globe with no record?

It’s worth noting that Carl Mears’ main contribution to that plot was for RSS, not the surface data. The calculations for that plot are Kevin Cowtan’s, and no, the HADCRUT4 portion of that plot does NOT include all the estimated uncertainty. When the MET informed him of his error, he factored the additional uncertainties into the calcs:
http://skepticalscience.com/surface_temperature_or_satellite_brightness.html#115558
The original spread in the trends was about 0.007C/decade (1σ). Combining these gives a total spread of (0.007^2+0.002^2+0.002^2)^1/2, or about 0.0075 C/decade. That’s about a 7% increase in the ensemble spread due to the inclusion of changing coverage and uncorrelated/partially correlated uncertainties. That’s insufficient to change the conclusions.

They must have God-like powers of divination to be that certain of the global average temperature to such accuracy.

Precision, you mean. This is what the MET have to say about uncertainty in global average surface temperature anomalies:
http://www.metoffice.gov.uk/hadobs/hadcrut4/data/current/time_series/HadCRUT.4.4.0.0.monthly_ns_avg.txt
http://www.metoffice.gov.uk/hadobs/hadcrut4/data/current/time_series/HadCRUT.4.4.0.0.annual_ns_avg.txt
From 1979-2012, the mean monthly uncertainty is ±0.151 K and the mean annual uncertainty is ±0.087 K.
A 2-sigma uncertainty in linear trend of ±0.015C/decade calculated over the same interval is a different animal entirely.

Just Some Guy
Reply to  AndyG55
January 22, 2016 12:58 pm

Brandon Gates said “Precision, you mean….”
Well no, Brandon, I meant accuracy. Perhaps I misinterpreted Zeke’s comment about “uncertainty range”. I assumed his little graphic by Mears was referring to the uncertainty range with respect to accuracy and not precision, because accuracy is what really matter here. If that graph posted is about “precision” and not “accuracy”, then it’s kind of irrelevant, in my opinion.

Brandon Gates
Reply to  AndyG55
January 22, 2016 2:19 pm

Just Some Guy,

If that graph posted is about “precision” and not “accuracy”, then it’s kind of irrelevant, in my opinion.

On review, I may have implicitly overstated my case. When dealing with temperature anomalies, we do care about accuracy when it is confirmed or suspected that the mean absolute error of an instrument has changed abruptly or is changing over time, both of which tend to introduce bias in trends. Otherwise, what we care about is precision — by how much we expect a given reading to deviate from its mean absolute error.
That all said, the graph Zeke posted is part of an article wherein Kevin Cowtan is making an explicit argument about trend precision, which I think is entirely relevant when the topic is comparing the reliability of (A)MSU-derived trend estimates vs. thermometer-derived trend estimates.

Just Some Guy
Reply to  AndyG55
January 22, 2016 3:24 pm

“We do care about accuracy when it is confirmed or suspected that the mean absolute error of an instrument has changed abruptly or is changing over time, both of which tend to introduce bias in trends. ”
AKA: Fiddling with the data. Trying to outsmart the data which you “suspect” is is showing the wrong trend is a recipe for wrong results and user bias.

Brandon Gates
Reply to  AndyG55
January 22, 2016 4:05 pm

Just Some Guy,

AKA: Fiddling with the data. Trying to outsmart the data which you “suspect” is is showing the wrong trend is a recipe for wrong results and user bias.

Quite possible, which is why I think it is good scientific practice to detail such adjustments in peer-reviewed literature, retain the unadjusted data so that it can be compared at its most granular level to the adjusted data, and to publish the computer codes which perform the adjustments.
Conversely, naively assuming that the raw data contain little to no error might be a recipe for wrong results due to data bias. Again, I think it is good scientific practice to always suspect that such errors exist, and either attempt to rule them out, or upon finding them estimate the error they introduce and correct for that error.
Now, both RSS and UAH have applied adjustments over the years because they suspected that things like orbital decay and diurnal drift were biasing the results of their trend estimates. Since that is a “recipe for wrong results and user bias” according to you, do you therefore reject their temperature anomaly products?

Just Some Guy
Reply to  AndyG55
January 22, 2016 5:05 pm

Brandon said, “Now, both RSS and UAH have applied adjustments over the years because they suspected that things like orbital decay and diurnal drift were biasing the results of their trend estimates. Since that is a “recipe for wrong results and user bias” according to you, do you therefore reject their temperature anomaly products?”
No I do not and I will explain why.
Orbital decay and diurnal drift are not “suspected” problems and do not require any human judgement in the corrections. They are issues which are known for a fact to exist and can be corrected with mathematical formulas. The accuracy of those formulas can be verified by calibrating the data with known measurements made by the weather balloons. This is far different from the case with the incomplete and flawed ground-based thermometers. (note I am not talking about TOBS adjustment here, I’m talking about the so-called “homogenization” and problems like UHI and station-siting which are being incorrectly assumed by yourself as a non-problem.) You yourself used the phrase “suspected that the…. error (of a particular instrument) is changing over time”. You have no way to verify the accuracy of such suspicions and so must rely on human judgement and computer models. Any time human judgement gets involved with a complex analysis of data, there will inevitably be human bias in the final product.
And btw, yes I’ve read the studies which try to dismiss the significance of UHI in the ground-based temp record. These studies miss the concept of UHI entirely. They attempt to categorize stations by either “urban” or “rural”, as if UHI were a sort of “diseases” which infects some thermometers but does not infect others. UHI effects do not work that way.

Brandon Gates
Reply to  AndyG55
January 22, 2016 6:59 pm

Just Some Guy,

Orbital decay and diurnal drift are not “suspected” problems and do not require any human judgement in the corrections.

They weren’t always known, were not initially corrected for, and would not have been identified if they had not first been suspected issues. Since humans are applying the corrections, I cannot for the life of me understand why you’d think no human judgement is involved.

They are issues which are known for a fact to exist and can be corrected with mathematical formulas. The accuracy of those formulas can be verified by calibrating the data with known measurements made by the weather balloons. This is far different from the case with the incomplete and flawed ground-based thermometers.

Rhetorical question: why not just use radiosonde data then instead of futzing around with orbital corrections?

(note I am not talking about TOBS adjustment here, I’m talking about the so-called “homogenization” and problems like UHI and station-siting which are being incorrectly assumed by yourself as a non-problem.)

No, I don’t assume that. Read my previous statement again: Conversely, naively assuming that the raw data contain little to no error might be a recipe for wrong results due to data bias. Again, I think it is good scientific practice to always suspect that such errors exist, and either attempt to rule them out, or upon finding them estimate the error they introduce and correct for that error.
I do not consider surface-based observations exempt from those same principles.

You yourself used the phrase “suspected that the…. error (of a particular instrument) is changing over time”. You have no way to verify the accuracy of such suspicions and so must rely on human judgement and computer models.

Well heck, if we knew all there is to know, we wouldn’t need to do science at all. On that note, I don’t understand how it is you know that “I” have no way of verifying suspected issues with the surface temperature record?

Any time human judgement gets involved with a complex analysis of data, there will inevitably be human bias in the final product.

I agree with that. It’s THE reason for peer review, and even that doesn’t catch every error.

And btw, yes I’ve read the studies which try to dismiss the significance of UHI in the ground-based temp record.

Such as?

These studies miss the concept of UHI entirely. They attempt to categorize stations by either “urban” or “rural”, as if UHI were a sort of “diseases” which infects some thermometers but does not infect others. UHI effects do not work that way.

I must confess, I do have a difficult time imagining that a weather station surrounded by corn fields in the dead center of Nebraska is going to be “infected” by UHI from Los Angeles.

Just Some Guy
Reply to  AndyG55
January 23, 2016 1:14 pm

[blockquote] I cannot for the life of me understand why you’d think no human judgement is involved. [/blockquote]
I am surprised that you still seem to not get my point that not all adjustments are equal. All I can say at this point is please re-read my previous comments. Or if you still disagree, then we’ll just have to agree to disagree.
[blockquote]I don’t understand how it is you know that “I” have no way of verifying suspected issues with the surface temperature record?[/blockquote]
I think you are missing the distinction between [i]knowing[/i] when there is an issue, and merely [i]suspecting[/i] one.
[blockquote]I agree with that. It’s THE reason for peer review, and even that doesn’t catch every error.[/blockquote]
I’m glad we can agree on something. Unfortunately, where it involves climate science, the peer review process has been subverted into a gate-keeping function. We have fraudsters like Michael Mann to thank for that.
[blockquote]I must confess, I do have a difficult time imagining that a weather station surrounded by corn fields in the dead center of Nebraska is going to be “infected” by UHI from Los Angeles [/blockquote]
No. But a station that was next to dirt road in 1972 but next to a small town shopping center in 2015 might still be counted as “rural” and yet would still show some UHI effects. Likewise a station that was installed the middle of an already urbanized downtown Denver in 1950 would be considered “urban” but might not show any UHI effects all between 1950 and 2015. UHI is caused by the [i]growth[/i] of manmade structures over time. It’s not a virus that only affects all urban stations and none of the rural ones. A study which just compares the trends of “urban” vs “rural” is meaningless, even more so when one considers that most weather stations have rather short time periods. What’s more revealing is the [b]fact[/b] heavy urban areas show significantly higher current temperatures than those in nearby rural areas. As far as I’ve seen, none of the warmists’ studies are able to reconcile their “results” against the proven reality of UHI effects.

Just Some Guy
Reply to  AndyG55
January 23, 2016 1:17 pm

[blockquote] I cannot for the life of me understand why you’d think no human judgement is involved. [/blockquote]
I am surprised that you still seem to not get my point that not all adjustments are equal. All I can say at this point is please re-read my previous comments. Or if you still disagree, then we’ll just have to agree to disagree.
[blockquote]I don’t understand how it is you know that “I” have no way of verifying suspected issues with the surface temperature record?[/blockquote]
I think you are missing the distinction between [i]knowing[/i] when there is an issue, and merely [i]suspecting[/i] one.
[blockquote]I agree with that. It’s THE reason for peer review, and even that doesn’t catch every error.[/blockquote]
I’m glad we can agree on something. Unfortunately, where it involves climate science, the peer review process has been subverted into a gate-keeping function. We have fraudsters like Michael Mann to thank for that.
[blockquote]I must confess, I do have a difficult time imagining that a weather station surrounded by corn fields in the dead center of Nebraska is going to be “infected” by UHI from Los Angeles [/blockquote]
No. But a station that was next to dirt road in 1972 but next to a small town shopping center in 2015 might still be counted as “rural” and yet would still show some UHI effects. Likewise a station that was installed the middle of an already urbanized downtown Denver in 1950 would be considered “urban” but might not show any UHI effects all between 1950 and 2015. UHI is caused by the [i]growth[/i] of manmade structures over time. It’s not a virus that only affects all urban stations and none of the rural ones. A study which just compares the trends of “urban” vs “rural” is meaningless, even more so when one considers that most weather stations have rather short time periods. What’s more revealing is the [b]fact[/b] heavy urban areas show significantly higher current temperatures than those in nearby rural areas. As far as I’ve seen, none of the warmists’ studies are able to reconcile their “results” against the proven reality of UHI effects.
[Not sure what you’re trying to do, but you can ONLY use the html “angled brackets” signs, in this WordPress site. Use the “Test” section link at top the home page to edit this entry, and leave [ ] square brackets for the mods. .mod]

Just Some Guy
Reply to  AndyG55
January 23, 2016 1:32 pm

Attention Mod: Sorry about the formatting errors. Here is a (hopefully) fixed version. 

I cannot for the life of me understand why you’d think no human judgement is involved.

I am surprised that you still seem to not get my point that not all adjustments are equal. All I can say at this point is please re-read my previous comments. Or if you still disagree, then we’ll just have to agree to disagree.

I don’t understand how it is you know that “I” have no way of verifying suspected issues with the surface temperature record?

I think you are missing the distinction between knowing when there is an issue, and merely suspecting one.

I agree with that. It’s THE reason for peer review, and even that doesn’t catch every error.

I’m glad we can agree on something. Unfortunately, where it involves climate science, the peer review process has been subverted into a gate-keeping function. We have fraudsters like Michael Mann to thank for that.

I must confess, I do have a difficult time imagining that a weather station surrounded by corn fields in the dead center of Nebraska is going to be “infected” by UHI from Los Angeles

No. But a station that was next to dirt road in 1972 but next to a small town shopping center in 2015 might still be counted as “rural” and yet would still show some UHI effects. Likewise a station that was installed the middle of an already urbanized downtown Denver in 1950 would be considered “urban” but might not show any UHI effects all between 1950 and 2015. UHI is caused by the growth of manmade structures over time. It’s not a virus that only affects all urban stations and none of the rural ones. A study which just compares the trends of “urban” vs “rural” is meaningless, even more so when one considers that most weather stations have rather short time periods. What’s more revealing is the fact heavy urban areas show significantly higher current temperatures than those in nearby rural areas. As far as I’ve seen, none of the warmists’ studies are able to reconcile their “results” against the proven reality of UHI effects.

Just some guy
Reply to  Zeke Hausfather
January 21, 2016 5:37 pm

Question: how can any satellite record be “relative to 1900-1920”. I thought satellite records started in ’79.

Reply to  Just some guy
January 21, 2016 5:46 pm

My mistake on the label. I was updating the figure cited in the original post and forgot to change it. It should be “relative to 1979-1984”

Werner Brozek
Reply to  Zeke Hausfather
January 21, 2016 7:51 pm

If you know where I might find U.S. data for UAH v6, I’d be happy to plot that as well.

See:
http://vortex.nsstc.uah.edu/data/msu/v6.0beta/tlt/uahncdc_lt_6.0beta4.txt

AndyG55
January 21, 2016 5:53 pm

Thanks to USCRN, all US temperatures have been brought under some semblance of adjustment control.
Trouble is, that leaves the rest of the world for the alarmista to play with. And they do.

Reply to  AndyG55
January 21, 2016 6:02 pm

Oddly enough, I have an academic paper on the subject of USHCN/USCRN comparisons that just got accepted for publication. We can chat about it in detail next month :-p

AndyG55
Reply to  AndyG55
January 21, 2016 6:09 pm

Don’t forget to mention the mathematical impossibility of the match shown in that link. 😉

AndyG55
Reply to  AndyG55
January 21, 2016 6:10 pm

ps.. any luck on that pic of the Addis ababa weather station.?

Reply to  AndyG55
January 21, 2016 5:59 pm

You do realize that the homogenization code used is public, and that it’s exactly the same in the post-CRN period as the pre-CRN period, right? This idea that NOAA suddenly did something different when the CRN came online is silly conspiracy-mongering.
ftp://ftp.ncdc.noaa.gov/pub/data/ushcn/v2/monthly/software/

KTM
Reply to  AndyG55
January 21, 2016 9:36 pm

comment image
Pure coincidence, right Zeke?

NeedleFactory
January 21, 2016 6:02 pm

The cited article (at ArsTechnica) begins, as its very first example of the scientific need for adjustments, the measurement of groundwater level over time. This example contradicts the article’s argument, stating: “Automatic measurements are frequently collected using a pressure sensor suspended below the water level. Because the sensor feels changes in atmospheric pressure as well as water level, a second device near the top of the well just measures atmospheric pressure so daily weather changes can be subtracted out“.
Thus the device collects two raw measurements, subtracting one from the other, producing a “raw” difference between the two sensors. This is the design of the apparatus. Neither sensor is adjusted.
David Middleton closes with “I think I can see why the so-called consensus has become so obsessed recently with destroying the credibility of the satellite data. Indeed. The so-called consensus has claimed that satellite also “requires adjustments,” ignoring the fact that — unlike ground weather stations — the “adjustments” are part of the measurement design, not after-the-fact fiddling.

Reply to  NeedleFactory
January 21, 2016 6:13 pm

Oh really, orbital decay adjustments and diurnal cycle change adjustments are part of the measurement design? That would be news to UAH and RSS. Especially UAH who released a new (and quite different) adjusted version of their record just 6 months ago.

NeedleFactory
Reply to  Zeke Hausfather
January 21, 2016 6:43 pm

I am happy to be corrected — but I thought even school children knew about orbital decay and am surprised the scientists did not expect it. I would have thought brightness differences during the day would also have been expected. I’d appreciate any references about this you might supply. TIA.

MarkW
Reply to  Zeke Hausfather
January 22, 2016 7:00 am

They expected it, however actual decay was not the same as expected decay, which was way the adjustment was necessary.

Richard M
Reply to  Zeke Hausfather
January 22, 2016 10:19 am

Really … the lack of proper adjustments 15-20 years ago was the subject of the recent video attacking Christy and Spencer.

Reply to  Zeke Hausfather
January 24, 2016 3:02 pm

Orbital decay and diurnal adjustments are made by both rss and uah. Without these adjustments you get nonsense data.

Brandon Gates
Reply to  NeedleFactory
January 22, 2016 3:22 pm

NeedleFactory,

The so-called consensus has claimed that satellite also “requires adjustments,” ignoring the fact that — unlike ground weather stations — the “adjustments” are part of the measurement design, not after-the-fact fiddling.

https://courses.seas.harvard.edu/climate/eli/Courses/global-change-debates/Sources/10-Mid-tropospheric-warming/more/Christy-etal-2007.pdf
11. Caveats
[52] We point out that data sets based on satellites undergo constant examination by the developers and users. These data are observed by complicated instruments which measure the intensity of the emissions of microwaves from atmospheric oxygen, requiring physical relationships to be applied to the raw satellite data to produce a temperature value. Further, the program under which these satellites were designed and operated was intended to improve weather forecasts, not to generate precise, long-term climate records.
[53] Since 1992 the UAH LT data set has been revised seven times or about once every 2 to 3 years. There is no expectation that the current version (5.2, May 2005) will not continue to be revised similarly as better ways to account for known biases are developed and/or new biases are discovered and corrected. Thus the production of climate time series from satellites will continue to be a work-in progress.

Emphasis added. Paragraph 53 there is an example of what I consider particularly good scientific thinking, and would be an entirely appropriate statement even if the (A)MSUs and related instrumentation had been purpose-designed for generating long-term climate records — which, like most of their surface-based weather station cousins, they weren’t.

January 21, 2016 6:08 pm

Thank you for a very informative article, and also for linking to the ars technica article, which as you say has a snarky tone but does a good job of broadly describing the whys and wherefores of homogenisation.

J
January 21, 2016 7:11 pm

You should read the comments forums to this article.
I comment frequently in their forums when they are on climate topics which they often are.
They are a fully committed to the cause crowd, enforcing the AGW dogma.
If one offers any dissenting ideas they are immediately attacked, some times correctly so. But in other cases cogent arguments are made, then there is a coordinated squad of enforcers that will attack, eventually devolving to swearing at the poster with assorted an hominums.
You should look at the comments to that story and see the partisan tatics.

Robert B
Reply to  J
January 21, 2016 8:07 pm

I was motivated to make comments by such behaviour just before the Climategate emails came out. I made a comment that was hardly sceptic but defensive of those who wanted to question “The Science” and point out flaws. Got a bollocking for an innocent and non-oil-funded scepticism.

Robert B
January 21, 2016 7:35 pm

Since when was the argument that temperature record was good as is? A quick look at nearby stations shows how you couldn’t be sure of anything unless the change was tenfold bigger and you restricted yourself with rural sites with few changes.
The argument is that with such large adjustments that you can’t have much confidence in a result that shows such a small trend globally and far from uniform across the globe. Even without accusations of fudging, it still isn’t good enough for basing policies on.
But the result of the adjustments is not the data being offset across the range, a small increase in the trend over the whole range nor is the plot of the differences from previous estimations noisy. The difference is a very smooth plot of what the activists wanted to see.

601nan
January 21, 2016 7:47 pm

Back in the day, we would call NOAA “Shits and Giggles.”
Ha ha
Even today they can’t figure out the meaning of an arithmetic mean from a mean.
Don’t ask a NOAA employee what is a geometric mean to an arithmetic mean! That, at a bar in Bethesda, would start a fight and the police would be called to close the bar.
Ha ha

January 21, 2016 10:18 pm

News Flash: Climate change caused by newly discovered super planet with orbit of 20,000 years. The planets are aligned right now. Big changes expected. Lost Pluto but found Micky Mouse.

January 22, 2016 12:07 am

Problem with USHCN : The logic around TOBS adjustment appear sound, but the documentation that observers actually did change their time of observation as needed for the huge adjustments from 1970, to 1980 to 1990 to 2000 to 2015 appear weak. So the foundation is weak.
When at the same time the number of missing datapoint in the most recent years has exploded, it becomes increasingly hard to explain adjustment as usual: “Well in the old days, collecting of temperature data was so very bad..” style.
On top, it seems that Karls UHI writing 1986 for USA has been forgotten and people are forced to believe this issue is tiny.

Tim Hammond
January 22, 2016 12:47 am

I understand homogenisation to get a global temperature. I understand adjusting data to get a consistent set of data for comparisons. What I don’t understand is where the “better” data comes from that is used for homogenisation and adjustment.
If we have lots of high quality data showing this warming, lets see it. If we don’t then you can’t use lower quality data to adjust higher quality data and claim you end up with a better result.
I don’t care what field you are talking about, you just cannot.

Marcus
Reply to  Tim Hammond
January 22, 2016 2:08 am

Shit plus more shit equals really good shit ?

Reply to  Tim Hammond
January 22, 2016 8:58 pm

And anyone who has experience in Africa knows, an extra $10 will buy you any temperature you want.

January 22, 2016 2:23 am

Why is this post only discussing the effect adjustments and such have on temperatures for the United States when one gets radically different results if they look at temperatures for the entire planet? Did the author just not look at what happened with global results, or is this just massive cherry-picking? Either way, it’s pretty ridiculous. Whatever value there may be in looking at US temperatures, there would be far more value in looking at global ones.
Especially since the post compares the temperatures it examines to global satellite temperatures. Why use global temperatures in one case but US temperatures for the other? Given basically nothing the post says holds true for global temperatures, it just looks like massive and intentional cherry-picking to me.

Reply to  David Middleton
January 22, 2016 3:17 am

David Middleton, you say:

Did you read my post? How about the article?
I focused on the US because the adjustments to the US temperature measurements equals the warming anomaly.

But that does nothing to contradict the idea you cherry-picked US temperatures for your post. Your post never even acknowledges the fact the article you’re discussing talks about global temperatures. Nobody could possibly know that unless they went to the article and read it for themselves. A person who had only read your post would naturally assume it only discussed US temperatures since that’s all you ever mentioned in reference to it.
That you find the US adjustments suspicious doesn’t justify completely ignoring the global temperatures. If you had wished to give a fair discussion of the US adjustments, you should have acknowledged your post says nothing about global temperatures, which you accept don’t suffer from any of what you describe and was a key topic of the article you responded to.

Regarding plotting the global satellite data on Zeke’s US graph, I clearly stated in English, “Just for grins, I plotted the UAH and RSS satellite time series on top of the Hausfather graph…”

This does nothing to justify your actions either. Saying you did something “for grins” doesn’t change whether or not it is misleading. If you wanted to publish the figure you made fairly, you should have cautioned readers you were comparing results for very different areas, and thus your figure really has no meaning. Instead, you provided the figure and said:

I think I can see why the so-called consensus has become so obsessed recently with destroying the credibility of the satellite data.

Which could only be based on the figure you published comparing the US land record to the global satellite record, a nonsensical comparison.
This post rests entirely upon cherry-picking. Your claims now, that you just didn’t want to talk about the things you didn’t cherry-pick, does nothing to change the fact you cherry-picked US results and presented them as though they were of central importance. If anything, your response just makes it clear what I said was true.

richardscourtney
Reply to  David Middleton
January 22, 2016 3:52 am

Brandon S? (@Corpus_no_Logos):
You say to David Middleton

But that does nothing to contradict the idea you cherry-picked US temperatures for your post. Your post never even acknowledges the fact the article you’re discussing talks about global temperatures. Nobody could possibly know that unless they went to the article and read it for themselves. A person who had only read your post would naturally assume it only discussed US temperatures since that’s all you ever mentioned in reference to it.

Any reasonable person would consider that the processing of US temperature data is a sample of the processing applied to all the temperature data.
Are you claiming that US data is processed differently from elsewhere?
If it is then how is that justified?
And if it is not then what are you complaining about?
Richard

Reply to  David Middleton
January 22, 2016 1:48 pm

richardcourtney, the very article this post responds to discusses how US temperatures are different from most of the rest of the world. It isn’t a matter of how the data is processed either. It’s because the US record has certain traits not found in most of the rest of the world.
Besides which, the author of this post decried the idea he was using this post to address anything other than US temperatures when responding to me. That means he rejects the idea he was making the sort of argument you claim. That means not only have you managed to ignore what the original article said, you’ve also managed to contradict the author of this post.

Reply to  David Middleton
January 22, 2016 1:57 pm

David Middleton, you can repeat claims like:

My statement renders the moronic accusation of cherry-picking totally moot.

But they won’t become true simply because you say them a lot and make derogatory remarks about the people who disagree. When you do nothing to address anything your critics say, you’re not actually contributing anything. I explained exactly why what you did was cherry-picking, and your response is nothing more than, “Nuh-uh, that’s stupid.” That isn’t how decent people behave, and it doesn’t do anything to actually show I am wrong. It just shows you’re obnoxious and don’t want to actually have discussions with people who disagree with you.

The caption clearly states that these are two different areas and an apples & oranges comparison.

Which does nothing to address what I said, which was that you should have cautioned readers you were making a nonsensical comparison and warned them that meant it had no meaning. Ignoring half of what I said to claim I am wrong does nothing but support the idea you cherry-pick things to misrepresent them.

Regarding my closing comment, I was being somewhat snarky. However, the fact is that the global satellite temperatures track at or below the raw US temperature measurements which don’t exceed the natural variability of the early 20th century.

This isn’t actually a fact, as it depends on a variety of factors and assumptions, but even if it were, it would be completely meaningless. Temperatures for a small fraction of the globe tell us very little about temperatures for the entire planet. Comparing satellite records to surface records for the US is no more appropriate than comparing them to surface records for Australia, Russia, South America or any other area. That you can cherry-pick one comparison and get a good rhetorical effect out of it doesn’t tell us anything.

richardscourtney
Reply to  David Middleton
January 23, 2016 1:57 am

Brandon S? (@Corpus_no_Logos):
I asked you

Any reasonable person would consider that the processing of US temperature data is a sample of the processing applied to all the temperature data.
Are you claiming that US data is processed differently from elsewhere?
If it is then how is that justified?
And if it is not then what are you complaining about?

and you have replied saying in total

richardcourtney, the very article this post responds to discusses how US temperatures are different from most of the rest of the world. It isn’t a matter of how the data is processed either. It’s because the US record has certain traits not found in most of the rest of the world.
Besides which, the author of this post decried the idea he was using this post to address anything other than US temperatures when responding to me. That means he rejects the idea he was making the sort of argument you claim. That means not only have you managed to ignore what the original article said, you’ve also managed to contradict the author of this post.

Say what!?
I was “making” a “claim” about “the sort of argument” provided by Middleton?
I “managed to ignore what the original article said”?
And I “managed to contradict the author of this post”?
NO, NO and NO.
I asked you for clarification of what YOU were saying.
If you don’t have a valid answer to my requests for clarification then say you don’t. Waving ‘straw men’ about things I did not mention does not ‘cut it’.

And it is meaningless armwaving to say “the US record has certain traits not found in most of the rest of the world” when you don’t specify those “traits” or what you think are their causes.
Richard

hot air
Reply to  Brandon S? (@Corpus_no_Logos)
January 22, 2016 8:52 am

“Why is this post only discussing the effect adjustments and such have on temperatures for the United States when one gets radically different results if they look at temperatures for the entire planet? Did the author just not look at what happened with global results, or is this just massive cherry-picking? Either way, it’s pretty ridiculous. Whatever value there may be in looking at US temperatures, there would be far more value in looking at global ones.”
Global surface temps are the epitome of cherry picking. You assert it is more accurate to use a 1200km radius from a single temperature measurement point? This will give an accurate representation of the temperature over that entire area?. So temperatures in Portland OR = Phoenix or death valley?
It is a PRACTICAL impossibility to get an accurate global surface temperature measurement when you have areas the size of the US with 1 measurement point.
“Well we don’t have coverage so we have to make due with what we have..” is not justification for doing so, The correct response is “We don’t have the coverage or sensor integrity to draw any useful conclusions from the measurements. Until we get something that gives us global coverage, (cough *satellites*) the best we can do is look at the trends from the places where we do have good coverage and see if we can independently confirm those measurements. BEFORE we conclude we see warming, cooling, or wiggling about a mean.
Balloon data and satellite data agree very well with each other, so either they BOTH have identical systematic errors, or they are confirming each other to within their inherent measurement accuracy. Which is more likely?
If the surface temps track the satellites/balloons you can trust the measurements because you now have 3 different measurements telling you the same thing. If they don’t which one would you question? The two that agree or the one that doesn’t?

3x2
January 22, 2016 3:14 am

I think I can see why the so-called consensus has become so obsessed recently with destroying the credibility of the satellite data.
It’s the only thing keeping them remotely honest. Without the sanity check from Satellites they have nothing holding them back.

Eliza
January 22, 2016 4:04 am

Again we forget to show that FOUR radiosonde datasets agree with the TWO satellite sets. There is no argument and NO warming
http://www.globalwarming.org/wp-content/uploads/2013/06/CMIP5-73-models-vs-obs-20N-20S-MT-5-yr-means1.png

sagi
Reply to  Eliza
January 22, 2016 11:33 am

Is anyone keeping this useful graphic up to date with the more recent balloon and satellite values?

January 22, 2016 7:18 am

Re: Thoroughly fabricated … data, 1/21/16:
[W]hy the surface station temperature data have to be adjusted and homogenized.
Data evolve to fit the model, to earn tenure, to make the catastrophe really scary, to loosen the money, to pay the salaries, to buy the next gen computers, to regulate out the capitalists, to elect the socialists.
It’s not wrong — it’s Post Modern Science.

January 22, 2016 8:30 am

Here is where it all began:comment image
With 1998 El Nino in, it was clear that 1934 in the US was still the record high year. Knowing that this was likely to be followed by a La Nina, it was likely going to be a long time they would have to suffer with the embarrassing fact that 1934 remained the record. The email from an FOI request shows chronologically how his assistant adjusted the figures until Hansen was happy!! I urge everyone who is wondering about this issue to read the historical first egregious tampering with the official record.
Remember that Hansen in 1988 had the airconditioning turned off and the windows all closed the night before in preparation for his alarmist speech to a sweltering Congress (an obliging congressman [Wirth??], I believe arranged this). Here, ten years later with the 1934 warmth dogging hime, he showed another example of his lack of scruples. Today, we have largely forgotten this historic fact of tampering with official US temperatures. We agonize over and measure the comparatively small changes made by T. Karl and whether the pause is 18 years or whatever, when the pause might in actuality be 80 years. Everyone argues that the US is only 3% of the Globe so it doesn’t mean that globally it is similar. However, the Iceland, Greenland, Canadian and Northern Russian temperature records also had 1930s-1940 as the warmest. WUWT? The Canadian all time high was in two places in Saskatchewan in 1937 when it was 47C!! and it was in the high 30s and 40s throughout much of the rest of Southern Canada as well.

Curious George
Reply to  Gary Pearse
January 22, 2016 9:21 am

Could you please provide a link?

TA
Reply to  Gary Pearse
January 22, 2016 6:09 pm

Gary Pearse wrote:
“With 1998 El Nino in, it was clear that 1934 in the US was still the record high year. Knowing that this was likely to be followed by a La Nina, it was likely going to be a long time they would have to suffer with the embarrassing fact that 1934 remained the record.”
I think 1934 should be cited as the “Hottest Year Evah! when we are talking about records, and not 1998. The Earth is currently *not* experiencing “unprecendented heat” as alarmists would have us believe. We would have to get hotter than 1934, to be experiencing unprecedented heat.
” Everyone argues that the US is only 3% of the Globe so it doesn’t mean that globally it is similar. However, the Iceland, Greenland, Canadian and Northern Russian temperature records also had 1930s-1940 as the warmest. WUWT? The Canadian all time high was in two places in Saskatchewan in 1937 when it was 47C!! and it was in the high 30s and 40s throughout much of the rest of Southern Canada as well.”
Every unmodified temperature chart or data chart I see, from around the world, shows the period around the 1930’s as being the hottest period since that time. I have a list of newspaper headlines of weather events during the decade of the 1930’s that shows there were massive heat waves all over the planet during that time period.
TA

January 22, 2016 9:10 am

thanks, when I dropped that into tip line yesterday
http://wattsupwiththat.com/tips-notes-2/#comment-2125475
I hoped someone would address it

Bill Marsh
Editor
January 22, 2016 9:13 am

It seems curious to me that the adjustments made post 1980 are significantly larger than the adjustments made pre-1980. Did we just not know what we were doing 1980 – present to cause the temps to be consistently measured lower (and a lot lower at that)?

john harmsworth
January 22, 2016 2:39 pm

I live in that area of Saskatchewan that had 47C in 1937 although I’m not that old. The local weather regularly shows record highs for a particular date as occurring in the 30’s. As well, we had significantly hot, dry weather in the 1980’s and I certainly remember some serious heat in the 60’s when I was a kid. Outside all the time and no A/C in most buildings might affect my memories but I’m curious about the 16-17 year gap between major el nino’s. Does this interval show up in records previous to 1998?

January 22, 2016 6:21 pm

Curious George
January 22, 2016 at 9:21 am
“Could you please provide a link?” [Query re comment above on 1934 still hotter than 1998 according to Hansen:
http://wattsupwiththat.com/2016/01/21/thorough-not-thoroughly-fabricated-the-truth-about-global-temperature-data-well-not-thoroughly-fabricated/#comment-2126590%5D
Here is the original link to an expose from an FOI request concerning the fiddling with 1934 record hot temperatures to reduce them below that of 1998 and the anger and excitement it garnered. Sorry I forgot to add it to my comment.
http://wattsupwiththat.com/2010/01/14/foiad-emails-from-hansen-and-giss-staffers-show-disagreement-over-1998-1934-u-s-temperature-ranking/
We have to keep hammering this stuff!!

Reply to  Gary Pearse
January 22, 2016 6:35 pm

While I’m at it, here is 295 pages of the email flurry surrounding all this and i recommend scimming that, too.
https://wattsupwiththat.files.wordpress.com/2010/01/783_nasa_docs.pdf

Michael C
January 23, 2016 10:28 am

Gary Pearse wrote:
“With 1998 El Nino in, it was clear that 1934 in the US was still the record high year. Knowing that this was likely to be followed by a La Nina, it was likely going to be a long time they would have to suffer with the embarrassing fact that 1934 remained the record.”
Can someone please tell me why El Nino increases global mean temperature and La Nina decreases it? according to the model they do not change mean temperature, they just redistribute it around the globe
Deal to this guys. It is important. Why? because should a logical explanation not be found it proves that surface measurements are not accurate. Do the satellite measurements show the same correlation? If they don’t then ‘bingo!” – you’v found the strongest arguments yet that surface measurement are biased by environment. How the heck could 18 months of El Nino increase mean marine temperature by any degree measurable??

Michael C
Reply to  Michael C
January 23, 2016 11:32 am

Much is made of the 98 Spike. If the records are remotely accurate then this deserves much more attention. A spike can only be the result of 2 factors or a combination of both:
A genuine pulse in mean global temperature due to increased energy input or decreased output
A distinct environmental change that resulted in elevated temperature readings within the zones measured that did not reflect the global mean
Either way it appears almost impossible for mean global temperature to increase at the rate shown for 98. Why – the sea. It is a huge energy soak that is comprised of millions of zones and cells measurable on a meter scale. Any swimmer knows this. Measure the mean? Who do they think they are fooling

January 23, 2016 5:29 pm

Another option: not thoroughly enough fabricated …

January 23, 2016 8:39 pm

Dr. Roy Spencer posted radiosonde data in Figure 7 of
http://www.drroyspencer.com/2015/04/version-6-0-of-the-uah-temperature-dataset-released-new-lt-trend-0-11-cdecade
This indicates the surface-adjacent lowest troposphere warmed since 1979 by about .02, maybe .03 degree C per decade more than the satellite-measured lower troposphere.