UAH, RSS, NOAA, UW: Which Satellite Dataset Should We Believe?

Reposted from Dr. Roy Spencer’s Blog

April 23rd, 2019 by Roy W. Spencer, Ph. D.

This post has two related parts. The first has to do with the recently published study of AIRS satellite-based surface skin temperature trends. The second is our response to a rather nasty Twitter comment maligning our UAH global temperature dataset that was a response to that study.

The AIRS Study

NASA’s Atmospheric InfraRed Sounder (AIRS) has thousands of infrared channels and has provided a large quantity of new remote sensing information since the launch of the Aqua satellite in early 2002. AIRS has even demonstrated how increasing CO2 in the last 15+ years has reduced the infrared cooling to outer space at the wavelengths impacted by CO2 emission and absorption, the first observational evidence I am aware of that increasing CO2 can alter — however minimally — the global energy budget.

The challenge for AIRS as a global warming monitoring instrument is that it is cloud-limited, a problem that worsens as one gets closer to the surface of the Earth. It can only measure surface skin temperatures when there are essentially no clouds present. The skin temperature is still “retrieved” in partly- (and even mostly-) cloudy conditions from other channels higher up in the atmosphere, and with “cloud clearing” algorithms, but these exotic numerical exercises can never get around the fact that the surface skin temperature can only be observed with satellite infrared measurements when no clouds are present.

Then there is the additional problem of comparing surface skin temperatures to traditional 2 meter air temperatures, especially over land. There will be large biases at the 1:30 a.m./p.m. observation times of AIRS. But I would think that climate trends in skin temperature should be reasonably close to trends in air temperature, so this is not a serious concern with me (although Roger Pielke, Sr. disagrees with me on this).

The new paper by Susskind et al. describes a 15-year dataset of global surface skin temperatures from the AIRS instrument on NASA’s Aqua satellite. ScienceDaily proclaimed that the study “verified global warming trends“, even though the period addressed (15 years) is too short to say much of anything much of value about global warming trends, especially since there was a record-setting warm El Nino near the end of that period.

Furthermore, that period (January 2003 through December 2017) shows significant warming even in our UAH lower tropospheric temperature (LT) data, with a trend 0.01 warmer than the “gold standard” HadCRUT4 surface temperature dataset (all deg. C/decade):

AIRS: +0.24
GISTEMP: +0.22
ECMWF: +0.20
Cowtan & Way: +0.19
UAH LT: +0.18
HadCRUT4: +0.17

I’m pretty sure the Susskind et al. paper was meant to prop up Gavin Schmidt’s GISTEMP dataset, which generally shows greater warming trends than the HadCRUT4 dataset that the IPCC tends to favor more. It remains to be seen whether the AIRS skin temperature dataset, with its “clear sky bias”, will be accepted as a way to monitor global temperature trends into the future.

What Satellite Dataset Should We Believe?

Of course, the short period of record of the AIRS dataset means that it really can’t address the pre-2003 adjustments made to the various global temperature datasets which significantly impact temperature trends computed with 40+ years of data.

What I want to specifically address here is a public comment made by Dr. Scott Denning on Twitter, maligning our (UAH) satellite dataset. He was responding to someone who objected to the new study, claiming our UAH satellite data shows minimal warming. While the person posting this objection didn’t have his numbers right (and as seen above, our trend even agrees with HadCRUT4 over the 2003-2017 period), Denning took it upon himself to take a swipe at us (see his large-font response, below):

First of all, I have no idea what Scott is talking about when he lists “towers” and “aircraft”…there has been no comprehensive comparisons of such data sources to global satellite data, mainly because there isn’t nearly enough geographic coverage by towers and aircraft.

Secondly, in the 25+ years that John Christy and I have pioneered the methods that others now use, we made only one “error” (found by RSS, and which we promptly fixed, having to do with an early diurnal drift adjustment). The additional finding by RSS of the orbit decay effect was not an “error” on our part any more than our finding of the “instrument body temperature effect” was an error on their part. All satellite datasets now include adjustments for both of these effects.

Nevertheless, as many of you know, our UAH dataset is now considered the “outlier” among the satellite datasets (which also include RSS, NOAA, and U. of Washington), with the least amount of global-average warming since 1979 (although we agree better in the tropics, where little warming has occurred). So let’s address the remaining claim of Scott Denning’s: that we disagree with independent data.

The only direct comparisons to satellite-based deep-layer temperatures are from radiosondes and global reanalysis datasets (which include all meteorological observations in a physically consistent fashion). What we will find is that RSS, NOAA, and UW have remaining errors in their datasets which they refuse to make adjustments for.

From late 1998 through 2004, there were two satellites operating: NOAA-14 with the last of the old MSU series of instruments on it, and NOAA-15 with the first new AMSU instrument on it. In the latter half of this overlap period there was considerable disagreement that developed between the two satellites. Since the older MSU was known to have a substantial measurement dependence on the physical temperature of the instrument (a problem fixed on the AMSU), and the NOAA-14 satellite carrying that MSU had drifted much farther in local observation time than any of the previous satellites, we chose to cut off the NOAA-14 processing when it started disagreeing substantially with AMSU. (Engineer James Shiue at NASA/Goddard once described the new AMSU as the “Cadillac” of well-calibrated microwave temperature sounders).

Despite the most obvious explanation that the NOAA-14 MSU was no longer usable, RSS, NOAA, and UW continue to use all of the NOAA-14 data through its entire lifetime and treat it as just as accurate as NOAA-15 AMSU data. Since NOAA-14 was warming significantly relative to NOAA-15, this puts a stronger warming trend into their satellite datasets, raising the temperature of all subsequent satellites’ measurements after about 2000.

But rather than just asserting the new AMSU should be believed over the old (drifting) MSU, let’s look at some data. Since Scott Denning mentions weather balloon (radiosonde) data, let’s look at our published comparisons between the 4 satellite datasets and radiosondes (as well as global reanalysis datasets) and see who agrees with independent data the best:

Sat-datasets-vs-sondes-reanalyses-tropics-Christy-et-al-2018-550x413

Trend differences 1979-2005 between 4 satellite datasets and either radiosondes (blue) or reanalyses (red) for the MSU2/AMSU5 tropospheric channel in the tropics. The balloon trends are calculated from the subset of gripoints where the radiosonde stations are located, whereas the reanalyses contain complete coverage of the tropics. For direct comparisons of full versus station-only grids see the paper.

Clearly, the RSS, NOAA, and UW satellite datasets are the outliers when it comes to comparisons to radiosondes and reanalyses, having too much warming compared to independent data.

But you might ask, why do those 3 satellite datasets agree so well with each other? Mainly because UW and NOAA have largely followed the RSS lead… using NOAA-14 data even when its calibration was drifting, and using similar strategies for diurnal drift adjustments. Thus, NOAA and UW are, to a first approximation, slightly altered versions of the RSS dataset.

Maybe Scott Denning was just having a bad day. In the past, he has been reasonable, being the only climate “alarmist” willing to speak at a Heartland climate conference. Or maybe he has since been pressured into toeing the alarmist line, and not being allowed to wander off the reservation.

In any event, I felt compelled to defend our work in response to what I consider (and the evidence shows) to be an unfair and inaccurate attack in social media of our UAH dataset.

5 2 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

150 Comments
Inline Feedbacks
View all comments
Michael S. Kelly LS BSA, Ret
April 26, 2019 3:48 am

I think any “scientist” who posts on Twitter should be exiled from the scientific community. After enduring so much sanctimony about “peer review” from these numb skulls, I really can’t brook their taking to a propaganda platform to issue “scientific” opinions.

Bindidon
Reply to  Michael S. Kelly LS BSA, Ret
April 26, 2019 1:26 pm

But luckily you don’t think any “president” who posts on Twitter should be impeached.

Dave Fair
Reply to  Bindidon
April 26, 2019 1:45 pm

It is a method to bypass the approximately 90% of the media that viscerally hates him.

MJB
April 26, 2019 5:24 am

Thank you Dr. Spencer for another informative and timely post. I feel compelled to offer a word of advice on your use of the phrase “wander off the reservation”.

The origins of this phrase are quite dark, referring of course to Indian Reservations, and a time when it was illegal to leave without permission, in some cases shot when found.

You are of course free to use whatever phrases you choose in your own posts, I realize the meaning has morphed now into referencing departure from the party line not an actual reservation, and I am generally not one for pandering political correctness, but wanted to let you know how deep this still cuts for some people.

icisil
Reply to  MJB
April 26, 2019 6:03 am

Claiming to eschew PC while facilitating PC. Lame

Dave Fair
Reply to  MJB
April 26, 2019 10:34 am

My ancestry is Cherokee, and I don’t take offense at ‘off the reservation.’ PC should be changed to PS; Professional Scold.

Elizabeth Warren has taken the bloom off claiming Cherokee ancestry. My great grandmother, however, registered herself, white husband and my grandfather at the turn of the 19th – 20th Centuries. Official BIA records of what led to their eventual divorce are hilarious.

pochas94
April 26, 2019 5:53 am

Denning’s nasty tweet is a sign his feedbag is running low.

Pamela Gray
April 26, 2019 6:52 am

This whole thing reminds me of the sun spot data. It takes leadership to form a group willing to put bias aside and work together to clean up a record filled with this person’s adjustment and that person’s adjustment to the count. Was it controversial? You bet. Still is. But at least it was done, collegially or not. And they put their names out there for all to see that they participated. That said, I would imagine they trucked in whole boxes of antacid whenever they met.

April 26, 2019 9:24 am

Testing IPCC’s Tropospheric Tropical Temperature anthropogenic signature prediction against data see:
McKitrick, R. and Christy, J., 2018. A Test of the Tropical 200‐to 300‐hPa Warming Rate in Climate Models. Earth and Space Science, 5(9), pp.529-536. https://bit.ly/2wFXtRN
Varotsos, C.A. and Efstathiou, M.N., 2019. Has global warming already arrived? Journal of Atmospheric and Solar-Terrestrial Physics, 182, pp.31-38. https://bit.ly/2CQBAT8
Popular summary: “Nature is NOT obeying the models.
Scientific summary: the models failed the validation against radiosonde and satellite data.

DWR54
April 26, 2019 3:24 pm

Dr Spencer says:

Furthermore, that period (January 2003 through December 2017) shows significant warming even in our UAH lower tropospheric temperature (LT) data, with a trend 0.01 warmer than the “gold standard” HadCRUT4 surface temperature dataset…

The wording here isn’t strictly accurate. The best estimate warming trend in UAH LT between 2003 and 2017 may be similar to that in HadCRUT4, but when error margins are taken into account only the HadCRUT4 trend is ‘significant’ (in a statistical sense).

HadCRUT4: 0.17 ±0.15 °C/decade (2σ)
UAH LT: 0.18 ±0.24 °C/decade (2σ)

http://www.ysbl.york.ac.uk/~cowtan/applets/trend/trend.html

The 2σ margin of error in UAH is wider than the best estimate trend, so not ‘statistically significant’; whereas the warming trend in HadCRUT4 is statistically significant.

Dr Spencer may be right to say that 15 years is too short a period to say much of value about global warming trends (though some folks around here seem to think that ~ 3 is plenty – so long as the trend is in a cooling direction!); nevertheless, it’s still possible to get a statistically significant trend (i.e. one with a less than 1 in 20 chance of occurring by chance, all other things being equal) over such a relatively short period.

Dave Fair
Reply to  DWR54
April 26, 2019 3:50 pm

In the absence of another big El Nino, the mid-2020’s should tell the trick. Otherwise, the only trend of interest would be a trend over at least 100 years. The multi-millennial trend shows cooling.

Richard M
Reply to  DWR54
April 27, 2019 8:29 am

DWR54, using a super El Nino to create a trend is going to come back to haunt folks like you. Right now the trend over the past 3 years is -1.2 C / decade. That means in around 7 more years all the warming of the past 150 years will disappear … right?

DWR54
Reply to  Richard M
April 29, 2019 1:04 am

Richard M

Right now the trend over the past 3 years is -1.2 C / decade. That means in around 7 more years all the warming of the past 150 years will disappear … right?

That was the logic used by Allan Macrae back in 2008 in his ICECAP article linked to above. That a short period of recent below average temperatures (again, following and El Nino high) could be used to claim that past warming had “disappeared!”.

Needless to say it is not a line of reasoning I agree with, because it covers such a short period over the total data set and because it ignores the enormous trend uncertainty that such a limited amount of data generates. (In your example, over the past ~3 years (since Jan 2016) the trend in UAH is -1.12 °C/decade, but the uncertainty is ±1.8 °C/decade (2σ). The uncertainty is greater than the estimate, so the trend is not significant.)

I hope I have been consistent in using the 30-year trend as my guiding metric, whether in satellite or surface data. In that case the 30-year trend in UAH up to 2016 (1986-2015 inc.) was 0.10 ±0.09 °C/decade (2σ); whereas in the 30-year trend in UAH to the latest month, Apr 1989-Mar 2019, is 0.13 ±0.09 °C/decade (2σ). So although the past few years show strong ‘best estimate’ cooling in UAH, overall the 30-year period ended March 2019 is considerably warmer than the 30-year period ended Dec 2015; although both periods show statistically significant warming.

Bindidon
Reply to  DWR54
April 27, 2019 11:12 am

DWR 54, Richard M

While I clearly disagree about DWR’s pedantic attitude (the REAL significance of 0.17 ±0.15 is imho by no means higher than that of 0.18 ±0.24), I think it is necessary to reply to Richard M’s comment as well.

Here is a chart showing, for UAH6.0 LT, the running 3 year trend, of course starting 3 years after begin:
https://drive.google.com/file/d/10va8z2uyS1kn-Wj3az_aTDukLsA1EHwt/view

As you easily can see, this trend time series shows four periods with a 3 year trend even below -1.38 °C / decade (i.e. a good bit below these -1.2 Richard M wrote about).

Rien de nouveau à l’Ouest!
So what…

Thus yes, Richard M: this superficial view over such a small period indeed “is going to come back to haunt you”.

Richard M
Reply to  Bindidon
April 28, 2019 7:25 am

The point was that trends are often the result of ENSO. I guess that went right over your head.

DWR54
Reply to  Richard M
April 29, 2019 1:08 am

Richard M

What period do you use as your metric for adjudging temperature trends? 30-years is the WMO one.

Richard M
Reply to  DWR54
April 30, 2019 9:09 am

Even 30 years is too short given the ocean cycles. Since we don’t have reasonable data that far back we are essentially in the situation where we must look for ways of removing noise from the data.

When I did this to the satellite data (removed the effect of ENSO, the AMO/PDO and volcanoes) I ended up with about .06 C / decade. However, that ignores the fact there was either cooling or at least no warming for the 40 prior years. No warming then halves this trend over the last 80 years.

The results are .03 C / decade which fits very well with the warming from the depths of the LIA which must have been natural. Hence, there is zero evidence of any warming which isn’t natural.

DWR54
Reply to  Bindidon
April 29, 2019 1:15 am

Bindidon

While I clearly disagree about DWR’s pedantic attitude (the REAL significance of 0.17 ±0.15 is imho by no means higher than that of 0.18 ±0.24)…

Well, the significance cut-off has to come somewhere. 2σ, or >95% confidence is the generally accepted scientific norm. I didn’t just make it up.

A trend of 0.17 ±0.15 tells us that even if we take into account the mathematical uncertainty inherent in the time series, we would *still* end up with a warming trend and that the chances of that happening in such a time series, all other things being equal, is less than 1 in 20.

A trend of 0.18 ±0.24 fails that test, so by the normal scientific standard (which may indeed be pedantic) there is a ‘significant’ difference between the two trends.

DWR54
Reply to  DWR54
April 29, 2019 1:30 am

P.S. Perhaps the term ‘statistically detectable’ might be more appropriate than ‘statistically significant’, since the warming fraction remaining after deduction of the error range is very small (+0.02 C per decade); whereas ‘significant’ makes it sound more pronounced than it actually is. However, I don’t make the terminology up either!

David Stone
April 30, 2019 1:58 am

The fact that there are differing data sets at all is interesting. If we were measuring reality by each set, the values would differ only by the instrumentation errors. So the difference between the sets (the maximum difference) shows the total instrumental measurement error, which is sufficient to invalidate ALL the data sets! I don’t think that the marked error bands show anything very useful, the real ones are huge compared with the claimed changes in temperature. Remember the scientific method demands that repeated experimental results are identical within the experimental errors, and that differing experimental techniques are expected to give the same results. Climate “science” does not display any of these characteristics, so must be invalid. The statistics are not relevant to this argument, it is all about repeatable results.

April 30, 2019 4:55 pm

Ok, Ok… now, why do they stop at 2003? It’s because that is when the “Pause” began with no net warming over the period. Let’s look at THOSE years!