Some Comments on the Lindzen and Choi (2009) Feedback Study
by Roy W. Spencer, Ph. D.

I keep getting requests to comment on the recent GRL paper by Lindzen and Choi (2009), who computed how satellite-measured net (solar + infrared) radiation in the tropics varied with surface temperature changes over the 15 year period of record of the Earth Radiation Budget Satellite (ERBS, 1985-1999).
The ERBS satellite carried the Earth Radiation Budget Experiment (ERBE) which provided our first decadal-time scale record of quasi-global changes in absorbed solar and emitted infrared energy. Such measurements are critical to our understanding of feedbacks in the climate system, and thus to any estimates of how the climate system responds to anthropogenic greenhouse gas emissions.
The authors showed that satellite-observed radiation loss by the Earth increased dramatically with warming, often in excess of 6 Watts per sq. meter per degree (6 W m-2 K-1). In stark contrast, all of the computerized climate models they examined did just the opposite, with the atmosphere trapping more radiation with warming rather than releasing more.
The implication of their results was clear: most if not all climate models that predict global warming are far too sensitive, and thus produce far too much warming and associated climate change in response to humanity’s carbon dioxide emissions.
A GOOD METHODOLOGY: FOCUS ON THE LARGEST TEMPERATURE CHANGES
One thing I liked about the authors’ analysis is that they examined only those time periods with the largest temperature changes – whether warming or cooling. There is a good reason why one can expect a more accurate estimate of feedback by just focusing on those large temperature changes, rather than blindly treating all time periods equally. The reason is that feedback is the radiation change RESULTING FROM a temperature change. If there is a radiation change, but no temperature change, then the radiation change obviously cannot be due to feedback. Instead, it would be from some internal variation in cloudiness not caused by feedback.
But it also turns out that a non-feedback radiation change causes a time-lagged temperature change which completely obscures the resulting feedback. In other words, it is not possible to measure the feedback in response to a radiatively induced temperature change that can not be accurately quantified (e.g., from chaotic cloud variations in the system). This is the subject of several of my previous blog postings, and is addressed in detail in our new JGR paper — now in review — entitled, “On the Diagnosis of Radiative Feedbacks in the Presence of Unknown Radiative Forcing”, by Spencer and Braswell).
WHAT DO THE AMIP CLIMATE MODEL RESULTS MEAN?
Now for my main concern. Lindzen and Choi examined the AMIP (Atmospheric Model Intercomparison Project) climate model runs, where the sea surface temperatures (SSTs) were specified, and the model atmosphere was then allowed to respond to the specified surface temperature changes. Energy is not conserved in such model experiments since any atmospheric radiative feedback which develops (e.g. a change in vapor or clouds) is not allowed to then feed-back upon the surface temperature, which is what happens in the real world.
Now, this seems like it might actually be a GOOD thing for estimating feedbacks, since (as just mentioned) most feedbacks are the atmospheric response to surface forcing, not the surface response to atmospheric forcing. But the results I have been getting from the fully coupled ocean-atmosphere (CMIP) model runs that the IPCC depends upon for their global warming predictions do NOT show what Lindzen and Choi found in the AMIP model runs. While the authors found decreases in radiation loss with short-term temperature increases, I find that the CMIP models exhibit an INCREASE in radiative loss with short term warming.
In fact, a radiation increase MUST exist for the climate system to be stable, at least in the long term. Even though some of the CMIP models produce a lot of global warming, all of them are still stable in this regard, with net increases in lost radiation with warming (NOTE: If analyzing the transient CMIP runs where CO2 is increased over long periods of time, one must first remove that radiative forcing in order to see the increase in radiative loss).
So, while I tend to agree with the Lindzen and Choi position that the real climate system is much less sensitive than the IPCC climate models suggest, it is not clear to me that their results actually demonstrate this.
ANOTHER VIEW OF THE ERBE DATA
Since I have been doing similar computations with the CERES satellite data, I decided to do my own analysis of the re-calibrated ERBE data that Lindzen and Choi analyzed. Unfortunately, the ERBE data are rather dicey to analyze because the ERBE satellite orbit repeatedly drifted in and out of the day-night (diurnal) cycle. As a result, the ERBE Team advises that one should only analyze 36-day intervals (or some multiple of 36 days) for data over the deep tropics, while 72-day averages are necessary for the full latitudinal extent of the satellite data (60N to 60S latitude).
Lindzen and Choi instead did some multi-month averaging in an apparent effort to get around this ‘aliasing’ problem, but my analysis suggests that the only way around the problem it is to do just what the ERBE Team recommends: deal with 36 day averages (or even multiples of that) for the tropics; 72 day averages for the 60N to 60S latitude band. So it is not clear to me whether the multi-month averaging actually removed the aliased signal from the satellite data. I tried multi-month averaging, too, but got very noisy results.
Next, since they were dealing with multi-month averages, Lindzen and Choi could use available monthly sea surface temperature datasets. But I needed 36-day averages. So, since we have daily tropospheric temperatures from the MSU/AMSU data, I used our (UAH) lower tropospheric temperatures (LT) instead of surface temperatures. Unfortunately, this further complicates any direct comparisons that might be made between my computations (shown below) and those of Lindzen and Choi.
Finally, rather than picking specific periods where the temperature changes were particularly large, like Lindzen and Choi did, I computed results from ALL time periods, but then sorted the results from the largest temperature changes to the smallest. This allows me to compute and plot cumulative average regression slopes from the largest to the smallest temperature changes, so we can see how the diagnosed feedbacks vary as we add more time intervals with progressively weaker temperature changes.
RESULTS
For the 20N-20S latitude band (same as that analyzed by Lindzen and Choi), and at 36-day averaging time, the following figure shows the diagnosed feedback parameters (linear regression slopes) tend to be in the range of 2 to 4 W m-2 K-1, which is considerably smaller than what Lindzen and Choi found, which were often greater than 6 W m-2 K-1. As mentioned above, the corresponding climate model computations they made had the opposite sign, but as I have pointed out, the CMIP models do not, and the real climate system cannot have a net negative feedback parameter and still be stable.
But since the Lindzen and Choi results were for changes on time scales longer than 36 days, next I computed similar statistics for 108-day averages. Once again we see feedback diagnoses in the range of 2 to 4 W m-2 K-1:
Finally, I extended the time averaging to 180 days (five 36-day periods), which is probably closest to the time averaging that Lindzen and Choi employed. But rather than getting closer to the higher feedback parameter values they found, the result is instead somewhat lower, around 2 W m-2 K-1.
In all of these figures, running (not independent) averages were computed, always separated by the next average by 36 days.
By way of comparison, the IPCC CMIP (coupled ocean-atmosphere) models show long-term feedbacks generally in the range of 1 to 2 W m-2 K-1. So, my ERBE results are not that different from the models. BUT..it should be remembered that: (1) the satellite results here (and those of Lindzen and Choi) are for just the tropics, while the model feedbacks are for global averages; and (2) it has not yet been demonstrated that short-term feedbacks in the real climate system (or in the models) are substantially the same as the long-term feedbacks.
WHAT DOES ALL THIS MEAN?
It is not clear to me just what the Lindzen and Choi results mean in the context of long-term feedbacks (and thus climate sensitivity). I’ve been sitting on the above analysis for weeks since (1) I am not completely comfortable with their averaging of the satellite data, (2) I get such different results for feedback parameters than they got; and (3) it is not clear whether their analysis of AMIP model output really does relate to feedbacks in those models, especially since my analysis (as yet unpublished) of the more realistic CMIP models gives very different results.
Of course, since the above analysis is not peer-reviewed and published, it might be worth no more than what you paid for it. But I predict that Lindzen and Choi will eventually be challenged by other researchers who will do their own analysis of the ERBE data, possibly like that I have outlined above, and then publish conclusions that are quite divergent from the authors’ conclusions.
In any event, I don’t think the question of exactly what feedbacks are exhibited by the ERBE satellite is anywhere close to being settled.
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.



Cheez, that ERBE sat. looks like something out of Jules Verne.
Does anybody here have a good understanding of how this study compares with the similar (and earlier) study of Ferenc Miskolczi?
see: http://www.youtube.com/watch?v=Ykgg9m-7FK4
Good. Those scientists who might generally be described as skeptics are auditing each other. I hope Drs. Lindzen and Choi respond.
Vincit omnia veritas.
(1) I am not completely comfortable with their averaging of the satellite data, (2) I get such different results for feedback parameters than they got
I know it’s a big thing to expect, but I hope to see both Richard Lindzen and Yong-Sang Choi here to first give their reasons, and then discuss them with Roy Spencer.
I would expect it would be a congenial interchange.
If I had only known I would need feedback and control system knowledge so desperately these days I would have paid a lot more attention. Who knew the world would go insane?
Kudos to those who did pay attention.
Dr. Spencer,
You said
“the real climate system cannot have a net negative feedback parameter and still be stable”
I think you meant net positive feedback.
On the Beck show Monckton said that the Lindzen paper proved the ipcc models to be in error, this seems to muddy the waters still further.
I thought the same as K. Kitty above that Roy Spencer meant net positive feedback, anyone else?
I too hope that Dr’s Lindzen and Choi will discuss their findings with Dr. Spencer on this blog. I would pay for admission to read the thoughts of these honest and brilliant scientists on this important subject.
Another thought I have, why not run their discussion, if they agree, on a thread that does require a fee to read. Split the proceeds between this blog and the 3 scientists. I would pay at least $20 for a seat in the audience.
He meant in the sense that the slope corresponds inversely to the feedback, so the parameter (slope) has the opposite sign.
A system which responds to warming by slowing infrared cooling further is essentially the climatological equivalent of a divide by zero error. The “no feedback” situation is in fact one in which the normal behavior between radiation and temperature occurs, namely that hotter bodies emit more IR. In more typical terms, this would in fact be called a “negative” feedback. See here:
http://www.drroyspencer.com/2009/04/when-is-positive-feedback-really-negative-feedback/
Sorry I meant K. Kilty not Kitty.
Gee, maybe that atmospheric window straight into space (and even through light cloud cover!) at 10 um (and +- a couple um) and coinciding with the LWIR peak from avg 288K earth and total radiation ~ T_to_the_fourth_power has something to do with it.
Naw …. just a lucky coincidence …
.
.
.
Has all the appearance of an intake manifold for an in-line four-cylinder engine …
.
.
.
RE evanmjones (19:27:51) :
“Cheez, that ERBE sat. looks like something out of Jules Verne.”
I reckon those two big plates on the top are actually the FLUX CAPACITOR.
And, related and therefore on topic –
If you know where to look for the DFW Metrplex (Dallas Ft Worth and mid-citied et al) they can be seen to be WARMER in this three hour sequence of images this evening (after sunset, from 7:15 ish till 10:15 ish PM local) owing to the UHI effect on this very still (wind-wise) evening:
Centered on Texas – LWIR (Long Wave Infra-Red) Satellite Image
I think that Oklahoma City metro area can also be seen ‘warmer’ than surroundings.
.
.
.
theduke said: vincit omnia veritas.
If it does, it takes its sweet time. Meanwhile, vincit prope omnis veritatem.
Thanks for taking the time to post your analysis and the interesting points you raise. I look forward to a reasoned debate – both you and Lindzen have shown how it can be done at this site.
I predict that McIntyre will find the Lindzen and Choi paper one of the most quietly disturbing papers he has ever read.
There have been reports in the peer review literature that the models violate the second law of thermodynamics, maybe the disagreement is part of this? After all numerical simulations have to be violating lots of things and brought into line at the boundaries of the grids used.
More to the point,
In my mind, the importance of the Lidzen paper is not if it really is measuring the sensitivity to whatever forcings. It is if they have used the models in the same way as they have used the data when making the crucial scatter plots.
If so, then the models are falsified, no matter if what is displayed is the true sensitivity . The scatter plots show a drastic difference between models and data. These might only be the AMIP models and these are then falsified. Somebody said that the AMIP models are embedded in the CMIP models but I was not able to find the reference.
Secondly, if the difference is between CMIP and AMIP model runs, I would like to see the same scatter plot of the CMIP runs as the crucial ones in the Lidzen presentation.
bugs,
your predictions are usually wrong. I feel better already!!
HAHAHAHAHAHAHA
Interesting to see that these two ‘skeptic’ scientists that so often agreed in the past now start to divert in opinion. What I find especially stunning about Dr. Spencer’s report is that he disputes all 3 main conclusions that Lindzen drew in his so widely publicised GRL paper. Spencer essentially states that :
(1) The ERBE data shows no significant climate feedback (as opposed to Lindzen who still concludes a strong negative feedback factor).
(2) The AMIP models that Lindzen used are not suitable for comparison with ERBE data, redering Lindzen’s famous (“infamous”?) ERBE-model figure useless
(3) The short term analysis done makes conclusions on any climate sensitivity factor questionable.
Note that here is the blog that first revealed the difference in results for at least (1) and (2) :
http://motls.blogspot.com/2009/11/spencer-on-lindzen-choi.html
There should be much more to to come on this, since especially the difference in feedback factor that the two scientists find from essentially the same data is not at all adequately explained.
Found the reference. So AMIP is included as an integral part in CMIP.
http://www-pcmdi.llnl.gov/projects/model_intercomparison.php
“AMIP – Atmospheric Model Intercomparison Project
AMIP is a standard experimental protocol for global atmospheric general circulation models (AGCMs). It provides a community-based infrastructure in support of climate model diagnosis, validation, intercomparison, documentation and data access. This framework enables a diverse community of scientists to analyze AGCMs in a systematic fashion, a process which serves to facilitate model improvement. Virtually the entire international climate modeling community has participated in this project since its inception in 1990.
CMIP – Coupled Model Intercomparison Project
The Coupled Model Intercomparison Project (CMIP) studies output from coupled ocean-atmosphere general circulation models that also include interactive sea ice. These models allow the simulated climate to adjust to changes in climate forcing, such as increasing atmospheric carbon dioxide. CMIP began in 1995 by collecting output from model “control runs” in which climate forcing is held constant. Later versions of CMIP have collected output from an idealized scenario of global warming, with atmospheric CO2 increasing at the rate of 1% per year until it doubles at about Year 70. CMIP output is available for study by approved diagnostic sub-projects. The WCRP CMIP3 multi-model dataset archived at PCMDI, which includes realistic scenarios for both past and present climate forcing, is the latest and most ambitious phase of the project. The research based on this dataset has provided much of the new material underlying the IPCC 4th Assessment Report.”
http://www-pcmdi.llnl.gov/projects/amip/index.php
“AMIP is now an integral part of CMIP
AMIP-style simulations are routinely performed at many climate and NWP centers during model development in order to evaluate atmospheric model performance and identify errors. The systematic intercomparison of atmospheric model components is currently being coordinated under the Coupled Model Intercomparison Project (CMIP), which includes AMIP simulations as an integral part.”
Let me phrase it differently:
I sit on the moon and every time there is a DeltaSST on the earth I look at the DeltaFlux , or vice versa, I make a point on the scatter plot. The scatter plot does not have cause and effect, because it does not record time.
I run a computer model ( or it has been run and stored in the system linked above) and look from the same place on the moon and every time there is a DeltaSST on the earth I look at the DeltaFlux , or vice versa, I make a point on the scatter plot.
Lindzen’s plots show a drastic difference between data and models for AMIP runs.
AMIPS are to go back to the drawing board.
Now we see that AMIPs are an “integral part of CMIPs”. What can we conclude?
If I understood it well, coupled model (CMIP) says with increasing surface temperature, there is more IR being emitted out. Lindzen AMIP model shows the opposite – that with the rising surface temperature, the atmosphere (probably because of thickening with water vapor as a secondary positive feedback) blocks the outgoing radiation much more, that it even decreases in time.
Dr Spencer also says that CMIP´s calculated increase of outgoing radiation is not that far from observed reality, while the outgoing IR is a bit higher.
Drs. Spencer and Lindzen & Choi (L&C) may both be right.
L&C may have chosen the AMIP models, rather than the CMIP models examined by Spencer, because they attempt to portray only the radiative response of the atmosphere to changes in surface temperatures, without regard for the additional feedbacks and other complexities introduced with the fully coupled (CMIP) models.
According to Lumo on The Reference Frame, Spencer said he had “examined the AMIP run for the CNRM CM3 model, and it, too, shows a negative slope between temperature and radiative flux, just as Lindzen and Choi found. So, the problem might NOT be neglect of the sigma*T^4 effect, which [he] believe[s] is already contained in the AMIP model fields.”
http://motls.blogspot.com/2009/11/spencer-on-lindzen-choi.html
The AMIP models are “integral components” of the CMIP models. So perhaps the CMIPs include some factors which offset the impossible negative slopes of their AMIP components, yielding the required net negative feedback, but one which is smaller than it should be.
There still remain questions about the proper averaging intervals and the difference in the temperature datasets used (Spencer used LT, L&C used SST).