Guest Post by Willis Eschenbach
In my earlier post about climate models, “Zero Point Three Times The Forcing“, a commenter provided the breakthrough that allowed the analysis of the GISSE climate model as a black box. In a “black box” type of analysis, we know nothing but what goes into the box and what comes out. We don’t know what the black box is doing internally with the input that it has been given. Figure 1 shows the situation of a black box on a shelf in some laboratory.
Figure 1. The CCSM3 climate model seen as a black box, with only the inputs and outputs known.
A “black box” analysis may allow us to discover the “functional equivalent” of whatever might be going on inside the black box. In other words, we may be able to find a simple function that provides the same output as the black box. I thought it might be interesting if I explain how I went about doing this with the CCSM3 model.
First, I went and got the input variables. They are all in the form of “ncdf” files, a standard format that contains both data and metadata. I converted them to annual or monthly averages using the computer language “R”, and saved them as text files. I opened these in Excel, and collected them into one file. I have posted the data up here as an Excel spreadsheet.
Next, I needed the output. The simplest place to get it was the graphic located here. I digitized that data using a digitizing program (I use “GraphClick”, on a Mac computer).
My first procedure in this kind of exercise is to “normalize” or “standardize” the various datasets. This means to adjust each one so that the average is zero, and the standard deviation is one. I use the Excel function ‘STANDARDIZE” for this purpose. This allows me to see all of the data in a common size format. Figure 2 shows those results.
Figure 2. Standardized forcings used by the CCSM 3.0 climate model to hindcast the 20th century temperatures. Dark black line shows the temperature hindcast by the CCSM3 model.
Looking at that, I could see several things. First, the CO2 data has the same general shape as the sulfur, ozone, and methane (CH4) data. Next, the effects of the solar and volcano data were clearly visible in the temperature output signal. This led me to believe that the GHG data, along with the solar and the volcano data, would be enough to replicate the model’s temperature output.
And indeed, this proved to be the case. Using the Excel “Solver” function, I used the formula which (as mentioned above) had been developed through the analysis of the GISS model. This is:
T(n+1) = T(n)+λ ∆F(n+1) * (1- exp( -1 / τ )) + ΔT(n) exp( -1 / τ )
OK, now lets render this equation in English. It looks complex, but it’s not.
T(n) is pronounced “T sub n”. It is the temperature “T” at time “n”. So T sub n plus one, written as T(n+1), is the temperature during the following time period. In this case we’re using years, so it would be the next year’s temperature.
F is the forcing, in watts per square metre. This is the total of all of the forcings under consideration. The same time convention is followed, so F(n) means the forcing “F” in time period “n”.
Delta, or “∆”, means “the change in”. So ∆T(n) is the change in temperature since the previous period, or T(n) minus the previous temperature T(n-1). ∆F(n), correspondingly, is the change in forcing since the previous time period.
Lambda, or “λ”, is the climate sensitivity. And finally tau, or “τ”, is the lag time constant. The time constant establishes the amount of the lag in the response of the system to forcing. And finally, “exp (x)” means the number 2.71828 to the power of x.
So in English, this means that the temperature next year, or T(n+1), is equal to the temperature this year T(n), plus the immediate temperature increase due to the change in forcing λ F(n+1) * (1-exp( -1 / τ )), plus the lag term ΔT(n) exp( -1 / τ ) from the previous forcing. This lag term is necessary because the effects of the changes in forcing are not instantaneous.
Figure 3 shows the final result of that calculation. I used only a subset of the forcings, which were the greenhouse gases (GHGs), the solar, and the volcanic inputs. The size of the others is quite small in terms of forcing potential, so I neglected them in the calculation.
Figure 3. CCSM3 model functional equivalent equation, compared to actual CCSM3 output. The two are almost identical.
As with the GISSE model, we find that the CCSM3 model also slavishly follows the lagged input. The match once again is excellent, with a correlation of 0.995. The values for lambda and tau are also similar to those found during the GISSE investigation.
So what does all of this mean?
Well, the first thing it means is that, just as with the GISSE model, the output temperature of the CCSM3 model is functionally equivalent to a simple, one-line lagged linear transformation of the input forcings.
It also implies that, given that the GISSE and CCSM3 models function in the same way, it is very likely that we will find the same linear dependence of output on input in other climate models.
(Let me add in passing that the CCSM3 model does a very poor job of replicating the historical decline in temperatures from ~ 1945 to ~ 1975 … as did the GISSE model.)
Now, I suppose that if you think the temperature of the planet is simply a linear transformation of the input forcings plus some “natural variations”, those model results might seem reasonable, or at least theoretically sound.
Me, I find the idea of a linear connection between inputs and output in a complex, multiply interconnected, chaotic system like the climate to be a risible fantasy. It is not true of any other complex system that I know of. Why would climate be so simply and mechanistically predictable when other comparable systems are not?
This all highlights what I see as the basic misunderstanding of current climate science. The current climate paradigm, as exemplified by the models, is that the global temperature is a linear function of the forcings. I find this extremely unlikely, from both a theoretical and practical standpoint. This claim is the result of the bad mathematics that I have detailed in “The Cold Equations“. There, erroneous substitutions allow them to cancel everything out of the equation except forcing and temperature … which leads to the false claim that if forcing goes up, temperature must perforce follow in a linear, slavish manner.
As we can see from the failure of both the GISS and the CCSM3 models to replicate the post 1945 cooling, this claim of linearity between forcings and temperatures fails the real-world test as well as the test of common sense.
w.
TECHNICAL NOTES ON THE CONVERSION TO WATTS PER SQUARE METRE
Many of the forcings used by the CCSM3 model are given in units other than watts/square metre. Various conversions were used.
The CO2, CH4, NO2, CFC-11, and CFC-12 values were converted to w/m2 using the various formulas of Myhre as given in Table 3.
Solar forcing was converted to equivalent average forcing by dividing by 4.
The volcanic effect, which CCSM3 gives in total tonnes of mass ejected, has no standard conversion to W/m2. As a result we don’t know what volcanic forcing the CCSM3 model used. Accordingly, I first matched their data to the same W/m2 values as used by the GISSE model. I then adjusted the values iteratively to give the best fit, which resulted in the “Volcanic Adjustment” shown above in Figure 3.
[UPDATE] Steve McIntyre pointed out that I had not given the website for the forcing data. It is available here (registration required, a couple of gigabyte file).
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.
Philip Foster says:
May 14, 2011 at 8:24 am
“have a look at the second expert article regarding simple modelling:
http://www.copenhagenclimatechallenge.org/index.php?option=com_content&view=article&id=52&Itemid=55”
Please don’t assign homework. This is a debate among consenting adults. If you have a point to make, state it. Then you can cite your references. For me, people who assign homework are trying to appear to have something to say when they have nothing to say.
Oh, by the way, earlier I wrote:
“In other words, they don’t even have a record of their judgements (rejiggers) and there is no rational process in place for evaluating judgements (rejiggers). Warmista have a duty to explicate their judgements and permit criticisms of their judgements and their methods of evaluating their judgements.”
In major corporations and the Defense Department and all organizations that use large and complex models for actual decision making, it is standard operating procedure to document all the judgments made about the model. Most discussion and debate about models is about the judgements made during their use. It has to be this way. Otherwise, no one can determine whether a rational process is in place for use of the models. I spent a lot of time trying to explain this to youngish engineers. They wanted numbers only. Eventually, I would just send a name and the word “hopeless” to the VP of engineering.
Margaret says:
May 14, 2011 at 3:21 am
Yes, it is ozone, Margaret. As to whether it is “reasonable”, I don’t know. Certainly the early part (pre-1970) is made of 100% finest quality smoke and mirrors, and the rest doesn’t seem much better.
w.
onion2 says:
May 14, 2011 at 4:59 am
You mean the same way that the temperature of the human body, a comparably complex system, boils down to a simple equation?
Some examples would be useful in supporting your case.
w.
Very interesting, Anthony. I am not so sure about your chaos argument as chaotic systems may still be somewhat estimable if not entirely predictable though the probable complexity of the interactions involved argues in your favor here..
Point in fact, multiple regression analysis can say nothing about cause and effect, so irrespective of the actual formulae, cause is STILL ‘inferred”. Is temperature the effect or the cause? Plus the existence of multicolinearity amongst the independent variables is another pitfall of the models being used to predict climate and causes them to be of much less value. With enough gyrations, as you have proven, a line can be fit to any set of data.
I would be very interested in what some of the other posts have asked regarding what happens in your derived formula when CO2 is taken out or changed?
REPLY: Note the author
Tom in Florida says:
May 14, 2011 at 5:39 am
Yes, it is subjective. These just happen to be the major forcings used by the CCSM3.
w.
Brett says:
May 14, 2011 at 6:11 am
Doesn’t matter what they are actually using (non-linear model, etc.). What matters is their output, which is functionally equivalent to a lagged linear equation, regardless of what calculations the model is actually doing.
w.
Michael J says:
May 14, 2011 at 6:28 am
Michael, it doesn’t matter what they used, so there’s nothing for me to “prove”, and you can’t prove anything in science in any case.
Nor do I care if they carried out their calculations on an abacus and wrote them down in cuneiform, or what equations they actually mistreated to get the result.
The issue is, does the model have a much simpler functional equivalent, and the answer is clearly “Yes”.
w.
PS – I doubt very much if it is “simply coincidental” that the same mathematical model fits both the GISSE and the CCSM3 data … which is why I did this analysis. I wanted to find out if the GISS result was simply by chance. It wasn’t.
Bernie says:
May 14, 2011 at 6:36 am
No, that’s about the standard value. “Lambda” as used for sensitivity is the reciprocal of the normal usage, so the results give a sensitivity on the order of 1.0/0.3 or about 3°C per doubling of CO2. However, their results suggest nothing about the real world, only about Modelworld™.
w.
Jim G says:
May 14, 2011 at 9:20 am
“Point in fact, multiple regression analysis can say nothing about cause and effect, so irrespective of the actual formulae, cause is STILL ‘inferred”. Is temperature the effect or the cause?”
There are no temperatures in nature. Nature does not have temperatures. Temperatures are neither cause nor effect. Temperature is a measure assigned by humans to natural phenomena. The causes and effects are in the natural phenomena but temperature is not. The point is that if you do not understand the causal relationships in the natural phenomena then your attempts to assign temperatures to them are futile.
I don’t mean to pick on you. I think most everyone shares this very common misunderstanding.
Werner Brozek says:
May 14, 2011 at 8:12 am
Werner, there’s no contradiction. The CCSM3 model does do a poor job of replicating history. However, that was not the subject of my analysis, merely a comment in passing.
w.
Jim D says:
May 14, 2011 at 8:48 am
The real climate response is a “simple function of forcing”? Really? Then it should be trivial to predict the climate for the next decade …
Jim D., my point is that we have no evidence that the temperature is a “simple function of forcing”, and we have lots of evidence that it is not such a function.
Nor are such “simple functions” common in other complex systems … which in part is why we call them “complex systems”, because they aren’t run by “simple functions”.
So simply asserting that “climate response is a simple function of forcing” merely shows that you’re not following the story … because whether the climate is even predicable at all, much less by a “simple equation”, is the question, not the answer.
w.
Well done, Willis
Very interesting and understandable.
Looking at the excellent graph for the output of the models [thanks for that Willis] all outputs except the one that freezes CO2 levels at the 2000 level predict about .4 ° C warming from 2000 to 2010.
That didn’t happen [according to GISS] did it?
http://data.giss.nasa.gov/gistemp/graphs/Fig.C.gif
The other surprise is that SESRESB1 predicts an asymptotic approach to 1 ° C maximum warming. What is that input like ? Did it stop further emissions after 2050 or so ?
My main point was, why use the ensemble average? Individual CCSM3 runs give you variability more like current climate, and don’t match the forcing so well. That was why I suggested also using real data, which also won’t match because of internal variability.
The forcing for the next century is certainly going to be dominated by CO2, so, yes, I think this is a good predictor plus or minus a few tenths of a degree if we knew the forcing’s development. Running your model forwards would show this in a very obvious way, especially if you also display the total forcing (or just assumed CO2 forcing) for the next century compared to the last, since CO2 forcing increases fivefold for the 21st century compared to the 20th.
Thanks much for your excellent work, Willis.
The latest version of the model (CCSM4) was recently announced in the abstract below, which contains a remarkable admission that the model exaggerates the global warming from 1850 – 2005 by 0.4C ( ~ 67% more than was observed).
http://journals.ametsoc.org/doi/abs/10.1175/2011JCLI4083.1
Your results seem to suggest that they could have spent a few of those billion dollars on tweaking the forcings a bit better before releasing a model with a clear upward bias.
Might be interesting to compare the forcings used and warming predicted by the two versions to see if climate science continues to devolve.
I noted that much of the projections can be done with eyeball, ruler and pencils. Sad to say, not all of the universe is so complex, or maybe a lot of the complexities don’t matter or cancel out. How simple is the Lorenz contraction equation and E=mc2!
Gee, a citizen might be able to understand, interpret and predict a few things after all. Puts the boots to God-as-politician/scientist/environmentalist, doesn’t it?
Hockey Schtick says:
May 14, 2011 at 10:14 am
“The latest version of the model (CCSM4) was recently announced in the abstract below, which contains a remarkable admission that the model exaggerates the global warming from 1850 – 2005 by 0.4C ( ~ 67% more than was observed).”
Isn’t it true that the data used for the early history, say 1850 to 1900 or so, was collected by Phil Jones and remains under his practical control? Just asking. There was someone during Climategate who had documented this, but I can’t find that documentation now.
The CCSM3 model, like the other 30 or so climate models that simulate global warming are all hard wired using radiative forcing. This is based on a circular set of empirical assumptions:
1) Long term averages of climate variables such as ‘surface temperature’ form some kind of ‘climate equilibrium’ that can be analyzed using perturbation theory.
2) Small changes in downward longwave IR (LWIR) flux can then change the ‘surface temperature’ and be calculated using black body equilibrium assumptions.
3) The meteorological surface air temperature (MSAT) measured in an enclosure at eye level above the ground can be substituted for the real surface temperature (the one ‘under my bare feet’).
4) The observed increase in the long term MSAT record of 1 C as indicated by the ‘hockey stick’ has been caused by a 100 ppm increase in atmospheric CO2 concentration.
5) The increase in downward LWIR flux from 100 ppm of CO2 has produced an increase in downard LIWR flux of 1.7 w.m-2 based on spectroscopic radiative transfer calculations. (correct). This can be used as a ‘calibration factor’ calculate the change in surface temperature from the change in LWIR flux from any greenhouse gas or aerosol. (totally false).
6) Using the ‘calibration factor’ from CO2, an increase in LWIR flux of 1.7 W.m-2 has produced an increase in temperature of 1 C. Linear scaling then indicates that a 1 Wm-2 increase in LWIR flux from any greenhouse gas or other ‘forcing’ agent’ must produce an increase in ‘equilbrium surface temperature’ of 2/3 C.
7) Since an increase of 1.7 W.m-2 of flux comes from a change in ‘surface temperature’ of 0.31 C at an average surface temperature of 15 C (288 K), the other 0.69 C must come from ‘water vapor feedback’. (Radiative forcing is by definition correct and the Laws of Physics must therefore be modified to match the global warming religion)
Yes, the models are just using the hockey stick to predict more hockey stick.
The LWIR greenhouse gas forcings are fixed by the atmospheric concentrations of the greenhouse gases. The aerosol and other forcings and ‘stratospheric’ ozone are used as fudge factors to make the ‘hindcasting’ work.
All of this is buried under lots of fancy fluid dynamics code. However, the Navier Stokes equation is so difficult to solve in climate models that it can be manipulated to give any desired result. (This is called ‘spin up’, to get the models of the ‘right’ track to give the ‘right’ answer).
Willis is indeed correct that the radiative forcing is linear with the temperature change. Its is made that way by Divine Decree from the Global Warming Gods.
Garbage in, Gospel Out.
When is NSF going to stop funding this climate astrology?
Jim D wrote
The forcing for the next century is certainly going to be dominated by CO2, so, yes, I think this is a good predictor plus or minus a few tenths of a degree if we knew the forcing’s development. Running your model forwards would show this in a very obvious way, especially if you also display the total forcing (or just assumed CO2 forcing) for the next century compared to the last, since CO2 forcing increases fivefold for the 21st century compared to the 20th.
*****************
So far it isn’t happening is it ?
http://www.cgd.ucar.edu/ccr/strandwg/CCSM3_AR4_Experiments.html
The model’s start their predictions in 2000. By 2010 they predicted there would be .4 ° C warming which obviously didn’t happen.
Why not ? El Nino’s and La Nina’s balanced out over that period so that can’t be the reason. Did the model fail to included some other variable or is there almost no effect from increased CO2 ? The actual warming from 2000 to 2010 is so close to zero that it is not possible to measure.
So why do you think CO2 will cause more effect in the distant future ?
onion2 says: “I don’t understand what this article proves…”
Correct at last, onoion!
“…After-all the concept of climate sensitivity and forcing implicitly mean global temperature is linearly related to forcings…”
The concept is most likely wrong, then.
“…In unrelated areas too – eg we can fit express the complex motions of planets and moons to the equation G(m1 + m2) / r2…”
Your statement is completely false and demonstrates total ignorance of the application of mathematical relationships to science. But since you think it is true, onoion, show us how to use that equation to derive the orbital elements for, say, Mars. Since you haven’t a clue as to what orbital elements are, I’ll start you on your way: a, e, i, node, omega, and t.
“…Some commenter’s [sic] seem to be confusing the derivation of such a simple equation to fit the behavior as a suitable replacement for the models themselves. As if scientists could have just foregone the millions spent on modeling and instead just used a simple equation….”
Looks like they could have if they’d been as clever as they think they are.
I apologise if I misinterpreted you. I thought you were asserting that the CCSM3 model did in fact use the linear model (or something close to it). It appears I was incorrect.
I wanted to emphasise that just because a linear model will produce the same results for a particular set of inputs, it might not do so for other inputs. But …
In my haste, I didn’t consider that you had matched two different data sets, thus making much more likely that you do have something approaching the same model.
I’m playing devil’s advocate here. Too much pro-agw science leaps to conclusions prematurely and I was trying to ensure that we don’t do the same thing. It looks like there’s nothing to worry about. 🙂
Again, thanks for an interesting post.
netdr, the more typical value, and what would be expected from 3 degrees C per doubling is near 0.2 C per decade, and indeed the 2000’s was nearly 0.2 degrees warmer than the 90’s. I think the 2010’s will exceed the 2000’s by a similar amount, especially since that decade ended up with a soft record to beat by not warming much.
Patrick Frank performed a somewhat similar analysis in 2008 on other models in his article, Climate of Belief, available here: http://www.skeptic.com/reading_room/a-climate-of-belief/
Margaret and Willis it appears to me to be a combination of a couple of small volcanoes just prior to and after 1970 along with the beginning of the large drop in ozone. You’ll note that after 1970 there were similar drops around a couple of large volcanoes as ozone continues to decline.
I have no plausible explanation for how the two small volcanoes and Ozone might be linked to the temp drop.