# Chaos & Climate – Part 2: Chaos = Stability

Guest Essay by Kip Hansen

“…we should recognise that we are dealing with a coupled non-linear chaotic system, and therefore that the long-term prediction of future climate states is not possible.”

– IPCC TAR Chap 14, Exec Summary

Introduction:

The IPCC has long recognized that the Earth’s climate system is a coupled non-linear chaotic system.   Unfortunately, few of those dealing in climate science – professional and citizen scientists alike – seem to grasp the full implications of this. It is not an easy topic – not a topic on which one can read a quick primer and then dive into real world applications.   This essay is the second in a short series of essays to clarify the possible relationships between Climate and Chaos. This is not a highly technical discussion, but a basic introduction to the subject to shed some light on just what the IPCC might mean when it says “we are dealing with a coupled non-linear chaotic system” and how that could change our understanding of the climate and climate science.  The first part of this series is here: Chaos and Climate – Part 1: Linearity. Today’s essay covers a single common feature of non-linear chaotic systems: Stability.

Definition:

For the purpose of this essay, I use the following definition of a non-linear system:

Non-linear system: A system in which alterations of an initial state need not produce proportional alterations in any subsequent states; one that is not linear.

This broadly general, non-technical, definition is taken from The Essence of Chaos written by Edward Lorenz, the father of chaos theory. From Lorenz’s introduction to that book: “Some thirty years previously [1960], while conducting an extensive experiment in the theory of weather forecasting, I had come across a phenomena that later came to be called ‘chaos’ – seemingly random and unpredictable behavior that nevertheless proceeds according to precise and often easily expressed rules”.

I note for those with a more technical bent that there are many other definitions of “non-linear” and “non-linear systems” – in mathematics, physics, and engineering.   But, as I said, this is not a technical discussion, but a practical discussion.   One will find that for application to the field of weather and climate, Lorenz’s definition is perfectly suitable. Although Lorenz made the following statement about a loose definition of “chaos”, it might be applied to his definition of “non-linear system” as well: “My somewhat colloquial definition may capture the essence of chaos [non-linear systems], but it would cause many mathematicians to shudder” [one might add: philosophers, statisticians and engineers].

Let’s note a few things about the definition before we get too far:

The first is that it speaks of altering an initial state, the state from which the system begins. In a dynamic system, the initial state can be “at the start of our experiment” or, more often, it is the state of a dynamic system at any given instant as the “initial state” for either the next instant or any subsequent length of time the observer or experimenter might want to consider; today’s weather as the initial state for the prediction of tomorrow’s weather, today’s weather for the calculation of the expected climate a hundred years from now, today’s market-close prices on the stock exchange for the starting prices tomorrow and/or the state of the economy next year,    exactly where one starts the ball rolling down a hill and how hard one pushes it to get it started. All these can be seen as initial states.

Lorenz says “alterations of an initial state need not produce proportional alterations in any subsequent state”. It is important to note that he does not say that alterations do not, he does not say alterations can not, but rather, need not “produce proportional alterations in any subsequent state”.   (Proportionality sets non-linear systems apart from linear systems in which alterations in the initial state necessarily produce proportional alterations in subsequent states.) This allows that small changes in initial states may produce small changes in subsequent states, they can, but they don’t have to. In other words, they need not….they might, they may, they could, and in fact often do, produce large changes in subsequent states.

How this simple definition plays out in the real world is the subject that came to be erroneously called Chaos Theory. Erroneously because it is not a theory at all, but a broad field of study that evolved, in a practical sense, from Lorenz’s discovery and his subsequent paper Deterministic Nonperiodic Flow, published in 1963 in the Journal of Atmospheric Sciences. [While the majority of this paper is highly technical and requires advanced maths skills, the link is to a .pdf and I highly recommend reading at least the first two paragraphs of the Conclusion section of this paper – which is easily understood by laymen such as I.]

In the following sections, I will lay out just one of the common features of the behaviors found in non-linear, dynamic systems. The fact that there are common features may seem counter-intuitive – one may object to the idea that non-linear systems that produce chaotic, unpredictable results could have common features. The fact that they do is what attracted my attention to ‘Chaos Theory’ in the first place. For those of you who have doubts – please take the time to find out for yourself by reading Dr. Lorenz’s book linked above, or either James Gleick’s CHAOS – Making a New Science or Ian Stewart’s Does God Play Dice?. Or at a minimum, take a quick read through the Wiki page on chaos theory which will give you enough information to benefit from this essay.

Stability — A Common Feature of Non-linear Chaotic Systems

Listing stability as the first of these common features might come as a surprise to many who are familiar with non-linear systems and chaos – but not to engineers. As we were told in the comments of Part 1 of this series, engineers use designs, out of necessity, which are based on non-linear equations all the time and find them perfectly stable. One of the more savvy engineers pointed out that engineers, as a class, are naturally well aware of the instabilities – the turbulences – that can develop in non-linear systems, and so use values for those systems that are well below the points which tend to devolve into turbulence or instability. Thus knowingly or not, they are taking advantage of this property of chaotic, non-linear systems: Stability.

In a comment to Part 1 of this series, Leo Smith wrote:

“In fact, as practicing engineers we go to enormous lengths to keep our systems linear, or if we can’t arrange that, at least keep them out of chaotic regions. One designs a car to get to journey’s end, not fly into a thousand pieces at the first corner.

…. the general case of a non linear dynamic system is that if it does exist in nature, its probably chaotic. Linear and non-chaotic non-linear systems are very much the minority in Nature, but of course, because engineers seek predictability, they are the rule in most engineering.”

This image, similar to the one used as the introductory image today, helps us to understand this point. I’m afraid you’ll have to trust me for the time being that this graph is common to many [all?] non-linear, chaotic systems in the real world – I admit that it doesn’t seem reasonable – but a great deal of research has been done on it over the last 50 years, and it is so. Versions of this diagram appear in all of the studied real world dynamical systems that I am aware of … I give just one example further on.

Figure 1: “Bifurcation diagram of the logistic map xr x (1 – x). Each vertical slice shows the attractor for a specific value of r. The diagram displays period-doubling as r increases, eventually producing chaos.”

The line that extends to the left of the graph continues as a single line, sloping in a curve downward as r approaches 1 (see the graphic at the beginning of the essay).

When we graph this equation — xr x (1 – x) — with a beginning “r” of 2.8, and an initial state value of 0.2, this is what we find:

Even though the starting value for x is 0.2, iterating the system causes the value to x to settle down to a value between 0.6 and 0.7 – more precisely 0.64285 — after 50 or so iterations. Jumping in at the 50th iteration, and forcing the value out of line, down to 0.077 (below) causes a brief disturbance, but the value of x returns to precisely 0.64285 in a short time:

Kicking the value out of line upward at year 100 has a similar result. Adjusting the “r”, the forcing value, down a bit at year 150 brings the stable attractor lower, yet the behavior remains stable, as always.

Refer to Figure 1, the bifurcation diagram, to see that the value 2.8 for r corresponds with a value of x of 0.64285. Had we used 2.4 for r, the stable value of x would have been 0.58333.   All of the values from 1 approaching 3 produce a stable single value result.

This single value result is an “attractor” for the system. An easy way to think of a single attractor is to think of a funnel.  Liquid poured anywhere inside the rim will be drawn to the bottom (by gravity) and exit in one, and only one location, the spout.

Alternately, consider the bowl. A marble placed anywhere inside the rim and released will roll to the bottom – it may roll around a bit, up the other side and then down again, but eventually comes to rest at the bottom of the bowl – that space, the bottom of the bowl, is the single attractor for that dynamic system.

When I was a kid, we had a nut bowl similar to the one pictured above, except that ours had a common rim that was 2 inches higher than the interior separators. We spent hours rolling marbles down the side from different points, like the ball in a roulette wheel, betting on which depression the marble would end up in. This nut bowl, with four separate bottoms but a common rim could be said to have four marble attractors. A roulette wheel could be said to have 37 attractors, 0 through 36 (or 38 in Las Vegas, where there is an additional 00 position).

We will take up the subject of attractors in a later part of this series but we should understand that the characteristic of stability in non-linear dynamics stems from the function of attractors. The bifurcation diagram gives the attractor for each value or “r” from 2.4 to 4.0. Some regions have a single value attractor, many are periodic with more than one – 2, 4, 8, 16, 32 and 3, 6, 12, 24 — stable attractors , and some regions are chaotic (we will have more on chaotic regions in a future installment of this series).

Where do we see such dynamic systems? The formula used here is the same as the basic formula for Population Dynamics, where x is the unit of the carrying capacity of an environment (in which 1 would represent 100%) and r is the growth factor. With low growth factors, populations tend to be stable and less than the carrying capacity of their immediate environment. This illustration for the fictional May Island Squirrel Population was included in Part 1. [ The Predator-Prey Equations, which reflect some populations, are also non-linear and are usually linearized in order to find approximate solutions.]

We see in this diagram the population of squirrels on May Island. With a growth rate below 3 – 2.7 in this example (green  blue trace) – stabilizes at 0.6xxx, roughly 60% of the islands carrying capacity. Bumping the growth rate up to 3 (orange trace) causes the population to wobble, saw-toothing a little bit higher. The wobble increases as the growth rate increases until at a growth rate of 4 (green trace) the population is very unstable, chaotic, and suffers a possible extinction (or very low numbers) for years 14-18 or so.   The purple line, provided for interest, represents what the average person would expect – a linear progression from a low population to a full carrying capacity population produced by a [incorrect] linear understanding of population dynamics.

In real world, complicated non-linear dynamic systems, such as the interplay between adult flour beetles, their pupae, and their larvae in a confined volume of flour – in which the adults happily cannibalize the pupae – we see this more complex version of [a small portion of] the bifurcation diagram which was then experimentally found to be valid.

The researchers focused on the chaotic regions except at the value “1”.   We can see where we could expect stable single value attractor results in the region just above 0.1 and at all values above 0.45, probably some period of 3 (3, 6, 9…).

The characteristic we see in these examples is stability – even the period-two wobbles are stable around a central value.

In real life population studies, all these features are seen. Some species populations are more prone to developing growth rates that cause chaotic dynamics – such as deer population in rural NY State where I raised my children. With deer, two or three good years in a row result in a growth rate that spikes population to unsustainable levels, resulting in heart-breaking population crashes from winter starvation. As a result, the NY State Department of Environmental Conservation struggles to keep growth rates in check regionally through the issuance of additional deer hunting tags for females – chopping back growth rate directly.

Engineers can and do take advantage of the stability in non-linear systems by designing systems that fall within the stable portion of bifurcation diagram for the particular system – staying well away from the point at which wobble, turbulence, and chaos ensue. Not only are these non-linear systems stable – they embody stability as part of the dynamics – perturb them and they return “of their own accord” to their stable point.

In real world dynamic systems, there is always some element of randomness added into the system – breezes, vibrations, confounding elements of other systems, traffic in the street – always something that deflects the system from our perfect mathematical rendering above.   The characteristic of a stable attractor dampens these effects – as long as the system stays away from the point of bifurcation, that period doubling which leads to Chaos.

Here’s what a non-linear chaotic system running in stable mode looks like in the real world:

The graph above shows a ~ 5 % or so variation over the entire length — it has jiggles and an apparent trend.   If this were a squirrel population somewhere, we’d suspect that things had generally improved a bit, perhaps increasing carrying capacity of the environment, a decline in predation, an increase in maturity of food providing trees or an incursion of a new food supply – say urban squirrel feeders. The point is that despite the multitude of things that could be affecting the overall system, it exhibits a high degree of stability, staying in a certain range.

It is a the same as the earlier blue graphs – Robert May’s population dynamics formula, a non-linear dynamic formula known to produce chaotic results when forced above a certain level (as in the green trace in the May Island Squirrel Population graph).   This version, though, was created by slightly altering the forcing (the “r” in the formula) so that it increases and decreases minutely — by 1/1000th a year, up or down in various time periods – and the entire result being overlaid with a random addition varying from 2 to 6 percent.

Anyone recognize the graph?  Ever seen this:

A rough, and widely used, version of land surface air temperatures over the last 140 years from the Met Office.   Here’s what they look like overlaid:

Of course, this is a set-up. This proves nothing, nor is it intended to prove anything. The purpose is just to illustrate that in the stable zone of a chaotic system, with very slight changes to the “forcing” factors and a bit of the natural jitters and randomness found in all real world systems, it is easy to make a generalized non-linear chaotic system behave in the same manner as the part of the Earth’s climate system that produced surface air temperatures over the last 145 years.

Chaos, Stability and Climate:

“The climate system is a coupled non-linear chaotic system, and therefore the long-term prediction of future climate states is not possible.” – IPCC TAR Chap 14, Exec Summary

This much is not in doubt – “the [Earth’s] climate system is a coupled non-linear chaotic system” — nearly all sides in the Climate Wars recognize this simple-appearing fact. That is where agreement apparently ends.

Many have put forward the idea that the Earth’s Climate System is in a stable period-two state (see the bifurcation diagram above) – shifting on a very long time scale from Ice Ages to Interglacial Periods and back again. From this, we can get general agreement that the Earth is currently in Interglacial mode. Within each extreme, the climate appears surprisingly stable – nice solid well-constrained Ice Ages and nice solid well-constrained Interglacials.   The sun seems to slightly perturb the system in each state, with some Interglacials or portions of them being a few degrees warmer or cooler and the same within Ice Ages.

In more recent times, kicking the climate system with a decade of frequent volcanism causes things to chill right down but after a few years, the system is back into its normal range. The Roman and Medieval Warm periods cool off and after a bit of a “Little Ice Age”, things warm back up. This warm period, cool period, warm period may be the result of a bit of wobble developing in the system or due to slight changes in the strength of the Sun, orbital changes, and other natural physical confounders – generally referred to as “natural variation”.    It might be a sign that the system is “striving” for stability, “trying” to return itself to a single stable point.   It is possible that the climate for the least ten thousand years is the stable value overlaid with a bit of physical noise.

source

The graph above (whether we accept it as accurate or not and ignoring the silly, unscientific additions of “future” values in red for 2050 and 2100) shows that for the last ten thousand years proxies of surface temperatures show a stability to within a range of 2°C, very well constrained.   The left-hand panel shows the period-two behavior of Ice Ages and Interglacials. (Note: the time scale changes at the panel break. Earlier panels of the original image have been cropped out. There are questions as to whether the vertical alignment of the first, left-hand, panel is properly represented and/or supported by data.)

The incredible thing about the Earth’s climate is that it is so stable, over the last million years, given the huge geological and biological changes that have taken place, including the most recent post-glacial sea level rise, which resulted in a massive change to ocean volume, shape, and extent – the oceans being one of the two coupled non-linear dynamic systems that make up the whole of the climate system.  Even with the Ice Ages, the climate has been stable enough for life to grow, change, and prosper.

Do we really know anything about why the geological-time temperature graph looks as it does? I’d have to say “No, not really.”   At best we can describe it: Ice Ages and Interglacials and on a smaller scale, the most recent 10,000 years, warm periods and cooler periods; we may have some guesses as to causes of the changes, some guesses more likely to be correct than others.

Chaos Theory gives us another way to look at the question based on the fact that Earth Climate is a complicated complex non-linear dynamic system, made up of at least two closely-coupled non-linear dynamic systems: the oceans and the atmosphere.   How that coupling affects the total system is what Climate Science is intended to study. How coupled chaotic systems behave in general, to my knowledge, is simply not known except in the studying of Earth climate as an example. In my opinion, the uncanny stability of the Earth’s surface temperature over the past 10,000 years is correctly represented as a single-value stable attractor of the coupled system.

Take Home Messages:

In this essay, I have tried to present the less-talked-about aspect of chaotic non-linear systems: their stability in certain regions, with a single-value attractor to which the system returns after being perturbed.

1. Non-linear chaotic systems have regions that are not only stable but are high resistant to being de-stabilized – they return to their stable value, their single-value attractor, after being perturbed.
2. The Earth’s land surface temperature record is extremely stable over the past 10,000 years. This stability may represent a single-value stable attractor for the system.
3. The Earth’s Climate System is “a coupled non-linear chaotic system” – and while exactly what that coupling means one can or should expect from it is not yet well understood and remains unclear, we should look to Chaos Theory to provide the necessary insight we need to reach a better understanding.

# # # # #

Author’s Comment Policy:

I will not be defending the idea that the climate system is a coupled non-linear chaotic system – it is simply too well established and supported by the physical actuality. Those who wish to rail against this fact can have their say here, but I will not be replying. It would be interesting to read a well presented essay from those who hold such an opinion as to why they do so and I’m sure Anthony would post such an essay.

I would be interested in your guesses as to why I say in the last paragraph before the Take Home Messages: “made up of at least two closely-coupled non-linear dynamic systems”.   Might there be more than two? If so, what might the additional systems be?

Further, this essay is not about the details of the Earth’s climate, CAGW, AGW, or related nonsense. I will not fight the Climate Wars in the comments – please reserve that for some other essay or take it over to the NY Times’ Dot Earth blog where a lively battle is nearly always taking place.

# # # # #

[This essay was edited at 8:30 Eastern Time Nov 24 2015 to correct minor formatting  issues and at 9:30 correcting the name of a  trace color  (h/t goldminor) – kh]

Article Rating
Inline Feedbacks
November 24, 2015 2:44 am

Entropy?

TPG
November 24, 2015 7:39 pm

(Mr. Dr. Ms?) Hansen;
Fascinating article and great heuristics. Your right, our climate remarkably stable dividing its time between two major states, namely glacial and interglacial that are stable within a few degrees C. So there must be attractors (2?) that lead to the state changes (within these two state there are additional states that show their own stability like alternating colder/warmer periods). Could it be said that there have been tipping points where we transition suddenly (mostly) to the non-current state? Much has been made in some circles that the global average temperature (rising) may well be approaching a tipping point. Is this a reasonable thought and what kind of state might we tip to? Curious as to your thoughts.
TPG

David L. Hagen
November 23, 2015 7:20 pm

How about at least 5 nonlinear coupled systems: Ocean, Atmosphere, Earth’s core, Sun and the Heliosphere.

November 24, 2015 6:44 am

I would also add Biosphere. 🙂

Robk
November 23, 2015 7:59 pm

Good overview, thanks.
Tricky question at the end. Here’s my list of coupled systems:
Atmosphere, heliosphere, lithosphere, hydrosphere, biosphere, cosmosphere….
The list can go on and on and include a carbosphere but I wouldn’t put it near the top.

Robk
November 23, 2015 8:05 pm

Put another way it’s one system which we compartmentalize for our convenience

goldminor
November 24, 2015 12:34 am

+1

Werner Brozek
November 23, 2015 8:00 pm

Non-linear system: A system in which alterations of an initial state need not produce proportional alterations in any subsequent states; one that is not linear.

So a good example of this is how Earth responds to a doubling of CO2 in the air. Earth’s absolute temperature does not double, nor does it even go up linearly, but presumably logarithmically.

November 23, 2015 8:31 pm

No, what needs to be emphasised about the definition is that it is a non-linear response of a state to alteration in the same state variable (or variable set). eg temperature responding to temperature. As in the example x → r x (1 – x).

davidb
November 24, 2015 12:56 am

Or down..

Smokey (salmon is delicious)
November 24, 2015 1:01 am

“So a good example of this is how Earth responds to a doubling of CO2 in the air. Earth’s absolute temperature does not double, nor does it even go up linearly, but presumably logarithmically.”
No, because a logarithmic increase which varies at a set rate according to a given input is still “linear” for these purposes.
In your description if you turn the amplifier knob one click, the sound produced increases by (let’s just say) 3dB each time, i.e., the volume doubles with every notch the dial is advanced. In a truly non-linear system though, the amplifier might increase three dB with any given click of the knob…, or it might go up 0.5dB, or 5.0dB, or it might not move at all, or maybe it even drops by 3dB.
The point is that in a non-linear chaotic coupled system, you cannot predict the outcome based upon any singular input.

Phil.
Reply to  Smokey (salmon is delicious)
November 24, 2015 12:28 pm

Usually to be a chaotic system you need one of the terms to be at least quadratic, logarithmic wouldn’t suffice.

Reply to  Smokey (salmon is delicious)
November 24, 2015 2:31 pm

Chaotic systems generally have feedbacks often both positive and negative; continue in the line of the amplifier, let’s add a speaker in room, a microphone and have people entering and leaving at apparent random. The microphone provides positive Feedback of the output of the speakers to the amplifier, and the people and their clothing absorbs sound providing negative feedback and the random entering and leave perturbs the system. Now can we predict when the speakers will start squealing as we increase the volume?

Marcus
November 23, 2015 8:13 pm

robbin
November 24, 2015 6:08 am

+1

Marcus
November 24, 2015 8:10 am

…….It must be contagious !! LOL

November 23, 2015 8:14 pm

I read both Gleick’s and Stewart’s books in the early 1990’s. Both were good reads, though the Feigenbaum number doesn’t seem to have attained the importance that Gleick thought it would.
I do have a couple of memories of the books. For gleick’s book, it was seeing a lot of figures credited to “James P. Crutchfield” and wondering why the name sounded so familiar – then realizing he was my dentist’s son. For Stewart’s book, it was wondering if he was the SF author – then noticed the chapter on Lorenz was titled “The Courage of his Convections” and ll doubt was removed.
A lot of “chaos” has roots in numerical analysis, there are some sets of “ill-conditioned” equations that are very sensitive to numerical errors, which can be thought of as more or less a source of noise. In the real world we have all sorts of perturbations.
My final word on this subject is: turbulence.

November 23, 2015 8:52 pm

Good article. Thanks for writing it. As we know, physical systems can have all sorts of nasty little things going on, including positive and negative feedbacks. The best we seem able do is keep up our linear approximations, but the key is to know where the system goes into distortion, or out of linearity.

November 23, 2015 9:08 pm

Specific predictions inside any chaotic system are impossible, but long term predictions about how that system will average out are possible. See any casino for direct proof of this.
So if a scientist has determined that CO2 has a specific thermodynamic property that can be mathematically quantified, then short term predictions are irrelevant. Whatever random or cyclical responses the rest of the climate has can at best delay the manifestation of the extra CO2 or at worst exaggerate them.
If as a roulette player I switched from a table with one zero (French wheel) to one with two zeros (American Wheel) I could still have a great winning streak. This doesn’t change the fact that a person will lose their money twice as fast on the table with the two zeros wheel.
So all the arguments about chaotic non linear systems are essentially irrelevant to the faithful.
Of course direct negative feedback are a separate issue. If you have a quantifiable negative feedback value for clouds, for example, to offset the positive value for CO2, then this simply gives a new equation to apply to the thermodynamics, but says nothing about the variation and chaos that will occur either side of the new calculated mean.
So the physics question always comes back to the thermodynamic value given to CO2. The easiest way to show this value to be based on faulty assumptions and poor science is to transfer it to a study of the planet Venus and to see how appallingly this value performs to describe temperatures there.

ferdberple
November 23, 2015 10:21 pm

Correct. You cannot calculate how much a change in CO2 will change temps any more than you can predict the height of the tides from the force of gravity. You can only predict based on past history and cyclical behavior.

goldminor
November 24, 2015 12:41 am

The roulette wheel is my favorite table game. The first time that I ever tried my hand at it, I was very successful after I was able to formulate a line of attack while playing. That has held true ever since, where at the very least, I am able to pass a lot of time for a small amount of money invested.

Richard G.
November 24, 2015 3:02 pm

“I am able to pass a lot of time for a small amount of money invested.”
Don’t you really mean:
You are able to pass a small amount of money for a lot of time invested .

goldminor
November 24, 2015 5:14 pm

It could be looked at that way. Yet I found it a much better alternative than losing 100 dollars at a blackjack table in 10 or 20 minutes. At a roulette table I could sit and play 30 dollars while sipping their drinks for an hour or two. Besides that I have had some nice wins at the table.

goldminor
November 24, 2015 5:26 pm

I have stayed away for quite some time myself. That was back in the 1970s/80s for me.

graphicconception
November 24, 2015 4:56 am

“… long term predictions about how that system will average out are possible. See any casino for direct proof of this.”
I don’t see why that applies to climate. In the case of coin tossing, dice rolling and roulette wheel spinning we know the “expected value” before we start. This does not apply to the climate – so all bets are off!

Alan McIntire
November 24, 2015 8:55 am

I agree that a roulette wheel results are random but not chaotic. Perhaps a better chaotic example would be one that followed a “Hurst” distribution.

November 24, 2015 5:22 am

Surely, a roulette wheel is a poor example for predictability in a chaotic system. It is chaotic in behavior, but statistically determinate in that over time, the outcomes will converge on an equal distribution of results around the wheel. The range of outcomes is constrained.
In a nonlinear system, as the system is perturbed more aggressively, the period-doubling cascade begins and degenerates into a much larger set of available states, within the constraints. A chaotic system is not statistically determinate in any real sense.
I recognize that I may not be using terms that are technically correct, but I trust that the sense of my comment is clear.

Phil.
November 24, 2015 6:51 am

Correct about the roulette wheel. Coupled non-linear systems are not necessarily unpredictable, much of the phase space lies in stable regions where prediction is possible (stable nodes and foci, and also stable limit cycles), only in certain regions are the solutions chaotic.

November 24, 2015 10:18 am

“Non-linear systems in their chaotic regions no not obey the laws of probability.”
That is not generally true. I knew a fellow who did his master’s thesis applying the Chapman-Kolmogorov equation to determine the evolving conditional probability distribution of the outputs of various chaotic maps, including the logistic map above. The distribution is definitely not Normal or Gaussian, but it can sometimes be determined very neatly.

JohnKnight
November 24, 2015 11:33 am

Kip,
Perhaps poker is a better gambling analogy? . . in that a given card’s impact on the game can be radically different depending on the lay of the cards at the moment it is dealt?

November 24, 2015 3:07 pm

Kip – IIRC, the logistic map with r = 4 converges to a U shaped “probability” density between 0 and 1, with mean 0.5 and pseudo-independent samples. You can verify it yourself running a few thousand variates and doing a histogram and estimating an autocorrelation. The fellow I knew actually derived a functional form for that limiting density, but I do not recall it. I’ve got the paper somewhere in my archives, but it would probably take hours if not days to find it – my archive is itself rather chaotic.
It qualifies as probabilistic in the sense that you can specify a distribution of likely occurrences at the nth step of the iteration, starting from some initial distribution for the starting value (e.g., a uniform density between 0 and 1). If you knew a gaming table were relying on the logistic map with r = 4 to determine outcomes, you would be much better off betting near 0 and 1 than 0.5.
One may take the initial probability density to be uniform between 0 and 1, and plot the updated density after each step of the map. If you choose r to be some value less than 4, the density converges to a multi-modal one, approaching delta-functions at the attractors. Once you’ve gotten within the event horizon, as it were, of one of the attractors, the conditional probability collapses to a single narrow mode approaching a delta function at that point as the number of steps taken increases.
I believe I recall he computed the densities by segmenting the initial uniform distribution into partitions. Then, you can compute the conditional distributions for each partitition, and sum them all up using the Law of Total Probability.
I think the point is not so much that chaotic systems cannot be predictable – sometimes they can be to some extent in a statistical sense – but that nobody is considering the climate from that point of view.

JohnKnight
November 24, 2015 5:37 pm

Kip,
I wasn’t actually referring to your mention of roulette in the article, but the mention by a gambler concerning it.
That gambling “system” seems essentially “linear” to me, in terms of each fall of the ball into an “attractor” being straightforward probabilistically, and resulting in a win or loss with regard to each bet, and the math involved being relatively simple . . but in poker a given card dealt can result in anything from a huge loss to a huge win, or anything in between depending on the circumstances it “falls into”, in terms of fit in the hand, what the other other players are looking at, and betting sequences during the play of hand . .

JohnKnight
November 24, 2015 9:15 pm

Kip,
My actual conceptual framework for the analogy came from bridge, but I was kinda going with the gambler motif . . What you guys are describing mathematically seems, to this mathematically challenged soul, similar to what “our” minds were often dealing with when I was a serious bridge player. (What you call “chaos” is the fun part ; )

Paul of Alexandria
November 26, 2015 5:02 pm

Just as a note: theoretically you can predict a non-linear chaotic system, even in a chaotic region, if you can simulate it with enough precision. The problem is that any real-world system is usually so complex that the required precision is less than the bit precision of the simulation. The best that a simulation can do is to tell you where the stable regions are.
It should be pointed out that not only is the climate chaotic, but the inputs are not entirely know or foreseeable. I would particularly point to cosmic ray effects on cloud cover, which depend on the Solar System’s particular location in the galaxy.

Phil.
November 23, 2015 9:12 pm

The May Island system you described is based on the Lotka-Volterra equations. The condition at r=2.7 is a stable focus, and a small perturbation from the stationary state will result in an oscillatory return to that point. At r=3 the stationary point becomes an unstable focus resulting in a limit cycle, the amplitude of which increases with r. If you start at r=2.7 and reach stable operation if you then increased r to 3 you would find that the system would start to oscillate.

Joe Born
November 24, 2015 2:25 am

Thanks for that clarification. From the head post one might have inferred the process reached and remained one of the two possible “attractor” values, the choice depending on initial conditions.

Joe Born
November 24, 2015 6:31 am

Thanks for the tip.
Although I can’t heartily recommend the book, I will say that Stephen Wolfram’s “A New Kind of Science,” too, has quite a bit to say about the emergence of complex behavior from simple rules.

Phil.
November 24, 2015 8:24 am

Your traces showed the approach from a distant point outside the limit cycle, as I pointed out it is also possible to approach the cycle from inside from the stable value if r changes to 3+.
I am familiar with Bob’s work, he worked on ecological systems whereas I worked on chemical kinetic systems. In your earlier post you referred to Bob becoming Dean of Research at Princeton, he later moved to Oxford and inter alia became Chief Scientific Advisor to the HM Government, president of the Royal Society and became a member of the House of Lords.
There is an actual island where such systems have been studied, Isle Royale in Michigan, Moose originally populated the island over one hundred years ago and population dynamics such as predicted by May’s model were observed. In 1958 wolves arrived on the island and the system changed to a prey-predator one (i.e. Lotka-Volterra, although strictly a 3-parameter system, forage, moose and wolves). It appears likely that the wolves will die out and the system will revert to the original one (disease reduced the wolves below a sustainable level).

spangled drongo
November 23, 2015 9:40 pm

So, Kip, can you say if you think that Peter Lloyd’s paper showing an average 0.98c of centennial natural climate variability for the last 80 centuries is a reasonable assessment:
http://wattsupwiththat.com/2015/05/17/new-paper-how-much-of-the-global-temperature-change-is-natural/
Or do you think that is not really knowable?

Paul Westhaver
November 23, 2015 9:45 pm

TILT… I can’t do this tonight. Kip. I will read this tomorrow and maybe understand some of it.

optcom
November 23, 2015 9:45 pm

Of course there was a post last month claiming that the climate is not chaotic. So which
to believe?
http://wattsupwiththat.com/2015/10/22/is-the-climate-chaotic/

ferdberple
November 23, 2015 10:09 pm

The ocean tides are chaotic and predictable. However they are not predictable using that used in climate models. Instead the tides are predicted using astrology.

Richard G.
November 24, 2015 3:26 pm

“Moon waves,” Otto Petterson called them.
They introduce a cyclic perturbation into the climate system. Resonance.
See:
“The old-timers are right–winters aren’t what they were. And the reason may be gigantic tides deep under the sea that apparently change the climate of the whole earth.”-http://wattsupwiththat.com/2008/07/25/who-knew-rachel-carson-climate-change-expert/

richardscourtney
November 23, 2015 11:44 pm

Kip Hansen:
I have often pointed out the importance of what you have written above and – in hope of adding to thoughts generated by your essay – I again copy my explanation here.
The climate models are based on assumptions that may not be correct. The basic assumption used in the models is that change to climate is driven by change to radiative forcing. And it is very important to recognise that this assumption has not been demonstrated to be correct. Indeed, it is quite possible that there is no force or process causing climate to vary. I explain this as follows.
The climate system is seeking an equilibrium that it never achieves. The Earth obtains radiant energy from the Sun and radiates that energy back to space. The energy input to the system (from the Sun) may be constant (although some doubt that), but the rotation of the Earth and its orbit around the Sun ensure that the energy input/output is never in perfect equilbrium.
The climate system is an intermediary in the process of returning (most of) the energy to space (some energy is radiated from the Earth’s surface back to space). And the Northern and Southern hemispheres have different coverage by oceans. Therefore, as the year progresses the modulation of the energy input/output of the system varies. The variation causes global average surface temperature anomaly (GASTA) to oscillate as its ‘seasonal variation’ (i.e. GASTA rises by 3.8°C from January to June and falls by 3.8°C from June to January during each year). Hence, the system is always seeking equilibrium but never achieves it.
Such a varying system could be expected to exhibit forced oscillatory behaviour, and the ‘seasonal variation’ shows that it does. Importantly, some oscillations could be harmonic effects of the ‘seasonal variation’ and have periodicity of several years. Of course, such harmonic oscillation would be a process that – at least in principle – is capable of evaluation.
However, there may be no process because the climate is a chaotic system. Therefore, the observed oscillations (ENSO, NAO, etc.) could be observation of the system seeking its chaotic attractor(s) in response to its seeking equilibrium in a constantly changing situation.
Very importantly, there is an apparent ~900 year oscillation that caused the Roman Warm Period (RWP), then the Dark Age Cool Period (DACP), then the Medieval Warm Period (MWP), then the Little Ice Age (LIA), and the present warm period (PWP). All the observed rise of global temperature in the twentieth century could be recovery from the LIA that is similar to the recovery from the DACP to the MWP. And the ~900 year oscillation could be the chaotic climate system seeking its attractor(s). If so, then all global climate models and ‘attribution studies’ utilized by IPCC and CCSP are based on the false premise that there is a force or process causing climate to change when no such force or process exists.
Richard

Robk
November 24, 2015 7:12 am

+1

goldminor
November 24, 2015 12:07 am

On your diagram for the mythical May Island squirrels you should correct green trace to blue trace here ” …With a growth rate below 3 – 2.7 in this example (green trace) – stabilizes at 0.6xxx,…”.

goldminor
November 24, 2015 12:10 am

Speaking of “providing for interest” was that “green trace vs blue trace” put in there to see who was paying attention?

November 24, 2015 12:14 am

re : ~60 and ~900 year oscillation. I have derived both of these periodicities from a combination of the earth’s and lunar orbital periodicities. Naturally this would occurred if the temperatures are function of the tidal events, or simply it could be a ‘numerical construct’ of interference patterns .

RoHa
November 24, 2015 12:28 am

I’m just going to grumble that I think that “chaos” is the wrong term to apply to a situation which is rule-bound. But it is too late now. It has become the term of art.

Leo Smith
November 24, 2015 4:35 am

I sympathise.
I wrote something once on the 20th century discovery of various insoluble problems. And in fact that mathematics of the 20th century was more about proving what could not be proved, than anything else.
Science is all about differential equations with respect to time. Sounds weird? Let me explain.
Any theory is essentially a shorter way of describing what happens (in time) and, if its a useful theory, predicting what’s going to happen (in time), and the way that is done is to establish a differential equation of the quantities of interest, over time. So a simple law like F=ma is in fact a time differential of the relationship between force, mass and acceleration that can be integrated to give is positions and velocities in times in the future, where we know what the acceleration and masses are, and where those are constant.
But what happens if the accelerations are not constant, that is the body in question might fall under the gravitational influence of some other body as its position takes it closer… This is a system that now has in a sense feedback,. Where it gets to depends on where it goes as well as where it starts.
Its still deterministic, but its not soluble by simple maths.
What I wanted to say is that we have classes of problems
Easy= simple linear differential equations where not only the starting conditions are well known, but subsequent positions are dominated by terms that are , or are nearly, constant.
Hard= complex non linear equations where even if the starting conditions are well known, subsequent positions are dominated by terms that are manifestly not constant.
Impossible in practice= complex non linear equations whose actual shape is not well understood, and where even if the starting conditions are well known, subsequent positions are dominated by terms that are manifestly not constant. I suspect that’s where climate prediction is currently.
Impossible in theory = complex non linear equations whose shape is well enough understood to calculate that the computational power to calculate where the system is going to end up requires a computer as big as the system under investigation. I.e. The earth’s climate is in fact the analogue computer that is running to tell us what the climate is going to be as soon as it happens 😉
None of these are ‘chaos’ though…
=================================================================================
…philosophical aside…
An interesting question to ask is ‘How does the worldview of the third rate climate scientist or AHGW protagonist differ from the world view of the first rate sceptic’ ?
And its actually possible to put a finger on this: Courtesy of Roger Scruton*, the warmist lacks pessimism. He believes, or purports to believe, that human minds can, given enough time (and of course taxpayer funding) solve any problem they are presented with,. And therefore we should just get on and solve them.
The first rate minds who have gone neared to the bleeding edge of human knowledge, are aware that there are classes of problem we can prove are insoluble, certainly with known techniques, and possibly intrinsically.
They are far more likley to be skeptical. They are more pessimistic. Because they understand the limitations.
*A Cambridge philosopher ‘of the right’ as his leftish colleagues call him.

Joe Born
November 24, 2015 5:51 am

Your point about “pessimism” provides an interesting way to divide up the idea space. I need to give that some thought.
In the meantime, I’ll succumb to the temptation to comment on the gap you’ve left between “easy” (linear time-invariant) and “hard” (non-linear time-variant). Perhaps there’s a “moderate” category (populated by, say, linear time-variant and/or non-linear time-invariant)?

goldminor
November 24, 2015 12:33 am

Don’t forget the Sun in with the ocean/atmosphere coupling. That is a thought I had as I read through to the end of your very clear post. Thank you for such an enlightening post as I was able to grasp a good bit of what is contained in it. I see that I have much more reading to do, but I feel ready for the task.

Clovis Marcus
November 24, 2015 1:34 am

Excellent work. One small point a roulette wheel that has 0 to 36 slots is actually 37 attractors. The odds on a single number are 36:1 which gives the house it’s edge. The 00 is 38 giving the house an extra advantage.

Clovis Marcus
November 24, 2015 2:24 am

Apologies. My reading comprehension completely failed my this morning. That is exactly what the article says.

November 24, 2015 2:41 am

The Hurst exponent of surface temperature
http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2689425
and what that implies about OLS trends in temperature
http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2631298

Smokey (can't do much about wildfires)
November 24, 2015 3:09 am

I read the first one, didn’t bother with the second; the first isn’t worth the .pdf its printed on, rendering its implications equally meaningless.
From the first paper:
“The Hadley Centre of the UK Met Office maintains a detailed global surface temperature dataset from
selected for this study are the monthly mean land and ocean surface temperatures from January 1850
to September 2015 in ensembles of gridded squares. Three hundred such gridded squares are identified with 100 each in the Tropics (30o North to 30o South), the Northern Hemisphere (north of 30o N), and the Southern Hemisphere (south of 30o S). A structured sample of 12 squares are selected from each ensemble of 100 defined as grid numbers 1, 10, 19, 28, 37, 46, 55, 64, 73, 82, 91, and 100. The sampling provides a wide coverage of the entire ensemble while maintaining a balance between even and odd numbered grids. A total of 36 grid datasets are analyzed for evidence of persistence using the R/S analysis described by Hurst and Mandelbrot (Hurst, 1951) (Mandelbrot B. , 1972) and with due regard to methodological issues described by Granero et al and others (Granero, 2008). In total, 36 Hurst
exponents are computed, 12 for each of the three regions of the globe. “
(emphasis mine)
In other words, of 300 available data sets, they used 36. Imagine the howl from sites such as WUWT if Trenberth & Mann, et al., threw something that blatantly pre-selected at us in defense of the CAGW argument.
It’s entirely possible that the paper’s conclusion (“The implication of the finding is that the stochastic process of nature that generates surface temperature can create patterns that may appear to be cooling trends, warming trends, and plateaus at decadal and brief multi-decadal periods to which no cause can be ascribed. “) is utterly valid. However, the paper itself fails to prove that thanks to its egregious sampling failure.
As our friend Willis might say: when they get around to doing all 300 available data sets, let me know; until they do this is just fun with numbers.

Smokey (can't do much about wildfires)
November 24, 2015 10:05 pm

@Kip and Chaam Jamal===> First off, I didn’t mean to be rude earlier with my criticism, so I apologize for that. In addition, I have no real issue with the conclusions reached by the paper, so my criticism was not intended to belittle that aspect of things either. Finally, I am not so hard-and-fast as the referenced Mr. (Dr?) Eisenbach, who wants the whole data set, all the time, every time; by contrast, I accept that there may be valid reasons for picking and choosing one’s data.
Those important items being covered, my issue with this paper is that there are no reasons given for why only 12% of the available data was used to draw conclusions about the entire set. No methodology was given as to why the different sets were chosen for analysis, or else left out entirely, beyond a vague reference to maintaining a “a wide coverage of the entire ensemble” and “a balance between even and odd numbered grids.” Why having both even & odd sets made a difference was not explained, and a better coverage of the entire ensemble would have been gathered using the entire data set, so neither wipes away my reason for concern.
Had the author so much as said “We only had time/resources to calculate a small part of the data, the initial results are interesting/encouraging, please give us more funding and we’ll do the rest of it,” I’d still have been alright with that. As it stands, it appears (no accusations nor insults intended) roughly as likely that the data were hand-picked to produce a result as it does that they were a genuinely representative sample of the entire data set. Because of this, the paper really cannot be taken seriously as anything other than an interesting exercise in mathematics, no matter how intuitively appealing the conclusion.
The bottom line is that regardless of what this chunk of the data indicates, we still need the rest of it to know for sure, since we can’t know from this paper alone whether the data shown are truly representative of the entire set.
I hope that makes my position a bit clearer. Again, my apologies for my rudeness earlier.

Joe Born
November 24, 2015 4:42 am

Those papers’ abstracts are a little, well, abstract. Could you favor us with a paragraph or two that tell us what we will likely conclude if we invest the time to read both of those papers?

November 26, 2015 7:33 am

hi kip, yes, they are my papers. the grids were selected at random. btw, it is widely assumed that precipitation patterns are also driven by Hurst persistence. I looked at that and found no empirical support for it, there are certain methodological issues in this line of research. would be interested in your comments. here is the precipitation paper.
http://papers.ssrn.com/sol3/papers.cfm?abstract_id=2695753

Joe Born
November 24, 2015 2:45 am

Thanks for post. The technical discussions seem to be thinning out on this site, so your contribution is welcome.
One minor ambiguity: the impression one might take from the discussion accompanying the second and third drawings (or the third and fourth, depending on whether you count the first’s repetition) is that a “kick” would always result in the system’s returning to the attractor value associated with the system’s r value. The equation suggests that won’t necessarily happen If the kick is big enough to make x exceed unity.

Phil.
November 24, 2015 6:09 am

Stability analysis is based on the response to a small perturbation (Lyapunov stability), depending on the system of equations it is possible that a sufficiently large perturbation could leave the locally stable region of the phase space. There could be a surrounding stable limit cycle with a smaller stable focal region inside, in which case a sufficiently large perturbation would lead to a stable oscillation.

Joe Born
November 24, 2015 7:08 am

It’s certainly true that one could write phase-velocity equations descriptive of a system that behaves as you say. That the discrete-time relationship x_{n+1} = r * x_n * (1 – x_n) discussed by Mr. Hansen exhibits such behavior is not so clear.

Phil.
November 25, 2015 7:11 am

Joe Born November 24, 2015 at 7:08 am
It’s certainly true that one could write phase-velocity equations descriptive of a system that behaves as you say. That the discrete-time relationship x_{n+1} = r * x_n * (1 – x_n) discussed by Mr. Hansen exhibits such behavior is not so clear.

Actually Bob May’s paper shows exactly that.

Joe Born
November 24, 2015 7:29 am

The point is that the post might have benefited from giving the variable x a physical meaning–and thus a limited domain–before it described x’s behavior as inevitably seeking an r-determined attractor (for r < 3).
Just a suggestion.

Phil.
November 24, 2015 8:39 am

Inside the unit limit yes, but not inside the limit cycle as your orange trace shows.

Phil.
November 24, 2015 9:06 am

Here’s an animation showing the various different behaviors, stable node, stable focus, chaotic:

Joe Born
November 24, 2015 10:49 am

Thanks for the animations, Phil.

November 24, 2015 3:48 am

There can be useful bounds of outcome to a short-range prediction in a defined problem domain, but in the real physical world the granularity of error multiplies as the timespan increases.
https://thepointman.wordpress.com/2011/01/21/the-seductiveness-of-models/
Pointman

Richard Barnett
November 24, 2015 12:00 pm

I now understand more, especially in terms of the false hokey stick.

November 24, 2015 7:59 am

@Kip,
All is chaos, a tectonic realisation to the deterministic mind-set of the 1960s scientist. God wasn’t even playing dice in any possibly predictable way …
Pointman

Leo Smith
November 24, 2015 4:05 am

Nit picking:
I am not a fan of the term ‘stable’ in this context. I would prefer ‘bounded’
It is obvious that cliamte is neither stable (and predictable) nor yet unstable (and totally unpredictable).
Lorenz claims that chaos maths started when he discovered it. This is assuredly bunk. Ever since the three body problem was posited, plenty of people were aware of the general nature of chaotic systems. All except mathematicians, who woke up 400 years later and ‘discovered’ it.
I suspect the reason for this was that ion general since you can’t predict chaotic systems reliably, developing detailed mathematical models was not a priority, and applied mathematicians applied themselves to linear problems that were soluble. Such studies as were done on chaotic systems were merely to determine ways to avoid them in practical situations.
That apart, full applause for a decent job of tackling a very hard to explain subject.
If chaos maths rather than ‘climate science’ were part of the O level syllabus..or equivalent in other nations ..
The next question of course, is whether we can prove that climate is chaotic, and if so whether it can be predicted, or is even worth trying to predict.

Joe Born
November 24, 2015 6:08 am

Another intriguing comment.
Unlike that of many commenters here, my purchase on the concept of chaos is tenuous at best. Perhaps that’s why it surprises me that a three-body system would be chaotic. For my benefit and that of any others here afflicted by the same limitation, could you explain how a three-body system qualifies as chaotic?

November 24, 2015 4:30 am

I read Gleick’s CHAOS at the time and have never quite got over the power of the ideas in it. Often visual, software also allowed anybody to experiment with fractals and the creation of complexity from simple systems. The first thought I had upon reading this post was that the real take-home message from these theories was that simple systems can exhibit very complex behaviour.
To equate the Earth’s climate with any of these theories is to go beyond there scope. The Earth is not a simple system, it is not even a combination of simple systems. This makes the IPCC statement quoted at the top of the post an utterly political one:

“…we should recognise that we are dealing with a coupled non-linear chaotic system, and therefore that the long-term prediction of future climate states is not possible.”

The statement is designed, I imagine, to equate climate with Chaos!
It is possible that very complex systems, linear or otherwise in combination may produce simple behaviours and predictable outputs, such as temperature. I disagree, that broadly speaking, the long term temperature is unpredictable. I expect it will continue as it has for the last tens of thousands of years, in a very narrow range, punctuated as it has been in the past by extreme periods lasting similar amounts of time!!

Leo Smith
November 24, 2015 4:48 am

I expect it will continue as it has for the last tens of thousands of years, in a very narrow range, punctuated as it has been in the past by extreme periods lasting similar amounts of time!!
That is not inconsistent with : long-term prediction of future climate states is not possible.
Let me explain. Climate has over millions of years varied enormously , but within a certain range. It has never since the earth first cooled down a bit, gone above 100C, and rarely gone below 0C as an average value across the whole globe.
That is actually quite a narrow range in geological terms, but its a hopelessly wide range for human civilisation’s purposes. To say the climate will on average be 9°C ± 5 degrees is probably accurate for at least the next thousand years, but that could encompass a complete change in the socio-economic patterns of human behaviour, as well as a sea level change of tens of meters.
The whole point (allegedly) of the IPCC is to assume the worst, get some figures for where the climate is headed and then offer advice to governments as to what to do. ± 5° C simply isn’t good enough to say more than ‘well just be prepared for almost anything from a plague of mosquitoes, to being underwater and living in a new coral reef, or living in an igloo’
That is, in the context of what the IPCC is supposed to be about, they need it more accurate than that, and it is their conceit and their folly to think that they can be, or their deceit and their betrayal to pretend that they can, according to how sceptical you feel 😉
The whole thing hinges on ‘very narrow’: ‘very narrow’ may not be narrow enough.

November 24, 2015 6:08 am

A+

goldminor
November 24, 2015 5:40 am

That is how I have come to see it in my short time of following the story. The IPCC and those who adhere to that line of reasoning are correct in that they will never be able to correctly predict as they have blinded themselves to that which is right in front of their eyes.

November 25, 2015 5:08 am

Reply to KH ==> I’m not sure we are disagreeing about anything here. We are more like ships passing in a fog though, than two ships in the night. I am a big fan of Lorenz and have a very sophisticated understanding of Chaos as I’ve had a long interest in these topics. In short and to quote, “The map is not the territory” a model of reality is not reality. This notion has been bitterly defended by a ragged band of artists, poets, philosophers (And the ocassional scientist 😉 since time immemorial. i.e. Plato or the Upanishads (c800 bc) for example. Lorenz’s insights came specifically from attempting to model weather using computers to calculate non-linear equations. Reducing the number of decimal places saved computer time but also produced completely different results. The sensitivity to initial conditions was a problem of computation not of reality. But as you said, you “will not be defending the idea that the climate system is a coupled non-linear chaotic system ” I won’t go any further here. Cheers SWB

November 24, 2015 5:19 am

Please, please, admins, god or gods, save us from the inability to edit our spelling mistakes and lead us into the green pastures of perfect grammar! There & their is driving to despair! 😉

Joe Born
November 24, 2015 6:14 am

It’s probably too inconvenient for Mr. Watts to provide, but the comment-entry arrangement at the JoNova site is worthy of emulation. In addition to permitting edits, it so numbers the comments as to make the reply hierarchy readily apparent.

November 24, 2015 7:16 am

Like 😉

Joe Born
November 24, 2015 11:02 am

As to the editing, you don’t really have to allow takebacks. At JoNova there’s a view-WYSIWYG step: before you commit your comment you can review it as it will actually look.
And I may be making this up, but I seem to remember a site where you have, say, five minutes to edit something before it’s indelible.

Joe Born
November 24, 2015 11:26 am

Kip Hansen:
Thanks for the pointer.

November 24, 2015 5:25 am

See what I mean:

There & their is driving ME to despair! ;-(

Admins, feel free to delete my last two posts if you manage to edit the first one appropriately! 😉

November 24, 2015 5:30 am

Reblogged this on gottadobetterthanthis and commented:

Simple, but involved. You’ll know more if you read. A bit of wisdom for the taking.
As the IPCC says, we can predict nothing of the future with regard to climate.

Kurt in Switzerland
November 24, 2015 5:48 am

Hey Kip,
Did you ever wonder why the AR4 and AR5 notably ‘dropped’ the wording from the TAR ref. “…a coupled non-linear chaotic system… [which renders the prediction of long-term trends impossible]”?
Did you by any chance attempt to reach the Lead Author(s) from TAR and AR4 WG1 to determine their intent in using (respectively in NOT using) that phrase?

Kurt in Switzerland
November 24, 2015 9:09 am

Thanks, Kip.
The quote on the INHERENT unpredictability of earth’s future climate from TAR (2001) is a very powerful one. It would truly be enlightening to read an interview of WG1 lead authors from the past three reports on this very question (including why it was left out of AR4 and AR5).
The “we don’t make predictions” claim strikes me as daft. The ‘experts’ repeatedly claim that the upper and lower bounds of the global mean surface temperature trend are VERY robust; that long-term climate IS predictable, whereas short-term weather is not. Yet the DATA don’t seem to cooperate very well, n’est-ce pas?
BTW, I’ve pushed for opting out of the Verified Commenter’s status over at Revkin’s blog (NYT Dot Earth). Perhaps others may wish to follow suit. IMHO, this will improve the conversation.

T-Braun
November 24, 2015 7:42 am

If a system has two stable attractors, (like the Earth and its oscillation between glacial periods), what is the nature of the cause for switching between them? Is the event that causes a switch between one and the other the same concept as a “tipping point” that is lurking within the system itself and waiting to be tipped? Or is it caused by a major change randomly coming from outside the system?

Phil.
November 24, 2015 8:47 am

T-Braun, in the case of the earth you have a variability in the orbit which can lead to changes, however there are also random internal changes which could be responsible. E.g. the blocking of the connection between the Pacific and Atlantic oceans by uplift, change in atmospheric circulation due to the uplift of the Himalayas, etc.

November 24, 2015 9:31 am

Thanks, Kip Hansen, for a very interesting essay.
You point to an interesting breakpoint in the history of the IPCC; the missing chaos that used to make long-term predictions impossible. TAR is dead, FAR killed it.

November 24, 2015 12:46 pm

The true chaos here is that every year “adjustments” are made to past average temperature data since 1880, so that the gap between reality and the official numbers increases.
In time, I expect the 1930’s US “dust bowl” will be remembered in the history books as the 1930’s “snow bowl”.

November 24, 2015 1:28 pm

Re: WUWT, Chaos & Climate Part 2, 11/23/15:
“…we should recognise that we are dealing with a coupled non-linear chaotic system, and therefore that the long-term prediction of future climate states is not possible.”
Part 2 corrects only the attribution. Part 1 said it was AR4 WG1. Now in Part 2 it is TAR Chap 14, Exec Summary. The significant thing that should have been corrected were IPCC’s conclusions about the climate system.
As I wrote on 3/15/15 @ 10:19 am,
What the IPCC, like many others, has long recognized is false. Linearity and chaos apply to models, not to the real world. Whether models are linear often depends merely on the scale factor* applied. A system is linear if f(ax+by) = af(x)+bf(y). Equation do not exist in the real world to apply the definition. Models and equations are strictly manmade.
Chaos does not exist in the real world because the real world has no initial conditions to which it might be sensitive. Only models do. Climatologists and physicists alike often confuse the real world with their models.
The ensuing discussion there did nothing to change the facts, or the definitions of the terms chaos and linearity, nor, apparently, to remedy the confusion between models of the real world and the real world they model held even by people who should be able trained in some scientific field and who should be able to grasp the problem. This is a matter of epistemology, but more importantly, it is a matter of scientific literacy, a skill sorely lacking among voters.
On an obviously higher plane, Kip Hansen, for example, defended his essay on 3/15/2015 writing this:
Turbulence in fluid flows of all kinds, including the atmosphere. Heat transfer through and between materials. Everyday population dynamics. Passage of radiant energy through a translucent medium (the atmosphere). All nonlinear dynamical systems, and subject to all the behaviors of nonlinearity. @ 11:25 am
and
There are so many real world examples of these chaotic behaviors in natural systems that I find your continuing assertions to the contrary difficult to understand.
A couple of examples might help Mr. Hansen in his quest for understanding. *An example of model dependence on scale factor, mentioned above, is radiation transfer. At the molecular level, it is nonlinear. But at the heat transfer level, it is linear, analogous to Ohm’s law. In fact, the entire climate system can be modeled linearly as heat transfer rather than radiation transfer, and with better – with success. Another example of model dependency is the flux of CO2 between the atmosphere and the surface ocean. According to Henry’s Law, uptake by the surface layer is linear in atmospheric CO2 concentration. Outgassing, however, is nonlinear, depending on the reciprocal of atmospheric CO2 concentration. IPCC doesn’t use Henry’s Law, and when it appeared in its experiments on the Revelle Factor, IPCC concealed its results. The real world flux is neither linear nor nonlinear; neither nonlinear nor chaotic. And this holds with the world flux deleted.
If Kip Hansen wants to prevail with his argument that chaos and nonlinearity exist in the real world, he needs to accomplish these three things:
1. Quote a reasonably acceptable definition of linearity (and its absence, nonlinearity),
2. Quote a reasonably acceptable definition of chaos, and
3. Choose any example of a real world process and show that it fits those definitions without resorting to any scientific model for the process.
As things now stand, each point is an independent, glaring omission in his continuing essay.
P.S.: The origin of IPCC’s claims of chaos and nonlinearity in real world climate is its excuse for its inability to model climate successfully, meaning not that it failed to be (1) peer-reviewed, (2) published in a certified journal, and (3) recognized in a certified consensus, but that its models are now proving invalid in making better-than-chance predictions, i.e., equilibrium climate sensitivity today measures at or below IPCC’s 5% confidence level, extrapolated.

n.n
November 24, 2015 2:29 pm

Chaos is a description of a system or process that is incompletely or insufficiently characterized and unwieldy, thus preventing or degrading accurate predictions of its future states and paths. It is the implicit acknowledgement of people’s limited skill and knowledge that motivated establishment of a [limited] frame-based scientific philosophy and methods. A chaotic system can only be reasonably described by feature envelopes and estimated with stochastic methods within progressively limited frames of reference in semi-stable systems and processes.

Paul of Alexandria
November 26, 2015 5:31 pm

Not correct. Chaotic systems are often quite simple, as the mathematical example given shows. What holds chaotic systems apart is, first, that they cannot be described with a simple time equation and, second, that they are extremely susceptible to “initial conditions”.
For example, given 4 or bodies in space, (I can’t remember if the 3 body problem has been solved, but I know that the 4-body cannot be) it is not even theoretically possible to derive an equation to predict one body’s path. The only way to predict trajectories is through numerical simulation, and even then you can only predict a certain distance into the future. The bit errors in your computation, and your limits of knowledge of the exact positions and velocities involved, will cause your model to eventually diverge from reality.

Barry
November 24, 2015 2:32 pm

Left side of graph has intervals of 200,000 years, while the right side is 5000 years, so you are comparing apples and oranges in terms of periodicity and “stability.”

Brett Keane
November 24, 2015 4:18 pm

I have been thinking that Ren’s sudden stratospheric warmings (SSWs) may be a ‘butterfly’ in short to medium term seasonal weather. They seem to have the characteristics, If so, this leads to an observation that: Chaos, like magic, is just another name for things we do not yet know, and cannot predict. But if Piers Corbyn can accurately predict this solar effect, who can say how much we may advance? If we study the right things for a change, that is.

November 24, 2015 4:16 pm

Kip, I hope this comment is not too late for you to see and respond. I believe it is important to examine the second part of what the IPCC said in the executive summary for AR4. The complete quote is here:
“In sum, a strategy must recognise what is possible. In climate research and modelling, we should recognise that we are dealing with a coupled non-linear chaotic system, and therefore that the long-term prediction of future climate states is not possible. The most we can expect to achieve is the prediction of the probability distribution of the system’s future possible states by the generation of ensembles of model solutions. This reduces climate change to the discernment of significant differences in the statistics of such ensembles. The generation of such model ensembles will require the dedication of greatly increased computer resources and the application of new methods of model diagnosis. Addressing adequately the statistical nature of climate is computationally intensive, but such statistical information is essential.”
The issue then focuses more precisely on the use of model ensembles to predict future climate states, AND is the IPCC doing this in a scientifically sound manner? Dr. Robert Brown (Duke University) has some thoughtful critiques of the IPCC methods. For example, the ensemble result from multiple models with different physics can’t be anything meaningful. My personal opinion is that even with the ‘perfect’ model we would still need to use non-parametric statistical analysis with each model realization (simulation) being equally likely.
Thoughts?

November 24, 2015 7:00 pm

Thank you for the reply. I went back to your original essay and read rgb comments. I had seen many of his comments here but not on that thread. Very interesting, notably some of the physics the models obviously get wrong, e.g. Model variance versus observations.

gymnosperm
November 24, 2015 8:07 pm

Ahaaaag, “coupled non-linear chaotic system” is just gobbeldespeak for “it’s complicated”. As you say, every step is completely deterministic, but the only reason we can’t predict the result is that we are unworthy… so far.

Brian H
November 24, 2015 11:43 pm

Kip, Lonnie, IPCC et al: aren’t “predict” and “future” redundant? What else could you predict?

Brian H
November 24, 2015 11:49 pm

g-sperm;
Maybe some of the crucial determinant data is below the level of even theoretically feasible detection!

Dave Fair
November 25, 2015 10:08 pm

Any thoughts on volcanic effects on W. Antarctic ice issues?

Dave Fair
November 26, 2015 9:55 am

Thank you, Captain (from an ex-drill Sgt.).
As pure speculation, by an ex-engineer, I wonder if ENSO, AMO, PDO, etc. are simply nature’s “one-finger-salute” to misuse of mathematics by climate modelers?
I wish you a pleasant Thanksgiving.
Dave

Dave Fair