Guest essay by Dr. Tim Ball
“If you torture the data enough, nature will always confess” – Ronald Coase.
Facts are stubborn things, but statistics are more pliable. – Anonymous.
Climatology is the study of average weather over time or in a region. It is very different than Climate Science, which is the study by specialists of individual components of the complex system that is weather. Each part is usually studied independent of the entire system and even how it interacts or influences the larger system. A supposed link between the parts is the use of statistics. Climatology has suffered from a pronounced form of the average versus the discrete problem from the early 1980s when computer modelers began to dominate the science. Climatology was doomed to failure from then on, only accelerated by its hijacking for a political agenda. I witnessed a good example early at a conference in Edmonton on Prairie Climate predictions and the implications for agriculture.
It was dominated by the keynote speaker, a climate modeler, Michael Schlesinger. His presentation compared five major global models and their results. He claimed that because they all showed warming they were valid. Of course they did because they were programmed to that general result. The problem is they varied enormously over vast regions. For example, one showed North America cooling another showed it warming. The audience was looking for information adequate for planning and became agitated, especially in the question period. It peaked when someone asked about the accuracy of his warmer and drier prediction for Alberta. The answer was 50%. The person replied that is useless, my Minister needs 95%. The shouting intensified.
Eventually a man threw his shoe on the stage. When the room went silent he said, “I didn’t have a towel”. We learned he had a voice box and the shoe was the only way he could get attention. He asked permission to go on stage where he explained his qualifications and put a formula on the blackboard. He asked Schlesinger if this was the formula he used as the basis for his model of the atmosphere. Schlesinger said yes. The man then proceeded to eliminate variables asking Schlesinger if they were omitted in his work. After a few eliminations he said one was probably enough, but you have no formula left and you certainly don’t have a model. It has been that way ever since with the computer models.
Climate is an average, and in the early days averages were the only statistic determined. In most weather offices the climatologist’s job was to produce monthly and annual averages. The subject of climatology was of no interest or concern. The top people were forecasters who were meteorologists with only learning in physics of the atmosphere. Even now few know the difference between a meteorologist and a climatologist. When I sought my PhD essentially only two centers of climatology existed, Reid Bryson’s center in Wisconsin and Hubert Lamb’s Climatic Research Unit (CRU) at East Anglia. Lamb set up there because the national weather office wasn’t interested in climatology. People ridiculed my PhD being in the Geography Department at the University of London, but university departments weren’t doing such work. Geography accommodated it because of its chorologic objectives. (The study of the causal relationships between geographic phenomena in a region.)
Disraeli’s admonition of lies, damn lies and statistics was exemplified by the work of the IPCC and its supporters. I realized years ago that the more sophisticated the statistical technique the more likely the data was inadequate. In climate the data was inadequate from the start as Lamb pointed out when he formed the CRU. He wrote in his autobiography “…it was clear that the first and greatest need was to establish the facts of the past record of the natural climate in times before any side effects of human activities could well be important.” It is even worse today. Proof of the inadequacy is the increasing use of more bizarre statistical techniques. Now they invent data such as in parameterization. Now they use output of one statistical contrivance or model as real data in another model.
The climate debate cannot be separated from environmental politics. Global warming became the central theme of the claim humans are destroying the planet promoted by the Club of Rome. Their book, Limits to Growth did two major things both removing understanding and creating a false sense of authority and accuracy. First, was the simplistic application of statistics beyond an average in the form of a straight-line trend analysis: Second, predictions were given awesome, but unjustified status, as the output of computer models. They wanted to show we were heading for disaster and selected the statistics and process to that end. This became the method and philosophy of the IPCC. Initially, we had climate averages. Then in the 1970s, with the cooling from 1940, trends became the fashion. Of course, the cooling trend did not last and was replaced in the 1980s by an equally simplistic warming trend. Now they are trying to ignore another cooling trend.
One problem developed with switching from average to trend. People trying to reconstruct historic averages needed a period in the modern record for comparison. The 30-year Normal was created with 30 chosen because it is a statistically significant sample, n, in any population N. The first one was the period 1931-1960, because it was believed to have the best instrumental data sets. They keep changing the 30-year period, which only adds to the confusion. It is also problematic because the number of stations has reduced significantly. How valid are the studies done using earlier “Normal periods”?
Unfortunately, people started using the Normal for the wrong purposes. Now it is used as the average weather overall. It is only the average weather for a 30-year period. Actually it is inappropriate for climate because most changes occur over longer periods.
But there is another simple statistical measure they effectively ignore. People, like farmers, who use climate data in their work know that a most important statistic is variation. Climatology was aware of this decades ago as it became aware of changing variability, especially of mid-latitude weather, with changes in upper level winds. It was what Lamb was working on and Leroux continued.
Now, as the global trend swings from warming to cooling these winds switched from zonal to meridional flow causing dramatic increases in variability of temperature and precipitation. The IPCC, cursed with the tunnel vision of political objectives and limited by their terms of reference did not accommodate natural variability. They can only claim, incorrectly, that the change is proof of their failed projections.
Edward Wegman in his analysis of the “hockey stick” issue for the Barton Congressional committee identified a bigger problem in climate science when he wrote:
“We know that there is no evidence that Dr. Mann or any of the authors in paleoclimatology studies have had significant interactions with mainstream statisticians.
This identifies the problem that has long plagued the use of statistics, especially in the Social Sciences, namely the use of statistics without knowledge or understanding.
Many used a book referred to as SPSS, (it is still available) the acronym for Statistical Packages for the Social Sciences. I know of people simply plugging in numbers and getting totally irrelevant results. One misapplication of statistics undermined the career of an English Geomorphologist who completely misapplied a Trend Surfaces analysis.
IPCC projections fail for many inappropriate statistics and statistical methods. Of course, it took a statistician to identify the corrupted use of statistics to show how they fooled the world into disastrous policies, but that only underlines the problem with statistics as the two opening quotes attest.
There is another germane quote by mathematician and philosopher A.N. Whitehead about the use, or misuse, of statistics in climate science.
There is no more common error than to assume that, because prolonged and accurate mathematical calculations have been made, the application of the result to some fact of nature is absolutely certain.
_______________
Other quotes about statistics reveal a common understanding of their limitations and worse, their application. Here are a few;
He uses statistics as a drunken man uses lampposts – for support rather than for illumination. – Andrew Lang.
One more fagot (bundle) of these adamantine bandages is the new science of statistics. – Ralph Waldo Emerson
Then there is the man who drowned crossing a stream with an average depth of six inches. – W E Gates.
Satan delights equally in statistics and in quoting scripture. – H G Wells
A statistical analysis, properly conducted, is a delicate dissection of uncertainties, a surgery of suppositions. – M J Moroney.
Statistics are the modern equivalent of the number of angels on the head of a pin – but then they probably have a statistical estimate for that. – Tim Ball
__._,_.___
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.
“The 30-year Normal was created with 30 chosen because it is a statistically significant sample, n, in any population N.”
Wrong. there is no such thing as a statistically significant sample.
the samples required is dependent upon the variance of the thing you are measuring and your desired accuracy.
here is something simple that even ball might get
http://statswithcats.wordpress.com/2010/07/11/30-samples-standard-suggestion-or-superstition/
With regards to the UN-IPCC AR5 report:
“The whole aim of practical politics is to keep the populace alarmed (and hence clamorous to be led to safety) by menacing it with an endless series of hobgoblins, all of them imaginary. ” H.L. Mencken
stan stendera says:
“Brad and Tom G: You should both write books!!!!”
I second that request. Both subjects are familiar to me. Building energy “efficiency” assessments where the perp walks away with the folding stuff while the costs go up. Groundwater transport requirements to protect an ephemeral watercourse 50m away, and the permeability rate is less than 2mm per day. I have done a fair amount of modelling. Models have now become a pandemic worse than swine flu.
I am halfway done…. Going to cover a lot more than modeling errors.
Robert Brown @ur momisugly 11:59 — “Applying the concept of the statistical variance/standard deviation to the results from an enemble of models as if it has any meaning whatsoever.”
You did most of the heavy lifting for a point I wished to raise, so I’ll pick on you just a bit here. Though with nothing personal intended, consider it a guitar jam. Is there meaning to the ensemble var/sd? Well, yes, absolutely. This is an Economics Toolkit issue. Where *an* investor is always an idiot, even if they are an expert idiot. And the var/sd speaks directly to the amount of conformity in the individual opinions of the idiots in the ensemble. The mean of the distribution directly speaks only to the opinion of a constructed Statistical Idiot.
To speak to any more than that requires demonstration that the subset ensemble is reflective of a larger population. In Economics the Market is *the* ensemble of idiots. And a panel of selected expert idiots, if selected without bias, can be extended from a subset ensemble to a population ensemble. Because the collected opinions of *all* idiots is directly causal to the Market outcomes. And I don’t think it terribly likely that you’ll find Climatologists or Catastro-fans signing onto the explicit statement that the Climate ensembles causally manifest outcomes in reality. Though I’m quite sure you’ll find a random fellow here and there that will sign onto it.
But the models are not reflective of a larger population. The Statistical Idiot they construct is not an abstract notion of the distribution of the opinions in the subset ensemble being representative of a population ensemble. It is a single, and solitary object. A fictional, but constructed, Committee Chairman that speaks as one voice for the ensemble of idiots used to construct it. Which is fine for what it’s worth. But how accurate are the Delphic prognostications of the Statistical Idiot? And what metric do we use to justify investing on the basis of those Delphic prognostications?
If we’re interested in sciency things such as laws and theories, then a Statistical Idiot applied to a single reality isn’t going to get us there. It requires the explicit statement that ‘Science,’ as a body of knowledge, is not yet competent enough to produce a law or theory on the given subject. And it requires the explicit statement that we reject that *any specific* idiot is actually correct. Either known to be correct, or *possibly but unknowably* correct. If we held any candle of hope that there was such an idiot in the ensemble, then we would not use the ensemble. And it requires the final explicit statement that, while we are self-certain that every idiot in the ensemble is wrong in material ways, that blunting individual wrongness by constructing a Statistical Idiot is useful.
For those not familiar with gambling, this is how the Bookie at the horse races determines what odds to give on each race. The gamblers are the ensemble of idiots that are not reflective of the population of dogs or ponies in the given race. Nor are they a subset of the population of race contestants. Nor can their constructed Statistical Idiot be causal to the outcome of the race; unless there are criminal elements involved. The Bookie merely uses the Statistical Idiot vying for each dog or pony as a manner to ensure he stays in business. To adjust his odds of profit and loss for himself.
But if there is only one Statistical Idiot, then a Bookie is out of business. His payout must go to zero. Unless he has better knowledge that the Statistical Idiot about how often that dog or pony wins. That is, absent empirical knowledge — though still statistically aggregated — he cannot permit any payout greater than zero. If he wants to stay in business. And here, in respect to climatology, the ensembles are the gamblers, reality is the pony, and the Bookie is each consumer of the pair. Which, in consideration to the recent IPCC report and its purposes, the Bookie is any Govenment or Actuary.
So is there worth in the Statistical Idiot constructed by the model ensembles? Absolutely. It is a direct and explicit reflection of the consensus in the Consensus Science of Climastrology.
I have an alternative vision of what a drunken man might do with a lamppost. And perhaps it’s an equally appropriate metaphor for how some climate change alarmists treat statistics.
Me too.
I am now.
I am skeptical sarcastic.
=================
Sincerely, I apologize to the Rev.
The indignation with such stupidity will lead me to be even more stupid.
And do not want to cause any embarrassment to my longtime friends.
There are no words. To describe. the incredible. 5 IPCC.
========================
Sorry.
The crazy liars ever crossed the line.
It is clear after the AR5 SPM that the IPCC forecasts based on climate models are completely useless as a basis for policy. This was a last chance for the IPCC contributors and editors to acknowledge frankly that their models have no skill in forecasting and begin to change their CAGW paradigm The IPCC scientists are so far out on a limb that for psychological and professional and funding reasons they cannot scramble back .Further discussion of the IPCC science is a waste of time – a new forecasting paradigm is required. Such a different approach is outlined in a series of posts at http://climatesense.norpag.blogspotr.com
Here are some quotes from the latest post.
“b) A Simple Rational Approach to Climate Forecasting based on Common Sense and Quasi Repetitive- Quasi Cyclic Patterns.
How then can we predict the future of a constantly changing climate?
When,about ten years ago ,I began to look into the CAGW – CO2 based scare, some simple observations immediately presented themselves. These seem to have escaped the notice of the Climate Establishment. ( See the Post 5/14/13 Climate Forecasting for Britain’s Seven Alarmist Scientists and for UK Politicians.)
a) Night is colder than day.
b) Winter is colder than summer.
c) It is cooler in the shade and under clouds than in the sun
d) Temperatures vary more widely in deserts and hot humid days are more uncomfortable than dry hot days – humidity (enthalpy) might be an important factor. We use Sun Screen against UV rays – can this be a clue?
e) Being a Geologist I knew that the various Milankovitch cycles were seen repeatedly in the Geologic record and were the main climate drivers controlling the Quaternary Ice Ages.
f) I also considered whether the current climate was unusually hot or cold. Some modest knowledge of history brought to mind frost fairs on the Thames and the Little Ice Age and the Maunder Minimum without sunspots during the 17th century . The 300 years of Viking settlements in Greenland during the Medieval Warm Period and viniculture in Britain suggested a warmer world in earlier times than at present while the colder Dark Ages separate the MWP from the Roman Climate optimum.
g) I noted that CO2 was about 0.0375% of the Atmosphere and thought ,correctly as it turns out, that it was highly unlikely that such a little tail should wag such a big dog.
I concluded ,as might any person of reasonable common sense and average intelligence given these simple observations that solar activity and our orbital relations to the sun were the main climate drivers. More specific temperature drivers were the number of hours of sunshine,the amount of cloud cover,the humidity and the height of the sun in the sky at midday and at Midsummer . It seemed that the present day was likely not much or very little outside the range of climate variability for the last 2000 years and that no government action or policy was required or would be useful with regard to postulated anthropogenic CO2 driven climate change.
These conclusions based on about 15 minutes of anyone’s considered thought are, at once , much nearer the truth and certainly would be much more useful as a Guide to Policymakers than the output of the millions of man hours of time and effort that have been spent on IPCC – Met Office models and the Global Warming impact studies and the emission control policies based on them.”
For a forecast of the coming cooling – very likely until 2035 and possible until 2650 check on the link above.
YEP says:
October 2, 2013 at 1:51 pm
First, SPSS is not a book, it’s a statistical software package. Perhaps the fact that it’s easy to use creates the temptation to use it without proper understanding…..
Feel free to apply any of the above to the IPCC and its “settled science”. But the generalized assault on the social sciences and the use of models misunderstands the most basic aspects of the philosophy of science, and is getting a little tiresome.
>>>>>>>>>>>>>>>>>>>>>
In my field, Quality Engineering/Chemistry, statistical software packages are routinely ‘used without proper understanding.’ It was one of my major gripes with the Six Sigma program as ‘taught’ in the companies I worked for. Heck my state had to pass a law making it mandatory kids are taught the multiplication tables!
As for “the generalized assault on the social sciences and the use of models misunderstands the most basic aspects of the philosophy of science” that is what happens when you intentionally use bad ‘science’ and suborned scientific societies to shove bad political programs down peoples throats.
If and when the general public finds out they have been intentionally misled by ‘scientists’ the backlash against science could get rather nasty and that is the real crime committed by ‘Climate Scientists’ (Aside from all the human deaths they have caused that is.)
Martin Clark says: @ur momisugly October 2, 2013 at 3:02 pm
stan stendera says:
“Brad and Tom G: You should both write books!!!!”
I second that request…. I have done a fair amount of modelling. Models have now become a pandemic worse than swine flu.
>>>>>>>>>>>>>>>
I rather see them write short essays like they just did so they can be plastered across the internet and in letters to the editor. (The seven second rule. )
As far as models and modelers go… well now we know what all those would be horse traders do for a living in the modern age.
Yes models are useful but only when used for a better ‘Dig Here’ guess. Without validation with real world data they are of no more use than fairy tales… Well actually of less use.
No wonder Mann wants to sue everyone. His integrity has been defined.
We don’t care about no steenking statistical underpinnings, just the HEADLINES-
http://www.adelaidenow.com.au/news/breaking-news/september-hottest-on-record/story-fni6ul2m-1226732022605
bearing in mind whitefellas only rolled up seriously in Gondwanaland in 1788, Adelaide itself was only founded in 1836-
http://en.wikipedia.org/wiki/Adelaide
and a reasonable network of Stevenson Screens was only rolled out throughout Australia around 1910, but never let the paucity of an historical data record get in the way of a ripping good headline here scary folk.
The priceless thing about the self appointed climatology club is they’ll happily wave away any early settler temp records and heat wave horror stories and then in the next breath tell you how important it is to recognise the thousands of years of aboriginal settlement and their Dreamtime stories.
iid sample
In probability theory and statistics, a sequence or other collection of random variables is independent and identically distributed (i.i.d.) if each random variable has the same probability distribution as the others and all are mutually independent.[1]
http://en.wikipedia.org/wiki/Independent_and_identically-distributed_random_variables
What is the “real data” that these much-vaunted global Models supposedly generate? I have NEVER seen a plot or graphic of their output winds, temperatures, ice areas, oceans and land areas EVER.
nor have we been told what the original (0,0) conditions are for their fixed variables: % land, % ice, locations of the land and sea masses, original currents, original temperature and solar radiation simulations, original land and water albedo simulations, etc. We are only told of the one-line output.
For example, summer and winter land albedoes are going to change (going to get darker! and cause the land to absorb more energy over longer periods of the year) as the increased CO2 DOES increases growth of every plant, tree, shrub, grass, and plankton on the planet by 12 to 27% fro 1970 through today’s more lush growth.
Is this 1% – 2% or 4% decrease in land albedo included as a function of time? .
We are told that “land use” changes (cutting trees) is some 15% of the man-caused increase in CO2 – but where is that estimate justified by data worldwide?
Your average HS student with internet skills could put these catastrophist chicken littles into perspective starting here-
http://en.wikipedia.org/wiki/List_of_disasters_in_Australia_by_death_toll#cite_note-39
Now bear in mind that’s for a whole continent full of just over 23 mill people nowadays-
http://www.abs.gov.au/ausstats/abs%40.nsf/94713ad445ff1425ca25682000192af2/1647509ef7e25faaca2568a900154b63?OpenDocument
But looking down that Wiki tragedy list including those various killer heat waves/bushfires and natural disasters you need to bear in mind in 1910 our popn was only 4.5mill and climbed to 7 mill at the end of WW2-
http://www.populstat.info/Oceania/australc.htm
Now to really put all that climate related death and the chicken littles into perspective here kiddies-
http://www.bitre.gov.au/publications/ongoing/rda/files/RDA_Aug_2013.pdf
note that during the 12 months ended August 2013 there were 1,265 road deaths nationally so be VERY VERY afraid when mum and dad want you to hop in the car to get to school!
I am always enlightened after reading one of Dr. Ball’s essays. His down home, common sense commentary on the climate field is plain refreshing, thanks.
Thanks, Dr. Ball.
Moshpup,
do you ever get tired of making incorrect assertions??
“Wrong. there is no such thing as a statistically significant sample.”
Even eHow has got you:
http://www.ehow.com/how_6967270_calculate-statistically-significant-sample-size.html
HAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHAHA
Maybe you could just hire this guy for help:
http://www.statisticallysignificantconsulting.com/SampleSize.htm
or
http://www.amnavigator.com/blog/2010/10/27/how-to-calculate-statistically-significant-sample-size/
Read all about it!
THE NEW AND IMPROVED IPCC AR5 REPORT
Propaganda with raw fear at its very finest.
Don’t wait, get your copy while they’re bright red and hot!
Use to scare the daylights out of your fellow comrades with ease!
Doubts? Just ask the environmentalist on your block for instructions.
IMPORTANT: Never let mere data or observations lead you astray,
all must first pass through an official UN.IPCC statistical filter.
Enjoy!
/sarc off
Now why did I put /sarc off at the end of that? That’s not right.
Kuhnkat,
There is no general statistically significant sample size. It is subject to and conditional upon the variance of the data and the question you are asking.
“30” is a rule of thumb, but you should know from polling for example that 30 people would not work to predict a presidential election. now would it
To repeat. 30 is not a magic number. Sometimes you can have fewer samples and sometimes you need more. There is no such thing as a canonical sample size for statistical significance. It depends. its conditional. Notcarved in stone, not in dropped from heaven. it depends.
Ask yourself what the sample sizes are for particle physics.. you wont get 99.99% from 30 samples
Ask yourself about 6 sigma practices.
The bottomline is that 30 years was not selected because of the reason Ball asserts. In fact, you can find a discussion about this in the climategate mails.
As they say in many parts of the Middle East, and this part of Canuckistan, “Shoe-kran, Dr. Tim!”
I have three things to say, and I will say them. Now.
A drunk wanders down the middle of the road. On average, he is fine.
Even as an undergrad, it became apparent to me that the social sciences were for the statistical lightweights.
Climatologists seem to want everyone else to stfu because they’re not members of the high priesthood of climatology. Well, to a great extent this is just applied statistics. No great mystery.
So, educate me here please:
The “average of the average of all of the world’s published (not measured or actual but “published”) average temperature anomalies” over 30 years is NOT an independently sampled statistical “number” by any means, right? So, though each year’s “average temperature anomoly” could be assigned an error band, why would somebody want to periodically “rest” the client for yet another 30 years? Are they not continuously trying to flat-line a ever-rising periodic wave ?
By definition, the global “average temperature anomaly” IS going to be changing over time, so understandably, we have to have some reference point. Should not that single reference point be assigned, then fixed?
Given that there is a very visible 55 year ACI variation over time (or 60, or 65, and now some writers are claiming 88 and 100 year periods!) all on top of a undeniable 800 year long-term rise and fall from the Roman Warming to the Dark Ages to the Medieval Warming Period to the Little Ice Age to today’s Modern Warming Pause …. Should not the climate community at least recognize that their temperature trends are NOT simple linear models, but have to include a period cycle that MAY LIKELY BE influenced by a linear CO2 increase on top the original trend?
Yet they seem zealously and emotionally fixated on projecting a simple linear trend out for 100 years, as this 30 year ploy of accepting their own models shows.
I like Cork Hayden’s comment : The average American has one breast and one ball .
From my perspective I see “climate scientists” following the path of “social scientists” learning ever more esoteric statistics and arguing endlessly over data sets .
But never having learned the most basic physics and its classical analytical approach . It appears to me that there are career “climate scientists” on both sides of the “debate” who have never even learned how to calculate the temperature of a radiantly heated colored ball .
Until that becomes an absolute requirement for any undergraduate presuming to enter the field , along with the return to the teaching of the analytical approach of comparable branches of applied physics , this decade upon decade of near total stagnation will continue .
Another of Cork Hayden’s aphorisms : If it were science , there would be 1 model instead of 30 ( now 73 ) .
Dr. Ball,
Your title reminded me of an analogous article, in the Atlantic: Lies, Damned Lies and Medical Science. When big bucks are available, human ingenuity devotes itself to acquisition.