Analysing the complete hadCRUT yields some surprising results

From The Reference Frame, 30 July 2011 via the GWPF

HadCRUT3: 30% Of Stations Recorded A Cooling Trend In Their Whole History

The warming recorded by the HadCRUT3 data is not global. Despite the fact that the average station records 77 years of the temperature history, 30% of the stations still manage to end up with a cooling trend.

In a previous blog entry, I encouraged you to notice that HadCRUT3 has released the (nearly) raw data from their 5,000+ stations.

undefined

Temperature trends (in °C/century, in terms of colors) over the whole history as recorded by roughly 5,000 stations included in HadCRUT3. To be discussed below.

The 5,113 files cover the whole world – mostly continents and some islands. I have fully converted the data into a format that is usable and understandable in Mathematica. There are some irregularities, missing longitudes, latitudes, heights of a small fraction of the stations. Some extra entries appear for a very small number of stations and I have classified these anomalies as well.

As Shawn has also noticed, the worst defect is associated with the 863th (out of 5,113) station in Jeddah, Saudi Arabia. This one hasn’t submitted any data. For many stations, some months (and sometimes whole years) are missing so you get -99 instead. This shouldn’t be confused with numbers like -78.9: believe me, stations in Antarctica have recorded average monthly temperatures as low as -78.9 °C. It’s not just a minimum experienced for an hour: it’s the monthly average.

Clearly, 110 °C of warming would be helpful over there.

I wanted to know what are the actual temperature trends recorded at all stations – i.e. what is the statistical distribution of these slopes. Shawn had this good idea to avoid the computation of temperature anomalies (i.e. subtraction of the seasonally varied “normal temperature”): one may calculate the trends for each of the 12 months separately.

At a very satisfactory accuracy, the temperature trend for the anomalies that include all the months is just the average of those 12 trends. In all these calculations, you must carefully omit all the missing data – indicated by the figure -99. But first, let me assure you that the stations are mostly “old enough”:

As you can see, a large majority of the 5,000 weather stations is 40-110 years old (if you consider endYear minus startYear). The average age is 77 years – and that’s also because you may find a nonzero number of stations that have more than 250 years of the data. So it’s not true that you can get too many “bizarre” trends just because they arise from a very small number of short-lived and young stations.

Following Shawn’s idea, I computed the 12 histograms for the overall historical warming trends corresponding to the 12 months. They look like this:

Click to zoom in.

You may be irritated that the first histogram looks much broader than e.g. the fourth one and you may start to think why it is so. At the end, you will realize that it’s just an illusion – the visual difference arises because the scale on the y-axis is different and it’s different because if there’s just “one central bin” in the middle, it may reach much higher a maximum than if you have two central bins. 😉

This insight is easily verified if you actually sketch a basic table for these 12 histograms:

undefined

The columns indicate the month, starting from January; the number of stations that yielded legitimate trends for the month; the average trend for the stations and the given month, in °C/century; and the standard deviation – the width of the histogram.

You may actually see that September (closely followed by October) saw the slowest warming trend in these 5,000 stations – about 0.5 °C per century – while February (closely followed by March) had the fastest trend of 1.1 °C per century or so. The monthly trends are slightly random numbers in the ballpark of 0.7 °C but the function “trend” seems to be a more continuous, sine-like function of the month than white noise.

At any rate, it’s untrue that the 0.7 °C of warming in the last century is a “universal” number. In fact, for each month, you get a different figure and the maximum one is more than 2 times larger than the minimum one. The warming trends hugely depend both on the places as well as the months.

The standard deviations of the temperature trend (evaluated for a fixed month of the year but over the statistical ensemble of all the legitimate weather stations) go from 2.14 °C per century in September to 2.64 °C in February – the same winners and losers! The difference is much smaller than the huge “apparent” difference of the widths of the histogram that I have explained away. You may say that the temperatures in February tend to oscillate much more than those in September because there’s a lot of potential ice – or missing ice – on the dominant Northern Hemisphere. The ice-albedo feedback and other ice-related effects amplify the noise – as well as the (largely spurious) “trends”.

Finally, you may combine all the monthly trends in a huge melting pot. You will obtain this beautiful Gauss-Lorentz hybrid bell curve:

undefined

It’s a histogram containing 58,579 monthly/local trends – some trends that were faster than a certain large bound were omitted but you see that it was a small fraction, anyway. The curve may be imagined to be a normal distribution with the average trend of 0.76 °C per century – note that many stations are just 40 years old or so which is why they may see a slightly faster warming. However, this number is far from being universal over the globe. In fact, the Gaussian has a standard deviation of 2.36 °C per century.

The “error of the measurement” of the warming trend is 3 times larger than the result!

If you ask a simple question – how many of the 58,579 trends determined by a month and by a place (a weather station) are negative i.e. cooling trends, you will see that it is 17,774 i.e. 30.3 percent of them. Even if you compute the average trend for all months and for each station, you will get very similar results. After all, the trends for a given stations don’t depend on the month too much. It will still be true that roughly 30% of the weather stations recorded a cooling trend in all the monthly anomalies on their record.

Finally, I will repeat the same Voronoi graph we saw at the beginning (where I have used sharper colors because I redefined the color function from “x” to “tanh(x/2)”):

undefined

Ctrl/click to zoom in (new tab).

The areas are chosen according to their nearest weather station – that’s what the term “Voronoi graph” means. And the color is chosen according to a temperature color scheme where the quantity determining the color is the overall warming (+, red) or cooling (-, blue) trend ever recorded at the given temperature station.

It’s not hard to see that the number of places with a mostly blue color is substantial. The cooling stations are partly clustered although there’s still a lot of noise – especially at weather stations that are very young or short-lived and closed.

As far as I remember, this is the first time when I could quantitatively calculate the actual local variability of the global warming rate. Just like I expected, it is huge – and comparable to some of my rougher estimates. Even though the global average yields an overall positive temperature trend – a warming – it is far from true that this warming trend appears everywhere.

In this sense, the warming recorded by the HadCRUT3 data is not global. Despite the fact that the average station records 77 years of the temperature history, 30% of the stations still manage to end up with a cooling trend. The warming at a given place is 0.75 plus minus 2.35 °C per century.

If the rate of the warming in the coming 77 years or so were analogous to the previous 77 years, a given place XY would still have a 30% probability that it will cool down – judging by the linear regression – in those future 77 years! However, it’s also conceivable that the noise is so substantial and the sensitivity is so low that once the weather stations add 100 years to their record, 70% of them will actually show a cooling trend.

Even if you imagine that the warming rate in the future will be 2 times faster than it was in the last 77 years (in average), it would still be true that in the next 40 years or so, i.e. by 2050, almost one third of the places on the globe will experience a cooling relatively to 2010 or 2011! So forget about the Age of Stupid doomsday scenario around 2055: it’s more likely than not that more than 25% of places will actually be cooler in 2055 than in 2010.

Isn’t it remarkable? There is nothing “global” about the warming we have seen in the recent century or so.

The warming vs cooling depends on the place (as well as the month, as I mentioned) and the warming places only have a 2-to-1 majority while the cooling places are a sizable minority. Of course, if you calculate the change of the global mean temperature, you get a positive sign – you had to get one of the signs because the exact zero result is infinitely unlikely. But the actual change of the global mean temperature in the last 77 years (in average) is so tiny that the place-dependent noise still safely beats the “global warming trend”, yielding an ambiguous sign of the temperature trend that depends on the place.

Imagine, just for the sake of the argument, that any change of the temperature (calculated as a trend from linear regression) is bad for every place on the globe. It’s not true but just imagine it. So it’s a good idea to reduce the temperature change between now and e.g. the year 2087.

Now, all places on the planet will pay billions for special projects to help to cool the globe. However, 30% of the places will find out in 2087 that they will have actually made the problem worse because they will get a cooling and they will have helped to make the cooling even worse! 😉

Because of this subtlety, it would be an obvious nonsense to try to cool the globe down even if the global warming mattered because it’s extremely far from certain that cooling is what you would need to regulate the temperature at a given place. The regional “noise” is far larger than the trend of the global average so every single place on the Earth can neglect the changes of the global mean temperature if they want to know the future change of their local temperature.

The temperature changes either fail to be global or they fail to be warming. There is no global warming – this term is just another name for a pile of feces.

And that’s the memo.

UPDATE:

EarlW writes in comments:

Luboš Motl has posted an update with new analysis over shorter timescales that is interesting. Also, he posts a correction showing that he calculated the RMS instead of Stand Dev for the error.

Wrong terminology in all figures for the standard deviation

Bill Zajc has discovered an error that affects all values of the standard deviation indicated in both articles. What I called “standard deviation” was actually the “root mean square”, RMS. If you want to calculate the actual value of SD, it is given by

SD2=RMS2−⟨TREND⟩2

In the worst cases, those with the highest ⟨TREND⟩/RMS, this corresponds to a nearly 10% error: for example, 2.35 drops to 2.2 °C / century or so. My sloppy calculation of the “standard deviation” was of course assuming that the distributions had a vanishing mean value, so it was a calculation of RMS.

The error of my “standard deviation” for the “very speedy warming” months is sometimes even somewhat larger than 10%. I don’t have the energy to redo all these calculations – it’s very time-consuming and CPU-time-consuming. Thanks to Bill.

http://motls.blogspot.com/2011/08/hadcrut3-31-of-stations-saw-cooling.html

0 0 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

111 Comments
Inline Feedbacks
View all comments
August 4, 2011 8:44 am

errr.. we’ve known this for quite sometime.
REPLY: Mosh, are you locked into being a permanent downer these days? A lot of people DON’T know about it, which is why I repeated the post here. – Anthony

wermet
August 4, 2011 8:48 am

It would be useful to see the “Voronoi graph” without showing any grid lines. Most of the US and European data is obscured by displaying those lines. As such the graph is not very helpful except in sparely covered regions.
Otherwise, it is a very interesting article.

August 4, 2011 8:51 am

Very interesting and informative post, in addition the illustrations of global temp distribution are stunning works of art in themselves. Has the Tate gallery ever seen them I wonder? I see a leading contender for the Turner prize.

August 4, 2011 8:56 am

Well what do you know. I am purely speculating here
but based on my own small sample
http://www.letterdash.com/HenryP/henrys-pool-table-on-global-warming
I am predicting that most of that cooling part took place in the SH.
I am right, aren’t I?

Anteros
August 4, 2011 8:56 am

I think that even more pertinent than the variability as regards warmer or cooler, is the fact that even at +/- 2.75 degrees……. nobody noticed….

Anteros
August 4, 2011 8:59 am

{Perhaps I should have said ‘at +3.05/-1.60 degrees…}

Tenuc
August 4, 2011 8:59 am

Great post which illustrates the uselessness and irrelevance of using global mean temperature as a climate metric. It is interesting that most of the warming took place in Feb/Mar, which means an earlier start to the growing season for the NH, which has to be beneficial!

Scott Covert
August 4, 2011 9:02 am

You call this science?
Where’s your model? /sarc

Mycroft
August 4, 2011 9:04 am

Anthony
If 30% show a cooling trend, what % show a warming trend, and what % show no trend at all.

Greg, Spokane WA
August 4, 2011 9:08 am

That’s a really interesting analysis, Luboš. A lot of people have pointed this out, in bits and pieces, but you wrapped it up nicely.
Thanks.
PS: Just for future reference… guest posters should put their names at the top of the articles. Otherwise there’s a tendency to say, “Great work, Anthony!” 🙂

PM
August 4, 2011 9:09 am

Do you know the proportion of the warming stations that are in cities? Or the proportion of cooling stations that are in rural locations?

stephen richards
August 4, 2011 9:15 am

Now that’s how you treat data, properly. Very well done Anthony; No drama, no hyperbole, no deceit and no lies, just good honest analysis.
Sooooo, you trolls. Compare this work to your high priests. This is how science works, not like the rubbish of RC et al.

stephen richards
August 4, 2011 9:16 am

Mosh doesn’t improve does he? I remember some years ago when he used to produce some really good work.

dmmcmah
August 4, 2011 9:17 am

You should post his most recent article, which shows the fraction of stations reporting cooling increasing when you take 1979-2011, 1995-2011, and then 2001-2011. Interesting.

TomRude
August 4, 2011 9:21 am

Thus local or regional warming and /or cooling are a result of dynamical processes, hence back to meteorological processes making Leroux analysis even more relevant.

August 4, 2011 9:23 am

Steven Mosher is apparently cool with using “Global Warming” to describe warming that isn’t “global”.
Snake Oil Salesman
Andrew

Dave Springer
August 4, 2011 9:27 am

I believe the talking points of the climate boffins have been modified to say that nothing really unusual happened before 1950 or so. What happens to those graphs if you only crunch the data from oh say the last 50 years? I believe you’ll get a X.X degrees C per century that is much higher than 0.76 and far fewer stations reporting a cooling trend.

August 4, 2011 9:29 am

Thanks Anthony for another interesting post. Your website continues to consume much time from my day, yet I don’t regret it. Here in western Oregon we are experiencing one of the coolest summers I can recall in many years as the peach crop is approximately 16 days late. Normally we are well into the season by now but I have yet to pick a peach or necterine this year and probably will not for several days. Where is that global warming happening? I doubt the late apples will have good quality, if they ripen at all. The plum set was poor due to the cold spring. I will finally pick a tomatoe today. I am having a hard time beleiving it is August.

Robert M
August 4, 2011 9:32 am

Very nice post Mr. Watts, keep up the good work.
It is sad that my first thought upon reading your post is that it just criminal that it took years and many legal battles to get this information out of the clutches of the people who were paid with taxpayer money to compile this data for public consumption. At first blush, there is nothing alarming in the data that jumps out at you. Imagine how different the conversation would have been if the “Climate Scientists” had started with, well we’ve got the data and some of it looks alarming, here it is, let’s talk.

August 4, 2011 9:33 am

Again illustrating the obvious question: What in hell is all the fuss about? The error bars are bigger than the perceived change! It could be Much Much worse than we thought, but then again it could be much much better! We spent billions on these smarmy COP meetings and bluster, enduring all the claptrap about more intense weather and the like, based on….? Really! What is all of it based on? 0.7 Kelvin? That’s nuts. Picking fly sh*t out of black pepper.

richard verney
August 4, 2011 9:34 am

Interesting article. It confirms a number of points that I have repeatedly been arguing, namely:
1. There is no such thing as global warming. Warming is a local event. It is necessary to examine matters on a local basis since some countries will experience no warming, some modest warming and some more than modest warming. Further the effects of warming will vary from country to country. For some countries if there is warming, this will be benefiical. For others, any warming will be neutral.And for some, any warming will be detrimental. Even sea level rise is not a uniform problem. Quite obviously, those countries that do not have a coast line will be unaffected. For some, sea level rise may be neutral and for some it may be a problem. The upshot is that every country should evaluate their own data and determine whether they are warming, and if so, whether this will or will not be a problem etc.
2. Dealing with climate science by looking at averages, only hides and conceals precisely what is going on, and hence the reason why certain events are happening. There is no such thing as a global average temperature (we could not possibly get a good and reliable assessment of this even if we were to increase station coverage a billion fold). Further, global average temperature is meaningless. The only reason for suggesting that there is a global average temperature is for political purposes to try and persuade everyone that we are all in this together and we need global solutions to a global problem. That is a falacy and the argument is facetious and disengenuous.
3. Looking at matters on a country by country basis, helps identify what may be causing the warming and whether this is due to natural causes. For example, if increased CO2 leads to increased backradiation (DWLWIR) and if this warms the planet or inhibits cooling that would otherwise take place, surely the effects of this would be seen the world over to the extent that CO2 is a well mixed gas and to the extent that humidity/water vapour levels are uniform. Of course, differences and changes in albedo and differences and changes in carbon sinks may also come into play and thus some adjustments to take those matters into account would be needed. However, that said, how does the ‘settled physics’ of increased GHGs leading to increased backradiation explain why certain stations show a cooling trend and others a neutral trend? The theory (if it is a valid theory) needs to be able to deal with this and explain these observations.
4. The ARGO data suggests that the oceans are not presently warming. Many stations will be heavily influenced by weather patterns coming off adjacent oceans and accordingly one would expect many stations to in effect be tracking ocean temperatures. Again, the AGW theory needs to be able to explain why the oceans do not appear to be warming (and of course, Trenberth’s missing heat).
The upshot is that the global temperature data requires complete re-evaluation from the ground up. It should be divided into a country or at any rate regiaonal basis and looked at on that basis. This would reveal a lot more as to preciesly what is going on and where it is going on and whether it is a cause for concern
. .

August 4, 2011 9:35 am

what’s the avg warming without the Antarctic Peninsula?

August 4, 2011 9:35 am

Mosh,
I gotta agree with Anthony. YOU have known about this because you’re highly intelligent and highly familiar with the data. People like me, moderately intelligent who get most of our 411 on this stuff from Anthony here, may have suspected as much (I did), but we didn’t really have our brains around it. If a reader only occasionally drifted in and let his or her eyes glaze over when numbers were discussed, he or she’d have no idea about this.
It’s really quite interesting to us. I’m glad Anthony republished this. Thanks to Lubos, too.

Dave Day
August 4, 2011 9:40 am

Anthony,
I second Mycroft’s question. What percentage of stations are within the error bars around the central, no trend value, meaning they don’t have any confirmed trend, and what percentage have a definite upward trend.
Thanks,
Dave

Scott Scarborough
August 4, 2011 9:40 am

Near the begining of this post you say that Antartica had a -78.9 deg. C reading for a monthly average. I don’t belive that. That is equivalent to -110 deg. F. Unless its wind chill, it must be -78.9 deg. F which would be equivalent to -61.6 deg. C. Wouldn’t some components of the atmosphere condense out at -110 F?

1 2 3 5