Guest Post by Willis Eschenbach
I was reading an interesting article, paywalled sadly, called “Detecting Novel Associations in Large Data Sets“, by David N. Reshef et al. It describes a subtle method for detecting relationships in datasets. Their method is called “MIC” for maximal information coefficient. The MIC coefficient measures the strength of the association of the two datasets. A value of 1 indicates a very close association, while a value of 0 means random noise. Their MIC coefficient outperforms traditional indicators for a range of complex non-linear types of relationships, including sinusoidal, circular, and multiple additive relationships. This is because it makes no assumptions about the shape or form of the association. It’s a fascinating method, one I want to learn more about.
One of their test cases involved looking for a relationship between a range of global indicators. Here is a list of their results, sorted by MIC.
Figure 1. Significant associations as indicated by the maximal information coefficient. Traditionally, the association would be measured by the Pearson coefficient.
The odd one out in this list is MIC rank 3, the association between oil consumption per person and income per person. The Pearson rank of this one was 207, while the MIC rank was 3. So I was motivated to take another look at the question of energy and development.
To do so, I used “Gapminder World”, an amazing online tool for visualizing data. Figure 2 shows an example. This is a comparison of average energy use and income, both on a per capita basis. Each country is represented by a “bubble” in the diagram.
Figure 2. Bubble plot, by country, of per capita energy use (vertical scale) versus income per person (horizontal scale). Note that both scales are logarithmic. Size of the individual bubbles shows total energy production by that country. Color of bubbles shows total oil production by that country. Units of energy use are tonnes of oil equivalent (TOE) per person per year. SOURCE
As you can see, there is a clear and quite tight linear relationship between energy use and income. This leads to an inexorable conclusion. You can’t get out of poverty without having access to affordable energy. Figure 3 below shows the same data, with larger energy producing nations identified.
Figure 3. Bubble plot, by country, of per capita energy use (vertical scale) versus income per person (horizontal scale). Note that both scales are logarithmic. Size of the individual bubbles shows total energy production by that country. Color of bubbles shows total oil production by that country. Units of energy use are tonnes of oil equivalent (TOE) per person per year. SOURCE
The bubble size shows that the US and China are about tied for top country regarding total energy production. Russia is third, the Saudis fourth, and surprising to me, India fifth. The colors show that for Russia and the Saudis most of the energy is produced from oil (red) while for China and the US coal is also a major source. India’s energy is mostly coal.
Figure 4 below shows the same basic energy vs. income chart, but in a different way. In Figure 4 the bubble size is energy production per capita, rather than total energy production. All of the bubbles are in the same location, but are changed in size.
Figure 4. Bubble plot by country of per capita energy use (vertical scale) versus income per person (horizontal scale). Note that both scales are logarithmic. Size of the individual bubbles shows total energy production per capita. Color of bubbles shows total oil production. Units of energy use are tonnes of oil equivalent (TOE) per person per year. SOURCE
We can draw some fresh conclusions from Figures 3 and 4. One is that you don’t have to produce a lot of energy, either per capita or in total, to have a modern industrial developed economy (lots of small bubbles at upper right). The Netherlands and Japan are examples. The second is that if you have high energy production per capita, it is easier to have high per capita income (preponderance of large bubbles at upper right).
The Gapminder website also allows us to look at the history of the various countries. Here is how some countries have evolved over time. Label lines show the start of each record.

Figures 5 and 6. Same as Figure 3, but showing the evolution of some countries 1971-2007. Size of the individual bubbles shows per capita energy production by that country. Color of bubbles shows total oil production by that country. “Trails” show the year by year values. Note that both scales are logarithmic. Fig. 4 SOURCE1 Fig. 5 SOURCE2:
Some comments on the historical figures. First, the direction you’d love for your country to be moving over time would be down and to the right. This would mean using less energy while making more money. Generally, almost nobody is moving in that direction overall.
The bad direction would be up and to the left. That would be using more energy to make less money. Ugly. The Saudis have moved that way in recent years.
Some countries took the worst quadrant, down and to the left. This is where you are using less energy, and you’re also making less money. Zimbabwe and the “Democratic” Republic of Congo did that. Bad sign. It’s de-development, and it generally involves suffering for both humans and the environment.
That leaves the fourth quadrant, moving up and to the right. Using more energy and making more money. Commonly called “development”, AKA getting out of poverty. Making enough money to be able to afford to protect the environment.
The game is to move to the right as much as you can (increased money) and upwards as little as you can (increased energy). So Bangladesh is not doing as well as India in that regard, since it is moving upwards more steeply. China was doing as well as India in the 70s and 80s, but has sloped upwards in the last decade of the record. Note that India is producing the majority of its energy from coal.
Russia went down and to the left in the early nineties, but has since recovered and nearly doubled its income without much increase in energy. Curiously, the income is now back to the 1990 level, but the energy use is less. The same is true of Uzbekistan and many other former members of the Soviet Empire. To their credit, they have fought back from the breakup of the Empire and returned in a more efficient form. Indeed, the Uzbeks have gone down and to the right in the last decade, and that’s the holy grail of development, doing more with less energy.
The poor Saudis, on the other hand, ended up going almost straight up (more energy used to provide the same income), and even lost a little ground. And Senegal has gone nowhere at all.
Japan, China, Mexico, and Australia have increased their per capita energy production over the period (bubble size), while the US and Russia have stayed about the same. The total oil production for the US has fallen (bubble color) while for China it has increased. Russian oil production fell and then has come back up.
The US and the UK have done a curious thing. Per capita energy use for each country in 2007 was about the same as in 1979. But income went up. Both countries nearly doubled their per capita income, with basically no increase in per capita energy use. Not sure what they are doing right, but we should figure it out and clone it …
Conclusions and final notes:
1. Development is energy, and energy is development. Although efficiency and conservation can help you, in general you must increase energy use in order to increase personal income enough to get out of poverty. If you make energy expensive, it is hugely regressive, as the poor countries and the poor people will simply not be able to afford it. Carbon taxes, “cap-and-trade”, or other energy taxes are a crime against the less favored inhabitants of our planet.
2. Large countries with higher transportation costs will use more energy per dollar of income than do small countries.
3. Within the limits of the “cloud” of countries shown in Figure 3, it is possible to increase energy efficiency, and to make more money using the same amount of energy.
4. Countries that produce lots of energy tend to waste it more than countries that produce little.
5. The preferable place for any given income level to be is on the lower edge of the “cloud” of countries with that income. This is where you get the most bucks for your bang. Many European countries are in this position. The US and Canada are about in the middle of the cloud. However, as noted they are much larger than the European countries.
6. China, India, and Bangladesh had about the same per capita income in 1971, ~ $700 per year. The differences in their current positions are large, with Bangladesh at $1,400, India at $2,600, and China at $6,000 per year.
7. Sadly, the datasets only go up to 2007 … it would be interesting to see the reduction in both energy use and income due to the global financial meltdown.
8. Finally, when someone says the word “technology”, many environmentalists think “bulldozers”. Instead, they should think “energy efficiency”. At the end of the day, technology is about doing more with less. Technology is what allows us to use less gasoline to go a mile. Through some combination of conservation and technological advances, the US and the UK were able to double their income on the same expenditure of energy. This technological advance is to the benefit of everyone including the environment.
Regards to all,
w.
PS—The source links below each chart goes to the corresponding live chart on the Gapminder website, where you can play with the variables or investigate the histories of countries other than the ones at which I looked.
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.
TimTheToolMan says:
December 19, 2011 at 2:16 pm
I liken this [ the poor lady not installing a heat pump] to making the choice to pay up front and go to renewable energy now vs taking the easy cheap way out and going with the ever increasing price of fossil fuels.
Good God! Since Wind and Solar energy have already been well proven failures, as well as only a Bilk Man’s Garden of Eden, what exactly are you talking about? And – even if you’ve never heard of things like Europe’s disastrous experience with “renewables” and new “carbon credit money”; the legal subsidized diversion of food production into ethanol, the trade of “Orangutan habitat for palm oil” and “people for Eucalyptus trees”; and of course Obama’s own “Solyndras”, now falling like dominoes as we speak – why don’t you personally try out whatever it is you are talking about yourself first, before trying to get everyone else to make your tithes to your Holy Church of Green Energy so that you can fool yourself into thinking you are saving the world?
You could start right now by buying that poor lady a heat pump, right?
JPeden writes “Good God! Since Wind and Solar energy have already been well proven failures”
I never much liked wind myself. Too much ongoing maintenance. I do, however, like PV solar very much and what do you mean PV solar has failed? People are still installing it here in Australia and its very popular.
JPeden then goes on to laughably write “why don’t you personally try out whatever it is you are talking about yourself first”
You have no idea what I do or dont do.
JPeden finishes off with “You could start right now by buying that poor lady a heat pump, right?”
Or instead we could simply increase the pension in line with oil prices. Whadayareckon?
Gail Combs writes “Oh good grief, as the working poor she probably never HAD the choice of buying more efficient heating because she could never save up that much money.”
Thats almost certainly not true. We all make choices throughout our lives and those that live for now or worse, borrow from their futures, pay the price in the future.
@ChE says:
December 19, 2011 at 12:45 pm
I also wonder if all the aeronautic professionals and academics at the turn of the century called the Wright brothers “amateurs”.
There were aeronautical professionals before the airplane was invented? Who knew?”
Since daVinci there has been a scientific exploration into flight. Ballooning was popular in the 18th century and gave way to blimps so there was definitely a field of aeronautics. What the Wright brothers learned to do was “heavier than air” flight, but aeronautics had been around long before them. A pioneer in the field was Octave Chanute, C. E. (Civil Engineer) of railroad fame. A lot of aeronautical publications were actually in “The American Engineer” and “Railroad + Engineering Journal”, probably because flight was an engineering endeavor and it was felt steam engines would supply the power to the aeroplanes.
An interesting read is Octave Chanute’s “Progress in Flying Machines”, Railroad+Engineering Journal, 1894. A book the Wright brother’s would have referenced while doing their work.
As you can see, there is a clear and quite tight linear relationship between energy use and income. This leads to an inexorable conclusion. You can’t get out of poverty without having access to affordable energy.
Wrong. You’ve made the classic mistake of confusing correlation with causation.
TimTheToolMan says:
December 19, 2011 at 4:30 pm
You have no idea what I do or dont do.
Yeah, and I still don’t. Please proceed.
Nor do I have any idea how anything of what you said was relevant to anything I said, except to illustrate what you don’t know, but which you should know.
Willis writes “You can’t get out of poverty without having access to affordable energy.”
In what sense do you mean this Willis? Even the people in poverty have access to the global energy markets and can buy tankers of oil at about the same prices as those in developed society. Surely by “access to (affordable) energy” you mean an electrical distribution network both of both wires, substations and so on as well as roads and petrol stations and businesses to distribute both.
The way I see it, greater energy use is linked to wealth AND wealth is linked to greater energy use and its not a causitive relation as you appear to be trying to paint.
Without a stable society its just not going to be possible to get the infrastructure in place and some of the poorest nations are some of the least stable.
RE: TimTheToolMan says:
December 19, 2011 at 2:16 pm
“Let them invest in heat pumps” reminds me a little of “Let them eat cake.” The French lady may not have actually said that, but the mere rumor of her saying that got her head got chopped off, just the same.
I wonder, as she faced her end, if she said anything like you said at 4:44, “We all make choices throughout our lives and those that live for now or worse, borrow from their futures, pay the price in the future.”
The economy is not as bad, here in southern NH, as other places, and the autumn has been
wonderfully mild, but I see signs people are hurting. I’m done my chores before the sun is up, and when I look over my little town in the ruddy glow of dawn’s dusk, it astonishes me how many chimneys are producing wood smoke. Last year there were perhaps two. Now there are twenty.
When I finish my chores after dark I look over my town, and it astonishes me how few Christmas lights there are. You probably clap your hands in glee about that, thinking it means less CO2 is being produced. It doesn’t seem to occur to you less gladness is produced, and greater suffering.
If you think your attitude is going to “benefit the poor in the long run,” you are deluding yourself. Furthermore, you are deaf to a growing growl.
The policies you subscibe to are hurting the poor. You need to wake up to this fact. This Christmas it is you who are the Grinch, taking away all the Whos down in Whoville have, “for their own good.”
It was a darn good thing that old Grinch returned all he had taken from the poor. If he hadn’t, then, once the Whos were done singing on Christmas morning, they would have gone after him.
You are making choices, and facing consiquences, whether it is warmer next year or colder.
Caleb writes ““Let them invest in heat pumps” reminds me a little of “Let them eat cake.” ”
There is one difference though. I’m advocating buying heat pumps (actually more generally investing in long term renewable energy security) while the sun is shining so that when the winter cold comes, we’ll be in a better position. And by sun and Winter, I’m referring to pre and post peak oil.
And so the difference is that the quote misattributed to Marie Antoinette is coming from a position of ignorance of the current position. I’m of the belief that energy wise, we’re well off right now and should be making (energy) hay whilst the sun shines.
Having said that, obviously in times of recession, R&D expenditure needs to be cut back. Marie wouldn’t have understood that either no doubt. Lets just hope we’re not actually at peak oil yet.
Another comment about Timthetoolman’s comment at 4:44, where he stated, “We all make choices throughout our lives and those that live for now or worse, borrow from their futures, pay the price in the future.”
Look at the gigantic federal deficit. Who is “borrowing from their futures.” ??????
But will they pay the price in the future? (And I’m not talking about in the afterlife.) Or will it be We The People?
Alan Statham says:
December 19, 2011 at 5:36 pm
So you are asserting that a country can get out of poverty without having access to affordable energy?
An example is crucial here, and you have not provided any.
w.
TimTheToolMan says:
December 19, 2011 at 6:51 pm
Indeed they do have access as you say. In addition, the poor can rent rooms at the Hotel Biltmore at about the same prices as the rich can rent them.
w.
Willis writes “In addition, the poor can rent rooms at the Hotel Biltmore at about the same prices as the rich can rent them.”
I do believe you’re missing the point Willis. You’re saying that cheap energy is the basis of wealth creation. By your own reasoning there is sufficient energy in $X of oil to produce $X+dx wealth because thats what wealthy nations do.
So where does this fail? Well clearly its not that simple and its the infrastructure surrounding the use of that oil that facilitates the wealth generation and that infrastructure is lacking in the poorer nations. Energy doesn’t “buy” infrastructure, it needs to be built and that takes wealth in the first place.
But of course its not a chicken and egg problem. Its a case of growing a nation’s wealth by building on its previous success. A difficult proposition when stability is an issue.
TimTheToolMan says:
December 19, 2011 at 6:51 pm
The way I see it, greater energy use is linked to wealth AND wealth is linked to greater energy use and its not a causitive relation as you appear to be trying to paint.
Without a stable society its just not going to be possible to get the infrastructure in place and some of the poorest nations are some of the least stable.
In Figure 5 above the poorest nation’s income, Bangladesh, increased by about 2.5 times, log scale, and energy use per capita increased about 4 times, log scale. Those people must be some pretty stable “climate refugees”, eh?
Whatever the pros and cons of the argument, one should be very wary of using log/log plots. Most relationships, even weak ones, look like a straight line on log/log plots. They also severely compress detail. Note that one country in the first plot uses 0.5 energy but has an income of 7,000, while another uses eight times as much energy but has an income of 4,000. Countries with energy use of 0.6-0.8 have incomes ranging from 600 to 11,000.
TimTheToolMan says:
December 19, 2011 at 7:11 pm
And what is “long term renewable energy security” when it’s at home? Certainly heat pumps are not renewable.
Since there is no currently economical renewable energy, you are asking others to subsidize your green fantasy.
w.
TimTheToolMan says:
December 19, 2011 at 9:10 pm
Tim, as you point out there are a host of things that need to be in place for a nation to succeed. Inexpensive energy is rightfully described as a “necessary but not sufficient” condition for development. Can’t happen without cheap power of some kind, and as you point out, that’s not all you need.
w.
Willis, I like that you highlighted “This leads to an inexorable conclusion. You can’t get out of poverty without having access to affordable energy.” I believe this is the KEY to getting the US economy out of its’ current slump. All of these GREEN energy mandates and the EPA are what is wrecking the US economy. Need to do away with the CLEAN coal concept. CO2 is not a pollutant, it is probably even beneficial having more CO2 in the air rather than less. If we can get energy costs back down to 1980s levels (easily doable if we cut the EPA and green energy regs) prosperity will soon follow.
Willis writes “And what is “long term renewable energy security” when it’s at home? Certainly heat pumps are not renewable.”
It was an analogy for your benefit Willis. There are many cheaper heating options than heat pumps. However once the electricity gets to a certain price the heat pump looks like a good option. The heat pump is meant to represent a higher initial cost with longer term benefits.
JPeden writes “Those people must be some pretty stable “climate refugees”, eh?”
Other people have pointed out the dangers of interpretation of log-log plots. I’ll simply say that a person who the doubles his standard of living may not be doing well if his previous standard was a cup of rice a day.
Willis writes “Can’t happen without cheap power of some kind, and as you point out, that’s not all you need.”
Cheap in what sense? I seems to me that the power only has to be cheap with respect to the thing produced. Hence it would be necessary to have cheap power to make Aluminium smelting profitable but perhaps less so to make call centres profitable.
TimTheToolMan says:
December 19, 2011 at 4:44 pm
Gail Combs writes “Oh good grief, as the working poor she probably never HAD the choice of buying more efficient heating because she could never save up that much money.”
Thats almost certainly not true. We all make choices throughout our lives and those that live for now or worse, borrow from their futures, pay the price in the future.
____________________________________
Yes decisions are made: Like do I put a new roof on the house, buy a new well pump, replace the rotted out door sills (necessities I have paid for) or put in new thermo windows, re-insulate the walls, buy a heat pump and completely retrofit for forced hot air. The only up grade that makes sense as ROI is adding insulation to the attic IMHO.
After all an older home would also need thermo-window and insulation blown into the walls as well as better attic insulation and the heat pump retrofit.
So what does a retro-fit for a mini-duct heat pump system cost?
Retrofitting Windows:
So for a small 2 bdrm/1bath house Min of 7 windows X $500 = $3500
Blown insulation in walls
OOPS, but this is an old lady and the contractor is not about to talk himself out of a job by telling the truth even if he happens to know it so say she goes for it in the interest of being “Green” and saving Energy. Since it is a small house we will say the cost covers insulating the attic too.
So it is $19,000 + $3,500 + $4,000 = $26,
So say she took out a mortgage to do this work at the same time we refinanced that gives her an 8% 30 yr mortgage (No corporate job gives you a much higher rate)
That is an additional $194.45 for the next thirty years. Do you think she is going to lower her heating/electric bill by $2400 a year?
Oh and the heat pump is only good down to 35F and then you need aux heat anyway.
Heck my friend in Watertown NY would sell you a whole house for that price!
Gail writes “So what does a retro-fit for a mini-duct heat pump system cost?”
Oh please. You go and find a $19k rolls royce ducted system to try to make your point? As if a financially struggling person will opt for that.
From here
http://www.splitsystemairconditioners.com.au/SplitsystemairconditionersBrandsInstallationPrices.html
…they range in price from AU$1630 to AU$3955 installed. And the $4k one is almost 10kW!
As far as insulation goes, you’d be mad to ignore it especially if you’re in a region where winters are bitterly cold.
You might be in some sense correct, Willis, but you can’t draw the conclusion you want to draw from that graph and that relationship. It’s a basic logical fallacy.
TimTheToolMan says:
December 19, 2011 at 7:11 pm
“There is one difference though. I’m advocating buying heat pumps (actually more generally investing in long term renewable energy security) while the sun is shining so that when the winter cold comes, we’ll be in a better position. And by sun and Winter, I’m referring to pre and post peak oil.”
After peak oil we can use coal.