NCAR's dirty little secret

by Anthony Watts

WUWT readers of course have heard about the Met Office and their giant new supercomputer called “deep black” that they use for climate simulation and short term forecasts.

Not to be outdone, the National Center for Atmospheric Research (NCAR) in Boulder, CO has commissioned a new supercomputer project of their own: The NCAR-Wyoming Supercomputing Center (NWSC) shown in artist rendering below.

click for a larger image

In the initial press release they state the location and purpose:

January 23, 2007

BOULDER—The National Center for Atmospheric Research (NCAR) and its managing organization, the University Corporation for Atmospheric Research (UCAR), announced today that they will form a partnership with the University of Wyoming, the State of Wyoming, and the University of Colorado at Boulder to build a new supercomputing data center for scientific research in Cheyenne. The center will house some of the world’s most powerful supercomputers in order to advance understanding of climate, weather, and other Earth and atmospheric processes.

The center’s supercomputers, which will be upgraded regularly, will initially achieve speeds of hundreds of teraflops (trillion floating-point operations per second).

The Met Office wrote in their initial press release:

By 2011, the total system is anticipated to have a total peak performance approaching 1 PetaFlop — equivalent to over 100,000 PCs and over 30 times more powerful than what is in place today.

We found out later that the Met Office supercomputer would have an electrical power consumption of 1.2 megawatts.

So with that it mind, we’d expect the new NCAR-Wyoming Supercomputing Center (NWSC) to have some similar sort of power consumption. Right?

On the masthead of the NWSC page they say they are all about energy efficiency.

The NWSC project encompasses the design and construction of a world class center for high performance scientific computing in the atmospheric and related geosciences. Consistent with its mission, the facility will be a leader in energy efficiency, incorporating the newest and most efficient designs and technologies available. The center will provide new space to enable the advancement of scientific knowledge, education, and service through high-performance computing.

And on the right sidebar:

Focus on Sustainability

Maximum energy efficiency, LEED certification, and achievement of the smallest possible carbon footprint are all goals of the NWSC project. In the coming weeks and months, check this section of the site for updates on project sustainability efforts and outcomes.

That’s great, I’m all for sustainability and energy efficiency, even the “smallest possible carbon footprint” doesn’t sound too bad. Surely it will be more energy efficient and “greener” than the Met Office Supercomputer, right?

There’s an interesting unanswered question though. Why put this new facility in Wyoming rather than “green” Colorado? Isn’t Boulder, where NCAR is headquartered, the greenest of Colorado cities, and in the US top five too?

In the initial press release announcing the project, there’s this bit of political feel good prose:

“Having an NCAR supercomputing facility in Wyoming will be transformative for the University of Wyoming, will represent a significant step forward in the state’s economic development, and will provide exceptional opportunities for NCAR to make positive contributions to the educational infrastructure of an entire state,” says William Gern, the university’s vice president for research and economic development.

Gosh, what an opportunity for Wyoming. But why give the opportunity away? Colorado doesn’t want this opportunity? None of the politicians in Colorado want to be able to say to their constituents that they brought “economic development” and “positive contributions to the educational infrastructure of an entire state”? That doesn’t seem right.

The answer may very well lie in economics, but not the kind they mention in feel good press releases.

You see as we know from supercomputers, they need a lot of energy to operate. And because they operate in enclosed spaces, a lot of energy to keep them cooled so they don’t burn up from the waste heat they generate.

For all their sophistication, without power for operation and cooling, a supercomputer is just dead weight and space.

Electricity is king.

Interestingly, in the press releases and web pages,  NCAR provides no answers (at least none that were easy to find) to how much electricity the new supercomputer might use for operation and cooling. They also provide no explanation as to why Colorado let this opportunity go to another state. I had to dig into NCAR’s  interoffice staff notes to find the answer.

The answer is: electricity.

Measuring 108,000 square feet in total with 15,000-20,000 square feet of raised floor, it will be built for 8 megawatts of power, with 4-5 megawatts for computing and 3-4 for cooling.

8 megawatts! Yowza.

It’s really about economics. Electricity is getting expensive, and likely to be more expensive in the future. Candidate Obama said that under his leadership, “electricity rates would necessarily skyrocket“. Clearly NCAR is planning for a more expensive energy future.

In the interoffice staff notes, NCAR outlines its decision logic.

NCAR considered partnerships for the data center with a number of organizations along the Front Range, giving CU-Boulder and the University of Wyoming particularly close scrutiny. NCAR also looked into leasing space and retrofitting an existing data center.

With support from NSF and the UCAR Board of Trustees, NCAR chose to locate the center in Wyoming after a rigorous evaluation, concluding that this partnership would facilitate getting the greatest computing capability for the regional and national scientific community at the earliest possible time.

“The Wyoming offer provides more computing power, sooner, and at lower cost,” Tim explained during an all-staff town hall meeting on January 31. “We’ve secured the future of NCAR’s role in leadership computing.”

The Wyoming offer consists of a 24-acre “shovel-ready” site for construction in the North Range Business Park in Cheyenne near the intersection of I-80 and I-25, along with physical infra- structure for fiber optics and guaranteed power transmission of 24 megawatts. The University of Wyoming will provide $20 million in endowment funds for construction, as well as $1 million annually for operations. NCAR will utilize the State of Wyoming’s bond program to fund construction, with the state treasurer purchasing bonds that will be paid off by NCAR.

Although CU-Boulder’s offer would have given the new center greater proximity to other NCAR facilities, it would have left NCAR with a mortgage of $50 million rather than $40 million and less long-term financial savings. The Cheyenne site offers cheaper construction costs and lends itself to future expansion. It also brings a transformative partnership to a state that has traditionally lacked opportunities in technology and research.

Indeed according to the latest figures from the Energy Information Adminsitration and Department of Energy (EIA/DOE) electricity is significantly cheaper in Wyoming.

click for source data

So besides the fact that NCAR abandoned “green” Colorado for it’s cheaper electricity rates and bond program, what’s the “dirty little secret?

Coal, the “dirtiest of fuels”, some say.

According to Sourcewatch, Wyoming is quite something when it comes to coal. Emphasis mine.

Wyoming is the nation’s highest coal producer, with over 400 million tons of coal produced in the state each year. In 2006, Wyoming’s coal production accounted for almost 40% of the nation’s coal.[1] Currently Wyoming coal comes from four of the State’s ten major coal fields. The Powder River Coal Field has the largest production in the world – in 2007, it produced over 436 million short tons.[2]

Wyoming coal is shipped to 35 other states. The coal is highly desirable because of its low sulfur levels.[3] On average Wyoming coal contains 0.35 percent sulfur by weight, compared with 1.59 percent for Kentucky coal and 3 to 5 percent for other eastern coals. Although Wyoming coal may have less sulfur, it also a lower “heat rate” or fewer Btu’s of energy. On average Wyoming coal has 8600 Btu’s of energy per pound, while Eastern coal has heat rates of over 12,000 Btu’s per pound, meaning that plants have to burn 50 percent more Wyoming coal to equal the power output from Eastern coal.[4]

Coal-fired power plants produce almost 95% of the electricity generated in Wyoming. Wyoming’s average retail price of electricity is 5.27 cents per kilowatt hour, the 2nd lowest rate in the nation[5]

It’s so bad, that Wyoming’s coal plants earned the coveted “Coal Swarm” badge on that page.

Gosh.

But not to worry, NCAR has a plan to “clean up” that dirty coal use to power their supercomputer climate modeling system.

Again from the interoffice staff notes

The new center will be the first NCAR facility to earn LEED (Leadership in Energy and Environmental Design) certification for its design, construction, and operation. Measuring 108,000 square feet in total with 15,000-20,000 square feet of raised floor, it will be built for 8 megawatts of power, with 4-5 megawatts for computing and 3-4 for cooling. The power will be generated primarily from “clean” coal (coal that has been chemically scrubbed to reduce emissions of harmful pollutants) via Cheyenne Light Fuel and Power. NCAR is also aggressively working to secure the provision of alternative energy (wind and solar) for the facility, hoping to attain an initial level of 10%.

“We’re going to push for environmentally friendly solutions,” Tim says.

Clean Coal? Hmmm. NASA GISS’ Dr. Jim Hansen says Clean Coal is a decade away:

James Hansen, one of the world’s best-known global warming researchers and a recent vocal advocate of proposed coal plants, says clean coal technology used on a full-scale coal-fired plant could be at least a decade away. He expressed the sentiment in a media briefing organized by clean energy group RE-AMP, arguing against a proposed coal plant in Marshalltown, Iowa.

Hansen also said that:

“The trains carrying coal to power plants are death trains. Coal-fired power plants are factories of death. When I testified against the proposed Kingsnorth power plant, I estimated that in its lifetime it would be responsible for the extermination of about 400 species – its proportionate contribution to the number that would be committed to extinction if carbon dioxide rose another 100 ppm.”

hansen_coal_death_train1

Don’t worry, the University of Wyoming in Cheyenne, where the new NCAR supercomputing center will be, is already on top of the situation. This is from their press release May 26th, 2008:

The University of Wyoming is ready to research clean coal and wants proposals from both academic and industry organizations. With the help of the Wyoming state government, they’ve arranged for up to $4.5 million in research funds — which can be matched by non-state funds.

And, Wyoming already has their hand out to Presdient Obama:

From CBS in Denver:

Colorado, Utah, Wyoming Seek Clean Coal Funding

DENVER (AP) ―

The governors of Colorado, Utah and Wyoming are asking President Barack Obama to fund the development of clean-coal technologies in the West.

Yup, clean coal will power that new NCAR supercomputer any day now, and we’ll be paying for it.

In the meantime:

I’m sure NCAR will let us know how those wind turbines work out for that other 10% of the power.

h/t to Steve Goddard in comments

Get notified when a new post is published.
Subscribe today!
5 1 vote
Article Rating
175 Comments
Inline Feedbacks
View all comments
Sharon
January 16, 2010 3:09 pm

Speaking of cars, that architect’s rendering of the new center has a couple of vehicles in it. Let’s take a closer look, shall we?
Driving by the shiny new center is a compact white sedan, probably some locals just passing by to admire the latest stimulus to the Wyoming economy. “Look honey, because of that there building we don’t have to sell the double-wide and move to Nevada like we were a-feared! And Granny can get her new teeth this year!”
Parked out front, there’s a Cooper Mini, a Volvo station wagon, and what looks to be a blue Subura Outback, all very CC (climately-correct) and surely belonging to Ph.D.s on research staff. There’s also a red, sporty number next to the Mini, possibly a Porsche, which I’ll assume is the center director’s sweet, sweet ride.
And finally, there’s a big ‘ol, gas-swilling, American-made TRUCK (with extended cab) parked right beneath the Stars and Stripes!
Priceless!

W Abbott
January 16, 2010 3:11 pm

Beyond cost, the Colorado front range is rapidly running out of electricity. Sebelius, when she was the Governor of Kansas, unconstitutionally tried to deep-six the expansion of the coal-fired Holcomb generating station in far western Kansas. Speculation was rife at the time it was to give her “bona fides” with the Obama camp as a real environmentalist. Maybe it worked too. Anyway – they utility people I know in Colorado are adamant – if they can’t find an additional two thousand megawatts there will be California style rolling blackouts this coming decade along the front range. It’s not merely cost – it is availability – they can’t add that type of load to the grid up at Boulder.

Charles. U. Farley
January 16, 2010 3:24 pm

New computers huh?
10 terry flops and peta flops…wowee.
Coding by Harry?
10 Print: “input data”
20 Input A$
30 Input B$
40 Input C$
50 CLS
60 Print: “Data indicates”
70 Print: “A definite”
80 Print: “Warming”
90 Goto 70

Speed
January 16, 2010 3:28 pm

Perhaps NCAR could look to the private sector for help in site selection.
“Giant IT companies with giant energy needs—Microsoft and Google are great examples—have been looking for low-cost, low-polluting ways of powering their massive server farms for years. In fact, both firms built server farms along the Columbia River in Washington and Oregon in order to take advantage of some of the cheapest hydro-power in the country.”
http://cleanenergysector.com/2009/10/microsoft-google-british-wind-power/

toyotawhizguy
January 16, 2010 3:37 pm

Quote:
“We found out later that the Met Office supercomputer would have an electrical power consumption of 1.2 megawatts.”
Lets see, approximately 50% of electrical power is generated by coal burning plants.
Now that’s a carbon footprint to be proud of!

January 16, 2010 3:40 pm

Speaking of coal, Terence Cardwell spent 25 years in the Electricity Commission of NSW (Australia) working, commissioning and operating the various power units, lastly at the 4 X 350 MW Munmorah Power Station near Newcastle. His letter appears in the Rockhampton Morning Bulletin where he lifts the lid on carbon dioxide emissions. http://thesixtyzone.com/wp-content/uploads/2010/01/cardwell-letter.pdf – More about Terry here: http://thesixtyzone.com/wp-content/uploads/2010/01/cardwell.pdf

rbateman
January 16, 2010 3:41 pm

Hmmm… Deep Black is powered by Big Coal.
Seems it threw an exception from the git go.

PaulH
January 16, 2010 3:44 pm

Every where I go they tell me that the science is settled, the debate is over, etc. and it’s time for action, blah, blah, blah. If so, one would think think that jumbo mega-computers dedicated to “climate research” would not be needed, wouldn’t one?
Paul

TomTurner in SF
January 16, 2010 3:47 pm

I believe Anthony Watts should include a “by line” in his articles, just as Steve McIntyre does. Posting the articles without a “by line” is a little too modest by half. Sometimes folks print or copy an article including the headline, and such prints and copies leave no clue as to the author.

Nomad-Brit
January 16, 2010 3:49 pm

Seriously, you want to have a look at this in the Timesonline. The cracks are appearing! http://www.timesonline.co.uk/tol/news/environment/article6991177.ece?token=null&offset=12&page=2

Michael
January 16, 2010 3:51 pm

I still want to comment on the Climategate book.
Perhaps the movie version could be made as an updated version of this movie.
All The Climategates Men
Mosher and Fuller are like Woodward and Bernstein.
Quick, Someone use this video and remake a trailer out of it titled, All the Climategates Men
All the Presidents Men Movie Trailer HQ

AdderW
January 16, 2010 3:58 pm

Howard Mitchell (15:00:24) :
Xft x Xft x Xft = volume, not area

Richard Wakefield
January 16, 2010 4:06 pm

It’s simple. Let them be an example of green technology by erecting 5 wind turbines to power the computers, and when the wind does not blow or blows too low… well they wont be able to make bad predictions.

Jim Bob
January 16, 2010 4:10 pm

“Nigel S (11:49:16) :
Apart from the monster truck of course but that is offset by the Volvo and the (BMW) Mini in the car park.”
Monster truck? That looks like your typical Chevy Silverado 1/2-ton crew-cab pickup. Here in farm ‘n ranch country that’s almost a compact truck. Trucks like that fill probably one-third of your average parking lot. If they are going to build the facility in Cheyenne they had better plan for large parking spots. Unless only climate scientists work there…Prius’s don’t need large spaces.
I don’t live in Wyoming but it is one of my favorite states to visit. Wide open spaces and beautiful scenery. Even better, a Wyoming “liberal” would be considered a right-wing wacko on the east or west coast.

old construction worker
January 16, 2010 4:12 pm

‘…..with the state treasurer purchasing bonds that will be paid off by NCAR.’
Question? What is NCAR selling to earn money to pay off the State of Wyoming’s bond program? Computer time?

Lady in Red
January 16, 2010 4:13 pm

Many years ago….
Many years ago, Walter Orr Roberts gave me a tour of NCAR. I did not comprehend: the Crays.
I do not comprehend, today.
Roberts, who would be disgusted by what’s happening today, studied “greenhouse glasnost” in the 1980’s, a non-problem, he decided then.
This is not science.

J.Peden
January 16, 2010 4:15 pm

Just think, soon with all this enormous computing power, we won’t need reality at all! ~”Free at last, free at last, thank God Almighty, we’re free at last.”

Steve Goddard
January 16, 2010 4:18 pm

Colorado pays a premium for electricity to get wind energy generated in Wyoming.
Meanwhile, Wyoming uses cheap, coal-fired power.

January 16, 2010 4:22 pm


Sharon (15:09:07) :
Parked out front, there’s a Cooper Mini, a Volvo station wagon, and what looks to be a blue Subura Outback, all very CC (climately-correct) and surely belonging to Ph.D.s on research staff. There’s also a red, sporty number next to the Mini, possibly a Porsche, which I’ll assume is the center director’s sweet, sweet ride.

I’ve got to think that Climate ‘Research staff’ will still reside in Colorado; this isn’t 1985 where you have to your TI 911 Terminal within 50′ (20 m) of your TI 990 minicomputer (or within RS-232 cable range of your VAX 11/780).
The tile, “NCAR-Wyoming Supercomputing Center (NWSC)” should give it away (as it is not titled “NCAR-Wyoming Research Center (NWRC)).
From _Jim; who remembers seeing one of the earlier Crays while touring the NCAR facility yrs back …
One wonders if this facility will be available for other computationally intensive research applications (e.g. maybe fuels research, DOE research programs, code-breaking sessions, etc).
.
.

sleeper
January 16, 2010 4:24 pm

Coal+Power Plant+Supercomputer=Climate Model
Climate Model+Politician=no Coal-fired Power Plant
Attention Cheyenne Light Fuel and Power- these guys are not your friends.

Roger Knights
January 16, 2010 4:28 pm

TomTurner in SF (15:47:51) :
I believe Anthony Watts should include a “by line” in his articles, just as Steve McIntyre does. Posting the articles without a “by line” is a little too modest by half. Sometimes folks print or copy an article including the headline, and such prints and copies leave no clue as to the author.

I’ve been saying the same thing too. Maybe you’ll get through to him.

cba
January 16, 2010 4:36 pm

Obviously, they should be required to power the super computer by windmills and without connection to the evil power grid. That way the computer center works which ever way the wind blows but not when the wind doesn’t blow.

John Archer
January 16, 2010 4:41 pm

OFF TOPIC:
My apologies for butting in here with an OT post.
It seems that Richard North (www.eurefendum.blogspot.com) and Christopher Booker may have been cheated out of credit for the great work they’ve been doing investigating the financial dealings of the Pachauri Gang by the Telegraph and had it given to some hack called Robert Mendick.
Last week’s intended publication of their story in this esteemed organ was unexpectedly delayed. Maybe now we can see why. Is this yet another instance of the MSM doing the dirty on bloggers, even though it agreed to accept their article? Does it want the credit for itself?
I don’t know, but if it is, the Telegraph needs its throat ripped out.
See http://eureferendum.blogspot.com/2010/01/pachauri-sunday-telegraph-part-1.html

rbateman
January 16, 2010 4:56 pm

PaulH (15:44:20) :
Every where I go they tell me that the science is settled, the debate is over, etc. and it’s time for action, blah, blah, blah. If so, one would think think that jumbo mega-computers dedicated to “climate research” would not be needed, wouldn’t one?

You need to supercompute the Global Warming causes next Ice Age scare, because the present scare is coming apart at the seams. They will go on a massive 20 year hunt to cherry pick the evidence to fit thier newest concoction. See, they were right in the first place. The oceans will now drop, stranding shipping everywhere. The glaciers will cut off water supplies. And it’s all due to C02.
Why do you think Gore bought shorline property?
Gravy Train.

Peter of Sydney
January 16, 2010 5:17 pm

I think I’ll search for a site where you can place bets on the weather predictions. Just bet opposite to the Met’s predictions and we should be on a sure winner most of the time.