Via the Stanford University press room: Stanford’s Chris Field has spent five years leading a large team of international scientists as they prepared a major United Nations report on the state and fate of the world’s climate. The hours were long, the company was good and the science is crucial.
By Rob Jordan

In the summer of 2009, Stanford Professor Chris Field embarked on a task of urgent global importance.
Field had been tapped to assemble hundreds of climate scientists to dig through 12,000 scientific papers concerning the current impacts of climate change and its causes.
The team, Working Group II, would ultimately produce a 2,000-page report as part of a massive, three-partU.N. Intergovernmental Panel on Climate Change(IPCC) Fifth Assessment Report, which details a consensus view on the current state and fate of the world’s climate.
The job would take nearly five years, spanning time zones and languages, and requiring patient international diplomacy, dogged organizational discipline and a few napkin doodles. Marathon debates conducted over Skype crashed the service more than once.
“It’s got lots of moving pieces, personalities and opportunities for things to go right or wrong,” said Field, who co-chaired the effort. “You end up with a report that reflects the balance of understanding across the scientific community.”
In addition to being a professor of biology and of environmental Earth system science, he heads the Department of Global Ecology at the Carnegie Institution for Science, and is a senior fellow at the Stanford Woods Institute for the Environment and the Precourt Institute for Energy.
This team conducted most of the work behind closed doors, but Field and other Stanford faculty members who played key roles shared a behind-the-scenes story of what it takes to generate the most comprehensive diagnosis of the health of the planet and the risks it faces.
Beginning the journey
For Field’s group, the long road began in earnest at a July 2009 meeting in Venice, Italy, where 209 scientific experts and IPCC members from around the world developed a chapter-by-chapter outline of the report. Their outline was later formally accepted at a meeting in Bali, Indonesia.
But before Field and his team could begin the heavy lifting of writing the report, they hosted a kind of American Idol-style search for scientists to serve as authors and editors.
Over several months, they sifted through 1,217 nominations representing 73 countries. Field’s team read every nominee’s resume and consulted with observer organizations and senior climate science leaders on each. “There’s a full diversity of opinions,” Field said, pointing out that some of those selected are outspokenly skeptical of computer climate modeling, for instance.
After participants from all IPCC countries vetted the final selections, the 310 new colleagues – including a number of Stanford researchers – were ready.
Putting the pieces together
Much of the work was done at night or on weekends. Among the authors and editors staying up late were Stanford Woods Institute Senior Fellows Terry Root, a professor, by courtesy, of biology, and David Lobell and Noah Diffenbaugh, both associate professors of environmental Earth system science. “There is no institution as richly represented as Stanford,” Field said.
Stanford even hosted a U.S. government-funded office on campus, with five scientists and four technical staffers. The university also provided library research privileges for IPCC authors from developing countries.
“Stanford didn’t see it as a distraction, but as a fundamental function of the university,” Diffenbaugh said. His 9-year-old daughter, however, had a different perspective. Her father, worn out from after-hours work on the assessment, would often fall asleep while reading bedtime stories.
“There were definitely a lot of late nights,” Diffenbaugh said. “You want to know the answer, and you want to get it right. In that sense, it’s not a punch-the-clock kind of activity.” Authors were told during orientation that they should expect to devote about 25 percent of their time for three years to the report.
“Overall, it’s a process designed to not let any nonsense through, so that policymakers get only the best of what science can say,” said Lobell, a lead author on a chapter about food production systems and food security. “That takes a lot of checking, rechecking and outside review, which is not always the most exciting, but you do it realizing that it’s part of the process.”
Sometimes, it took pen sketches too. Lobell recalled a group effort to come up with a key summary figure for the chapter he worked on about food security. “We ended up doodling on napkins over dinner, and then I went back and made a version that ended up in the final report. One of the senior authors described that as the highlight of his career.”
Reaching consensus
The journey to the final draft was a delicate exercise in international relations.
“It is a tough job,” said Root, a review editor for a chapter on terrestrial and inland water systems. “You must be very current with the literature, and due to space constraints there are always ‘battles’ to include what each author thinks is important. It is wonderful, though, getting the opportunity to work with the best scientists around the world.”
Root and her fellow chapter editors in Spain and Switzerland would hash out their different perspectives during early-morning conference calls. Their Skype sessions sometimes went for more than four hours.
The chapter teams pored over dozens of peer-reviewed studies, some of them from nonscientific journals, discussed and debated findings, and then settled on language they were all comfortable using. “Instead of telling your fellow scientists they were full of it, you just had to say, ‘Where’s the traceable evidence?’ and they would change their tune,” Lobell said. Still, “there was nearly always a friendly atmosphere.”
“The challenge is also to communicate things clearly,” he added. “For example, it doesn’t help much to say, ‘Things are uncertain.’ It’s better to say something like, ‘If we knew A, we would know B, but we don’t really know A.'”
With consensus on their minds, representatives of IPCC member countries met in Switzerland in late February to review the report’s final draft.
“If the countries don’t agree on particular text, generally the text doesn’t get in there,” Field said. In some cases, representatives from a small group of countries might decamp to a separate room to work out differences of opinion. “For the exceptionally rare cases where every country but one agrees on something, sometimes text will go into the report saying every country but one agrees on this.”
The homestretch and beyond
Leaders in business, national security, public health, agriculture and other fields can make good use of the data, said Michael Mastrandrea, a Stanford Woods Institute consulting assistant professor. “Climate change is not just something for governments to be thinking about.”
Field acknowledged that the report’s continued value depends on making it more accessible and relevant to a wider audience. “There are a number of things I think the IPCC does spectacularly well. There are some things we don’t do so well,” he said. Field would like to see more author participation from the private sector, such as oil companies and reinsurance firms, and more integration of IPCC working groups.
Perhaps most important, Field envisions providing more user-friendly, customizable and interactive electronic data on an ongoing basis, as opposed to one massive report every six or seven years.
The report will serve as a foundation for international negotiations at events such as the U.N. Climate Leaders Summit scheduled for September. U.N. Secretary General Ban Ki-moon has called on world leaders to make “bold” pledges at the meeting and to demonstrate they will achieve ambitious emissions cuts as part of a legal agreement to be signed in early 2015. Field remains optimistic that the report can spur policy and technology that will steer the Earth toward a more sustainable future.
“Even though we face some serious challenges, we have some really attractive opportunities for building a better world in the future,” Field said. “The thing we need to wrap our collective brains around is that building a better world is going to require taking advantage of the scientific knowledge and being smart about managing the risk.”
-30-
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.
By the way, it took me some time to realize that Jeff and Lucia had criticized my paper without actually having read through it. I respect Jeff’s work a lot. That he’d made a mistake like that was a realization a long time coming.
The problem only became obvious when I challenged them to produce the weather noise error they claimed was there, and they could not. Up to that point, I had thought their problem was a misunderstanding and had directed my explanations to clearing that up. It didn’t occur to me, til the end, they were criticizing what they hadn’t read.
And now you’re doing the same thing, Steve; criticizing what you’ve never read. Arguing from the authority of mistaken views that you’ve taken as true and never bothered to understand.
You’re up to your neck in a swamp and don’t even know it.
Real science stands on its own; CAGW needs circle-jerks like these to motivate the minions to keep up the activism.
Kermit, you’ve captured a central error of modelers. They don’t think at all like scientists.
Two reviewers of my manuscript essentially said that all the errors in the models are already present in a spun-up equilibrated base-state 1850 simulation. The errors are taken as constant from then on. Differencing subtracts away these errors, leaving them with accurate anomaly trends.
But the only way to know what the errors are in the 1850 simulation is to compare it to the authentic 1850 climate. Those data do not exist. So, the errors in the 1850 base climate cannot be known. I.e., modelers cannot have tested their supposition of constant error. It’s strictly based on a theoretical formalism that’s accepted as true.
I’m not a climate scientist but my experience working on large-group reports in various fields tells me there is 0% chance a group such as this would ever make a significant reversal of position or recognize/admit its prior conclusions had been wrong. It is simply not in the nature of human social dynamics for consensus to be overturned via a large working group, no matter what the evidence may say.
Kermit,
As a follow-on to your comment – when models are found to be wrong, the modelers simply blame it on someone/something else. They then refuse to provide the original data.
I peer-review building energy models, and anytime a modeler refuses to give me the input data I know it is toilet paper. Plain and simple, no other option exists.
In the private arena, refusing to provide all the data gets you fired. (Professional Engineers found guilty of fraud can get their license to practice revoked.)
In fact, here is a section from the latest EPA’s Energy Star Certification Guidelines:
http://www.energystar.gov/ia/business/evaluate_performance/pm_lp_guide.pdf
The Licensed Professional’s Guide:
Understanding the Roles and Requirements for Verifying Commercial Building Applications for ENERGY STAR Certification
Page 4: “Should a LP be found to have falsified information on a building’s application for ENERGY STAR Certification, EPA reserves the right to pursue recourse through the engineering and architectural professional licensing authorities granting that individual’s license, and under Federal law. Title 18 USC Section 1001, Crimes and Criminal Procedure, Fraud and False Statements, holds that:
Whoever, in any matter within the jurisdiction of the executive, legislative, or judicial branch of the Government of the United States, knowingly and willfully – (1) falsifies, conceals, or covers up by any trick, scheme, or device a material fact; (2) makes any materially false, fictitious, or fraudulent statement or representation; or (3) makes or uses any false writing or document knowing the same to contain any materially false, fictitious, or fraudulent statement or entry; shall be fined under this title, imprisoned not more than 5 years … or both.1”
(1- Full text of Title 18 USC Sec 1001 is available at: http://uscode.house.gov)
So, why is this not the case in the climate-change industry??? Change just that one aspect, and the industry would most likely crumble in on itself in a matter of months.
revealing talk called
Coffee Hour: Being a social scientist on the IPCC: Reflections from the conceptual frontline
by Petra Tschakert
http://www.geog.psu.edu/news/events/coffee-hour-being-social-scientist-ipcc-reflections-conceptual-frontline
click on ‘coffee hour to go’ to see the presentation that describes the hoops the unpaid researchers have to go thro and the constraints imposed from on high that guide the direction. A revealing shift is that the vulnerability definition in AR5 is totally decoupled from anything to do with climate. So really the IPCC should be the IPVP [vulnerability and poverty ]
The Stanford group is mentioned and a certain MM is in the audience.
Bruce Cobb: It may be better-smelling, and a bit tidier garbage, but I still wouldn’t want it on my lawn.
Your lawn is your lawn. I would not argue with that.
WGII process was “behind closed doors”.
But we can see the report issued by the process, so no problem?
That despite the Richard Tol criticism of the process?
No, the behind closed doors of the WG process is unacceptable. Audit needed.
John
Responding to:
Pat Frank @ur momisugly April 1, 2o14 at 10:54 AM
I do emphasize with your frustration in dealing with the Climatology modeling establishment. But in general, at least outside of Climatology, I don’t agree with your statement that “They (i.e., modelers) don’t think at all like scientists.”
Instead, I believe that scientists, more typically, use existing data to hypothesize governing physical mechanisms, which they then attempt to describe mathematically (and in code) in the form of a model. If the model has fidelity only within the bounds of the pre-existing data, it an engineering model. On the other hand, if the model can be extrapolated and predict previously unknown effects, it’s a scientific model — at least until it’s superseded by a better model.
I have a great affinity for the power of data; but I also believe that describing that same data with physically-based models is also powerful in the sense of confirmation and also future application opportunities.
But too often here at WUWT, I hear a much different refrain with many commenters deriding modeling. . . it’s all about data they say. I suggest that we not abandon physically-based models just because the GCM crowd are seemingly inept and untethered to generally accepted modeling verification and validation techniques. Remember, everything “sticky” we learned in physics, chemistry etc. etc. was expressed in the form of models. Corollary: without models, we’d all be swimming, lost in a sea of data. [NB: yes, I recognize that non mathematical models can organize such data. . . but not as effectively or efficiently IMHO]
Dan
Dan Met’al, you’re right. I should have qualified the comment about modelers with, ‘climate modelers of my experience.’
Totally agree with your distinction between engineering and scientific models, and the great value physical models have when used in conjunction with data. Science proceeds only by the strong interplay between models and data. Physical models falsifiably predict, data provide the yay or nay.
The problem with climate modeling, is that the models are parametrized data-bounded engineering models but are being represented as predictive scientific models.
Truthseeker says:
March 31, 2014 at 4:29 pm
The best laugh I’ve had all day. Dead horses provide point sources of greenhouse gases, by the way.
Responding to:
Pat Frank @ur momisugly April 1, 2014 at 12:28 PM
Thanks for your response. . . and I do agree with your follow-up comments. . . spot on! But I’d like feedback from you and others on “why the WUWT community seems passive”? Yes, there’s a lot of sound and fury on this site, and yes Anthony and many other commenters have made impact on key climate issues.
But what can the WUWT community do to more aggressively push for honest data analysis and more transparent data and uncertainty quantification for GCM results? Imposition of modeling standards, standard on data acquistion, storage, and subsequent manipulation. . . . Yes, pretty feeble ideas. . . BUT please what your ideas.
Dan
Dan,
Simple, enforce the law against filing fraudulent documents. I am sure Holder and his army would be thrilled to.. Oh wait, never mind. They are too busy covering up and shutting down investigations INTO scandals like this.
Sigh….such a sad state of the Union.
==============================================================
A dead horse has a better chance of winning the Kentucky Derby than the climate science community being correct based on actual facts and observations. But to act on the climate science community’s opinions would be catastrophic for future generations. Including my and my wife’s additions to future generations.
(What’s with the “older white American males” crack? I bet you have a “Coexist” bumper sticker on your car.)
I got three paragraphs in started to feel nauseous so stopped reading … seriously, not joking, really felt like I was gonna hurl …
So the behind closed doors approach we’ve come to expect from this bunch continues. Presumably that means we’ll have to wait for Climategate III before we find out what “tricks” WG II got up to in the production of the latest episode of The Goldilocks Chronicles.
”The challenge is also to communicate things clearly,” he added. “For example, it doesn’t help much to say, ‘Things are uncertain.’ It’s better to say something like, ‘If we knew A, we would know B, but we don’t really know A”
But that won’t stop us coming up with C(rap)
Matthew R. Marler, Steve isn’t criticizing my AGU poster. He’s upset about my papers on the global air temperature record, first one here (869.8 kb pdf), follow-up here (1 mb pdf).
They show that systematic temperature sensor measurement error has been ignored in the published record. Including that error produces a lower-limit uncertainty of (+/-)0.5 C. The climate has warmed, sure, but the rate and magnitude are lost in the measurement error and are unknowable.
So, Steve has a bee in his bonnet about the papers, because the uncertainty bars show the BEST project he’s involved in is an empty exercise. For that matter, so is GISS Temp and CRU Temp.
The situation in the global air temperature record exemplifies the pervasive neglect of error in AGW consensus climate science.
Dan Met’al, I guess we all do what we can. The WUWT contributors are part of a larger community of skeptics that has actually been pretty active.
The problem is that the AGW narrative has garnered a huge social momentum. It’s supported, not just by activist data-mangling journal-bullying integrity-betraying scientists, but by every single environmental NGO, their paid and partisan PR groups, all kept on-message through the Climate Action Network, with millions of $ in grants provided annually by governments, foundations, and rich donors.
Their contributions to political candidates means they get the ears that you and I do not. It’s a bitter irony that government grants are used by NGOs to lobby politicians so as to obtain government grants. The institutional inertia is huge, and we see partisan NGOs now invited to the table where governments decide policy. It’s totally undemocratic, which suits them fine.
That ship won’t turn easily. It’s going to take time and effort.
So, what do do? What we can. Write letters. Tell your congress person you’ll withhold your vote if they support subsidies for green stupidity. If you can, do some critical analysis and publish it. Maybe organize a local group to do a little counter-demonstration, or hold teach-ins about green venality and factual dishonesty. We all have differing abilities. I’m not an organizer. But I can do critical analysis, and am trying to publish right now. Maybe we need a Reasoned Action Network to organize skeptical groups internationally. Imagine lobbying politicians for reasoned laws. What a concept! 🙂
the ipcc gave out advice to the researchers how to deal with the media and what words to avoid including
Bias, Risk, Ozone, Regime, Species, Positive, Negative, Theory, Uncertainty, Manipulation, Model, Error, Ecology
full list here
https://docs.google.com/file/d/0B88iFXWgVKt-NDc2N2FiM2QtYzQzYS00MWMxLWE4MGEtZjUwZDlmNzc3MTcz/edit?hl=en
some said this exposed a bunker mentality
http://dotearth.blogs.nytimes.com/2010/07/10/climate-panel-struggles-with-media-plan/?_php=true&_type=blogs&_r=0
“We are an intergovernmental body and we do what the governments of the world want us to do,” Pachauri told the London paper. “If the governments decide we should do things differently and come up with a vastly different set of products we would be at their beck and call.”
http://www.wnd.com/2014/04/u-n-climate-chief-admitted-political-agenda-of-science-report/#JrW8VbbylrRwCu2X.99
so looking thro 12,000 report for facts is just a tick box exercise?
don’t people feel used? or are people hoping for a nobel?
Pretentious Mosher strikes again…………
“Teddi says:
April 2, 2014 at 2:23 am”
http://dotsub.com/view/326dcd74-446d-4790-b6e1-9d727d4b9725
Reply to Brad on April 1 at 11:15 am
Accountability solves most every problem, doesn’t it? There is simply no accountability when it comes to climate modeling. Thanks.
Reply to DanMet’al on April 1 at 12:10 pm
“I suggest that we not abandon physically-based models just because the GCM crowd are seemingly inept and untethered to generally accepted modeling verification and validation techniques.”
You are absolutely right. I use them all the time. The key is to know what their limitations are, or, more to the point, admit to what their limitations are (especially, in my case, to myself).
Reply to Pat Frank on April 1 at 12:28 pm
“but are being represented as predictive scientific models.”
Would you say that this is intentional, or is it simply that they don’t know any better?
Reply to DanMet’al on April 1 at 1:51 pm
“But what can the WUWT community do to more aggressively push for honest data analysis and more transparent data and uncertainty quantification for GCM results?”
This is my frustration too. This site is extremely important, but this central question is pretty much being ignored – even here on this site. My feeling is that so very few people have even the most rudimentary knowledge of computer modeling that they cannot begin to understand why the climate models are so useless.
I have a suggestion for Anthony. Do a survey of how much people right here on this site who are very interested in this subject really understand about what is at the center of this debate. How many people can answer the very simple question – what do climate scientists say is the actual science behind the claim that man made CO2 is a significant cause of any current warming? No technical details are needed – just a very simple general explanation of the science behind the claim. I’ll bet that not one in fifty, even here on this site, can answer this question. I’ll bet that, even with Google Search, no one can find a general explanation for this question. If I’m right, and this is indeed the case, doesn’t it make a person wonder why? Doesn’t it make a person suspect that climate scientists do not want a simple answer to this question easily available on the net? Doesn’t it make a person suspect that they do not want a discussion on this?
Pat Frank: Matthew R. Marler, Steve isn’t criticizing my AGU poster. He’s upset about my papers on the global air temperature record, first one here (869.8 kb pdf), follow-up here (1 mb pdf).
OK, but up thread you posted the link to the poster, and he responded after you posted that link.
Here is his whole comment:
“I presented a poster at the 2014 Fall AGU Meeting in San Francisco last December on the same work. The download is here (2.9 mb). Zero predictive value; it’s all there for critical examination.”
Pat your work was torn to shreds by JeffId (skeptic), Lucia (lukewarmer) and every person who looked at your nonsense. When asked tough questions you avoided them and changed the subject.
The models are wrong as all models are. But your stuff isnt even wrong
The quote is from your preceding post. It looked to me like he was criticizing the poster.
Kermit, from my own experience I’d say it is intentional and that they don’t know any better, both.
My impression after talking with climate modelers is that either they were not trained as physical scientists or else that they’ve forgotten how to think as a scientist. The model is all for them. Measurement data are either confirmatory or an annoyance.