
Theories that can be easily tested should have a high degree of consensus among researchers. Those involving chaotic and less testable questions – climate change or economic growth, physiology or financial markets – ought to have a greater level of scientific disagreement. Yet this is hardly the case for climate science. In the Paradox of Consensus, we illustrate that the greater the level of consensus for certain classes of hypotheses (those that are difficult to test) the less truth we should assign to them.
Guest Essay By D. RYAN BRUMBERG and MATTHEW BRUMBERG
The moon is not made of cheese, the earth is not flat, and lightning may strike the same place twice. We believe these claims to be true, yet it is unlikely that most readers have personally confirmed each of them. Because it would be nigh impossible for anyone to verify all they take as true, most individuals arrive at their worldview by following the beliefs of others (often “experts”). While there can be good reason to accept an idea based on its popularity, this consensus heuristic must be used with care. There must be a sufficient number of others who did arrive (and continue to arrive) at the same conclusion through independent verification and testing. When this condition is not met, the results can be catastrophic (recall the Challenger disaster). Instead of independent observers arriving at the same conclusion, we risk an information cascade. This failing goes by many names—argumentum ad populum, groupthink, the “bandwagon effect”—but its function is the same: increasing numbers of people will buy into an idea simply because many others already believe it.
Consensus, in and of itself, is not necessarily a bad thing. The more easily testable and verifiable a theory, the less debate we would expect. There is little disagreement, for example, about the sum of one plus one or the average distance of the earth from the sun. But as a question becomes more complex and less testable, we would expect an increasing level of disagreement and a lessening of the consensus—think: the existence of god, the best band since the Beatles, or the grand unified theory of physics. On such topics, independent minds can—and should—differ.
We can use a simple formula to express how an idea’s popularity correlates with its verifiability. Let us introduce the K/C ratio—the ratio of “knowability,” a broad term loosely encapsulating how possible it is to reduce uncertainty about an idea’s correctness, to “consensus,” a measure of the idea’s popularity and general acceptance. Topics that are easily knowable (K ~ 1) should have a high degree of consensus (C ~ 1), whereas those that are impossible to verify (K ~ 0) should have a low degree of consensus (C ~ 0). When the ratio deviates too far from the perfect ratio of 1, either from too much consensus or too little, there is a mispricing of knowledge. Indeed, in cases of extreme deviations from the perfect ratio, additional support for a concept with such a lopsided K/C ratio increasingly subtracts from its potential veracity. This occurs because ideas exist not simply at a single temporal point, but rather evolve over the sweep of time. At the upper reaches of consensus, there is less updating of views to account for new information—so much so that supporters of the status quo tend to suppress new facts and hypothesis. Government agencies deny funding to ‘sham’ scientists, tenure boards dissuade young researchers from pursuing ‘the wrong’ track, and the establishment quashes heretical ideas.
Consider the belief that the sun, moon, and stars circle the earth—a reasonable initial proposition. Yet, as additional facts became available (Copernicus, Brahe, Galileo), the dogmatic believers of the consensus condemned these observations as heresy. A world with a less skewed K/C ratio (lower level of consensus given low knowability) would have advanced to the heliocentric model sooner. Given that we know not the evolutionary stage for any current theory, we arrive thus at the unexpected conclusion that when knowability is low, as the level of consensus increases (without a commensurate increase in knowability), there should be a decrease in the probability assigned to the truth of the matter. While not always clear why the K/C ratio can become highly skewed, one interpretation is that more than just the search for knowledge is at play.
To see how this works in practice, we turn to the evergreen topic of climate change. Notwithstanding the underlying ecological threat of climate change itself, the debate about how to confront human-caused global warming has spawned unprecedented financial, political, and social risks of its own. Entire industries face extinction as the world’s governments seek to impose trillions of dollars of taxes on carbon emissions. The New York Times’s Thomas Friedman approvingly writes that Australian politicians—not to mention public figures through the world—now risk “political suicide” if they deny climate change. But if carbon dioxide turns out not to be the boogey-man that climate scientists have made it out to be, tens of trillions will be wasted in unneeded remediation. Much of the world—billions of humans—will endure a severely diminished quality of life with nothing to show for it. The growth trajectory of the world in the twenty-first century may well depend more on the “truth” of climate change ex ante than ex post.
With climate change, as in many areas of scientific complexity, we can (and do) use models to understand the world. But models have their problems. This is particularly true when dealing with complex, non-linear systems with a multitude of recursive feedback loops, in which small variations produce massive shifts in the long-term outcome. Pioneered by the mathematicians Edward Lorenz and Benoit Mandelbrot, chaos theory helped explain the intractability of certain problems. Readers of pop science will be familiar with the term the “butterfly effect,” in which “the flap of a butterfly’s wings in Brazil set[s] off a tornado in Texas.” The earth’s climate is one such dynamic, chaotic system and it is within the whirling, turbulent vortex of unpredictability that the modern climate scientists must tread.
And boldly have they stepped into the breach. The scope of agreement achieved by the world’s climate scientists is breathtaking. To first approximation, around 97% agree that human activity, particularly carbon dioxide emissions, causes global warming. So impressed was the Norwegian Nobel Committee by the work of the Inter-governmental Committee on Climate Change and Al Gore “for their efforts to build up and disseminate greater knowledge about man-made climate change, and to lay the foundations for the measures that are needed to counteract such change” that it awarded them the 2007 Nobel Peace Prize. So many great minds cannot possibly be wrong, right?
Yet something nags us about this self-congratulatory consensus. Our intuition is that this narrow distribution of opinions yields a knowability to consensus ratio far removed from the perfect ratio of 1. To reach their conclusions, climate scientists have to (a) uncover the (historical) drivers of climate, (b) project the future path of these inputs and others that may arise, and (c) predict how recursive feedback loops interact over multi-decadal time horizons, all without being able to test their hypotheses against reality. When evaluating the causes of past climate shifts, for example, scientists cannot simply re-run history to test the impact of changing different variables. Similarly, although climate scientists can make testable hypotheses about the future, their short-term predictions have an embarrassing record (think post-Katrina predictions of a massive surge in US hurricanes or the failed attempts to forecast temperature changes for the 2000s), while the debate will be moot by the time we can test their long-term forecasts in the year 2100.
We would, therefore, expect this limit on empirical verifiability to birth widely divergent views on the path, causes, and consequences of earth’s future climate. In other arenas, only after a theory has been empirically verified has the scientific community coalesced around it. Even then, scientists continue to subject such theories to rigorous testing and debate. For example, consider the current state of theoretical physics: quantum physics, loop quantum gravity, string theory, super-symmetry, and M-theory, among others, all vie for acceptance. Albert Einstein’s general relativity itself did not begin to garner widespread support until four years after its publication, when Arthur Eddington verified its predictions during a 1919 solar eclipse. Even so, as illustrated by the rash of headlines in late 2011 announcing the (false) discovery of faster-than-light neutrinos, scientists continue to try to poke holes in Einstein’s theory.
Yet the expectation of a rich debate among scientists about climate change does not reconcile easily with the widely endorsed shibboleth that human activity will warm the globe dramatically and dangerously over the next one hundred years. As climate scientists are themselves fond of repeating, the vast majority have arrived at the exact same conclusions about both past warming and future trends. Any discussion that doubts the fundamental premises of climate change is dismissed by the mainstream media and climate scientists as pseudo-science conducted by quacks or ideologues. Thus, questions about observational biases in the location of temperature stations, changes in the earth’s albedo, the cooling effect of dust particles, shifting ocean cycles, fluctuating solar activity, correlation v. causation of historical warm periods and carbon dioxide, catastrophic model failure caused by chaotic interactions, and innumerable other theories—most of which are presumably wrong—are never properly mooted in the public debate.
In our view, the fact that so many scientists agree so closely about the earth’s warming is, itself, evidence of a lack of evidence for global warming. Does this mean that climate change is not happening? Not necessarily. But it does mean that we should be wary of the meretricious arguments mustered in its defense. When evaluating complex questions—from climate change to economic growth, physiology to financial markets—it is worse than naïve to judge the veracity of an idea merely from the strength of consensus. The condemnation of Galileo Galilei meant one man served a sentence of life imprisonment. His ecumenical accusers at least acknowledged a force greater than science drove their decision. The modern priests of climate change endanger the lives of billions as they wield their fallacy that consensus is truth.
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.
K/C sounds a lot like Karl Popper’s ‘surprise’ of The Logic of Scientific Discovery.
The real danger comes when K/C approaches 0, and people start to act on the lack of knowledge. You do more damage when you do not know what you are doing, than doing nothing.
Yes, the ‘modern priests of climate change’ endanger us all, epecially with their diversion of political energies away from the developmemnt of cheap electrical energy.
There is nothing wrong with a consensus of opinion (or belief) as long as we do not behave as if such a consensus is the same as physical reality: William James, pragmatist, described any “truth” as a useful article to be considered only an approximation of truth, and only useful as long as evidence showed it to be an approximation of truth less than needed.
An opinion is not fact, regardless of how many hold it, and a “fact” is only a close representation of reality as it is not in contradiction with other “known” truths, leads us correctly towards other things we would not have found otherwise and is useful. CAGW does not lead us correctly towards the mid-tropospheric hotspot, does not lead us to the temperature history of the last 30 years and several other items. As such CAGW theories are opinions, not facts and not very good “truths”, though they are more useful than nothing.
If we were faced with no theory, a guess would be more useful than nothing, and a consensus opinion of a guess would be more useful than a guess without any opinion at all. Fortunately we are not faced with no theory, but several, one or two of which handle the other two weaknesses of CAGW with regard to a pragmatist’s “truth”, i.e. the predicted events that aren’t present and the present events that aren’t predicted. So a consensus of opinion in the current case has no value.
We don’t have to admit we know a lot to go forward, but if we think we go forward thinking we have lot more than we actually have, we’ll be like the fellows wading into the empty swamp surprised to find something biting on their butts.
“recall the Challenger disaster”
Why yes I did, and I was scolded and told that was a low blow. But I made my point. See the late April comments near the current end of this thread :
http://channel9.msdn.com/Forums/Coffeehouse/Crown-Capital-Earth-Management-Fraud-Warriors-Earth-Hour
You’ll have to excuse the title of the thread, I had nothing to do with that.
Money is the reason that the truth is being hidden. They have invested all that money needlessly, and don’t want to admit it….
The post brought this to mind…
So there is a consensus on AGW. JP
I thought the “consensus” was that man “contributed to” not caused global warming? The PNAS said scientists agreed with the “basic tenets of the IPCC” whatever that means and the other survey said there was a “significant contribution”, but I don’t remember any that said it was “caused” by man’s activity.
The fluid terminology surrounding climate politics is a dead giveaway.
‘Global warming’ (usually implies AGW and often CAGW) is used interchangeably with ‘Climate Change’, a meaningless axiomatic term that has more recently been adopted to imply AGW or CAGW, but purposely not defined in order to embraces any and all, known and unknown, actual and potential adverse anthropogenic influences.
Such fluid terminology is resistant to a testable definition, which suits both scientific uncertainty and political agendas. And needless to say, it is not the first time ‘consensus’ has dragged us to hell.
A better test of the meaningfulness of a consensus would be if there are no compelling data and analyses offered from within the greater peer group. This consensus would only matter in politics where reason is frequently suspended in order to move an agenda forward. None of this is a substitute for the truth as a consensus can be the result of laziness or funding (Gentlemen – we are agreed. This is hard/expensive – let’s do it wrong) or the consensus may be entirely opinion (gut feel) and not a result of artfully presented compelling data. A consensus does not alter facts and is not a component of science and does not survive debate within the scientific circle (Listen to me, Einstein – give it up. Everyone is in the Euclidean camp). It is made much over outside that circle largely in the fourth estate of comedy — the press.
The only way to relate consensus to the world is to state clearly that consensus is of no consequence in matters of science and a consensus of scientists whose actions are to use that consensus as a tool of influence should be treated like pick-pockets and con-artists.
Well basically every person who wants to become a climate modeler these days will probably get a nice warm place to go to during office hours, will be paid pretty well by a Green government; and otherwise achieve exactly nothing in his life. From time to time he will have the opportunity to pontificate in state-owned media about the terrible future that awaits us all. If that’s your cup of tea, go for it. Maybe you can also land a nice marketing deal with Panasonic.
John Parsons says:
April 30, 2013 at 4:27 pm
“So there is a consensus on AGW. JP”
Yes, amongst idiots.
Mike Hulme has already made the related point that the appearance of consensus makes people less likely to accept the consensus view. The reason is that we are instinctively suspicious of what appears to us as manufactured conformity (especially in a complex area like climate).
Re: Gofer @1631 on 4/30/13
Q. How do you significantly contribute toward a result without being one of the effective causes of that result?
I’ve seen a quotation in a climate blog recently but unfortunately I can’t find it again.
Basically it said: If everyone really did believe the same thing then you would not have to go round telling everyone there was a consensus.
In the fields of “soft science”, consensus is most important. Much like a popularity contest–“Here is what we found, if you disagree you are stupid”.
“Hard science” is not questioned. No one questions gravity. But ice cores, rock formations, and lake bottoms, are subject to interpretation. If you disagree, you do not get your doctorate, or you to not get your funding, our you do not get to appear on TV.
When people have motivations other than the TRUTH, the real science disappears.
It’s not the percentage that matters, it’s the Politburo.
Consider the standard “theory” of evolution. It’s not a theory in the first place, only a set of beliefs; it has never been proved by the origin of any species; and lots of working biologists have abandoned most of its details for various alternatives that are closer to the facts. But the standard “theory” is still REQUIRED BY LAW. If you dare to teach any of the alternatives seen by large numbers of working biologists, you will be fired or sued.
For all X: As long as the silverbacks who control the grant money believe in theory X, theory X will be the only allowed theory.
In our view, the fact that so many scientists agree so closely about the earth’s warming is,..
An incorrect view, since “so many” is really nowhere near 97%.
So Global Warming is nothing more than unsubstantiated opinion. Loosely held, too.
In a chaotic system, such as the atmosphere and oceans, two or more forcings deprives the system of being capable of being forecast over a longer period. Yes, we have climate changes on many time scales (not man-made), and we are unable to predict them because the system is chaotic.
Remember, the same man does not go into the same river twice.
Let’s see if I have this right …
The “97%”.
1.
Bunch of post-grad students decided to conduct a survey.
Many of us have been “post-grad” students. Many more of us know that the species can be downright dangerous 🙂
They have passed some sort of milestone, so think they know it all etc etc
2.
They didn’t get any advice about ensuring questions were concise, unambiguous, and were NOT leading questions etc.
3.
Contacted about 3000 “scientists”? Not a bad effort.
4.
About 1,000 responded. Not so good in my experience as a perpetrator of surveys. A decent survey will usually get 50% at the first call, most people being helpful etc.
5.
Many of the responses were highly critical of the questions, approach etc.
6.
Perps didn’t like this, so instead of fixing the problems, they filtered the responses to include only those respondents who identified themselves as “climate scientists”. As we know, this is widely regarded as an oxymoron. Climate goes in a thousand directions. It has been estimated (I do not recall by whom) that there are over 100 scientific and technical disciplines that have a bearing on the understanding of climate. (I did not take this as “given” so I started compiling a list. Stopped when I got to 84.) No one person can be expert in more than about 3 or 4 of these. So it is unsurprising that people who actually know stuff about climate tend to identify themselves according to their base qualifications and avoid the term.
7.
They (claim to have) got 77 responses identifying as “climate scientist”. 75 of the 77 believed that GW, CC, EW or whatever term was being peddled at the time was anthropogenic.
75/77 x 100 = 97.4%
The last time I went with consensus , I wound up soaked to the bone and fourteen miles from the truck !
As one of the paper’s authors, I wanted to share a response I received that helps illustrate how too much consensus (at least among “mainstream scientists”) can impede the search for truth. The language is strong, but this sentiment is common among people’s responses. Such strongly held beliefs create an environment where it is difficult to challenge the established wisdom. This is an example of why we should assign a lower ex ante probability to claims that have high levels of consensus (with low knowability) compared to when there is less consensus (with low knowability).
———
FROM: G.R. [ a Stanford/OECD economist ]
You’re ignorant.
The climate has changed and it due to greenhouse gases. There is no scientific debate about this. None.
The opposing side (the side of ignorance) is the side of greed, supported by the energy companies. They are committing crimes against humanity and the planet, and should be tried as the Nazis were tried after WWII.
They are not held accountable because half the population in the US (not the rest of the world) thinks “global warming” is a sign of the end of the world and the second coming of Christ. Do you think my hackels have been raised?
Your application to this particular issue is an apology for their crimes. And you will come to regret your wasted efforts.
Is your work an apology or a scientific inquiry into the creation of facts by consensus instead of scientific inquiry?
I’ll take my answer off the air