Newsbytes: Big Science Is Broken

Also: Poll: Just 6 Percent Of Americans Say They Trust News Media

johann-wolfgang-von-goethe

From the Lewpaper department:

Science is broken. That’s the thesis of a must-read article in First Things magazine, in which William A. Wilson accumulates evidence that a lot of published research is false. But that’s not even the worst part. Advocates of the existing scientific research paradigm usually smugly declare that while some published conclusions are surely false, the scientific method has “self-correcting mechanisms” that ensure that, eventually, the truth will prevail. Unfortunately for all of us, Wilson makes a convincing argument that those self-correcting mechanisms are broken.

Advocates of the existing scientific research paradigm usually smugly declare that while some published conclusions are surely false, the scientific method has “self-correcting mechanisms” that ensure that, eventually, the truth will prevail. Unfortunately for all of us, Wilson makes a convincing argument that those self-correcting mechanisms are broken.

For starters, there’s a “replication crisis” in science. This is particularly true in the field of experimental psychology, where far too many prestigious psychology studies simply can’t be reliably replicated. But it’s not just psychology. In 2011, the pharmaceutical company Bayer looked at 67 blockbuster drug discovery research findings published in prestigious journals, and found that three-fourths of them weren’t right. Another study of cancer research found that only 11 percent of preclinical cancer research could be reproduced. Even in physics, supposedly the hardest and most reliable of all sciences, Wilson points out that “two of the most vaunted physics results of the past few years — the announced discovery of both cosmic inflation and gravitational waves at the BICEP2 experiment in Antarctica, and the supposed discovery of superluminal neutrinos at the Swiss-Italian border — have now been retracted, with far less fanfare than when they were first published.”

What explains this? In some cases, human error. Much of the research world exploded in rage and mockery when it was found out that a highly popularized finding by the economists Ken Rogoff and Carmen Reinhardt linking higher public debt to lower growth was due to an Excel error. Steven Levitt, of Freakonomics fame, largely built his career on a paper arguing that abortion led to lower crime rates 20 years later because the aborted babies were disproportionately future criminals. Two economists went through the painstaking work of recoding Levitt’s statistical analysis — and found a basic arithmetic error.

Then there is outright fraud. In a 2011 survey of 2,000 research psychologists, over half admitted to selectively reporting those experiments that gave the result they were after. The survey also concluded that around 10 percent of research psychologists have engaged in outright falsification of data, and more than half have engaged in “less brazen but still fraudulent behavior such as reporting that a result was statistically significant when it was not, or deciding between two different data analysis techniques after looking at the results of each and choosing the more favorable.”

Then there’s everything in between human error and outright fraud: rounding out numbers the way that looks better, checking a result less thoroughly when it comes out the way you like, and so forth.

Still, shouldn’t the mechanism of independent checking and peer review mean the wheat, eventually, will be sorted from the chaff?

Well, maybe not. There’s actually good reason to believe the exact opposite is happening.

The peer review process doesn’t work. Most observers of science guffaw at the so-called “Sokal affair,” where a physicist named Alan Sokal submitted a gibberish paper to an obscure social studies journal, which accepted it. Less famous is a similar hoodwinking of the very prestigious British Medical Journal, to which a paper with eight major errors was submitted. Not a single one of the 221 scientists who reviewed the paper caught all the errors in it, and only 30 percent of reviewers recommended that the paper be rejected. Amazingly, the reviewers who were warned that they were in a study and that the paper might have problems with it found no more flaws than the ones who were in the dark.

This is serious. In the preclinical cancer study mentioned above, the authors note that “some non-reproducible preclinical papers had spawned an entire field, with hundreds of secondary publications that expanded on elements of the original observation, but did not actually seek to confirm or falsify its fundamental basis.”

This gets into the question of the sociology of science. It’s a familiar bromide that “science advances one funeral at a time.” The greatest scientific pioneers were mavericks and weirdos. Most valuable scientific work is done by youngsters. Older scientists are more likely to be invested, both emotionally and from a career and prestige perspective, in the regnant paradigm, even though the spirit of science is the challenge of regnant paradigms.

Why, then, is our scientific process so structured as to reward the old and the prestigious? Government funding bodies and peer review bodies are inevitably staffed by the most hallowed (read: out of touch) practitioners in the field. The tenure process ensures that in order to further their careers, the youngest scientists in a given department must kowtow to their elders’ theories or run a significant professional risk. Peer review isn’t any good at keeping flawed studies out of major papers, but it can be deadly efficient at silencing heretical views.

All of this suggests that the current system isn’t just showing cracks, but is actually broken, and in need of major reform.

–Pascal-Emmanuel Gobry, The Week, 18 April 2016

 

At its best, science is a human enterprise with a superhuman aim: the discovery of regularities in the order of nature, and the discerning of the consequences of those regularities. We’ve seen example after example of how the human element of this enterprise harms and damages its progress, through incompetence, fraud, selfishness, prejudice, or the simple combination of an honest oversight or slip with plain bad luck. When cultural trends attempt to render science a sort of religion-less clericalism, scientists are apt to forget that they are made of the same crooked timber as the rest of humanity and will necessarily imperil the work that they do. The greatest friends of the Cult of Science are the worst enemies of science’s actual practice. –William A. Wilson, First Things, May 2016

Trust in the news media is being eroded by perceptions of inaccuracy and bias, fueled in part by Americans’ skepticism about what they read on social media. Just 6 percent of people say they have a lot of confidence in the media, putting the news industry about equal to Congress and well below the public’s view of other institutions. The poll shows that accuracy clearly is the most important component of trust. Nearly 90 percent of Americans say it’s extremely or very important that the media get their facts correct, according to the study. Readers also are looking for balance: Are there enough sources so they can get a rounded picture of what they are reading. –Carole Feldman and Emily Swanson, Associated Press, 18 April 2016

h/t to Benny Peiser of The GWPF

Get notified when a new post is published.
Subscribe today!
0 0 votes
Article Rating
166 Comments
Inline Feedbacks
View all comments
Owen in GA
April 19, 2016 10:37 am

I think the inclusion of the superluminal particles team is a bit of a cheap shot. The researchers put all their techniques and data out there a practically begged other teams to please find their error. Then when someone did, they thanked them and pulled down the whole thing. That was a case of researchers mistrusting their own results, being skeptical and asking for help.
For the most part physics seems to work about as well as it always has. (there is still resistance to change, but we are human and that is part of our nature)

Reply to  Owen in GA
April 19, 2016 10:42 am

I think the inclusion of the superluminal particles team is a bit of a cheap shot.

Absolutely! The team did advertise their results, but explicitly asked for help figuring out if they were making a mistake or actually observing what they thought they were. And when they accepted they had made a mistake, they published their retraction with equal fanfare. It’s not their fault that other people decided to promote the first announcement more dramatically than the second one.

Reply to  Owen in GA
April 19, 2016 11:23 am

The Bicep2 retraction came rather quickly as well. There were already teams extemely skeptical when the result was first published. Questions on solar system related noise quickly came up.
Hard physics is not broken.
Climate scince though is beyond repair.
Or as was said above, “science advances one funeral at a time..” Too many reputations of entrenched, (politically favored) well-funded climastrologists need to first be buried before the fever from the CAGW sickness abates.

john harmsworth
Reply to  Joel O’Bryan
April 19, 2016 1:47 pm

Ive got a shovel!

Reply to  Joel O’Bryan
April 19, 2016 4:05 pm

Not so with BICEP2, they said “just because we over interpreted the data doesn’t mean we were wrong”, they said, after being shown to be wrong.
For the love of…. I knew they were wrong before they made the claim they were right. You cant detect a signal that is an order or two of magnitude smaller than the noise in between the observer and the signal unless you have a priory knowledge of that signal or you control the signal, those are the standards, if you cant meet either of those criteria, you cant claim to have a signal.

Wrusssr
Reply to  Joel O’Bryan
April 19, 2016 10:41 pm

Bury them face down so they can’t dig out.

Stephen Richards
Reply to  Owen in GA
April 19, 2016 11:24 am

I would agree with this comment. As I former member of the Inst of physics I thought it did it’s best but I remember several ,instances of arse protection and their latest declaration on global warming is verging on the inept.

Aphan
Reply to  Owen in GA
April 19, 2016 12:03 pm

I don’t read that part as calling the physicists involved in those two events liars or bad. His entire sentence reads that they were retracted with “less fanfare” than they were announced. Meaning most average readers have no idea they were retracted.
His point is that science is broken. Discoveries like those two, should have been validated and verified BEFORE they were announced to the world as “accomplished”. He even speaks of physics as the science one would think has NOT been infected, but it too has become “media” fodder and abused for headlines and drama.

Alan Ranger
Reply to  Owen in GA
April 19, 2016 3:49 pm

I think the context is the most important issue here:
“two of the most vaunted physics results of the past few years — … and the supposed discovery of superluminal neutrinos at the Swiss-Italian border — have now been retracted, with far less fanfare than when they were first published.”
The criticism is of the relative degrees of “vaunting” by the news media. Much cheering, wailing and gnashing of teeth in the race to headline that “Einstein was all wrong!” Hardly a whimper on the back pages that the whole scare was a false alarm. I fear that the eventual revelation/demise that AGW was all a scam will also fade into an inconspicuous fine print fizzle. Nobody will learn from history … again.

April 19, 2016 10:40 am

“In 2011, the pharmaceutical company Bayer looked at 67 blockbuster drug discovery research findings published in prestigious journals, and found that three-fourths of them weren’t right.”
No possible conflict of interest there, right? I would be interested to see their reasonings. Sounds to me like the other side of the same coin; nobody else’s work is “right”…except ours.

D. J. Hawkins
Reply to  Mike
April 19, 2016 11:02 am

Not having read whatever report Bayer generated, I reserve comment on your claim. Consider, however, that the “not invented here” syndrome can easily make you a competitive also-ran. Is it unreasonable to believe that Bayer looks outside itself to consider promising lines of investigation? In that light, knowing that 75% of the disclosures out there are, well, crap, potential JV’s aimed at developing any of these wonder-drugs suddenly look a lot riskier.

Owen in GA
Reply to  D. J. Hawkins
April 19, 2016 11:11 am

It would seem to me that the first step in deciding to acquire rights to a chemical or process would be to try to fully replicate the experiment to see if it was worth the monetary risk. The company would likely have to invest billions in the development and clinical testing to get the item to market. Checking if the basic concept makes sense seems like a good investment.

D. J. Hawkins
Reply to  D. J. Hawkins
April 21, 2016 10:05 am

@Owen
Replication sounds all well and good, but remember we’re not dealing with patent applications where the disclosure is supposed to provide enough information for replication by anyone “skilled in the art”. So now you have to negotiate non-disclosure agreements (NDA’s) to get enough info to figure out how to replicate the compound, do your own study and THEN find out it’s junk. And you’ve probably paid the original investigators some kind of fee because while you’re doing your thing they can’t shop it around to other potential partners. Double-plus ungood.

thallstd
Reply to  Mike
April 19, 2016 5:16 pm

That reminds me more than a little bit of the following article that discusses this subject as well…
http://www.newyorker.com/magazine/2010/12/13/the-truth-wears-off
Which begins…
“On September 18, 2007, a few dozen neuroscientists, psychiatrists, and drug-company executives gathered in a hotel conference room in Brussels to hear some startling news. It had to do with a class of drugs known as atypical or second-generation antipsychotics, which came on the market in the early nineties. The drugs, sold under brand names such as Abilify, Seroquel, and Zyprexa, had been tested on schizophrenics in several large clinical trials, all of which had demonstrated a dramatic decrease in the subjects’ psychiatric symptoms. As a result, second-generation antipsychotics had become one of the fastest-growing and most profitable pharmaceutical classes. By 2001, Eli Lilly’s Zyprexa was generating more revenue than Prozac. It remains the company’s top-selling drug.
But the data presented at the Brussels meeting made it clear that something strange was happening: the therapeutic power of the drugs appeared to be steadily waning. A recent study showed an effect that was less than half of that documented in the first trials, in the early nineteen-nineties. Many researchers began to argue that the expensive pharmaceuticals weren’t any better than first-generation antipsychotics, which have been in use since the fifties. “In fact, sometimes they now look even worse,” John Davis, a professor of psychiatry at the University of Illinois at Chicago, told me.
Before the effectiveness of a drug can be confirmed, it must be tested and tested again. Different scientists in different labs need to repeat the protocols and publish their results. The test of replicability, as it’s known, is the foundation of modern research. Replicability is how the community enforces itself. It’s a safeguard for the creep of subjectivity. Most of the time, scientists know what results they want, and that can influence the results they get. The premise of replicability is that the scientific community can correct for these flaws.
But now all sorts of well-established, multiply confirmed findings have started to look increasingly uncertain. It’s as if our facts were losing their truth: claims that have been enshrined in textbooks are suddenly unprovable. This phenomenon doesn’t yet have an official name, but it’s occurring across a wide range of fields, from psychology to ecology. In the field of medicine, the phenomenon seems extremely widespread, affecting not only antipsychotics but also therapies ranging from cardiac stents to Vitamin E and antidepressants: Davis has a forthcoming analysis demonstrating that the efficacy of antidepressants has gone down as much as threefold in recent decades.”

wws
Reply to  thallstd
April 20, 2016 4:12 am

I submit this hypothesis – that it a gross characterization to say that the efficacy of this class of drugs has “gone down”‘; rather, I submit that their true efficacy is finally being revealed, now that the sample size has gotten too large for all the overhyping and generous patient selection to cover up reality.
In this case, the motive was simple to understand – everyone involved officially made a huge profit off of making sure that everyone was told that these drugs were wonderful. Anybody in the system who tried to rock the boat would have found themselves out of a job very quickly, on the basis that “you’re trying to oppose the consensus”.

Reply to  thallstd
April 20, 2016 5:14 am

This phenomenon doesn’t yet have an official name, but it’s occurring across a wide range of fields, from psychology to ecology.
________________
It’s called ‘Verlust des Neuigkeitswerts’; some kind’a placebo effect.
Same with dietary products.
Cheers – Hans

Samuel C Cogar
Reply to  thallstd
April 20, 2016 10:57 am

thallstd stated:

Davis has a forthcoming analysis demonstrating that the efficacy of antidepressants has gone down as much as threefold in recent decades.”

Well SURPRISE, SURPRISE, …… given the fact that antidepressants are only good for “masking” the emotional effects one suffers from during their “bouts” of depression. Antidepressants do nothing to aid or help in the “curing” of the person’s depression causing problem.

Aphan
Reply to  Samuel C Cogar
April 20, 2016 1:01 pm

Samuel C Cogar
“Well SURPRISE, SURPRISE, …… given the fact that antidepressants are only good for “masking” the emotional effects one suffers from during their “bouts” of depression. Antidepressants do nothing to aid or help in the “curing” of the person’s depression causing problem.”
Ladies and gentlemen, please welcome the World’s Authority on Antidepressants and Depression-Samuel C. Cogar!!!
Blanket statements of any kind deserve ridicule. Sorry. MANY people who struggle with depression have a chemical imbalance in their neurotransmitters just like people who have diabetes have an insulin imbalance or the inability to regulate hormones, vitamins levels or sodium. It can be a hereditary condition, or one brought on by physical trauma to the brain, or an actual emotional event. But people like you who speak without thinking are the reason that many people refuse to seek help from ANYONE in the first place.
Of COURSE antidepressants don’t “cure” anything you idiot, depression isn’t a disease! It’s a chemical reaction that is part of the survival instinct. But medications often DO help those with imbalances they cannot control, or did not cause, to regulate brain chemistry. Not all people who suffer from depression have some kind of life horror story going on that needs to be dealt with in order to restore them to health and peace. And many of those that do, have literally altered their brain chemistry to the point of no return trying to deal with those emotional issues, and need to be stabilized in order to deal with them properly.

Samuel C Cogar
Reply to  thallstd
April 21, 2016 6:40 am

Aphan said:

Of COURSE antidepressants don’t “cure” anything you idiot, depression isn’t a disease! It’s a chemical reaction that is part of the survival instinct.

Survival instinct, HUH?
After making that statement you really should refrain from calling other people “idiots”.
So tell us, Oh Wise One, just how in hell does “depression” aid us humans in “survival of the species”? Other than, of course, providing of a “Cash Cow” for the opulent survival of the Psychiatrists and Psychologists.
Depression has been studied and treated since the 1800’s …… and the “psycho-babblers” of today are still faithfully following the written verbiage of a late-19th Century “cocaine addicted” author, …. Sigmund Freud, … and the only things they have accomplished in respect to the “treatment of depression” during the past 130 years is: 1) new types of prescription drugs every few years to “mask” the effect; ….. and 2) they now have dozens of “names” for depression and they keep changing the “names” and/or keep thinking up “new names” ….. but they have never figured out the cause of depression or how to cure it.
They are trying to “treat” the conscious mind of a person suffering from “depression” ….. without realizing that the conscious mind is subservient to the subconscious mind.
Ya can’t teach the conscious mind much of anything ….. because it will go to sleep when ya least expect it. Cheers

thallstd
Reply to  Samuel C Cogar
April 21, 2016 9:36 am

“the conscious mind is subservient to the subconscious mind” which begs the question…
What is the subconscious mind subservient to if not he biochemistry of the organism in which it resides?

Aphan
Reply to  thallstd
April 21, 2016 12:03 pm

Samuel C Cigar,
I said “part of” because the BRAIN controls all survival instinct. I’m talking basic biology, not psychology. Learn something.
https://en.m.wikipedia.org/wiki/Neurotransmission
Neurotransmitters are KEY to every physical function. The chemicals in the brain regulate our fight or flight responses, our sensitivity to sound, light, threat, safety, taste, touch, etc. When those chemicals are not balanced, whether it be due to genetics, physical trauma, or repeated emotional stressors that exhaust specific neurotransmitters, the body physically responds. If the body cannot produce them fast enough, or steadily enough, to cope with demand, depression of normal mood, energy levels, functions results.
Being physically wounded causes the brain to release certain chemicals in a survival response. Not just to thicken and clot our blood, or rush pain relieving endorphins to the location, but also to increase adrenaline…sharpen our thinking and saving skills. Then, once the “danger” is gone, it releases calming, normalizing chemicals. Studies have shown that being emotionally wounded can cause some of the exact same chemical responses. If the brain’s ability to control key neurotransmitters like norepinephrine, dopamine, serotonin, and epinephrine is reduced, stress induced chemical imbalance dominates and over time, the body/mind simply cannot handle it.
“They are trying to “treat” the conscious mind of a person suffering from “depression” ….. without realizing that the conscious mind is subservient to the subconscious mind.”
Oh. My. Word. You just contradicted yourself so blatantly. It was the “cocaine addicted” “psycho babbler” Sigmund Freud that developed the idea that the conscious mind is subservient to the subconscious mind! Lol!
http://www.simplypsychology.org/psychoanalysis.html

Samuel C Cogar
Reply to  thallstd
April 22, 2016 7:44 am

Aphan said:

Oh. My. Word. You just contradicted yourself so blatantly. It was the “cocaine addicted” “psycho babbler” Sigmund Freud that developed the idea that the conscious mind is subservient to the subconscious mind!

Aphan, your reading comprehension skills are somewhat lacking and sorely need improvements.
Excerpted from your cited link, to wit:

Freud believed that people could be cured by making conscious their unconscious thoughts and motivations,

You should educate yourself on the difference between ….. conscious, unconscious and subconscious.
Freud was utterly ignorant of the nurturing and/or functioning of the human brain/mind. The conscious mind is only capable of “making choices”, that is, only if and when the subconscious mind presents it with two (2) or more entities to choose from.
Aphan also said:

Neurotransmitters are KEY to every physical function. The chemicals in the brain regulate our fight or flight responses, our sensitivity to sound, light, threat, safety, taste, touch, etc.

And Sam says, …. “So what?” The heart regulates the blood flow, …. does it not?
Aphan, please address the root cause of the “triggered” release of the aforesaid neurotransmitters.
“DUH”, if the subconscious mind detects environmentally sensed “info” that triggers a reaction of an Inherited Survival Instinct then said neurotransmitters are released and the person reacts accordingly ……. and the conscious mind won’t know what happened until “after the fact”.
Aphan, you should familiarize yourself with some basic fundamentals associated with your brain/mind ….. and you can do so by reading this commrntary, to wit:
A View of How the Human Mind Works
You need to embrace the “new” neuroscience of the 21st Century and relegate Sigmund Freud et ell and their wacky ideas to the dustbin of historically bad ideas.

Aphan
Reply to  Samuel C Cogar
April 22, 2016 9:49 am

Samuel C,
I’m not the one with a comprehension problem. I stated clearly that I was talking about biology, NOT psychiatry or psychology. I am not a Freud fan, nor am I talking about therapy outside of balancing brain chemistry. I specifically spoke only about the brain, and have zero interest in discussing the “mind” with you here.
Your OPINION that antidepressants are ineffective and only benefit psychiatrists is yours and mine that they do benefit millions of people is mine.

timg56
Reply to  thallstd
April 22, 2016 9:48 am

I seem to recall reading how those 2nd generation drugs were basically nothing more than Prozac modified in order to garner new patent rights, as the patent on Prozac was about to expire. I remember the tv commercials at the time – how they basically targeted select audiences and relabeled their medical issues in order to say they now had a new drug specifically designed to treat these conditions.

Samuel C Cogar
Reply to  thallstd
April 23, 2016 5:56 am

I stated clearly that I was talking about biology,
Aphan, I know what you were “talking about”, …… my Degree “major” was Biological Science.
The functioning of the brain, brain stem, spinal cord, etc., is all biological … and they all function via an electro-chemical “messaging” architecture.
I posted that hyper-link to commentary that I authored …… in hopes that you would read it and thus gain a better understanding, as well as improve your BIOLOGICAL knowledge of the human brain.
Being “bedazzled” with the currently recognized “neurotransmitters” only makes for an interesting conversation of unimportance.
But it would be a “game-changer” that would make for a truly interesting conversation ….. iffen you were to talk about the “data code” that those “neurotransmitters” are transmitting via the Nervous System network of nerve fibers.

Aphan
Reply to  Samuel C Cogar
April 23, 2016 2:55 pm

Nothing in your article was anything I didn’t already know, but thanks for insinuating and assuming otherwise. I find that nothing makes a person’s arguments more questionable that introducing bias and illogical reasoning along with them. Well…that and attempting to back up your arguments using something else you wrote somewhere else. That whole “I support my own arguments” thing is really hilarious.
But I disagreed with some of your points, as did several commenters. This isn’t a thread on brain chemistry or depression or neurotransmitters, so I’m outtie on this topic.

Geistmaus
Reply to  Mike
April 19, 2016 7:57 pm

Possibly, possibly. Or you could just replicate the Bayer study and see if it was reproducible.

Rob
Reply to  Mike
April 20, 2016 8:18 am

This included a lot of Bayer’s own research projects and the study was originally conceived in an attempt to understand why so many of their “lead” drugs failed to show efficacy in later studies.
I know the current meme is that all drug companies are baddies, but let’s not let that get in the way of understanding the issue: You can’t get a government grant to confirm a study already published by someone else. Consequently there is almost never even an attempt to replicate findings and to do so is seen as lower level science, not worthy of top quality researchers.

Owen in GA
Reply to  Rob
April 20, 2016 1:34 pm

I can sympathize in part with that sentiment, but to me, core research needs to be readdressed occasionally just to make sure we are all still understanding it in the same way. Language and research trends drift over time and understandings can sometimes move a long ways off course to the point where the early papers we cite don’t really mean what we think they mean. The only way to clear that up is to take a fresh look at the raw data down to the sample selection methodology and piece the whole thing back together. We might find some surprising insights in this activity, but we would probably be prevented from publishing them until many funerals later…

Taphonomic
April 19, 2016 10:43 am

So what else is new? John P. A. Ioannidis published “Why Most Published Research Findings Are False” in 2005. It’s only gotten worse since then.
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1182327/

Don K
Reply to  Taphonomic
April 20, 2016 12:45 am

But at least Ioannidis’ colleagues acknowledge that he has a point. They do not call him names and look into the possibility of jailing him.

jeff
April 19, 2016 10:58 am

Bravo !!!

ShrNfr
April 19, 2016 11:01 am

Editorial comment. Second paragraph is repeated verbatim at the end of the first paragraph.

David Smith
Reply to  ShrNfr
April 19, 2016 11:42 am

Could we class it as a successful replication? 😉

misterkel
April 19, 2016 11:03 am

Read Spiritual Autopsy of Science &Religion by K. Mitchell for a great book on this subject.

Lem
April 19, 2016 11:03 am

Advocates of the existing scientific research paradigm usually smugly declare that while some published conclusions are surely false, the scientific method has “self-correcting mechanisms” that ensure that, eventually, the truth will prevail. Unfortunately for all of us, Wilson makes a convincing argument that those self-correcting mechanisms are broken.
Advocates of the existing scientific research paradigm usually smugly declare that while some published conclusions are surely false, the scientific method has “self-correcting mechanisms” that ensure that, eventually, the truth will prevail. Unfortunately for all of us, Wilson makes a convincing argument that those self-correcting mechanisms are broken.
For starters, there’s a “replication crisis” in science.
…as well as this article 🙂

David Smith
Reply to  Lem
April 19, 2016 11:43 am

It seems I was replicating your comment Lem.
This could go on for ever…

Dodgy Geezer
April 19, 2016 11:04 am

… That’s the thesis of a must-read article in First Things magazine, in which William A. Wilson accumulates evidence that a lot of published research is false. …
I’m not sure why William Wilson gets any plaudits. John P. A. Ioannidis said exactly the same thing over 10 years ago in his paper ‘Why Most Published Research Findings Are False’ (2005) – see http://www.ncbi.nlm.nih.gov/pmc/articles/PMC1182327/
He also commented that publishing error is built into the system, and is not an unfortunate by-product – in fact he spent some time making the point that research results contrary to what were ‘required’ were automatically suppressed in Medical Research…

John
April 19, 2016 11:08 am

Perhaps the most damaging example of all time: Ancel Keys fabricating results in the cholesterol/saturated fat theory.

Ian W
Reply to  John
April 19, 2016 4:41 pm

Which has spawned an industry of food marketers and led to many deaths. But still blindly supported by many ‘nutritionists’.

NW sage
Reply to  Ian W
April 19, 2016 6:56 pm

It also destroyed the credibility of nearly everything related to the Government regulation of food and nutrition. So many FDA recommendations/requirements have now been shown to be not based on sound science that people are unwilling to believe ANY pronouncement the Government now makes.

Reply to  Ian W
April 20, 2016 11:24 am

If I believed in hell, I would like to think there is a special place there for the suffering and death caused by that one man

timg56
Reply to  Ian W
April 22, 2016 9:57 am

Tony,
If we become one with God when we die, and God is the all knowing entity claimed, it is possible that as part of him we too become all knowing. Under that hypothesis, it is entirely possible we create our own hell. Imagine knowing everyone you ever affected by your thoughts and actions, with them knowing everything about you.

markl
April 19, 2016 11:08 am

They forgot to include willful exaggeration and discounting of data to advance an ideology unrelated to science. Misusing science as a means to an end.

Resourceguy
Reply to  markl
April 19, 2016 11:11 am

That was a huge oversight.

john harmsworth
Reply to  markl
April 19, 2016 3:53 pm

I think Herr Goebels covered that one.

April 19, 2016 11:11 am

At last, the hard truth touches down on WUWT – science is broken.
https://thepointman.wordpress.com/2014/02/28/a-climate-of-deception-deceit-lies-and-outright-dishonesty/
Pointman

Dinsdale
April 19, 2016 11:17 am

Another problem is funding bias. When your benefactor wants a certain outcome and your livelihood depends on it, bias is built into the research from the start. When the government is the source of funds (supposedly in the service of the taxpayers) then their desired outcome is usually for more power. Climate research is the prime example of this funding bias. Why would they pay for research that says “its all natural”? How can you implement more laws and regulations if their is nobody to blame?
It is high time that we abolish all government funding for scientific research.

Severian
Reply to  Dinsdale
April 19, 2016 12:29 pm

He who pays the piper calls the tune.

Bruce Cobb
Reply to  Severian
April 19, 2016 1:14 pm

Yes, but they fiddled with the data, and now the jig is up.

PiperPaul
Reply to  Severian
April 19, 2016 2:05 pm

Unfortunately, I’m currently not playing.

PiperPaul
Reply to  Severian
April 19, 2016 2:06 pm

And Peter doesn’t have any money left; it’s tax time.

Reply to  Severian
April 20, 2016 6:40 am

The Golden Rule; He who has the Gold sets the Rule. 🙂

Reply to  Severian
April 21, 2016 1:36 pm

In old German:
Wess Brot ich ess, dess Lied ich sing.
I sing the song of the one who gives me bread.

Mike M. (period)
Reply to  Dinsdale
April 20, 2016 11:11 am

Dinsdale wrote: “It is high time that we abolish all government funding for scientific research.”
That is pretty much the same thing as abolishing all funding for research; especially since the stated reason applies to pretty much all sources of research funding.

April 19, 2016 11:18 am

LIke the “consensus paradox” , while increasing numbers of scientists are found fudging the data, well groomed media outlets portray climate scientists as beyond fault that are being harassed by evil skeptics. Despite climategate emails, or blatant deceptive sins of omissions that should have a paper retracted http://landscapesandcycles.net/American_Meterological_Society_half-truth.html
climate science does not “officially” acknowledge the problems with the expected frequency of retractions and bad science seen in other disciplines. Have climate scientists simply circled the wagons to protect their funding or is it due to the inability to test climate projections 100 years into the future

Reply to  jim Steele
April 19, 2016 11:26 am

That Science mag has fefused to acknowledge the M&M desembly of Mann’s tree ring paper tells you all you need to know about climate corruption for cash in our academies and science societies.

Catcracking
Reply to  Joel O’Bryan
April 19, 2016 12:14 pm

Agree, it is a disgrace that so many are unwilling or afraid to expose the errors associated with the tree ring paper. Even those who reluctantly admit it will not speak out for fear of reprisal.
Yet we are wasting billions of dollars and putting coal workers out on the streets. Have they no shame?

Catcracking
Reply to  Joel O’Bryan
April 19, 2016 12:16 pm

We even had to waste our time with congressional hearings where the lies were perpetuated.

Scottish Sceptic
Reply to  jim Steele
April 19, 2016 11:51 am

In my book “The Academic Ape: Instinctive aggression and boundary enforcing behaviour in academia”, I explain how academia is behaving like a closed shop union that is trying “demark” areas of knowledge as “belonging” to them. As such when we sceptics take an interest in the subject and start writing about “their” subject, we get a hostile reaction very much akin to that of the territorial reaction of great apes.
Hence, whilst those like Lewandowsky are clueless on the climate science, they and a host of other academics will gang together to “repel invaders” whenever they feel their “territory” is being invaded.
As such, whilst those like Mann try to rationalise their response by arguing that we are in some way to blame for their aggression, it seems most likely that much of the appalling behaviour we see is the purely instinctive and (for us in a modern society) irrational behaviour of the primitive ape.

PiperPaul
Reply to  Scottish Sceptic
April 19, 2016 12:10 pm

…rationalise their response by arguing that we are in some way to blame for their aggression…
“See what you made me do?”

Scottish Sceptic
April 19, 2016 11:27 am

If you are an academic researching this area, you should buy my book (only available on kindle).
The Academic Ape: Instinctive aggression and boundary enforcing behaviour in academia
If however, you are a sceptic: there’s a free copy here

Reply to  Scottish Sceptic
April 19, 2016 12:49 pm

Thank you. 🙂

Jurgen
Reply to  Scottish Sceptic
April 19, 2016 1:05 pm

Thanks for the free copy!

Duncan
Reply to  Scottish Sceptic
April 19, 2016 6:52 pm

Reading this blog means you are an Academic, searching all avenues and contrary views. Does that mean by default we must pay?

Reply to  Scottish Sceptic
April 19, 2016 8:44 pm

Thanks Scottish! Nice work.

Reply to  Scottish Sceptic
April 20, 2016 5:39 am

Duncan on April 19, 2016 at 6:52 pm
Reading this blog means you are an Academic, searching all avenues and contrary views. Does that mean by default we must pay?
____________
Academics ought to reward other academics work – the / earnest / conter the more.
Me curious layman is welcome.

Yirgach
Reply to  Scottish Sceptic
April 20, 2016 6:01 pm

A nice April 1 publish date…

Nigel S
April 19, 2016 11:31 am

Oh for the likes of Sir Isaac Newton Warden and Master of the Royal Mint and scourge of coiners and clippers (capital crimes in the good old days).

April 19, 2016 11:39 am

I don’t think all science is broken. University based grant seeking science probably is. Most corporate sponsored research isn’t. Saw this up close and personal concerning energy storage materials for LiIon and supercaps. There are, IMO, several reasons for this university/grant nexus. Grant theme ‘fads’ susceptible to policy/political angles. Publish or perish academia resulting in too much quantity and too little quality. Consequent failure of peer review.
This nexus is particularly strong in policy relevant areas like climate, energy, healthcare (NIH, NSF). It is weaker in areas that are more ‘pure science’ like physics, chemistry, paleontology. It is also relatively weak were there is a strong interplay between private/corporate and public/university research since the former is to some degree an honesty check on the latter. For example, pharma companies trying replication because they are looking to invest in new therapies. Or VCs demanding replication before funding a biopharm spinout or a new battery concept. That is what has exposed the poor quality of much university basic medical/biochem/genetic research lamented by Ioannidis and the editor of Lancet.
The strongest nexus between grant policy fads and University/gov ‘public’ research, with the weakest ‘private’ reality checks and balances, is ‘climate science’. Hence it is the most massively failing ‘science’. The IPCC wont be able to hide that fact by AR6. In WG1, Pause will be over two decades. Models still producing a nonexistant tropical troposphere hotspot. SLR not accelerating. Arctic ice cyclically recovering. Observational ECS ~ 1.5-1.8. In WG2, greening, increased crop yields, no extinctions. In WG3, visible failure of mitigation strategies like renewables on cost and intermittency grounds. No climate refugees.

Scottish Sceptic
Reply to  ristvan
April 19, 2016 11:43 am

“No climate refugees.” What about the 350 from CSIRO?

Aphan
Reply to  ristvan
April 19, 2016 12:09 pm

Universities is where these kids LEARN how to “do science”. Then they move on and infect the next stage of it. Not all scientists are broken, and the actual Scientific Method is still breathing, but this has to be stopped now, or it won’t be for long.

Scottish Sceptic
Reply to  Aphan
April 19, 2016 12:16 pm

It’s my contention that the “scientific method” is just a fancy name for what engineers do by instinct (check it works). Engineers don’t need a fancy name, because “testing it works” is just part of the way engineers work. But academics … many particularly in climate detest the whole idea of having to prove their ideas actually work in practice and will do anything to avoid subjecting their work to the ordinary scrutiny engineers just naturally assume needs doing.

rah
Reply to  Aphan
April 19, 2016 1:25 pm

Scottish Sceptic
It seems to me that so called “Peer Review” is considered by many to be the equivalent to testing or replication of results. It isn’t!
“The duty of the man who investigates the writings of scientists, if learning the truth is his goal, is to make himself an enemy of all that he reads, and … attack it from every side. He should also suspect himself as he performs his critical examination of it, so that he may avoid falling into either prejudice or leniency.”
al-Ḥasan ibn al-Haytham

Duncan
Reply to  Aphan
April 19, 2016 7:07 pm

Scottish Sceptic….”just a fancy name for what engineers do by instinct (check it works)”
As an Engineer (slash Project Manager) I will be pinning your whole post on my ‘wall’ for a while as inspiration. When in the “dirt” the best solutions are always the most practical once tested.
My hat off to you Sir.

Geistmaus
Reply to  Aphan
April 19, 2016 8:04 pm

No True Scottish Skeptic: Science without engineering is just Philosophy. Science without philosophy is just engineering. Between philosophy and engineering, obviously it is Philosophers that sent men to ride around the moon in a dune buggy.
/Obligatory

Ian Macdonald
Reply to  Aphan
April 19, 2016 11:14 pm

“But academics … many particularly in climate detest the whole idea of having to prove their ideas actually work in practice”
If that’s true in climate science it’s true in spades in renewable energy.

Mike M. (period)
Reply to  ristvan
April 20, 2016 11:21 am

ristvan,
You wrote: “I don’t think all science is broken. University based grant seeking science probably is. Most corporate sponsored research isn’t.”
Although most of what you say in your analysis is spot on, I think the summary above is overstated. Although much is broken with university based research, there is also still a lot of good work being done. And corporate research is completely directed towards the short term needs of the sponsor; that is hardly a good model for science as a whole. And while publicly funded policy-relevant research can certainly be warped by the sponsor, that is far more certain with privately funded policy-relevant research.

April 19, 2016 11:46 am

It’s all about money. A lot of science is now a big business, universities are a huge business, free-standing (almost invariably government supported) research institutions are a big business. Money corrupts. And the more money that’s involved, the more it corrupts. There’s little doubt that pharmaceutical research, even in universities where it’s funded by pharmaceutical companies) is the worst. Here’s one case where it came to light and they failed to bribe the whistle blower so they dismissed him:
https://ethicalnag.org/2009/09/08/sheffield/
And that is almost certainly the tip of the iceberg.
Need to publish: It is virtually a law that researchers must publish, leading to a lot of hastily prepared, often ambiguous material getting into print. Continued funding more or less requires publication of prior research so it goes on and on.
Too many scientists, too many journals. They can’t all be good at what they do, even with the best of intentions.
Yes, it’s broken. What do do about it? Don’t ask me, but perhaps reducing the number of the (reported) 100,000 academic journals (OK only half are scientific) would be a good start.

Reply to  Smart Rock
April 19, 2016 12:08 pm

Here are some ideas.
1. No independent replication, no further grants on the subject matter.
2. Tenure based on quality, not quantity.
3. Severe consequences for academic misconduct. Science would not address or retract Marcott 2013 even when presented with indelible written evidence comparing thesis to paper. Nature Geoscience did not require a correction to OLeary 2013 Figure 3 even when presented with indelible written evidence from the SI.
4. Some percentage of grant budgets (NSF, NIH) mandated to be spent outside the mainstream or on ‘counter research’ seeking to poke holes in theme fads.
5. Any paper using complex statistics, or claiming p values, must also be peer reviewed by a statistician.

Scottish Sceptic
Reply to  ristvan
April 19, 2016 12:24 pm

I’d suggest that all papers are peer reviewed by someone who is not part of the subject area – ideally someone who is not even part of academia (there’s plenty of retired engineers and scientists who’d love to get involved) more importantly all grant bodies should not only include non-academics, but ideally non-academics should be a majority of those taking the decisions as to who gets funding.
Finally, I’d introduce something akin to “ISO9000” – a requirement of an audit trail for all work so there was an onus to be able to prove the results were obtained rather than an assumption that “so long as nothing looks wrong – we won’t ask questions”.

john harmsworth
Reply to  ristvan
April 19, 2016 4:12 pm

It seems to me that there are peers and there are peers. The review work should itself be reviewed and the peers given ratings that indicate the quality of work. If 4 papers are reviewed by an individual and he passes them intact and they are subsequently found to be faulty, his rating goes down. The papers would come to be rated according to the quality of the reviewers on a cumulative basis. Peer review without accountability assumes that all reviewers are equal, disinterested in the result and qualified. We all know this is not the case. At a minimum this would greatly reduce duplication and speed discovery. Is Michael Mann or James Hansen reviewing papers, credible or laughable

thallstd
Reply to  ristvan
April 19, 2016 5:29 pm

Michael Crighton proposed a solution in “Aliens Caused Global Warming” or one of his other lectures (all available on line last time I looked). His idea (simplifying a bit) is that the originator of the experiment should not be involved in performing the experiment other than to plan it out. It should be planned to insure there are multiple stages or steps and each should be delegated to a different individual or team. No participant knows the overall objective, just what he needs to do to complete his portion. No participant knows how many steps there are or who is performing the other steps. The final results are put together by yet another individual or team and delivered to the originator.
This may be difficult to accomplish in many cases but it would go a long way in removing subconscious bias from the results.

Geistmaus
Reply to  ristvan
April 19, 2016 8:09 pm

rstivan: Alternately you could just consider every result bollocks until you find the fruit of that research for sale in a product at Walmart. After that, you can amend your notions to consider that the idea has promise.

LdB
Reply to  ristvan
April 19, 2016 8:43 pm

I love Scottish Sceptics suggestion to your suggestion a tribunal of idiots to decide the fate of science research … hey lets make it a vote in parliament.

Ian Macdonald
Reply to  ristvan
April 19, 2016 11:19 pm

“Severe consequences for academic misconduct. ”
They already exist. Look at the treatment of Pons and Fleischmann, who were principally correct about their findings. The misconduct revealed by Climategate was infinitely worse than the trivial issue of publishing without peer review. The climate scientists seem to have an exemption, that is the problem.

Reply to  ristvan
April 20, 2016 6:58 am

It’s all Greek to me – am I an idiot?
Of course not! And by the way the Greeks say: ‘It’s all Chinese to me’ when they don’t get it. In Ancient Greek the word ιδιώτης (idiotis) meant a private person who remained silent and therefore could not handle public affairs because of their low intelligence. In general in Ancient Greece, anyone who didn’t present themselves in public or wasn’t eloquent enough to express themselves and take part in the current affairs was automatically considered anidiotis; a weakly presented society member, and therefore uneducated, untalented, and stupid. (Jungian Introversion perhaps wasn’t yet a concept in Ancient Athens!)
Interestingly enough, in Modern Greek the word has dropped its negative connotationand it now means just private, in the sense of: private property, private topic, matter etc.;introversion is finally accepted in Greek society! What is more interesting, though, is that in English, the meaning of the word idiotstill carries its Ancient Greek meaning; a stupid person.

Reply to  ristvan
April 20, 2016 7:02 am

Citation Oxford Dictionaries.

Reply to  ristvan
April 20, 2016 8:12 am

An idiot is exaktly ‘a single person on a discrete Ort / location’ wheras the indogerman Ort is in the meaning of Schwertspitze or cutting edges of a Burgzinne.

Reply to  ristvan
April 20, 2016 8:17 am

idi – ot : ‘exactly him’, ‘ == him’, ‘the same one’

CaligulaJones
April 19, 2016 11:51 am

If anyone is interested in this topic, Retraction Watch is a good bookmark to have:
http://retractionwatch.wordpress.com/

April 19, 2016 11:53 am

Since our chosen task is to create an audit trail from the Sun’s irradiance to our surface temperature , it’s useful to learn of this link . I’ll have to find time to check whether these data confirm the peri- to ap-helion variation one must expect . Are the data really accurate to over 4 decimals ?
I like to think in terms of temperatures so these numbers induced me to implement the conversion of Power to Temperature in 4th.CoSy :

: P>Tsb ( P -- T ) 5.6704e-8 _f %f .25 _f ^f ;
f( 1361.6 1360.4 )f 4. _f %f P>Tsb |>| 278.35 278.29

It ain’t as clean as a traditional APL yet because it’s working down at the x86 stack level , but it’s getting there .
So that represents a 06c change in equilibrium temperature .

rabbit
April 19, 2016 12:01 pm

“Less famous is a similar hoodwinking of the very prestigious British Medical Journal, to which a paper with eight major errors was submitted. Not a single one of the 221 scientists who reviewed the paper caught all the errors in it, and only 30 percent of reviewers recommended that the paper be rejected.”
That no one found all eight errors is not disconcerting,because..
1. There is almost always more than on reviewer. Together they might catch all errors.
2. Even if not all major errors are caught, the 2nd review process (if the paper was not rejected outright after the first review process) might well catch any missed errors.
3. If I was reviewing such a paper and found four or five serious error, I might quit looking for problems at that point and simply recommend the paper be rejected.

David A
Reply to  rabbit
April 19, 2016 11:02 pm

I think you missed the point that only 30 percent recommended rejecting the paper.

rw
Reply to  rabbit
April 22, 2016 12:29 pm

Or at least be revised and resubmitted.

Alx
April 19, 2016 12:40 pm

“some non-reproducible preclinical papers had spawned an entire field, with hundreds of secondary publications that expanded on elements of the original observation, but did not actually seek to confirm or falsify its fundamental basis.”

This behavior with secondary publications is especially pernicious in climate science, Hundreds of papers are based on the presumption that the speculative and sometimes flimsy conclusions and theories of global warming have been overwhelming established and proven. Talk about a house of cards…

Gamecock
Reply to  Alx
April 19, 2016 3:08 pm

True. Over the years, I have seen many “Given global warming, . . . .” studies.

TA
Reply to  Alx
April 19, 2016 3:31 pm

Alx wrote: “This behavior with secondary publications is especially pernicious in climate science, Hundreds of papers are based on the presumption that the speculative and sometimes flimsy conclusions and theories of global warming have been overwhelming established and proven.”
Yes, they are working under false assumptions.

Gary
April 19, 2016 12:44 pm

Of course science self-corrects. But it usually takes too long, wastes far to many resources, and sometimes requires total collapse to clear the deck. Rather than lamenting the obvious, let’s figure out a better method than what happens now.

PiperPaul
Reply to  Gary
April 19, 2016 2:10 pm

Brandolini’s Law: “The amount of energy needed to refute bullshit is an order of magnitude bigger than to produce it.”

thallstd
Reply to  Gary
April 19, 2016 5:32 pm

See my post above April 19, 2016 at 5:29 pm summarizing Michael Crighton’s proposal…

Doug Huffman
April 19, 2016 12:44 pm

Is there a chance that the label science is too easily granted, dare I say, liberally? Might the demarcation between science and technology be falsification and verification?

Scottish Sceptic
Reply to  Doug Huffman
April 19, 2016 1:06 pm

There’s a simple demarcation – engineering is science that works.

Reply to  Scottish Sceptic
April 19, 2016 2:42 pm

Refreshing how penalties for failure can work to produce ‘truth’ benefits. Engineering and business provide many examples. Theranos blood testing criminal investigation is a present example of both at the same time.
In academia, once tenured there is no penalty for any failed theory (more properly, speculation) or biased/wrong observation. Michael Mann is offered as exhibit A. Camille Parmesan (Jim Steele’s link above) is offered as exhibit B. And there are many, many more less well known in various Blowing Smoke essays.

Ed Zuiderwijk
April 19, 2016 1:09 pm

Being a scientist is entertaining the notion that your teachers may be wrong, even may be wrong most of the time. (Free after Richard feynman).

Christopher Paino
April 19, 2016 2:23 pm

This might be slightly off-topic, but I think it fits.
I was just reading Jeff Hester’s “For Your Consideration” section of the January 2016 issue of Astronomy, and in the article he speaks of falsifiability and the existence of multiverses. He says, “The whole science of cosmology rests on the untestable claim that our observable universe lies buried within a vastly larger universe filled with stars and galaxies that we can never see. We know those galaxies are there because well-tested theories rely on them.”
I’m not a scientist, but saying we “know” something exists only because if it didn’t the theory wouldn’t work seems dangerous to me. Maybe I’m hung up on semantics, but wouldn’t it be more accurate to say, “We assume those galaxies are there because well-tested theories rely on them”?

Reply to  Christopher Paino
April 19, 2016 8:44 pm

“I’m not a scientist, but saying we “know” something exists only because if it didn’t the theory wouldn’t work seems dangerous to me.”
Christopher you aren’t alone in that observation, most especially as it applies to developments in astrophysics over the past 20 years. Multi-verse theories are, by definition, unfalsifiable; if it were possible to detect the presence of a physical reality outside current perception, it would immediately become a member of the known universe. This isn’t particularly difficult.
Like “Dark Matter” and “Dark Energy”, the “Mulitverse” is ontological beetle-tracking and has no place among the sciences. As with “climate science”, cosmologies based on unprovable speculation simply provide a comfortable place to park the asses of perpetual grant seekers. It’s become formulary in some of the “sciences” these days; first propose a completely fictitious hypothetical that can never be demonstrated false, then happily spend your life researching it at public expense. All it requires is a large enough group of co-conspirators and a gullible public.

Reply to  Bartleby
April 20, 2016 7:26 am

stop reading here.

Reply to  Christopher Paino
April 20, 2016 7:24 am

Like “Dark Matter” and “Dark Energy”, the “Mulitverse” is ontological beetle-tracking and has no place among the sciences.
Xcuse, dark matter / energy are just nicknames of fundamentals that can’t be searched for- they have to be found.

Reply to  Johann Wundersamer
May 3, 2016 4:19 pm

stop reading here.

Stop reading where Johann? At the criticism of “Dark Matter”? “Dark Energy”? Why?
There is absolutely no evidence whatsoever to support either hypothesis. None at all.So what’s your beef? Where’s the problem Johann?