The numbers on "bad science"

This infographic from www.clinicalpsychology.net is interesting. It speaks to President Eisenhower’s second warning in his famous farewell speech. More below.

Here’s the references as actual links:

http://www.plosmedicine.org/article/info:doi/10.1371/journal.pmed.0020124

http://www.nytimes.com/2011/11/03/health/research/noted-dutch-psychologist-stapel-accused-of-research-fraud.html

http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0005738

http://techyum.com/2011/03/omg-aliens1-or-is-it-just-more-fake-science-news/

http://www.badscience.net/2011/04/i-foresee-that-nobody-will-do-anything-about-this-problem/#more-2024

http://www.citypages.com/2011-03-23/news/women-s-funding-network-sex-trafficking-study-is-junk-science/

http://www.psychologytoday.com/blog/naturally-selected/201109/what-do-about-scientific-fraud-in-psychology

http://www.scientificamerican.com/article.cfm?id=researchers-failing-to-make-data-public

http://www.guardian.co.uk/science/blog/2011/aug/22/riot-control-newspapers-distorting-science

http://www.bmartin.cc/pubs/92prom.html

=============================================================

This WUWT post: Ike’s second warning, hint: it is not the “military-industrial complex” is well worth a read for the prescient context it provides to this infographic.

Get notified when a new post is published.
Subscribe today!
0 0 votes
Article Rating
85 Comments
Inline Feedbacks
View all comments
Tim
February 7, 2012 2:42 pm

If you don’t believe it, follow this site:
http://retractionwatch.wordpress.com/

Josualdo
February 7, 2012 2:42 pm

I lived in akademia for over 30 years, and the amount of fraud was impressive. I’m not saying error. I don’t think that more than 10% of current published research can be relevant for 10 years. Most depends on what’s fashionable and akademic politics. It doesn’t matter how right you are. (I will not produce a single more comment on this.)

mfosdb
February 7, 2012 2:47 pm

There is a 2009 study called, “How Many Scientists Fabricate and Falsify Research? A Systematic Review and Meta-Analysis of Survey Data” here-
http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0005738
“…while surveys asking about colleagues are hard to interpret conclusively, self-reports systematically underestimate the real frequency of scientific misconduct. Therefore, it can be safely concluded that data fabrication and falsification –let alone other questionable research practices- are more prevalent than most previous estimates have suggested.”
“…scientists were less likely to reply affirmatively to questions using the words “fabrication” and “falsification” rather than “alteration” or “modification”. Moreover, three surveys found that scientists admitted more frequently to have “modified” or “altered” research to “improve the outcome” than to have reported results they “knew to be untrue”. In other words, many did not think that the data they “improved” were falsified. To some extent, they were arguably right. But the fuzzy boundary between removing noise from results and biasing them towards a desired outcome might be unknowingly crossed by many researchers.”
The research includes some interesting diagrams such as, ” Admission rates of Questionable Research Practices (QRP) in self- and non-self-reports.”
http://www.plosone.org/article/slideshow.action?uri=info:doi/10.1371/journal.pone.0005738&imageURI=info:doi/10.1371/journal.pone.0005738.g002#

Editor
February 7, 2012 2:52 pm

renowebb says:
February 7, 2012 at 1:51 pm
> These people are racist , every caricature is of a minority type person. I am calling the Whitehouse.
Yes, it’s shameful, all the scientists are balding (even the redhead), only the monster has a full head of hair. Clearly we need more diversity among caricature scientists. People will think the caricature is settled. 🙂
Umm, /sarc seems to be important here.

James Sexton
February 7, 2012 3:04 pm

Heh, another timely post! Clearly this isn’t confined to psychology. Nothing can be more clear that bad science is prevalent throughout than the circular and contradictory blatherings about our corals.
http://suyts.wordpress.com/2012/02/07/new-information-demonstrates-why-alarmist-scientists-can-not-be-trusted
We simply cannot trust scientists to give us the whole unabridged truth. They won’t do it even when their own recent blatherings contradict their already accepting ravings.

Josualdo
February 7, 2012 3:05 pm

WillR says: February 7, 2012 at 2:29 pm On the other hand I have known some who told me right to my face… I even worked with some who told me same…
I’ve seen two picking cherries in their data right in front of me (Not this one… , this one is ok…) and a third bragging of plagiarizing. I’ve seen published papers entirely made up. I’ve seen averages of a population of ONE, and fabricated data. I was asked to hammer statistics (of course I didn’t). Etc.

February 7, 2012 3:05 pm

Anonymous publication is especially important because there you can report unlikely, surprising observations and theories, which are exactly the ones that have the highest value.
Think just about cold fusion. Devastating change if proven true, but also high risk of being wrong.
Peer-review is anonymous in principle, but not in reality. Scientific publications are nowadays like newspapers and report things that we already “know”. Confirmation bias is palpable.

TG McCoy (Douglas DC)
February 7, 2012 3:14 pm

Matt in Houston-Feynman, Dyson, Borlaug. all Heros…

mfosdb
February 7, 2012 3:20 pm

Perhaps Climate Science needs an Office of Climate Science Research Integrity, similar to this
http://ori.hhs.gov/case_summary
In a case involving a scientist at the University of Michigan Medical School, the Office of Research Integrity “found that the Respondent knowingly and intentionally tampered with research materials related to five (5) immunoprecipitation/Western blot experiments and switched the labels on four (4) cell culture dishes for cells used in the same type of experiments to cause false results to be reported in the research record. ORI also found that the Respondent tampered with laboratory research materials by adding ethanol to his colleague’s cell culture media, with the deliberate intent to effectuate the death of growing cells, which caused false results to be reported in the research record. ORI has concluded that these acts seriously deviated from those that are commonly accepted within the scientific community for proposing, conducting, and/or reporting research.”

Rogelio
February 7, 2012 3:30 pm

[harmless, but way way off topic – Anthony]

Dr. Dave
February 7, 2012 3:37 pm

At first I had a really hard time accepting what they said about medical research, then I remembered all the crap that passes for “medical research.” A really good example are the last studies that “proved” second-hand smoke presents a health risk. There were three very large, well designed studies that explored this question. Problem was they kept getting “the wrong answer”. Eventually the anti-tobacco zealots cobbled together a much smaller study with ridiculous confidence limits. At last! They got the desired answer. It was politically correct but scientifically meaningless. I’m not defending smoking, but I strongly oppose fraudulent science. A lot of the stuff that comes out of the CDC under the guise of “medical research” is actually crap. I’m sure a lot of grad students in academia cheat and fudge data and results of their projects which could be called “medical research”.
Most of what I consider “medical research” is funded by the private sector and is conducted with strict scientific rigor and intensive review.

Dave Wendt
February 7, 2012 3:46 pm

Latitude says:
February 7, 2012 at 1:37 pm
No amount of time and money can be compared to medical……
…immediately followed by an ad from a lawyer saying
“If you took this medicine and you leg fell off…..call us”
And we should think a group of glorified weathermen are somehow more advanced than that?
“glorified weathermen”? I would suggest that a more accurate characterization of the climate community would be “degenerated weathermen”. After all, in order to maintain themselves in their positions, weathermen must eventually demonstrate at least some level of predictive skill. From what I’ve seen, no such restriction applies in the field of climate mythology.

Rogelio
February 7, 2012 4:00 pm

Thanks antony it was way off topic LOL

James Sexton
February 7, 2012 4:03 pm

Dr. Dave says:
February 7, 2012 at 3:37 pm
At first I had a really hard time accepting what they said about medical research, then I remembered all the crap that passes for “medical research.” A really good example are the last studies that “proved” second-hand smoke presents a health risk.
======================================================
I remember it well. It was for the greater good….. I believe that was the rationalization. It was then that caused me not to believe a damned thing spewed from the govt/scientific community. I recall the EPA changing their standards so SHS could be labeled as a carcinogen. Alas, poor Liberty, we barely knew ye.

David A. Evans
February 7, 2012 4:06 pm

Matt in Houston
Spot on post. If that post was serious about racism, how come no-one else saw it? Says more about the observer as in too many real life cases of racism
DaveE.

Rogelio
February 7, 2012 4:09 pm

This is not off topic I think its obvious that the AGW scam is about over. I don’t think we should hound the people responsible. I think they honestly believed in it (I did certainly did when I saw the Hadcrut Graphs 4 years ago!).. To their credit, they have provide graphs showing flat temps since 1998 (Hadcrut)/. I say leave them alone… They will retire or change their research subject.

February 7, 2012 4:14 pm

Good post, Anthony. Thank you.
I think that some scientists are willing to make such admissions in a survey, despite the conceivable risk to themselves, because of a feeling of guilt over not having admitted them publicly. Of course, the one does not remit the other, but it is better than nothing, and deserves our praise.
Thank you, scientists who answered these survey questions truthfully — especially those scientists whose truthful answer was in the affirmative. May your honesty be rewarded.
RTF

KnR
February 7, 2012 4:19 pm

Basic problem , in the name of ‘the cause’ anything is justified so bad practice becomes good practice in the same way poor research becomes good if it supports ‘the cause ‘ Therefore, its simple not possible for bad science to be done when its result are useful to ‘the cause ‘ The final part of this idea is that is of course that any practice or research that does not support ‘the cause’ is automatically bad becasue clearly no good research could ever do this .
Look up Orwells 1984 and will understand how this works.

Kate60
February 7, 2012 4:25 pm

http://www.scientificamerican.com/article.cfm?id=an-epidemic-of-false-claims
one more link – could be re-written with “climate science” replacing “medical” in about one minute.

Alan D McIntire
February 7, 2012 4:25 pm

I can see how scientists can subconsciously cherry pick data, but I cannot for the life of me understand why 1 in 50 would admit to falsifying data or that 81% of biomedical research trainees would admit that they would modify or fabricate data to get a grant or get published. Those actions should be beyond the pale!

R. Shearer
February 7, 2012 4:26 pm

I’ll have my consensus science with hot fudge and a cherry on top!

MikeO
February 7, 2012 4:47 pm

Anthony I follow links http://www.clinicalpsychology.net/ does not appear the above content, can you clarify. Did it come from somewhere else?

Rosco
February 7, 2012 5:45 pm

How much research science is actually done by students under supervision for their doctoral thesis ?
When you see how the “team” behave there is no reason to doubt their students would do anything to keep the “research” true to the holy grail.

Owen in Ga
February 7, 2012 6:12 pm

You know, I think it used to be standard practice in a thesis defense for one of the interrogators (ok they aren’t really interrogators, it just feels that way) to take a contrarian view in line of questions to force the candidate to defend his position against the pall of authoritative adverse opinion just to test the candidates integrity. Do they not do this anymore? It seems we could weed out a bunch of bad actors by making sure they understand they have to go where the data leads and not lead the data to popular opinion.

February 7, 2012 6:44 pm

renowebb says: “These people are racist , every caricature is of a minority type person. I am calling the Whitehouse.”
Wal… I laughed along with you, renowebb. Nice!