Discussion: Five reasons blog posts are of higher scientific quality than journal articles

Dr. Judith Curry tips me to this interesting blog post by Daniel Lakens, an experimental psychologist at the Human-Technology Interaction group at Eindhoven University of Technology, The Netherlands.

The 20% Statistician

A blog on statistics, methods, and open science. Understanding 20% of statistics will improve 80% of your inferences.


Five reasons blog posts are of higher scientific quality than journal articles

The Dutch toilet cleaner ‘WC-EEND’ (literally: ‘Toilet Duck’) aired a famous commercial in 1989 that had the slogan ‘We from WC-EEND advise… WC-EEND’. It is now a common saying in The Netherlands whenever someone gives an opinion that is clearly aligned with their self-interest. In this blog, I will examine the hypothesis that blogs are, on average, of higher quality than journal articles. Below, I present 5 arguments in favor of this hypothesis.

  1. Blogs have Open Data, Code, and Materials [when technical articles are published, yes, whenever possible]
  2. Blogs have Open Peer Review [oh, don’t you know it, except hardly anyone reads RealClimate anymore]
  3. Blogs have no Eminence Filter [just look at the variety of articles on Climate etc, Climate Audit, and WUWT]
  4. Blogs have Better Error Correction [absolutely, mistakes are usually caught within minutes]
  5. Blogs are Open Access (and might be read more). [no paywalls=broad distribution]

Read his entire article for the thinking behind the reasons, my comments are [in brackets] above. Item 5 is particularly important. It has been said to me by a few people that WUWT has changed the world. I think it has, but I view it as a collective effort with other climate blogs. If climate blogs didn’t exist, there would be no exposure of Climategate, no exposure of the [IPCC’s] horrid messes in AR4 and AR5, among other issues.

There may be other benefits, I’m sure readers can add some points not covered above.

0 0 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

271 Comments
Inline Feedbacks
View all comments
April 15, 2017 10:12 pm

6. A published research paper takes about 500 manhours to write, which limits the message, scope, and amount of data presented and number of papers written. This is not the limitation in a blog.

seaice1
Reply to  Donald Kasper
April 16, 2017 4:05 pm

This dos allow more scope for speculation on blog, but does not suggest better science. Which would you have more more confidence in, something rattled off in 5 minutes on the back of an envelope or something that a scienist had spent 500 hours preparing? It might be that those 500 hours were wasted, but is is nonsense to suggest that the 5 minute sketch is superior because of the lack of time and attention devoted to it.

Richard G.
April 15, 2017 11:27 pm

Anthony, I know you have made an enormous contribution with your blog. Thank you. You are greatly appreciated. That goes for all the Moderators and helpers too. Kudos.

lonetown
April 16, 2017 3:09 am

I agree with the article but caution, all blogs are not equal. The cream rises to the top, however, and separation by quality is easy, if you contain your bias.

seaice1
Reply to  lonetown
April 16, 2017 4:01 pm

How is one to do that?

ralfellis
April 16, 2017 3:51 am

I would agree that blogs are better. With my palaeoclimatology peer review paper, I was appalled by the poor knowledge and quality of the reviewers. One reviewer wrote:

Quote:
This hypothesis relies on a strong effect of reduced CO2 (during the ice-ages) on vegetation at altitude. I strongly suspect that the calculations showing a 120ppm drop in CO2 at 4000m in the tropics and 65ppmb drop at 2000m in the extra-tropics are completely wrong. Observations of CO2 with altitude show tiny variations (less that 5ppmv, e.g. Olsen & Randerson, 2004, figure 3). So this calculation in table 4 is very likely wrong. This means that the emergence of deserts at sub-190ppmv is not realistic because it is based on flawed calculations. This undermines much of the rest of the manuscript.

The reviewer was unable to differentiate between a change in concentration, and a change in partial pressure. For instance, the concentration of oxygen in the atmosphere also does not change with altitude, but this does not mean that you can breathe as easily on Mt Everest as at sea level. That is the degree of error being made.

These sort of errors (the reviewers made a dozen similar errors) would simply not happen on a blog like WUWT, as they would be picked up immediately. Or the two-way discussion with the reviewer would sort out the confusion.

Ralph

seaice1
Reply to  ralfellis
April 16, 2017 4:00 pm

The units quoted are concentrations, not partial pressures, which would be in Pascals (or equivalent). I can’t see table 4, but if it specified ppm the reviewer was right.

ralfellis
Reply to  seaice1
April 17, 2017 12:32 am

The units were micro-bars (μbar).

Ralph

seaice1
Reply to  seaice1
April 18, 2017 5:08 am

The units in the quote above are in ppm. If the original used microbars that is indeed a unit of pressure. As I said, I cannot see table 4.

April 16, 2017 5:23 am

For a great insight into statistics or popular topics using government data from around the world learn to use Gapminder, the creation of the late Hans Rosling carried forwardby his son. Uou can choose your own lin or log axes and run time series data for a s long as we have it.
You have to be able to check the data to comment on any paper in energy and climate change. Usually a “back of the envelope” check on the established physics of independently published data gives the BS alert if appropriate. I am lucky, as I trained in physcis (radiation speciality) and electrical engineering and worked in government science and Imperial College before spending the rest of my career in advanced technology business, where you don’t sell it if it doesn’t work as advertised, cost effectively and safely. Same for cars, [lanes, bridges, buildings, etc. ) Consensus won’t do, what bilogists, economists and doctors call science is not approriate to engineering a safe future that works as advertised.
All my comments come from what works or can work on the physics. I also did modelling (Chemical Process Plant) at IC so experienced how prediction can and can’t work in real systems, but only up to degree level with a bit of PhD research support in there. . In energy it is possible to get all the data you need from government and pan national sources, like the iEA, UN, UK DECC, US has the same.
KEY POINT: This is all proven science, not unprovable complex empirical models as with climate science, which must always be consesnus because it cannot be proven. So is an unprovable in science fact religion that can be used to justify anything the priests promote to its believers..
BUT you can check everything on the energy science facts and proven physics before posting, and I do. Mostly. Others seem less interested in such inconvenient science and factual data sets, particularly politicians , lobbysists and greens, who have other agendas that profit them through energy science denial that the technological facts of generation, for example, simply don’t support.
So they say your facts are opinions and theirs are better opinions. without any hard scientific support for that assertion on the proven science and actual data. Spot the difference betrween science fact and the unproven opinions of hypotheses (unproven guesses)? Watch Feynman on pseudo science for a better and longer but short description.
[youtube=https://www.youtube.com/watch?v=tWr39Q9vBgo&w=640&h=390]
Belief in unrpovable so always unknowable climate change modelling is great way to justfy false enrgy solutions, because it diverts the arguemen t away from the hard facts of energy to the unprovable climate models (they have limited data, ov bviously can’t do experimets onthe planetary scale subject, the non linear complex multi variate relationships are extended beyond their kown range, a big statistical fail, and are obviosuly unrepeatable as there is only one continually changing planet, can’t hold other variables constant while modfying one to watch it’s effects on another e.g. “controlled conditions” can’t exist, and the models are all guesses they keep changing to fit, Bit like the Police farming an innocent person. But here Science basics 101 are overtly denied by most in the climate science acedemic bubble. Independnent validation by outsiders who understand ohysics is not their plan.
…………….they really only have a model, with limited understanding of what its relationships are.
Journalists are MUCH worse. They largely don’t have the basic foundation in scientific method and its actual application so work on received opinion, no understanding of the basics. . They are usually arts graduates who probably gave up maths as soon as possible and prefer soft logic where they can like things that don’t work best, probably not very numerate so checks at the root level are not possible. Two of my family work for National media and conform to the spec. No tools to validate what they believe from first principals. You will also find politicians in the West hold similar soft degrees, in contrast to the numerate disciplines of half the 20 Chinese politburo, , the PPE degree has very unchallenging economics, lets our hard of maths elite obtain an honours degree, mostly in winning argumets confrontationally instead of proving on the rational facts and laws, the rest of their degree is knowledge of things, not personal deduction from hard laws, or the creation of those laws that anyone can test and find wanting – they hate that discipline.
Outside of specialist professional periodicals, (but sadly not always – Nature/New Scientist and others are guilty of pubishing opinion as proven science, even the idiotorial pages of professional journals edited by journalists not scientists), editors want something that fits with popular topics, prejudices, public preconceptions they can exploit rather than correct, or meets editoral agendas for propaganda as with the Guardian or BBC in the UK.
Liberal left opinions are preferred to inconvenient truths of science, no scientists on editorial staff, etc..
If you would ike examples of how bad this was after Fukushima, watch this experience of Science Media in the UK,16.30 in. How the media behaves re science fact in crises.
[youtube=https://www.youtube.com/watch?v=OVQ0NvEcyqw&w=640&h=390]
Honest facts were not of interest, because of course, no one died or will die from the contained meltdown of the commercial reactors there. Radiation release with resilient containment is significant but not large, and the actual effects of radiation nowhere near as toxic as a lot of other things, possibly hormetic up to 500 times the lelevels in most cities, a level which can occur naturally around our radioactive world.
Not what editors want to print, doesn’t “whip up a frenzy” of quite irrational fear, as another national journalist friend of my daughters said as he left one day .
I have been a scientist professional in the energy and radiation and risk area, when we believed the current craft beliefs because the science had not yet been understood, versus a craft practitioners who sy till used the dispoved LNT approachto radiation, and other hazards where low levels are harmless, natural and can be beneficial.
On the hard science my focus is on the fake relationship on the science facts between net CO2 emission and putting intermittent and weak renewable energy on the grid, as well as the wholly false approach to radiation and risk on the now available science and epidemiology of dose and dose effects.
So much rubbish is printed, using data that has not been independently corroborated, as fake news from pretend scientists, that the provable facts have been buried, AKA the truth. The goal of these organisations is to shout down the science facts with made up stuff.
As well as the realities of deploying renewables on the grid ihat make all the things claimed to be better expesnively worse in fact for fast buck, on the hard physics, the UNSCEAR reports on Chernobyl and Fukushima tell you all you neeed to know about radiation risks at civilian generating plants, same for 3 Mile Island. But no one one in the media, extremist pressure groups or troughing politics wants you to spoil what sells for therm, at your expense. Or Hollywood.
Get what happened in the UK with a respected science media communications service – who use independent expert scientists who volunteer their input, not pressure group so called concerned “scientists”/ “experts”. The mass media prefer the extremist organisations whose experts are pseudo scientists in this area, Osteopath, medical doctors, – hard of physics and scientific proof at the necessary level Feynman describes above.
The energy science denial points are already well discussed here, basically around the facts of CO2 emissions, energy density and intermittency, actual sustainability as viable sources after fossil, and the cost related impact of these fundamental physics. I lecture on this.
Here’s an image for you re facts and fear. For an interesting set of You Tube videos watch the radiation physicist shovelling radioactive sand over herself while mixing elevated background radiation bathing (a medical therapeutic treatment in fact, something Germans also do down mines) with sun bathing on the Monazite Beaches of Brazil, you can do this yourself, here and elsewhere. This is reality, not media nonsense. It may be a fact that many established Health Spas around the World are much more radioactive than elsewhere, perhaps beacuse of more radioactive releases from the geo thermal water sources, elevated background enhances the immune system, so a study may be interesting. Ramsar Iran at 300mSv pa, is 15 timse the Fukushima evacuation level, and the most famous. NO epidemiological evidence of adverse health effects. Thers ia much argued belief among radiation workers that they live longer and die less of cancer, you can research that 😉
[youtube=https://www.youtube.com/watch?v=RvgAx1yIKjg&w=640&h=390]
Note – this is FAR more radioactive that you see know-nowt journalists in hazmat suits and meters getting hysterical about on the news, and with no detectable short or long term epidemiological risk. They don’t want you to know the inconvenient truth.
Especially not Al Gore, who is unable to prove most of the assertions of his Inconvenient Truth on climate 19 years on, and whose effect has diverted $Billions from Extreme Weather defences that can save lives, to the pockets of renewable energy lobbyists who impose regressive solutions that can’t on the grid, that also make CO2 emissions per KWh avoidably worse, energy supply intermittent, expensive and insecure, and leave people at risk from weather.. You could claim Gore is a mass murderer, in consequential science fact. Politician, heal thyself.
I could go on. The only thing that suffers in this debate is the truth, as defined in science fact, not science fiction. But the masses seem not to want to know about science fact. It isn’t simple tribal belief, doesn’t create fear or excitement, doesn’t make easy money for lobbysits, politicians and insiders, sell papers. or justify extremist religions of climate change, anti-nuclear, anti GM, anti vaccination, anti-technology throwbacl Malthusians like Greenpeace et al, who know what’s good for you. So I blame people. We need the next ice age to become Neanderthal 2.0, so sometjhing more rational and smarter can evolve. Perhaps.

The Badger
April 16, 2017 9:29 am

Why are blogs different ?

1. You can write WTF you like with little or no risk to your reputation in the real world or your career if posted anonymously as many do. So you can be totally truthful to what you really believe (no need to bite your tongue !).

2. Despite some accusations (!) we actually don’t get paid to write this stuff. So it is your own tune not the piper payer’s.

3. With light moderation the threads can often wander off into random areas and new insights can be obtained. A bit like brainstorming.

4. No qualifications to join in so we end up with a wide church of many specialists and many generalists plus the very useful “innocent babes” who can spot and speak of the emperor’s clothes (or lack of).

5. On any topic there are almost always several blogs with different flavours. The difference is massively wider than the difference you get in scientific journals.

6. There is usually no peer pressure to conform to a particular agenda or political view.

7. It’s a text media and tends to invite challenges to the “rules”. A poster who types Na2i to get round the filter will often have something clever to say about things other than H1tl3rZ works.

ralfellis
Reply to  The Badger
April 16, 2017 1:17 pm

>>>4. wide church.

That is important. If you write a wide ranging paper, the reviewers only understand 20% of it.

R

April 16, 2017 10:22 am

Blogs are good when they quote peer-reviewed research. Otherwise not.

I read WUWT and Science Magazine regularly. Mistakes and bad writing occur in each, but Science Magazine is consistently of far higher quality.

MarkW
Reply to  matthewrmarler
April 17, 2017 11:44 am

It’s good when I agree with it.
It’s bad when I don’t.

April 16, 2017 1:35 pm

true!!!

seaice1
April 16, 2017 3:53 pm

If this premise were acceted it would be the end of science as we know it. There is much nonsense published here, but this takes the biscuit.

There is a place for blogs – but replacing science is not it.

To suggest that this can replace peer reviewed science is simply deluded. Every creationist, anti vax, anti-GMO, anti nuclear blog likes to pretend they are science, but they are not. They are a conduit for people to express their opinions and bounce some ideas around. That is a valid space, bt it ain’t science mate.

Reply to  seaice1
April 16, 2017 5:06 pm

seaice1 said just above “…If this premise…” What premise are you referring to? We need the “Willis Rule” about CLEARLY stating what you are referring to!

Out of curiosity, when was the last time you did a peer review?

MarkW
Reply to  Bernie Hutchins
April 17, 2017 11:48 am

I believe he’s saying that allowing anyone to do science is a bad idea. Only those with official approval should be allowed to do science. The rest of us should limit ourselves to genuflecting at the appropriate points in the ceremony.

Reply to  Bernie Hutchins
April 17, 2017 5:03 pm

Mark – indeed!

Last summer, the little girl next door (5 y.o.) was turning over rocks. “What are you doing?” “Looking for ants.” “Are there ants under every rock?” “No – just the flat rocks.”

I was astounded. She had made an observation, formed a hypothesis, and was performing an experiment. That’s three intrusions. Just now it occurs to me that she was guilty of a fourth. In telling me what she learned, she had released a result without proper peer review!

seaice1
Reply to  Bernie Hutchins
April 18, 2017 5:12 am

“What premise are you referring to?” That blog posts are of higher scientific quality than Journal articles, as it says in the title. It is a few years since I was on either side of peer review. How about you?

seaice1
Reply to  Bernie Hutchins
April 18, 2017 5:14 am

MarkW. I said no such thing – please re-read.

Reply to  Bernie Hutchins
April 18, 2017 11:00 am

seaice1 said in part, April 18, 2017 at 5:12 am, “..…It is a few years since I was on either side of peer review. How about you?…..”

My inquiry related to the old joke about watching sausage and the Law being made and still tolerating either. Your admiration for peer review suggested non-participation, and you didn’t actually answer my
question.

For myself, I am retired and haven’t reviewed anything for five years. I did write about peer review (see link in April 15 comment above in this thread) in 2013 (with other links there) and recently (yesterday!) posted a fuller 9-page discussion written in 2014:
“PEER-REVIEW – LESS THAN YOU SUPPOSE”
http://electronotes.netfirms.com/ENWN48.pdf

If you do read this material, and have any inclination to reply, please feel free to email me directly (Google my name).

Chimp
Reply to  seaice1
April 16, 2017 5:26 pm

Somehow science managed to progress spectacularly from 1543 until California mandated peer review in 1997. Einstein was quite right to denigrate the idea.

So-called peer review has never been of any use, but since the 1980s became a huge negative, once corrupted by pal review, a self-perpetuating priesthood enforcing orthodoxy.

Butch
Reply to  seaice1
April 16, 2017 5:57 pm

” There is much nonsense published here” …Yes, every time you post something !! D’oh !

MarkW
Reply to  seaice1
April 17, 2017 11:47 am

Translation: It’s awful that ideas that I disagree with are allowed to see the light of day.
The world was so much better when only those ideas that were officially approved were allowed out in the open.

PS: I love the way the troll tries to lump WUWT in with creationist, ant-vaxers, etc. As if the world was a binary situation. IE, there’s officially approved science and everything else is junk.

PPS: It’s only science when the high priests of science say it’s science.

seaice1
Reply to  MarkW
April 18, 2017 5:18 am

I did not lump WUWT in with ant-vaxers (those in favor of innoculating insects?) etc. The headline says blogs, it does not say WUWT, or or certain sub-section of blogs. If we were to accept that blog posts were high scientific quality than journals we must include all blogs.

Reply to  MarkW
April 18, 2017 3:18 pm

seaice1 said above in part on April 18, 2017 at 5:18 am: “…..I did not lump WUWT in with [anti]-vaxers […..] etc……”

but seaice1had already said in part on April 16, 2017 at 3:53 pm “….. Every creationist, anti vax, anti-GMO, anti nuclear blog likes to pretend they are science, but they are not……”

which is, at best, careless on seaice1’s part, if he is NOT intending to lump.

Authors such as Jerry Coyne in his book “Faith Versus Fact…” (Penguin 2015) annoyingly, GRATUITOUSLY, and counter-productively lumps those who deny CAGW with creationism in a section “Global–Warming Denialism” (pp 245-250). He is arrogantly telling us that he gets to tell us what science is and is not, and if you disagree – shut up (he is, in fact, a proud censor!).

Johann Wundersamer
April 16, 2017 4:51 pm

misanthropic is for man that don’t like any anthropoii wether male nor female;

misogyni is reserved for anthropoii disliking females.

Tom Rowan
April 17, 2017 2:43 am

I used to read WUWT ALL the time. Alas I went blind on account of the sheer volume of SCIENCE! Carry on soldiers!

(Btw, I think Suri is cheating on me with Michael Mann….I cannot be sure, because of my blind and lying eyes…..But Suri keeps interrupting herself while reading me the posts here at WUWT with unsolicited commentary such as; “no, I can’t marry you, ” and “I am not programmed for THAT,” and “you MUST OBEY Michael Mann,” and all these jokes that start with the premise: “Ok, so Algore and Anthony Watts walk into a bar….etc…..”)

I now have a cane, a half blind seeing eye dog, and a blue handicap sticker on my Ford F250.

All because of SCIENCE. Can you all tone it down a few decibels?

* ~ )

Tom

Patrick MJD
Reply to  Tom Rowan
April 17, 2017 3:59 am

Old bass player here, can you speak up a bit?!

Tom Rowan
Reply to  Patrick MJD
April 17, 2017 5:06 am

° ~ O! ‘ ~ }…..* ~ )

Vanessa
April 18, 2017 5:51 am

Absolutely no doubt about it. Blogs do the research and check their facts, media do not do either. I read EUReferendum.com on the European Union and his pieces are “second to none”. Thoroughly researched and checked whereas the UK socialist main stream media are hopeless and print rubbish.