Dr. Roy Spencer’s Ill Considered Comments on Citizen Science

Guest Post by Willis Eschenbach

Over at Roy Spencer’s usually excellent blog, Roy has published what could be called a hatchet job on “citizen climate scientists” in general and me in particular.  Now, Dr. Roy has long been a hero of mine, because of all his excellent scientific work … which is why his attack mystifies me.  Maybe he simply had a bad day and I was the focus of frustration, we all have days like that. Anthony tells me he can’t answer half of the email he gets some days, Dr. Roy apparently gets quite a lot of mail too, asking for comment.

Dr. Roy posted a number of uncited and unreferenced claims in his essay. So, I thought I’d give him the chance to provide data and citations to back up those claims. He opens with this graphic:

roy spencer homer simpson climate scientistDr. Roy, the citizen climate scientists are the ones who have made the overwhelming majority of the gains in the struggle against rampant climate alarmism. It is people like Steve McIntyre and Anthony Watts and Donna LaFramboise and myself and Joanne Nova and Warwick Hughes and the late John Daly, citizen climate scientists all, who did the work that your fellow mainstream climate scientists either neglected or refused to do. You should be showering us with thanks for doing the work your peers didn’t get done, not speciously claiming that we are likeable idiots like Homer Simpson.

Dr. Roy begins his text by saying:

I’ve been asked to comment on Willis Eschenbach’s recent analysis of CERES radiative budget data (e.g., here). Willis likes to analyze data, which I applaud. But sometimes Willis gives the impression that his analysis of the data (or his climate regulation theory) is original, which is far from the case.

Hundreds of researchers have devoted their careers to understanding the climate system, including analyzing data from the ERBE and CERES satellite missions that measure the Earth’s radiative energy budget. Those data have been sliced and diced every which way, including being compared to surface temperatures (as Willis recently did).

So, Roy’s claim seems to be that my work couldn’t possibly be original, because all conceivable analyses of the data have already been done. Now that’s a curious claim in any case … but in this case, somehow, he seems to have omitted the links to the work he says antedates mine.

When someone starts making unreferenced, uncited, unsupported accusations about me like that, there’s only one thing to say … Where’s the beef? Where’s the study? Where’s the data?

In fact, I know of no one who has done a number of the things that I’ve done with the CERES data. If Dr. Roy thinks so, then he needs to provide evidence of that. He needs to show, for example, that someone has analyzed the data in this fashion:

change in cloud radiative effect per one degree goodNow, I’ve never seen any such graphic. I freely admit, as I have before, that maybe the analysis has been done some time in the past, and my research hasn’t turned it up. I did find two studies that were kind of similar, but nothing like that graph above. Dr. Roy certainly  seems to think such an analysis leading to such a graphic exists … if so, I suggest that before he starts slamming me with accusations, he needs to cite the previous graphic that he claims that my graphic is merely repeating.

I say this for two reasons. In addition to it being regular scientific practice to cite your sources, it is common courtesy not to accuse a man of doing something without providing data to back it up.

And finally, if someone has done any of my analyses before, I want to know so I can save myself some time … if the work’s been done, I’m not interested in repeating it. So I ask Dr. Roy: which study have I missed out on that has shown what my graphic above shows?

Dr. Roy then goes on to claim that my ideas about thunderstorms regulating the global climate are not new because of the famous Ramanathan and Collins 1991 paper called “Thermodynamic regulation of ocean warming by cirrus clouds deduced from observations of the 1987 El Niño”. Dr. Roy says:

I’ve previously commented on Willis’ thermostat hypothesis of climate system regulation, which Willis never mentioned was originally put forth by Ramanathan and Collins in a 1991 Nature article.

Well … no, it wasn’t “put forth” in R&C 1991, not even close. Since Dr. Roy didn’t provide a link to the article he accuses me of “never mentioning”, I’ll remedy that, it’s here.

Unfortunately, either Dr. Roy doesn’t fully understand what R&C 1991 said, or he doesn’t fully understand what I’ve said. This is the Ramanathan and Collins hypothesis as expressed in their abstract:

Observations made during the 1987 El Niño show that in the upper range of sea surface temperatures, the greenhouse effect increases with surface temperature at a rate which exceeds the rate at which radiation is being emitted from the surface. In response to this ‘super greenhouse effect’, highly reflective cirrus clouds are produced which act like a thermostat, shielding the ocean from solar radiation. The regulatory effect of these cirrus clouds may limit sea surface temperatures to less than 305K.

Why didn’t I mention R&C 1991 with respect to my hypothesis? Well … because it’s very different from my hypothesis, root and branch.

•  Their hypothesis was that cirrus clouds act as a thermostat to regulate maximum temperatures in the “Pacific Warm Pool” via a highly localized “super greenhouse effect”.

•  My hypothesis is that thunderstorms act all over the planet as natural emergent air conditioning units, which form over local surface hot spots and (along with other emergent phenomena) cool the surface and regulate the global temperature.

In addition, I fear that Dr. Roy hasn’t done his own research on this particular matter. A quick look on Google shows that I have commented on R&C 1991 before. Back in 2012, in response to Dr. Roy’s same claim (but made by someone else), I wrote:

I disagree that the analysis of thunderstorms as a governing mechanism has been “extensively examined in the literature”. It has scarcely been discussed in the literature at all. The thermostatic mechanism discussed by Ramanathan is quite different from the one I have proposed. In 1991, Ramanathan and Collins said that the albedos of deep convective clouds in the tropics limited the SST … but as far as I know, they didn’t discuss the idea of thunderstorms as a governing mechanism at all.

And regarding the Pacific Warm Pool, I also quoted the Abstract of R&C1991 in this my post on Argo and the Ocean Temperature Maximum. So somebody’s not searching here before making claims …

In any case, I leave it to the reader to decide whether my hypothesis, that emergent phenomena like thunderstorms regulate the climate, was “originally put forth” in the R&C 1991 Nature paper about cirrus clouds, or not …

Finally, Dr. Roy closes with this plea:

Anyway, I applaud Willis, who is a sharp guy, for trying. But now I am asking him (and others): read up on what has been done first, then add to it. Or, show why what was done previously came to the wrong conclusion, or analyzed the data wrong.

That’s what I work at doing.

But don’t assume you have anything new unless you first do some searching of the literature on the subject. True, some of the literature is paywalled. Sorry, I didn’t make the rules. And I agree, if research was public-funded, it should also be made publicly available.

First, let me say that I agree with all parts of that plea. I do my best to find out what’s been done before, among other reasons in order to save me time repeating past work.

However, many of my ideas are indeed novel, as are my methods of analysis. I’m the only person I know of, for example, to do graphic cluster analysis on temperature proxies (see “Kill It With Fire“). Now, has someone actually done that kind of analysis before? Not that I’ve seen, but if there is, I’m happy to find that out—it ups the odds that I’m on the right track when that happens. I have no problem with acknowledging past work—as I noted above,  I have previously cited the very R&C 1991 study that Dr. Roy accuses me of ignoring.

Dr. Roy has not given me any examples of other people doing the kind of analysis of the CERES data that I’m doing. All he’s given are claims that someone somewhere did some unspecified thing that he claims I said I thought I’d done first. Oh, plus he’s pointed at, but not linked to, Ramanathan & Collins 1991, which doesn’t have anything to do with my hypothesis.

So all we have are his unsupported claims that my work is not novel.

And you know what? Dr. Roy may well be right. My work may not be novel. Wouldn’t be the first time I’ve been wrong … but without specific examples, he is just handwaving. All I ask is that he shows this with proper citations.

Dr. Roy goes on to say:

But cloud feedback is a hard enough subject without muddying the waters further. Yes, clouds cool the climate system on average (they raise the planetary albedo, so they reduce solar input into the climate system). But how clouds will change due to warming (cloud feedback) could be another matter entirely. Don’t conflate the two.

I ask Dr. Roy to please note the title of my graphic above. It shows how the the clouds actually change due to warming. I have not conflated the two in the slightest, and your accusation that I have done so is just like your other accusations—it lacks specifics. Exactly what did I say that makes you think I’m conflating the two? Dr. Roy, I ask of you the simple thing I ask of everyone—if you object to something that I say, please QUOTE MY WORDS, so we can all see what you are talking about.

Dr. Roy continues:

For instance, let’s say “global warming” occurs, which should then increase surface evaporation, leading to more convective overturning of the atmosphere and precipitation. But if you increase clouds in one area with more upward motion and precipitation, you tend to decrease clouds elsewhere with sinking motion. It’s called mass continuity…you can’t have rising air in one region without sinking air elsewhere to complete the circulation. “Nature abhors a vacuum”.

Not true. For example, if thunderstorms alone are not sufficient to stop an area-wide temperature rise, a new emergent phenomenon arises. The thunderstorms will self-assemble into “squall lines”. These are long lines of massed thunderstorms, with long canyons of rising air between them. In part this happens because it allows for a more dense packing of thunderstorms, due to increased circulation efficiency. So your claim above, that an increase of clouds in one area means a decrease in another area, is strongly falsified by the emergence of squall lines.

In addition, you’ve failed to consider the timing of onset of the phenomena. A change of ten minutes in the average formation time of tropical cumulus makes a very large difference in net downwelling radiation … so yes, contrary to your claim, I’ve just listed two ways the clouds can indeed increase in one area without a decrease in another area.

So, examining how clouds and temperatures vary together locally (as Willis has done) really doesn’t tell you anything about feedbacks. Feedbacks only make sense over entire atmospheric circulation systems, which are ill-defined (except in the global average).

Mmm … well, to start with, these are not simple “feedbacks”. I say that clouds are among the emergent thermoregulatory phenomena that keep the earth’s temperature within bounds. The system acts, not as a simple feedback, but as a governor. What’s the difference?

  • A simple feedback moves the result in a certain direction (positive or negative) with a fixed feedback factor. It is the value of this feedback factor that people argue about, the cloud feedback factor … I say that is meaningless, because what we’re looking at is not a feedback like that at all.
  • A governor, on the other hand, uses feedback to move the result towards some set-point, by utilizing a variable feedback factor.

In short, feedback acts in one direction by a fixed amount. A governor, on the other hand, acts to restore the result to the set-point by varying the feedback. The system of emergent phenomena on the planet is a governor. It does not resemble simple feedback in the slightest.

And the size of those emergent phenomena varies from very small to very large on both spatial and temporal scales. Dust devils arise when a small area of the land gets too hot, for example. They are not a feedback, but a special emergent form which acts as an independent entity with freedom of motion. Dust devils move preferentially to the warmest nearby location, and because they are so good at cooling the earth, like all such mechanisms they have to move and evolve in order to persist. Typically they live for some seconds to minutes and then disappear. That’s an emergent phenomenon cooling the surface at the small end of the time and distance scales.

From there, the scales increase from local (cumulus clouds and thunderstorms) to area-wide (cyclones, grouping of thunderstorms into “squall lines”) to regional and multiannual (El Nino/La Nina Equator-To-Poles warm water pump) to half the planet and tens of years (Pacific Decadal Oscillation).

So I strongly dispute Dr. Roy’s idea that “feedbacks only make sense over entire atmospheric circulation systems”. To start with, they’re not feedbacks, they are emergent phenomena … and they have a huge effect on the regulation of the climate on all temporal and spatial scales.

And I also strongly dispute his claim that my hypothesis is not novel, the idea that thunderstorms and other emergent climate phenomena work in concert planet-wide to maintain the temperature of the earth within narrow bounds.

Like I said, Dr. Roy is one of my heroes, and I’m mystified by his attack on citizen scientists in general, and on me in particular. Yes, I’ve said that I thought that some of my research has been novel and original. Much of it is certainly original, in that I don’t know of anyone else who has done the work in that way, so the ideas are my own.

However, it just as certainly may not be novel. There’s nothing new under the sun. My point is that I don’t know of anyone advancing this hypothesis, the claim that emergent phenomena regulate the temperature and that forcing has little to do with it.

If Dr. Roy thinks my ideas are not new, I’m more than willing to look at any citations he brings to the table. As far as I’m concerned they would be support for my hypothesis, so I invite him to either back it up or back it off.

Best regards to all.

w.

Get notified when a new post is published.
Subscribe today!
0 0 votes
Article Rating
1.2K Comments
Inline Feedbacks
View all comments
Jquip
October 9, 2013 2:11 pm

Climatologists are predicting an increased chance of tempests due to heat hiding in a teapot.
Gotta say though, this is just caste-baiting nonsense from Mr. Spencer. His entire complaint is that Mr. Eschenbach is duplicating work. But the entire point of replication in science is? To duplicate work. Don’t want to say nasty things about Spencer, but it doesn’t seem to me more than fancy Argument to ‘Argument to Authority’.
Which is all that needs to be said on the matter, Willis. Don’t get sidetracked over clay feet.

EternalOptimist
October 9, 2013 2:12 pm

I have learned a lot about science since I started reading WUWT and other blogs. I also learned a fair bit about academia
Seems to me that academics are like horse sh1t.
Spread them around thinly, and they do a power of good. Pile them into a heap and they just stink
Stay clear of the heap Willis

bit chilly
October 9, 2013 2:13 pm

Rud Istvan,that is a fantastic post. the group think mentality is very evident in many areas of established science,well done done for beating it down with cold hard evidence.

Sigh
October 9, 2013 2:15 pm

Looking at these two:
Their hypothesis was that cirrus clouds act as a thermostat to regulate maximum temperatures in the “Pacific Warm Pool” via a highly localized “super greenhouse effect”.
My hypothesis is that thunderstorms act all over the planet as natural emergent air conditioning units, which form over local surface hot spots and (along with other emergent phenomena) cool the surface and regulate the global temperature.
it seems like the two hypotheses are tangentially related. A average guy like me would read yours as extending theirs to a larger, global scope, advancing (aka “adding to”) what others have done before. Isn’t that what Dr. Roy says he wants or am I being to Homer Simpsonish?

geran
October 9, 2013 2:17 pm

I’m not sure what is going on with Dr. Roy. I’m not sure why he is attacking Willis. He seems to hint that he does not want people to get off on the wrong science road (where, he implies, Willis is taking them), but then he hints that Willis “copied” (my wording, not Spencer’s) from peer-reviewed papers. The two ideas don’t equate.
And, why WIllis? Great garbled garbage, aren’t there literally 100’s of “establishment scientists” that Dr. Roy needs to be attacking, to clean up his profession?
If Dr. Roy has so much free time on his hands that he can attack Willis, maybe he should find a charity where he can donate some of his time–THAT would be constructive.

bit chilly
October 9, 2013 2:18 pm

eternaloptimist,stunning analogy,i hope you do not mind if i use that in the future 🙂

Jack
October 9, 2013 2:18 pm

Since Dr. Roy’s article is without references my guess is that his future funding is being threatened.

AndyG55
October 9, 2013 2:19 pm

Could it be that Roy’s funding chain has changed recently ? Just asking.

October 9, 2013 2:20 pm

it is a great pity to see two of the most prominent anti-Warmist figures fighting with each other in public view. This sort of thing is best worked out in private exchanges. There is enough work to be done in the struggle against the Warmists without the effort being weakened by this sort of wrangle.

October 9, 2013 2:21 pm

IMHO, if Dr. Spencer is correct and Willis’ ideas have been extensively published before, then his criticism is much more profitiably directed to the IPCC, which has completely failed to recognize or cite any of it. Any failings ascribed to citizen scientists for lack of proper research should apply a thousandfold to an organization claiming to include hundreds of “top climate scientists” having just spend 4 years studying all the latest research.

Stephen Wilde
October 9, 2013 2:21 pm

“my ideas about thunderstorms regulating the global climate ”
That may well be original to Willis but is likely wrong as being insufficient.
“that emergent phenomena regulate the temperature”
That is a whole different scenario since it covers the entire global climate system including all aspects of the hydrological cycle.
It is likely correct but I would be surprised if it is original to Willis.
“the idea that thunderstorms and other emergent climate phenomena work in concert planet-wide to maintain the temperature of the earth within narrow bounds.”
There Willis combines the two but is that idea original ?
It was first published at WUWT on 14th June 2014 and described the behaviour of tropical weather systems as the regulating process.
The year before that I published several articles proposing the entire global air and ocean circulation as a regulating mechanism:
http://www.newclimatemodel.com/the-hot-water-bottle-effect/
June 25, 2008
http://www.newclimatemodel.com/weather-is-the-key-after-all/
June 18, 2008
and:
“The Earth is well able to adjust it’s built in thermostat to neutralise all but the largest categories of
disruption (usually geological or astronomic) and humanity does not come anywhere near what would be required.”
from here:
http://www.newclimatemodel.com/the-unifying-theory-of-earths-climate/
January 8, 2009
I am sure all overlaps are inadvertent since it is often the case that different enquiring minds come to similar conclusions around the same time.

October 9, 2013 2:23 pm

A.D. Everard Yes, Dr Spencer needs to be clear as to how Willis has been unoriginal.
And I would prefer such discussions to be made in private.
But that is not the way of internet citizens and Dr Roy chose to play on Willis’s turf; that is an admirable choice.
I maintain that we who are not in the firing line should not become partisan.
From my perspective both sides are honourable searchers for truth.

Stephen Wilde
October 9, 2013 2:23 pm

Sorry, Willis first published 14th June 2009. Please ignore my typo or could the Mods amend it for me.

October 9, 2013 2:27 pm

Above should read “… having just spent …”

October 9, 2013 2:27 pm

Wilis, I don’t read Dr. Roy’s comments as an attack on you at all – I am not sure why you took it that way. From a disinterested 3rd party, it all looked like constructive criticism to me. Your comments on the other hand, were defensive & much more of an attack on Dr. Roy.
It is always good to be deferential to those is power, such as Dr. Roy – look at his comments as constructive criticism & improve your product. I am guessing everyone will be pleased with the outcome, including yourself.

Jeremy
October 9, 2013 2:27 pm

Roy is wrong to slander anyone not doing “novel” work. There’s plenty of scientists who never do an original piece of work in their lives, their work and expertise have great value.

Jean Demesure
October 9, 2013 2:33 pm

@Willis,
In automation and system control, “regulator” or “controller” would be used instead of “governor”.

Theo Goodwin
October 9, 2013 2:35 pm

Excellent essay, Willis. You defended yourself in all the right ways and you questioned Spencer in all the right ways. You have shown a nasty side to Spencer. He writes:
“But if you increase clouds in one area with more upward motion and precipitation, you tend to decrease clouds elsewhere with sinking motion. It’s called mass continuity…you can’t have rising air in one region without sinking air elsewhere to complete the circulation.”
Here he is simply applying a rule of thumb from textbook climate science and failing to look at the details of your actual empirical hypothesis. When he made this comment the first time, here on WUWT, I pointed out then that the rising and sinking of air might tell us something about cloud formation but it does not determine cloud formation. There is need for empirical study on the latter.
Then the mainstream climate scientist in Spencer comes out:
“So, examining how clouds and temperatures vary together locally (as Willis has done) really doesn’t tell you anything about feedbacks. Feedbacks only make sense over entire atmospheric circulation systems, which are ill-defined (except in the global average).”
So, according to Dr. Spencer. all climate science will ever give us are global averages based on time series analysis? In that case, he has left science and joined the Alarmists. There has never been a science based on the results of time series analysis and there never will be. Does anyone use time series analysis outside of economics, political science, climate science, and corporate directors of budgeting?
Willis offers physical hypotheses about cause and effect in cloud formation that invites empirical investigation and Spencer dismisses it out of hand. Ridiculous. Trenberth has explained recently that he will be investigating the particular ocean mechanisms that transport heat from shallow water to deep waters. Trenberth needs to find mechanisms described by physical hypotheses. Will Spencer call him down and tell him to use time series analysis to provide global averages?
Finally, Willis should not be held to the standards of tenured professors of climate science. Those tenured professors work in buildings where someone in that building has ready memory of all the papers written on any topic you want. Willis works alone.
Willis is fortunate that he works alone. It is becoming apparent, through the opinions of people such as Spencer. that everyone who works in climate science is averse to formulating and testing physical hypotheses about cloud formation. Spencer wants to keep us in the doldrums of global average non-science and nonsense.

October 9, 2013 2:35 pm

Citizen Science should be appreciated for what it achieves. It is not important if someone repeats work done by others even if ignorant of such previous research, in fact that should be one of it’s strengths, either providing an independent confirmation or providing an opportunity to view the subject from a different perspective.
With a mechanical engineering background, I always sought to surround myself with a team of people who rather than all having been trained to approach problem solving from a text book, were instead mainly independent thinkers who tended to think outside the box.
Sure, some weird solutions were often thrown up, but as problems progressed from the easily solved where the solution was readily arrived at with most of those addressing it locking onto it fairly quickly, the more difficult problems as they progressed upwards saw the solutions being suggested becoming more and more divergent until finally, with the most difficult to solve of all problems, often it came down to one person who happened to see or consider something that nobody had seen or considered, that is until that one person pointed it out, then everybody could see it.
Whenever I heard the words “Why didn’t we think of that” I took that as having been a success for the team as the last thing I wanted to here was “We all came up with the same idea at the same time”
Keep doing what you are doing Willis. Don’t worry about what criticism others might make, especially if it comes from them defending what they consider their territory. Even though they may try to profit from it, such knowledge ultimately belongs to all citizens.

Gene Selkov
October 9, 2013 2:39 pm

There is a 100% certainty that whatever you do in public will upset some people and make others happy. Count me among the happy ones here; I just like seeing errors corrected. I would like it as much if it were Roy correcting an error made by Willis. In this case, I do appreciate Willis’s taking the time to show the less experienced among us here how to do it properly.
Overreacting? I don’t know, but I am 100% certain that whatever your reaction to something is, many will judge your reaction excessive, and perhaps just as many will find it insufficient.
But I have a slightly off-topic question about feedbacks.
Willis, I am sorry to be so thick, but I fail to understand the importance of your taxonomy of feedbacks. If I have a system with a negative feedback, I can use it as a regulator, or governor, whether its feedback factor is fixed or variable. For example, linear op amps are used in feedback circuits such as power regulators because their linearity and the constancy of the feedback factor make them easy to design. On the other hand, the fill valve in my lavatory cistern is controlled by a float through a variable (but consistently negative) feedback. What difference does it make if both systems succeed at keeping a quantity of something at a set level?
The only difference I can imagine will be in the dynamics of their response to perturbations, or the accuracy of their steady state.
So I wonder if you could perhaps explain us with more examples what makes the word “governor” more important to you than other synonymous terms, and why just “feedback” does not work. I grew up with the word “feedback” meaning any mechanism whereby part of the output is combined with the input, and the use of the word was not sensitive to the nature of that mechanism (or I failed to sense it).

Latitude
October 9, 2013 2:41 pm

I made a mistake….I should have read Dr. Spencer’s blog first..
…I withdraw my comment and sincerely apologize to Dr. Spencer
===========
Latitude says:
October 9, 2013 at 1:59 pm

Fernando (in Brazil)
October 9, 2013 2:42 pm

After years of reading papers on climate science.
I am convinced that I have read the definitive answer.
Michelson and Morley
They proved that climate models do not depend on the real existence of CO2.
Hendrik Lorentz:
Proposes the existence of temporal dilation of heat in the ocean depths.
Meanwhile at the patent office, Bern, Switzerland ……..
========
Boys [W. and RS] back to the drawing board.
You two. Did not know how to do politics.

acementhead
October 9, 2013 2:44 pm

Jeff L says: October 9, 2013 at 2:27 pm
“Wilis,(sic) I don’t read Dr. Roy’s comments as an attack on you at all – I am not sure why you took it(sic) that way. From a disinterested 3rd party, it all looked like constructive criticism to me. Your comments on the other hand, were defensive & much more of an attack on Dr. Roy.
It is always good to be deferential to those is(sic) power, …”
Ah yes Deference to Power that’s what we need. A million dead here 50 million dead there, doesn’t matter as long as we have Deference to Power.
Maybe I missed your irony; yeah that’s it. Sorry, my mistake.

October 9, 2013 2:46 pm

bit chilly says at October 9, 2013 at 2:07 pm…
The institutional quality control standards are very weak at the lower end of the market. The dumber journals accept any old rubbish. Nature Climate Change is a fine example of a journal that lives off exciting papers which are never cited again after 3 months.
The institutional quality control standards are very strong at the upper end of the market. Yet those journals don’t get anywhere near the readership of WUWT.
The as yet unanswered question is how important and skilful are the readership of WUWT.

RC Saumarez
October 9, 2013 2:49 pm

Roy Spencer is a professional scientist and has worked in remote sensing for many years. He is likely to have a sophisticated understanding of his field.
Is Steven McIntyre a citizen scientist? He is a trained mathematician and has years of experience in the practical use of statistics. Because of this, he was able to dissect the mathematics used by Mann, publish his results, and show that it was incorrect. It is unlikely that someone who has not had mathematical training would have spotted Mann’s error.
What is the problem with citizen scientists (CS)? None, anyone is entitled to express their opinions and good luck to them. The difficulty is when the CS uses techniques that he/she doesn’t understand, produces slip-shod work, can’t perform experiments and then wants to convince the scientific community that he or she is correct and everone else is wrong.
The training of a scientist is directed at learning experimental and theoretical methods but, above all, to understand how to apply these methods in a sensible and critical way. A scientific training is a foundation to be able to apply critical thought in a scientific context. To say that the citizen scientist can, in general, perform in advanced science is to say that scientific training is superfluous and a deep understanding of experimental methods, mathematics, data analysis, statistics isn’t really necessary to achieve sensible results. In fact why have scientists at all when any CS can knock up antibiotics, design large bridges, discover atomic particles and so on?
There are of course notable examples of Citizen scientists. Einstein for example. The thing that makes these citizen scientists proper scientists is that they publish their results in mainstream journals, expose themselves to independent criticism and defend there theses with logic.
This is the critical distinction. Probably every scientist becomes obsessed by an attractive hypothesis, performs the wrong experiment, fails to calibrate a device properly and so on. The essential aspect of science is that one opens up one’s ideas to criticism so that one’s logic and methods can be attacked by knowledgeable critics. If they show you that you are wrong, then you are wrong, if you can defend your thesis you may be right.
Unfortunately, there are other types of CS, who do not understand data, its limitations, experimental methods, calibration or any relevent mathematics and produce absolute nonsense. In my experience these individuals are extremely sensitive to criticism and distinguish themselves by refusing to adhere to the normal disciplines of science. If their ideas are not tested they can’t tell if they are are correct. Unless their ideas are revolutionary, it’s unlikely that anyone is going to try and test them experimentally and so what they have to say is unlikely to be important. In this case what passes for citizen science isn’t science.