Berkeley Earth has just released a new version of the Berkeley Earth dataset, which is more comprehensive than the version released in October 2011, and fixes some bugs in the initial release. You can access the new dataset here: www.BerkeleyEarth.org/data.
The new dataset includes:
- Additional data not included in the first release of the dataset (e.g. early data from South America, data through 2011, etc.)
- TMIN and TMAX (in addition to TAVG)
- Intermediate versions of the data (including multi-valued, single valued, with and without seasonality removed, with and without quality control)
- Source data in a common format, as well as links to the original sources
All files are in Text format, but if there is enough interest we can also provide them in Matlab. Steven Mosher has independently put together a R function to import the Berkeley Earth data, which is available here:
http://cran.r-project.org/web/packages/BerkeleyEarth/index.html
In making these data accessible to professional and amateur exploration we hope to encourage further analysis. If you have questions or reflections on this work, please contact, info@berkeleyearth.org. We will attempt to address as many inquiries as possible, and look forward to hearing from you.
Best regards,
Elizabeth Muller
Founder and Executive Director
Berkeley Earth Surface Temperature
Discover more from Watts Up With That?
Subscribe to get the latest posts sent to your email.
I hope ther was some communication with you, Anthony
Off topic>>
Go to Fox news and see the video of tornados on the surface of the sun… Unbeleavable
Elizabeth, thank you.
Anthony, appreciate your venue for providing a vehicle to discuss it.
John
Bad to have to say this but I want to compare this data with the previous release to make sure no “corrections” were added in.
Those solar tornadoes are caused by anthropogenic CO2, don’t ya know.
ok, guys, just uploaded a new version of the package to allow those with limited memory to play.
i suggest 4GB at least, but I tried to add support for smaller machines. its a beast.
If you have any questions, just write me.. help I need testers.
Okidoki, so what’s the moral here? First release substandard data with an even worse conclusion, then just release a new “fixed” dataset and call it a day, like oh, they’re not a complete set of incompetent activists by default?
The first release was clearly to be read as a first approach. If it takes ten revisions to iron the bugs out, then that is merely ‘scientific democracy’ at work, plus the contributions of people adding considerable knowledge usually free of charge.
DocWat says:
February 17, 2012 at 2:34 pm
Off topic>>
Go to Fox news and see the video of tornados on the surface of the sun… Unbeleavable
———————
Here’s that link:
http://video.foxnews.com/v/1458377781001/vast-solar-tornado-spied-on-sun/
Thanks geoff.
The orginal release is still there, but I dont think people get the process.
At the end of the day, all of the source data will be posted. Code taking folks step by step to the final data will all be posted. If I survive all the steps in matlab will be re done in R. But its a huge amount of work and I’m just one guy.
oh, if folks want source to version 1.1 to the package they can just write me. Its been posted to CRAN, in line for building… sometimes that happens in a day or two.
Berkeley Earth releases new version of the BEST dataset
Now with only half the errors! Still has the same great taste and smell you enjoy!
Recommended by 4 out of 5 climatologists*!
(*among climatologists who expressed a preference)
First, my thanks to Steven Mosher for putting out the R code for the import, and to Anthony for the notification.
Next, Geoff Sherrington says:
February 17, 2012 at 3:20 pm
Nope. The first release was clearly a publicity seeking device, devoid of backup, underlying data, or code. It was a shabby thing, designed to get people’s attention but devoid of any scientific value … as can be seen by the fact that no one tried to do any science with it.
w.
steven mosher says:
February 17, 2012 at 3:39 pm
Mosh, we understand the process quite well.
First put out all of your claims, gain all the glory, make the interview circuit, get the tame journalists to do puff pieces, have Mosher explain how it’s all quite logical. Do not include data or code with this one, or it might bite you.
Second, months later when you have garnered all the laurels, then and only then release the data … without code, of course, but have Mosher give a promise that the data will be followed, “at the end of the day”, by the code.
Yeah, Mosh, that’s the ticket, keep trying to convince us that’s how science is done—Congressional appearance one day, press release next day, interview next day … and then data in six months, code in a year, science at its finest…
If I tried that kind of bull here on this website people would crucify me, Mosh, INCLUDING YOURSELF.
And you actually have the nerve to stand there and tell us we don’t understand the process??
Oh, we do, Mosh, we do … but it’s clear that someone here doesn’t.
w.
Plus, not even a mention of systematic measurement error.
Thanks Mr. Mosher, Mr. Watts.
This ain’t going to work on my pesky ZX81! What’s the best way (if any) to edit down the data set to the last n years? [Sorry if stupid question.]
Have any of thier papers from the Best Project passed peer reviewing and been published yet?
I nominate Steven Mosher for Data Salesman of The Month. 😉
Andrew
Willis,
You are just jealous that you have not been made a part of the Muller family. Mosher-to-Muller is not a big name change. You got way too many conflicting letters.
Science is rarely enough. Shall we talk heliocentric vs. geocentric? Cholera? Flat vs round earth? antiseptics? Come on. Be real. Half of you are convinced that global warming is coming; half of you aren’t. Obviously, the science isn’t enough.
While agreeing with the general skepticism about Dr. Muller and his motives, Mr, Mosher (who has a reputation of not being easily satisfied) has worked on it and it IS data. So let’s have a fair look at it.
PS: Managed to get most data through before the fire started. 🙂
for me the only things that matter are the error bars! Just how wide ar ethey? Have you responded to informed critiques from folks such as Briggs and JeffID?
“Berkeley Earth has just released a new version of the Berkeley Earth dataset, which is more comprehensive than the version released in October 2011, and fixes some bugs in the initial release. ”
==================
Have they deigned to explain why it is more comprehensive, or released the code that fixes the bugs ?
With bated breath, I await, an explanation.
doug@4:17 – quite the contrary, the ice is coming. How much longer do you think the present inter-glacial will last? Beyond our lifetimes almost certainly, but history has shown us that the ice is much more common than the heat (and that there is more life and diversity of life when it is hotter).
Thanks to Mosh for all his efforts on this.
Thx also to Greg, from Spokane for the link.