New Climate Audit Server Migration Completed

If some of you have noticed I’ve been a bit absent from WUWT it is because I’ve been working the last two weeks with Mr. Pete and JohnA to get the climateaudit.org server migrated to a new home.

We wanted off a single server box and onto wordpress.com where they have a distributed cloud computing system, gobs of optical pipe bandwidth, automated backup, automated code updates, and 24/7 support. I wish to personally thank Nick and Lloyd of WordPress VIP support who went above an beyond to manage the huge migration of files that spanned all the way back to 2004. WordPress.com has a great staff and a great product.

When Climategate broke, so did the climateaudit single box server. It was more traffic than any one server could bear. The datapipe to the box at our CoLo was also not sufficient to handle the load. I setup camirror.wordpress.com for Steve to use in the interim while the CA IT team figured out how to make this migration happen. There were lots of hitches. Some are still unresolved but the bulk of it is there.

Today, about 5PM PST 90% of the migration has been completed. Steve McIntyre made this announcement:

We have a new and hopefully final home. It has been a very big and complicated job moving climateaudit.org with its nearly 2000 threads, over 200,000 comments, plus images, data, scripts to wordpress.com, which has large enough facilities to prevent the chronic server problems that plagued climateaudit as a standalone server. camirror.wordpress.com was set up to deal with overthrow while our new “home” was being prepared and has been transferred as well.

What substantially complicated the move was our desire to preserve the very large number of links to existing climateaudit images and threads (which I’m told create a subterranean draw and which we didn’t want to disconnect.) Anthony, Mr Pete and John A all contributed to the move, which was accomplished during a period when I was otherwise occupied so to speak.  I’m very grateful to them.  WordPress.com went several extra yards to accomodate the move and I’m very grateful to their staff as well.  We think the old addresses are all pointing to the new addresses – let us know if you have any problems.

A couple of caveats before you rush off to view it:

1) There may still be an occasional broken link or missing file, we’ll get to them all as time permits. Don’t overload Steve with comments about these.

2) DNS propogation may not have completed yet for your portion of the web. So if you visit www.climateaudit.org and you get nothing don’t freak out. The IP address/DNS server changes will eventually propagate to you.

3) Can’t wait? You can try forcing a DNS refresh if you own a PC with Windows by doing the following.

Open a command prompt and type the command in yellow below and press enter.

If you have a Mac, I have no idea how to do this, maybe somebody who owns one can leave a comment.

So within 24 hours or so, almost everybody should be able to get to www.climateaudit.org

Also, beyond the above, and maybe cycling your router/modem, I can’t suggest how to solve DNS propagation delays at your location, so just wait it out if none of that works.

We all look forward to Steve’s next big thing. Now CA can handle most anything we throw at it and Steve can drive CA “car” without having to carry a set of tools and a small army of mechanics jammed in the trunk.

0 0 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

70 Comments
Inline Feedbacks
View all comments
SABR Matt
December 8, 2009 8:15 pm

Cheers, Steve!
Nice to see the new site…the formatting looks a little wonky on my screen, I think because I have non-default font settings (I have to…I’m visually impaired), but otherwise…everything seems to be working just fine.

Admin
December 8, 2009 8:24 pm

You guys did a great job. DNS propagation is still sporadic at my ISP, and yes I did flush my resolver cache, before I even read your instructions.

pwl
December 8, 2009 8:26 pm

Excellent work to all of you and thanks for keeping the subterranean views of stalactites and stalagmites of climate debate alive and kicking! [:)]
Oh, Steve you were great on CNN by the way! Looked like you had more to say at the end, what was it that you wanted to say when they said by and cut off your feed?

Erik Anderson
December 8, 2009 8:26 pm

Kudos to you, Anthony, for all your generous efforts. Climate Audit’s new bandwidth capabilities will serve the public well in the post-climategate era. Who knows what sudden climate change controversies will explode in 2010! I look forward to being reliably informed by WUWT & CA in the years to come. Cheers!

Nic
December 8, 2009 8:28 pm

On the subject of new web resources; “Copenhagen Climate Challenge”
http://www.copenhagenclimatechallenge.org/index.php?option=com_content&view=frontpage&Itemid=1

Dev
December 8, 2009 8:31 pm

To flush the DNS cache on Mac OS X Leopard, open Terminal and type:
dscacheutil -flushcache
Thanks for all who helped get CA back up and running.

TurkeyLurkey
December 8, 2009 8:35 pm

Thanx for the clue of the DNSflush.
Didn’t make it fly, but probably will soon.
At least i have something to try besides mindlessly trying the same old thing over and over.
any idea about the actual IP address?
TIA
TL

December 8, 2009 8:38 pm

Great work to all involved. The new site looks good from here!

Denbo
December 8, 2009 8:41 pm

For Mac if you are running Leopard run “dscacheutil -flushcache”
See http://developer.apple.com/mac/library/documentation/Darwin/Reference/ManPages/man1/dscacheutil.1.html
Prior to Leopard run: lookupd -flushcache
See http://support.apple.com/kb/TA25216?viewlocale=en_US

jenny
December 8, 2009 8:47 pm

I am unable to connect to the new Climate Audit site. Neither of the links work for me in FireFox or IE. I have tried all evening.

geo
December 8, 2009 8:47 pm

Thank you for your hard work, Anthony. As an “investor” in the last Climate Audit upgrade, perhaps you can tell me and the other contributors what will happen to that hardware going forward?
REPLY: That hardware becomes a new repository for code, data, scripts, and misc files that can’t be stored on wordpress.com It will be setup as data.climateaudit.org or climateaudit.info at the CoLo – Anthony

TurkeyLurkey
December 8, 2009 8:47 pm

OK, working on a machine that is using a VPN to somewhere else than here.
Thanks for all the work.
(and nice mustache for that matter…)
TL

WAG
December 8, 2009 8:48 pm

Actually, I was just thinking how the tendency of Climateaudit to “break down” and “be overrun” with hits was a great marketing tool. Those episodes did three things:
Created a sense of drama that elevated the importance of whatever was being posted. Other blogs would say, “CA is overloaded,” creating more of a stampede to get over there and see what all the fuss was about.
Created scarcity – people who checked and couldn’t get in would keep coming back. Something that’s hard to get seems more valuable.
Established McIntyre’s credentials as an everyday citizen auditor, unfunded by interests that could afford a big fancy server.
For whatever that’s worth.

December 8, 2009 8:54 pm

I’ll flush my stuff tomorrow….. ew, that sounded ickey!

Calvin Ball
December 8, 2009 9:04 pm

Climateaudit.org just vanished from the internet. Gone. I get a Comcast page with “Sorry, we can’t find “www.climateaudit.org”. We suggest that you check the spelling of the web address or search above.” I take it this is a hiccup?

December 8, 2009 9:22 pm

All my old links don’t work nor do links from a search. Will that be fixed?

NickB.
December 8, 2009 9:28 pm

A little tip but if you have your DNS folks cut down the TTL (time to live) on your record ahead of time if you know you’re going to be moving something, you can cut down significantly on that 24 hours to propogate
Congrats on the move to all involved!

Editor
December 8, 2009 9:29 pm

It will take a little work, but I think I can produce Tables of Content for CA like I’m cranking up for WUWT, see http://home.comcast.net/~ewerme/wuwt/
CA doesn’t need them as much as WUWT does, though!

Doug Werme
December 8, 2009 10:03 pm

I doubt this was free. Can we help with the cost?
REPLY: Steve’s tip jar isn’t working just yet, perhaps later. Thank you for the offer. – Anthony

Shawn S
December 8, 2009 10:05 pm

Heads up …The old climateaudit.com does not redirect to the new one.
The new one doesn’t let me past the man page, anything I click on goes to nothing.

REPLY:
heads up ….it’s climateaudit.org

debreuil
December 8, 2009 10:13 pm

sorry for the ot post, but did I just read correctly Al Gore saying the climaegate email is all over 10 years old? Three times?
“A: To paraphrase Shakespeare, it’s sound and fury signifying nothing. I haven’t read all the e-mails, but the most recent one is more than 10 years old.”
He has a shockingly bad grip on all this situation, as well as the science, I’m actually quite surprised. He isn’t doing his cause any favors spewing nonsense like this. (The north polar ice cap was the same size for 3 million years? Wow.)
http://www.slate.com/id/2237789/

Molon Labe
December 8, 2009 10:45 pm

This petition looks significant. Signed by 141 scientists with expertise in relevant areas of science.
http://www.copenhagenclimatechallenge.org/

E.M.Smith
Editor
December 8, 2009 11:05 pm

I connected nicely.
Well done. I know that kind of platform transition can be incredibly painful and detailed work. Doing it while under machine crushing load and staying live? Priceless…
Now that you’re back, take a look at the current weather. Wonderful things are happening. De-icing planes at San Jose, snow in Sacramento, Chicago intraday temps dropping like a rock, blizzard warnings in N. Arizona, lake effect snow in N.Y. (get ready for the “usual” Buffalo story 😉 Seattle Wa. did not get above freezing as the high today, and some places are having HIGHS that are “below zero F”. The Weather Channel is calling it “amazing arctic cold” and there was a report that IOWA (the whole thing) might be shut down soon from the expected cold. Oh, but I-5 has finally reopened…
AND on 810 KGO here in the SF area I heard the News Readers discussing the bitter cold in Napa (where they had been for some reason) and doing a poll among the staff to find if ANYONE had ever experienced colder. (I *think* they said 18F low at night, but I wasn’t listening very closely..) One guy said he thought there might have been ONE day back in the ’70s that was colder, but he wasn’t sure.
So it ought to be a “Weatherman’s Candy Store” 😎
Have fun, do another “Weather is not Climate” and stock up on Firewood!

Alberto
December 8, 2009 11:13 pm

The website seems to be down at the moment. Can anyone confirm this?
REPLY: No

E.M.Smith
Editor
December 8, 2009 11:14 pm

Oh, and while it’s too late to be any help now:
When doing a transition like this, call up your ISP and ask that they push a new Time To Live for your DNS entry (the old one) and set it to something like 1 hour. This means any cache will update after no more than one hour. This is done on unit of your prior expiration in advance. ( So if TTL was 10 days, you do it 11 days before the expected move).
After the move, you push a new, longer, TTL with the new DNS entry.
That way your total DNS cache “issue” time is the short TTL interval. I’ve done as short as 8 min TTL (though the ISP complained… we did it in two steps which made them happier. Push 1 day 10 in advance, then push 8 minutes the day before the move).
I know, “Now you tell me”…
If you ever want a free experienced P.M. on this kind of stuff, I’m often available.
Oh, and Steve, the CNN piece was priceless. That little smile when you knew you “had him” on a point was enough for me to do a little jig… Folks catch those small things and know who’s got the truth and who’s faking it.

1 2 3
Verified by MonsterInsights