RealClimate.org – down

UPDATE: As of 10PM PST, RC is back up and running, no mention of the outage though – Anthony

I figured I’d better note this since a number of people have brought it to my attention. Trying to reach realclimate.org was giving a 502 error much of today, which is likely due to an internal problem with their database used to run WordPress. They run a custom version of wordpress code and theme on a LAMP configuration, and it appears the PHP code can no longer communicate with the MySQL database.

After several hours of that 502 error, realclimate.org is now giving a 503 error:

Service Temporarily Unavailable

The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.

Here’s some background on these codes:

Error: 503 Service Unavailable
The server is currently unavailable (because it is overloaded or down for maintenance). Generally, this is a temporary state.

Error: 502 Bad Gateway

A 502 Bad Gateway error occurs when the front-end web server cannot communicate with the application responsible for responding to the request. To resolve this error:

  • Confirm that the application is running. If the application crashed, was terminated, or has not yet started following a system reboot, the application must be restarted to respond to requests. If the application was terminated, you will receive a notification email with additional information.To restart the application manually, please see your application type’s documentation or control panel entry for instructions.Most stopped applications are automatically restarted during periodic cron jobs. Please see the application’s entry in the control panel for details.
  • Confirm that the application is listening to the correct port. Check your application’s configuration to make sure that it is listening to the port assigned to the application in the control panel.

Gavin is probably pulling out what little hair he has about right now.

This is why I use wordpress.com – I don’t have to worry about maintenance, hacking, updates, or other server related issues.

Based on the return codes, the issues at RC today are likely due to internal code or maintenance problems, so I wouldn’t speculate beyond that.

0 0 votes
Article Rating
82 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments
October 17, 2011 5:13 pm

Tragic.

Editor
October 17, 2011 5:19 pm

I still find it amusing that given how much they deny the sun’s influence on climate, they have the sun in their banner and you dont….

October 17, 2011 5:28 pm

I wonder if they have tried to apply their world-famous coding skills…

1DandyTroll
October 17, 2011 5:29 pm

And what a bad pseudo gateway it is to climate science.

Truthseeker
October 17, 2011 5:30 pm

Still down …
It is not as if they have many viewers to disappoint …

October 17, 2011 5:33 pm

Hi Mike – all they care about is giving the impression of great heat – and hope people don’t do something really radical like think about it.

October 17, 2011 5:33 pm

Given the high traffic of your site, does it ever get overloaded? Or do you solve that by buying extra bandwidth?

Paul Westhaver
October 17, 2011 5:37 pm

Mike Lorrey… interesting observation…
Yes RC has a sun… but the solar influences deniers’ sun is an “angry sun”…. Anthony has a much nicer soft reflection of our beautiful life giving sun…

October 17, 2011 5:37 pm

503’s are frequently authentication errors too. Might be as simple as someone fat fingering the new password in a script or the password/shadow file. BTW, it’s back to a 502, which likely implies they’re not troubleshooting methodically and logically…

Paul Westhaver
October 17, 2011 5:38 pm

I guess my hack worked its magic. ;’)

Editor
October 17, 2011 5:38 pm

Usually I’ll see a sign that says “Wet paint” and won’t touch the paint to see if it’s still wet.
Why did I rush right over to RealClimate to see for myself?
I can connect, but I don’t get anything back.
I wonder if they use the – oops, just got 504 – Gateway Timeout – Phil Jones backup method. “I know it’s here, somewhere.”
Yep, still wet.

ShrNfr
October 17, 2011 5:42 pm

LAMP with MYSQL makes for a fairly nice web platform until it doesn’t. At that problem you have a major project on your hands fixing it. Musta been the global warming that got to his CPU or something.
@Bradley, the major problem is the core database and its server. You have to do transactions to it and not get locks. Bandwidth turns out to usually be the least of your problems in the long run.

Editor
October 17, 2011 5:49 pm

You know, Anthony, a truly decent human being would contact Gavin and offer to host all his posts until he’d resolved his issues. Kind of in the spirit of Trenberth meeting with skeptics…. Uh… your moderators would, of course, continue to handle the moderation duties.

October 17, 2011 5:58 pm

Paul Westhaver says: October 17, 2011 at 5:37 pm
Mike Lorrey… interesting observation…
Yes RC has a sun… but the solar influences deniers’ sun is an “angry sun”…. Anthony has a much nicer soft reflection of our beautiful life giving sun…

Just my feelings too. Like a Freudian slip they show the sun and like a second Freudian slip they show it as angry. Truth will out.

Gary Hladik
October 17, 2011 6:12 pm

Real WHO?

Hoser
October 17, 2011 6:14 pm

Oh, gosh, Betsy must be pulling out her hair about now. Maybe now she realizes solar hosting might not be such a great idea after all.

ferd berple
October 17, 2011 6:15 pm

RC is green technology. Only works when the wind blows government grants in their direction. The green you see is your $$ going down the toilet to help “the Team” live large.

Theo Goodwin
October 17, 2011 6:21 pm

omnologos says:
October 17, 2011 at 5:28 pm
“I wonder if they have tried to apply their world-famous coding skills…”
Yeah, the ability to code for a supercomputer makes a mere webserver a piece of cake. I don’t know how many times Warmista have implied that they understand their supercomputer code so well that reading it is as easy as reading a physics text. What could go wrong?

James Wesley
October 17, 2011 6:23 pm

Maybe their part of the stimulus ran out and they won’t be back up till the “Jobs act” is passed so they can get their jobs funding.

Lew Skannen
October 17, 2011 6:26 pm

“This is why I use wordpress.com – I don’t have to worry about maintenance, hacking, updates, or other server related issues.”
Yes, but Gavin doesn’t have to worry about traffic….

Bob Moss
October 17, 2011 6:33 pm

Maybe their proxy server is upside down.

Keith W.
October 17, 2011 6:34 pm

Theo Goodwin says:
October 17, 2011 at 6:21 pm
Yeah, the ability to code for a supercomputer makes a mere webserver a piece of cake. I don’t know how many times Warmista have implied that they understand their supercomputer code so well that reading it is as easy as reading a physics text. What could go wrong?

Theo, as most of their released code has proven to be Matlab, FORTRAN, or other codes which have been readily duplicated by non-progammers (Steve McIntyre is a mining engineer not a programmer, but has duplicated Team studies repeatedly in R), you need to be careful throwing that supercomputer coding idea around. People have been duplicating their “supercomputer codes” on desktop PCs all over the world.

October 17, 2011 6:37 pm

Hmmm … time yet for a sidebar category titled “Down” ?
Probably only if they lose their posting-database for the x number of years they’ve been in existence …
.

Hank
October 17, 2011 6:39 pm

I hope they have a good (recent) backup of their database file or the are going to lose everything if they need to rebuild their site. What a shame 😉

Konrad
October 17, 2011 6:46 pm

Does Mr. Soros get a refund or a credit note?

October 17, 2011 6:46 pm

Most likely the database is so much toast… Unless you _really_ know what you are doing databases need periodic ‘spring cleaning’ (not of the deleting posts type) to keep operational – i.e. tweaking configs, checking disc space etc
I’d put my money on that they have run out of disc space… Usually something you can plan for and the OS should be been screaming into the log files that the ceiling was fast approaching..
BTW coding a web site is considering harder than a supercomputer – with web sites you need to deal with the real world on every single request…

October 17, 2011 6:47 pm

Still ‘502’ errors inquiring using Sam Spade:
Host: http://www.realclimate.org
Connection: close
User-Agent: Sam Spade 1.14
HTTP/1.1 502 Bad Gateway
Server: nginx
Date: Tue, 18 Oct 2011 01:40:56 GMT
Content-Type: text/html; charset=utf-8
Connection: close
Last-Modified: Thu, 29 Sep 2011 14:45:01 GMT
Accept-Ranges: bytes
Content-Length: 682
Cache-Control: max-age=0, no-cache, no-store, must-revalidate
Pragma: no-cache
Expires: Wed, 11 Jan 1984 05:00:00 GMT
<!DOCTYPE html PUBLIC “-//W3C//DTD HTML 4.01//EN”
“http://www.w3.org/TR/html4/strict.dtd”>
<html>
<head>
<meta http-equiv=”Content-Type” content=”text/html; charset=utf-8″>
<meta http-equiv=”pragma” content=”no-cache”>
<title>502 – Bad Gateway</title>
</head>
<body>
<h1>502 – Bad Gateway</h1>
<p>The page you requested is currently unavailable. Please try again later.</p>
<p>If you are the website owner, please see
<a href=”http://docs.webfaction.com/software/general.html#error-502-bad-gateway”>Error: 502 Bad Gateway</a>
documentation for more information and possible steps to resolve the problem.</p>
</body>
</html>
– – – – – – – – – – – – – – – – –

Michael in Sydney
October 17, 2011 6:51 pm

I didn’t notice.

John Crane
October 17, 2011 6:54 pm

Maybe they’re part of the IPCC Cloud and are now frantically cleaning house.

stevo
October 17, 2011 7:21 pm

“Gavin is probably pulling out what little hair he has about right now.”
Hilarious! You must have spent ages thinking of that.

REP
Editor
Reply to  stevo
October 17, 2011 7:28 pm

Stevo, you really need to develop a sense of humor. Gavin has a problem with his site that would lead most of us, many with IT skills, foaming at the mouth. Many of us would not wish it on a nicer person. I’m twice his age and have twice the hair. I think I don’t have enough. Hope Gavin has a better response than hair-pulling.

October 17, 2011 7:21 pm


Maybe they’re part of the IPCC Cloud and are now frantically cleaning house.

Aha “document shredding” … lol …
.

October 17, 2011 7:23 pm

I’m sorry RealClimate has gone down; it provided another perspective on climate change. And the RC moderators’ practice of censoring anything challenging CAGW dogma may have been as effective as WUWT in converting open-minded visitors into skeptics. 😉

jorgekafkazar
October 17, 2011 7:32 pm

It’s wonderful how much I’m not interested.

wotsit
October 17, 2011 7:32 pm

Isn’t that the standard server response to FOI?

Dr. Dave
October 17, 2011 7:46 pm

Y’all are nuts! Clearly the site is possessed of demons.

DavidM
October 17, 2011 7:49 pm

Apparently the IT guys have been told to take Steig’s Matlab class before they can fix anything which is slowing things down a bit. Also, it turns out one of the techs doesn’t have his PhD in Radiative Physics yet.

Dr. Dave
October 17, 2011 7:49 pm

While I am normally loathe to dispense free medical advice, Gavin should prepare a hot, moist herbal poultice and lay it upon his server to draw out the evil humors.

crosspatch
October 17, 2011 7:51 pm

My guess is that it just got suicided in order to prevent any IPCC related FOIA requests.

crosspatch
October 17, 2011 7:51 pm

Or someone has seized their database. That is another possibility.

Frank Kotler
October 17, 2011 7:53 pm

#
Bob Moss says:
October 17, 2011 at 6:33 pm
Maybe their proxy server is upside down.
#
Quote of the week! Thanks, Bob!

Mike Bromley the Kurd
October 17, 2011 7:57 pm

Maybe a denial of sevice hack from some of those Anonymous people, mistakenly thinking it was a Skeptic site….

G. Karst
October 17, 2011 8:00 pm

FBI raid… well, we can at least hope that the long arm of the law, has finally caught up to the team. It may be a brief fantasy, but I think I will enjoy a few more moments, of it. GK

Gerald Machnee
October 17, 2011 8:06 pm

Will give them more time to read “The Spoiled Child”.

Jimmy Haigh
October 17, 2011 8:09 pm

So RC is down? No great loss to humankind.

David Ball
October 17, 2011 8:10 pm

Perhaps the sea has inundated their office, …………

Jimmy Haigh
October 17, 2011 8:11 pm

Mike Lorrey says:
October 17, 2011 at 5:19 pm
I’d noticed that before too. Looks like their sun’s at solar maximum too.
Bob Moss says:
October 17, 2011 at 6:33 pm
Good one!

Shub Niggurath
October 17, 2011 8:14 pm

“Maybe their proxy server is upside down.”
ROFL.

Mike
October 17, 2011 8:24 pm

Perhaps all their tech people are out supporting an “occupy something effort” somewhere ?

Robinson
October 17, 2011 8:30 pm

… and just for a few days at least, the Internet was slightly less stupid.

AntonyIndia
October 17, 2011 8:33 pm

Still: “503 Service Temporarily Unavailable”.
Who pulled the plug on this (private? – government?) project?

phlogiston
October 17, 2011 8:49 pm

HarryHelpMe!

October 17, 2011 8:52 pm

And – RC is UP:
– – – – – – – – – – – – – – – – –
10/17/11 22:48:05 Browsing http://www.realclimate.org/
Fetching http://www.realclimate.org/
GET / HTTP/1.1
Host: http://www.realclimate.org
Connection: close
User-Agent: Sam Spade 1.14
HTTP/1.1 200 OK
Server: nginx
Date: Tue, 18 Oct 2011 03:48:17 GMT
Content-Type: text/html; charset=utf-8
Transfer-Encoding: chunked
Connection: close
X-Powered-By: PHP/5.2.9
X-Pingback: http://www.realclimate.org/xmlrpc.php
3f23
<!DOCTYPE html PUBLIC “-//W3C//DTD XHTML 1.0 Transitional//EN” “http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd”>
<html xmlns=”http://www.w3.org/1999/xhtml” dir=”ltr” lang=”en-US”>
<head profile=”http://gmpg.org/xfn/11″>
<meta http-equiv=”Content-Type” content=”text/html; charset=utf-8″ />
<title> RealClimate</title>

– – – – – – – – – – – – – – – – – –

October 17, 2011 8:52 pm

Up now…

October 17, 2011 8:53 pm

Maybe Gavin is trying to cover his tracks so it can’t be shown as to how so very much time he has spent blogging and posting and moderating a website while on the taxpayer’s clock.
Chris
Norfolk, VA, USA

DR
October 17, 2011 8:54 pm

http://www.wnd.com is down too.

Martin Clauss
October 17, 2011 8:55 pm

It’s 8:54 Arizona Time (which is the same as Pacific Daylight time since AZ doesn’t go on daylight savings time), and RC is back up . .

October 17, 2011 9:03 pm

Anthony/mods – Who has the sense of humor?
Check out “X-hacker” header line below:
– – – – – – – – – – – – – – – – – – – – – – –
10/17/11 22:56:48 Browsing http://wattsupwiththat.com/
Fetching http://wattsupwiththat.com/
GET / HTTP/1.1
Host: wattsupwiththat.com
Connection: close
User-Agent: Sam Spade 1.14
HTTP/1.1 200 OK
Server: nginx
Date: Tue, 18 Oct 2011 03:56:50 GMT
Content-Type: text/html; charset=UTF-8
Transfer-Encoding: chunked
Connection: close
Vary: Accept-Encoding
Last-Modified: Tue, 18 Oct 2011 03:54:50 +0000
Cache-Control: max-age=180, must-revalidate
Vary: Cookie
X-hacker: If you’re reading this, you should visit automattic.com/jobs and apply to join the fun, mention this header.
X-Pingback: http://wattsupwiththat.com/xmlrpc.php
Link: <http://wp.me/7y4l&gt;; rel=shortlink
X-nananana: Batcache
efd
<!DOCTYPE html>
<!–[if IE 6]>
<html id=”ie6″ dir=”ltr” lang=”en”>
<![endif]–>
<!–[if IE 7]>
<html id=”ie7″ dir=”ltr” lang=”en”>
<![endif]–>
<!–[if IE 8]>
<html id=”ie8″ dir=”ltr” lang=”en”>
<![endif]–>
<!–[if !(IE 6) | !(IE 7) | !(IE 8) ]><!–>
<html dir=”ltr” lang=”en”>
<!–<![endif]–>
<!–
generated 120 seconds ago
generated in 0.978 seconds
served from batcache in 0.005 seconds
expires in 180 seconds
–>
<head>
<meta charset=”UTF-8″ />
<title>Watts Up With That?</title>

– – – – – – – – – – – – – – – – – – – – –

October 17, 2011 9:08 pm

It’s bad Karma to use a computer to make light of people having computer problems.

October 17, 2011 9:48 pm

Has anyone blamed the ‘Skeptics’ yet?
Wouldn’t surprise me.

petermue
October 17, 2011 10:29 pm

Maybe they Bore Holed themselves.
LOL

UK Sceptic
October 17, 2011 10:38 pm

Error 504: Debating the “Science” Permanently Unavailable

jeef
October 17, 2011 10:53 pm

I bet every cynical clickthrough from WUWT quadrupled their traffic hourly!

NZ Willy
October 18, 2011 12:07 am

Don’t care if they’re up or down or outta here…

Crispin in Waterloo
October 18, 2011 12:10 am

The RC server is not running, it’s drooling.
Now because of this failure of ‘service’ for so many hours, and taking a lesson from RIM, we all deserve an apology in the form of $100 worth of free downloaded programmes, each.
I will accept, for my entire $100 credit, a download of the programme used to generate the CRU temperature output files, fully annotated by HarryReadMe.
I believe Steve McIntyre has a little list…

Truthseeker
October 18, 2011 12:13 am

Maybe Trenberth’s missing heat was in their servers and the cooling system could not cope …

KenB
October 18, 2011 12:13 am

petermue
Thinking the same, Gavin’s been enlarging the borehole and the censorship props failed dumping the site in with the rest. Think of all that accumulated crud they carried and of course we know they are not meticulous engineers!!

DirkH
October 18, 2011 12:26 am

When you have a website that already lies in their header image, you shouldn’t expect truth below that (The same holds for SkepticalScience).

October 18, 2011 1:13 am

No mention of outage…perhaps really they don’t expect anybody to notice.
So now there are hundreds of True Believers going to argue “502 Error” against evil deniers.

Orkneygal
October 18, 2011 2:58 am

“Gavin is probably pulling out what little hair he has about right now.”
Was that comment really necessary?
Anyway, the Borehole is available again. Best part of the entire site.
Later…….

Man Bearpigg
October 18, 2011 3:22 am

I wonder if there were any hidden/password access forums on there that have mysteriously vanished ?

Hoser
October 18, 2011 7:08 am

We are still on daylight saving time. PDT.

Miguel
October 18, 2011 7:16 am

It’s just been announced that Gavin Schmidt will be the recipient of AGU’s first Climate Communications Award.

Snotrocket
October 18, 2011 9:29 am

According to a leak from an engineer fixing RC’s X-Box/Commodore 64, the problem was down to ‘parasitic oscillations due to inter-stage feedback in the Eccles-Jordan mono-stable double diode flip-flop’.
(Now, everything but one element of the bold is a true condition, but that one ‘untruth’ makes the whole statement a lie. There’s a parable for our times, perhaps.)

October 18, 2011 11:24 am

Crispin in Waterloo
harry did not work on CRUTEMP.
so many people get this wrong. the harry readme does not refer to ANY work done on hadcru.
Its an entirely different dataset that nobody even uses.

Frumious Bandersnatch
October 18, 2011 11:38 am

Only an idiot studying to be a moron would even consider running critical apps on a light weight DB engine such as MySQL. They should only be using an enterprise level one such as Postgres, Ingres, etc.
Way, way too many problems with MySQL. More especially as the relational model is not strictly enforced. Now try rolling back from an error in such a situation. Database inconsistencies everywhere…

John Trigge
October 18, 2011 1:06 pm

Was this fixed on company or personal time and who is paying for it?

mrrabbit
October 18, 2011 5:11 pm

Frumious Bandersnatch:
Might want to have a little chit chat with the folks over at Slashdot who for many years did a helluva job running Slashdot on MySQL.
Considering the load and demands put on it – “light weight” is a little harsh.
=8-)

Brian H
October 18, 2011 5:55 pm

Coincidence? The front page is a loving paean to Gavin, recipient of some award or other, probably written by Gavin. It’s an infinite loop problem.

October 18, 2011 6:03 pm

steven mosher says:
“It’s bad Karma to use a computer to make light of people having computer problems.”
If karma worked, Algore could make the temperature drop wherever he went…
oh, wait…

stan
October 19, 2011 6:06 am

fascinating

James P.
October 19, 2011 12:28 pm

Probably a DDoS attack by climate deniers.

%d bloggers like this: