UPDATE: As of 10PM PST, RC is back up and running, no mention of the outage though – Anthony
I figured I’d better note this since a number of people have brought it to my attention. Trying to reach realclimate.org was giving a 502 error much of today, which is likely due to an internal problem with their database used to run WordPress. They run a custom version of wordpress code and theme on a LAMP configuration, and it appears the PHP code can no longer communicate with the MySQL database.
After several hours of that 502 error, realclimate.org is now giving a 503 error:
Service Temporarily Unavailable
The server is temporarily unable to service your request due to maintenance downtime or capacity problems. Please try again later.
Here’s some background on these codes:
- Error: 503 Service Unavailable
- The server is currently unavailable (because it is overloaded or down for maintenance). Generally, this is a temporary state.
Error: 502 Bad Gateway
A 502 Bad Gateway error occurs when the front-end web server cannot communicate with the application responsible for responding to the request. To resolve this error:
- Confirm that the application is running. If the application crashed, was terminated, or has not yet started following a system reboot, the application must be restarted to respond to requests. If the application was terminated, you will receive a notification email with additional information.To restart the application manually, please see your application type’s documentation or control panel entry for instructions.Most stopped applications are automatically restarted during periodic cron jobs. Please see the application’s entry in the control panel for details.
- Confirm that the application is listening to the correct port. Check your application’s configuration to make sure that it is listening to the port assigned to the application in the control panel.
Gavin is probably pulling out what little hair he has about right now.
This is why I use wordpress.com – I don’t have to worry about maintenance, hacking, updates, or other server related issues.
Based on the return codes, the issues at RC today are likely due to internal code or maintenance problems, so I wouldn’t speculate beyond that.
Tragic.
I still find it amusing that given how much they deny the sun’s influence on climate, they have the sun in their banner and you dont….
I wonder if they have tried to apply their world-famous coding skills…
And what a bad pseudo gateway it is to climate science.
Still down …
It is not as if they have many viewers to disappoint …
Hi Mike – all they care about is giving the impression of great heat – and hope people don’t do something really radical like think about it.
Given the high traffic of your site, does it ever get overloaded? Or do you solve that by buying extra bandwidth?
Mike Lorrey… interesting observation…
Yes RC has a sun… but the solar influences deniers’ sun is an “angry sun”…. Anthony has a much nicer soft reflection of our beautiful life giving sun…
503’s are frequently authentication errors too. Might be as simple as someone fat fingering the new password in a script or the password/shadow file. BTW, it’s back to a 502, which likely implies they’re not troubleshooting methodically and logically…
I guess my hack worked its magic. ;’)
Usually I’ll see a sign that says “Wet paint” and won’t touch the paint to see if it’s still wet.
Why did I rush right over to RealClimate to see for myself?
I can connect, but I don’t get anything back.
I wonder if they use the – oops, just got 504 – Gateway Timeout – Phil Jones backup method. “I know it’s here, somewhere.”
Yep, still wet.
LAMP with MYSQL makes for a fairly nice web platform until it doesn’t. At that problem you have a major project on your hands fixing it. Musta been the global warming that got to his CPU or something.
@Bradley, the major problem is the core database and its server. You have to do transactions to it and not get locks. Bandwidth turns out to usually be the least of your problems in the long run.
You know, Anthony, a truly decent human being would contact Gavin and offer to host all his posts until he’d resolved his issues. Kind of in the spirit of Trenberth meeting with skeptics…. Uh… your moderators would, of course, continue to handle the moderation duties.
Paul Westhaver says: October 17, 2011 at 5:37 pm
Mike Lorrey… interesting observation…
Yes RC has a sun… but the solar influences deniers’ sun is an “angry sun”…. Anthony has a much nicer soft reflection of our beautiful life giving sun…
Just my feelings too. Like a Freudian slip they show the sun and like a second Freudian slip they show it as angry. Truth will out.
Real WHO?
Oh, gosh, Betsy must be pulling out her hair about now. Maybe now she realizes solar hosting might not be such a great idea after all.
RC is green technology. Only works when the wind blows government grants in their direction. The green you see is your $$ going down the toilet to help “the Team” live large.
omnologos says:
October 17, 2011 at 5:28 pm
“I wonder if they have tried to apply their world-famous coding skills…”
Yeah, the ability to code for a supercomputer makes a mere webserver a piece of cake. I don’t know how many times Warmista have implied that they understand their supercomputer code so well that reading it is as easy as reading a physics text. What could go wrong?
Maybe their part of the stimulus ran out and they won’t be back up till the “Jobs act” is passed so they can get their jobs funding.
“This is why I use wordpress.com – I don’t have to worry about maintenance, hacking, updates, or other server related issues.”
Yes, but Gavin doesn’t have to worry about traffic….
Maybe their proxy server is upside down.
Theo Goodwin says:
October 17, 2011 at 6:21 pm
Yeah, the ability to code for a supercomputer makes a mere webserver a piece of cake. I don’t know how many times Warmista have implied that they understand their supercomputer code so well that reading it is as easy as reading a physics text. What could go wrong?
Theo, as most of their released code has proven to be Matlab, FORTRAN, or other codes which have been readily duplicated by non-progammers (Steve McIntyre is a mining engineer not a programmer, but has duplicated Team studies repeatedly in R), you need to be careful throwing that supercomputer coding idea around. People have been duplicating their “supercomputer codes” on desktop PCs all over the world.
Hmmm … time yet for a sidebar category titled “Down” ?
Probably only if they lose their posting-database for the x number of years they’ve been in existence …
.
I hope they have a good (recent) backup of their database file or the are going to lose everything if they need to rebuild their site. What a shame 😉
Does Mr. Soros get a refund or a credit note?
Most likely the database is so much toast… Unless you _really_ know what you are doing databases need periodic ‘spring cleaning’ (not of the deleting posts type) to keep operational – i.e. tweaking configs, checking disc space etc
I’d put my money on that they have run out of disc space… Usually something you can plan for and the OS should be been screaming into the log files that the ceiling was fast approaching..
BTW coding a web site is considering harder than a supercomputer – with web sites you need to deal with the real world on every single request…
Still ‘502’ errors inquiring using Sam Spade:
Host: http://www.realclimate.org
Connection: close
User-Agent: Sam Spade 1.14
HTTP/1.1 502 Bad Gateway
Server: nginx
Date: Tue, 18 Oct 2011 01:40:56 GMT
Content-Type: text/html; charset=utf-8
Connection: close
Last-Modified: Thu, 29 Sep 2011 14:45:01 GMT
Accept-Ranges: bytes
Content-Length: 682
Cache-Control: max-age=0, no-cache, no-store, must-revalidate
Pragma: no-cache
Expires: Wed, 11 Jan 1984 05:00:00 GMT
<!DOCTYPE html PUBLIC “-//W3C//DTD HTML 4.01//EN”
“http://www.w3.org/TR/html4/strict.dtd”>
<html>
<head>
<meta http-equiv=”Content-Type” content=”text/html; charset=utf-8″>
<meta http-equiv=”pragma” content=”no-cache”>
<title>502 – Bad Gateway</title>
</head>
<body>
<h1>502 – Bad Gateway</h1>
<p>The page you requested is currently unavailable. Please try again later.</p>
<p>If you are the website owner, please see
<a href=”http://docs.webfaction.com/software/general.html#error-502-bad-gateway”>Error: 502 Bad Gateway</a>
documentation for more information and possible steps to resolve the problem.</p>
</body>
</html>
– – – – – – – – – – – – – – – – –
I didn’t notice.
Maybe they’re part of the IPCC Cloud and are now frantically cleaning house.
“Gavin is probably pulling out what little hair he has about right now.”
Hilarious! You must have spent ages thinking of that.
Stevo, you really need to develop a sense of humor. Gavin has a problem with his site that would lead most of us, many with IT skills, foaming at the mouth. Many of us would not wish it on a nicer person. I’m twice his age and have twice the hair. I think I don’t have enough. Hope Gavin has a better response than hair-pulling.
Maybe they’re part of the IPCC Cloud and are now frantically cleaning house.
Aha “document shredding” … lol …
.
I’m sorry RealClimate has gone down; it provided another perspective on climate change. And the RC moderators’ practice of censoring anything challenging CAGW dogma may have been as effective as WUWT in converting open-minded visitors into skeptics. 😉
It’s wonderful how much I’m not interested.
Isn’t that the standard server response to FOI?
Y’all are nuts! Clearly the site is possessed of demons.
Apparently the IT guys have been told to take Steig’s Matlab class before they can fix anything which is slowing things down a bit. Also, it turns out one of the techs doesn’t have his PhD in Radiative Physics yet.
While I am normally loathe to dispense free medical advice, Gavin should prepare a hot, moist herbal poultice and lay it upon his server to draw out the evil humors.
My guess is that it just got suicided in order to prevent any IPCC related FOIA requests.
Or someone has seized their database. That is another possibility.
#
Bob Moss says:
October 17, 2011 at 6:33 pm
Maybe their proxy server is upside down.
#
Quote of the week! Thanks, Bob!
Maybe a denial of sevice hack from some of those Anonymous people, mistakenly thinking it was a Skeptic site….
FBI raid… well, we can at least hope that the long arm of the law, has finally caught up to the team. It may be a brief fantasy, but I think I will enjoy a few more moments, of it. GK
Will give them more time to read “The Spoiled Child”.
So RC is down? No great loss to humankind.
Perhaps the sea has inundated their office, …………
Mike Lorrey says:
October 17, 2011 at 5:19 pm
I’d noticed that before too. Looks like their sun’s at solar maximum too.
Bob Moss says:
October 17, 2011 at 6:33 pm
Good one!
“Maybe their proxy server is upside down.”
ROFL.
Perhaps all their tech people are out supporting an “occupy something effort” somewhere ?
… and just for a few days at least, the Internet was slightly less stupid.
Still: “503 Service Temporarily Unavailable”.
Who pulled the plug on this (private? – government?) project?
HarryHelpMe!
And – RC is UP:
– – – – – – – – – – – – – – – – –
10/17/11 22:48:05 Browsing http://www.realclimate.org/
Fetching http://www.realclimate.org/ …
GET / HTTP/1.1
Host: http://www.realclimate.org
Connection: close
User-Agent: Sam Spade 1.14
HTTP/1.1 200 OK
Server: nginx
Date: Tue, 18 Oct 2011 03:48:17 GMT
Content-Type: text/html; charset=utf-8
Transfer-Encoding: chunked
Connection: close
X-Powered-By: PHP/5.2.9
X-Pingback: http://www.realclimate.org/xmlrpc.php
3f23
<!DOCTYPE html PUBLIC “-//W3C//DTD XHTML 1.0 Transitional//EN” “http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd”>
<html xmlns=”http://www.w3.org/1999/xhtml” dir=”ltr” lang=”en-US”>
<head profile=”http://gmpg.org/xfn/11″>
<meta http-equiv=”Content-Type” content=”text/html; charset=utf-8″ />
<title> RealClimate</title>
…
– – – – – – – – – – – – – – – – – –
Up now…
Maybe Gavin is trying to cover his tracks so it can’t be shown as to how so very much time he has spent blogging and posting and moderating a website while on the taxpayer’s clock.
Chris
Norfolk, VA, USA
http://www.wnd.com is down too.
It’s 8:54 Arizona Time (which is the same as Pacific Daylight time since AZ doesn’t go on daylight savings time), and RC is back up . .
Anthony/mods – Who has the sense of humor?
Check out “X-hacker” header line below:
– – – – – – – – – – – – – – – – – – – – – – –
10/17/11 22:56:48 Browsing http://wattsupwiththat.com/
Fetching http://wattsupwiththat.com/ …
GET / HTTP/1.1
Host: wattsupwiththat.com
Connection: close
User-Agent: Sam Spade 1.14
HTTP/1.1 200 OK
Server: nginx
Date: Tue, 18 Oct 2011 03:56:50 GMT
Content-Type: text/html; charset=UTF-8
Transfer-Encoding: chunked
Connection: close
Vary: Accept-Encoding
Last-Modified: Tue, 18 Oct 2011 03:54:50 +0000
Cache-Control: max-age=180, must-revalidate
Vary: Cookie
X-hacker: If you’re reading this, you should visit automattic.com/jobs and apply to join the fun, mention this header.
X-Pingback: http://wattsupwiththat.com/xmlrpc.php
Link: <http://wp.me/7y4l>; rel=shortlink
X-nananana: Batcache
efd
<!DOCTYPE html>
<!–[if IE 6]>
<html id=”ie6″ dir=”ltr” lang=”en”>
<![endif]–>
<!–[if IE 7]>
<html id=”ie7″ dir=”ltr” lang=”en”>
<![endif]–>
<!–[if IE 8]>
<html id=”ie8″ dir=”ltr” lang=”en”>
<![endif]–>
<!–[if !(IE 6) | !(IE 7) | !(IE 8) ]><!–>
<html dir=”ltr” lang=”en”>
<!–<![endif]–>
<!–
generated 120 seconds ago
generated in 0.978 seconds
served from batcache in 0.005 seconds
expires in 180 seconds
–>
<head>
<meta charset=”UTF-8″ />
<title>Watts Up With That?</title>
…
– – – – – – – – – – – – – – – – – – – – –
It’s bad Karma to use a computer to make light of people having computer problems.
Has anyone blamed the ‘Skeptics’ yet?
Wouldn’t surprise me.
Maybe they Bore Holed themselves.
LOL
Error 504: Debating the “Science” Permanently Unavailable
I bet every cynical clickthrough from WUWT quadrupled their traffic hourly!
Don’t care if they’re up or down or outta here…
The RC server is not running, it’s drooling.
Now because of this failure of ‘service’ for so many hours, and taking a lesson from RIM, we all deserve an apology in the form of $100 worth of free downloaded programmes, each.
I will accept, for my entire $100 credit, a download of the programme used to generate the CRU temperature output files, fully annotated by HarryReadMe.
I believe Steve McIntyre has a little list…
Maybe Trenberth’s missing heat was in their servers and the cooling system could not cope …
petermue
Thinking the same, Gavin’s been enlarging the borehole and the censorship props failed dumping the site in with the rest. Think of all that accumulated crud they carried and of course we know they are not meticulous engineers!!
When you have a website that already lies in their header image, you shouldn’t expect truth below that (The same holds for SkepticalScience).
No mention of outage…perhaps really they don’t expect anybody to notice.
So now there are hundreds of True Believers going to argue “502 Error” against evil deniers.
“Gavin is probably pulling out what little hair he has about right now.”
Was that comment really necessary?
Anyway, the Borehole is available again. Best part of the entire site.
Later…….
I wonder if there were any hidden/password access forums on there that have mysteriously vanished ?
We are still on daylight saving time. PDT.
It’s just been announced that Gavin Schmidt will be the recipient of AGU’s first Climate Communications Award.
According to a leak from an engineer fixing RC’s X-Box/Commodore 64, the problem was down to ‘parasitic oscillations due to inter-stage feedback in the Eccles-Jordan mono-stable double diode flip-flop’.
(Now, everything but one element of the bold is a true condition, but that one ‘untruth’ makes the whole statement a lie. There’s a parable for our times, perhaps.)
Crispin in Waterloo
harry did not work on CRUTEMP.
so many people get this wrong. the harry readme does not refer to ANY work done on hadcru.
Its an entirely different dataset that nobody even uses.
Only an idiot studying to be a moron would even consider running critical apps on a light weight DB engine such as MySQL. They should only be using an enterprise level one such as Postgres, Ingres, etc.
Way, way too many problems with MySQL. More especially as the relational model is not strictly enforced. Now try rolling back from an error in such a situation. Database inconsistencies everywhere…
Was this fixed on company or personal time and who is paying for it?
Frumious Bandersnatch:
Might want to have a little chit chat with the folks over at Slashdot who for many years did a helluva job running Slashdot on MySQL.
Considering the load and demands put on it – “light weight” is a little harsh.
=8-)
Coincidence? The front page is a loving paean to Gavin, recipient of some award or other, probably written by Gavin. It’s an infinite loop problem.
steven mosher says:
“It’s bad Karma to use a computer to make light of people having computer problems.”
If karma worked, Algore could make the temperature drop wherever he went…
oh, wait…
fascinating
Probably a DDoS attack by climate deniers.