Jo Nova writes (and I’m repeating here to get he word out)
Behind the scenes, I’ve been playing with a new neat tool for hunting hypocrisy, corruption, bias and unprofessional behaviour and I’m pleased to announce its ready to share with the world. The kudos for this all belongs to, as usual, a skilled volunteer. Thanks to EcoGuy for turning his rapid-fire coding ability onto this.
On the EcoWho site he has helpfully placed all of Climategate I and II together into a combined searchable database. It’s fast, easy to scan, it copes with tricky search requests and provides a link to the full email from the results page of the search.
Welcome to the ClimateGate FOIA Grepper !!!
Now if someone will come up with the key to the all.7z file we can find out what was being said entirely out-of-context…
Thanks for the link. This one is also great: http://di2.nu/foia/foia.pl
You can search CG I & II, you get three summary lines, which pop open on clicking.
Thank you, Jo and EcoGuy.
Dangerous tool … for some people involved, but very helpful for all of us.
Thank you.
Excellent!
tallbloke says:
November 25, 2011 at 2:56 pm
hehehe were you rubbing your hands together while saying that Mr Burns?
On a grateful note, where would we be without all those volunteers? Thank you EcoGuy and Jo.
Unbelievably nice – I was able to get search data after only a few seconds. This community is awesome!
It would be nice if it could handle this:
egrep -i -B3 -A3 “delet|foi” *.txt
It means find delet (which includes delete, deleted, deleting…) OR foi, foia, foible, etc. Earlier the site was struggling with “foia” and returned pointers to the file space.
If you want a fat dose of deceit, try entering “lawyer” as a search pattern. They clearly have no clue that FOIA is not negotiable. Some time in jail away from their broken thermometers will afford them some time to study the act.
I built a table of From: -> To: addresses to get an idea of who was talking to whom. Very interesting stuff. I’m now unconvinced all this mail came from one source.
Keep up the good work
@dp
I have been thinking about creating a more advanced grepper with support for regexes etc. on my one (http://di2.nu/foia/foia.pl ) currently it’s just doing “grep -i ..”
I’ll probably add a separate page with this more advanced version, if you have any other suggestions please leave them here because I cna easily change it again
I hope that while everyone is combing through climategate 2.0 we’re not missing something else going on in the world. The Team seem almost glad of the distraction for the time being.
Early criticisms from “Team” supporters have dismissed email quotes from FOIA 2011 as being taken “out of context”.
But stringing together pearls of evidence from searches using “Kendall” is highly revealing. http://di2.nu/foia/foia.pl allowed me to view many fragments simultaneously. I’ve extracted key elements simply to allow the story to flow, to reveal evidence that I think is even more damning when taken “in context”. Comparing these 2011 results with JoNova’s grepper’s results shows that all the Kendall-related emails were released only just now – in other words, the 2.0 Climategate release is, as we already know, putting everything more and more “in context”.
Dr Alan Kendall taught about climate at the University of East Anglia until he retired in 2010, apparently. He is clearly of a different mettle to his “Team” colleagues. The emails tell a whole story of his parting company with his colleagues over time.
Also, tellingly, the references in emails 3114 and 4341 to Douglas Keenan, Steve McIntyre, Willis Eschenbach and Climate Audit show how legally inappropriate it was to omit all these key witnesses in the Oxburgh and Muir Russell / Boulton “enquiries”. The full references have been omitted below, but they are highly relevant.
EMAIL 1443 – In August 1999, Tim Osborn invites Alan Kendall to join a “discussion seminar on detection of anthropogenic climate change”. The atmosphere is congenial, friendly, relaxed.
EMAIL 2380 – By September 2006, the atmosphere has changed. Dr David Viner writes, apropos a letter Kendall sent to The Guardian, “Whilst Alan may have his own personal views on climate change (that are not supported by the science) I do not believe he should be using our School’s affiliation on these letters”.
EMAIL 3143 – December 2006 is the time when battle lines are drawn, judging by the tone and quantity of comments.
Alan Kendall emails “Dear all, I trust you enjoyed the seminars yesterday”:
David Viner emails Alan Kendall in reply to this:
Alan Kendall replies:
EMAIL 4341 – In March 2007, Dave Palmer, UEA FOIA expert, emails Kitty Inglis
Palmer adds a message to Phil Jones
Jones replies to Alan Kendall
to which Kendall replies:
To this note, Jones replies:
Lastly, Kendall replies:
EMAIL 3114 in March-April 2007 is mainly a sequence between Dave Palmer and Douglas Keenan, starting at around the same time as the above. Dave Palmer is slowly waking up and we see his fresh reactions which seem reasonable in the circumstances. His emails widen to include references to requests from Steve McIntyre and Willis Eschenbach, and draw in Phil Jones for comments. Jones includes this titbit:
EMAIL 3281 – In October 2008, Alan Kendall emails:
and Jones replies by pulling rank:
EMAIL 5182 – In September 2009, Professor Neil Adger emails his staff on the schedule for the incoming semester on ‘Adapting to Climate Change’: “Welcome back to 1A01 – where we inspire the next generation of environmental scientists. Attached you will find the updated course manual for the semester. It is all but unchanged from last year…”
Alan Kendall replies to all recipients, including Tim Osborn:
EMAIL 4333 – A fortnight after email 5182, Prof Adger writes to Tim Osborn:
Tim Osborn passes on this note to Phil Jones:
and emails Mick Kelly (EMAIL 3252):
Mick Kelly answers:
EMAIL 2639 – A week after email 4333, Tom Wigley apparently emailed Ben Santer and Phil Jones: “See the item by Pat Michaels [from Benny Peiser to “cambridge-conference”] – “THE SUN COULD BE HEADING INTO A PERIOD OF EXTENDED CALM…”
Ben Santer replied:
Phil Jones replied:
dp says:
November 25, 2011 at 11:19 pm
I tried that. Then resorted to adding -l and wc because -l was still too long to post:
(-l lists file names, one per line, wc lists # lines, words, and characters):
tux:mail> egrep -l -i -B3 -A3 ‘delet|foi’ *.txt | wc
572 572 5148
Even uppercase only FOI has a lot of refs, few are off target:
tux:mail> egrep FOI *.txt | wc
wc: standard input:542: Invalid or incomplete multibyte or wide character
913 9763 72065
(haven’t checked out that complaint.)
I did notice some BASE64 encoded Emails, I haven’t checked to see if
those are expanded at web archives.
@Lucy
That was an amazing set of communications and it is obvious you are not removing context – the gist is very clear: there are ‘enemies’ in science and everything possible should be done to ‘shape the message’ the public hears.
What is inevitable is the conclusion that the BBC is deeply involved with a person or persons at UEA and an organisation or organisations and further that a high level decision has been taken to cover for appalling scientific misconduct and blatant misrepresentation of the climate facts. Experienced as I am at hearing and reading this CAGW nonsense, even your early cull of a few Climategate 2 files shows that the dishonesty and petty bitterness of the Team renders their future involvement in IPCC matters untenable.
Is it possible that Phil was removed as part of a behind-the-scenes agreement with the whitewashing groups that they (persons/organisation) will bury the matter as well as they can but he has to go? What reasons were given for his removal? These days UEA means Unbelievable from Every Angle. There is not a single example of honourable academic conduct from this vituperative lot. They have rejoiced at the slow death of balance, truth and the individual investigation of truth by UEA students. Of what worth is a degree granted by UEA? Are they not just trained fools with Names to be Wise?
The BBC has supported this lot, hook, line and stinker. Something connects them and clearly it is not science or morals. The argument that is their common (and heavy) investment in carbon trading is wearing thin. Science and ideology only find common cause in back rooms.
Hi,
Just added a checkbox so you can search with case sensitivity on if you wish, helps with targeting names and places.
Thanks EcoGuy!
Thanks Jo!
Duly linked.
Ric:
Not to turn this into a techie thread but it would probably be a better effect to use good old ht:dig or Estraier which are true indexers that provide context. Takes a lot of real-time load off the server, indexes once, serves many. But my point with that use of egrep was to allow OR as well as AND. Even more is possible using the PHP intrinsic prcegrep functions. Taken to extremes it could probably be wedged into Splunk.
Thanks Lucy for some very intresting reading. It’s like being a fly on the wall and in their ointment all at once! Also thanks of course to ecoGuy and that most troublesome fly, FOIA.
Crispin, I wouldn’t go as far as saying “There is not a single example of honourable academic conduct from this vituperative lot ” Alan Kendall comes accross as a shining light of honour in an otherwise disreputable bunch.
Thanks Lucy, very informative! Maybe Dr. Kendall may speak out even more forcefully, now that he is retired. Or not, if he is the whistleblower…
Thanks Lucy, too bad we only get to see what went on a UEA. I’d love to be a fly on the wall at Columbia or Carnegie Mellon.
Jo Nova has a finger on the pulse of the 7z files and a possible explanation that is more the more than interesting.
THE ONE THINGS THAT SCARES THE POLITICIANS THAT HAVE SUPPORTED THE CAGW POLICY’S, IS EXPOSURE THEY WERE IN ON THE SCAM ALL ALONG?
http://joannenova.com.au/2011/11/pointman-a-dead-mans-hand-detonator-on-hidden-emails-may-protect-climategate-whistleblower/
Climategate 2
Pointman — A dead man’s hand detonator on hidden emails may protect ClimateGate 1 & 2 whistleblower FOIA
He points out there are no emails released yet between key scientists and people in power
We do not have a single one of those high-level political emails but they must of course exist.
I strongly suspect we now have them in our possession.
In the high-powered risky game of whistle blowing there are ways to make the Climategate 2 leaker a less attractive target.
Pointman analyzes the ClimateGate whistleblower’s tactics and explains why he, she or they probably released those other 200,000 emails but kept them hidden behind the 4000-8000 character almost unbreakable password.
He points out there are no emails released yet between key scientists and people in power, hence the worst, most damaging emails may be kept under a ” dead man’s hand detonator”. If politicians are afraid of what might be in those released-but-hidden emails, they may not want to expose or attack the whistleblower for fear of unleashing the other emails. The hidden emails buy the whistleblower protection.
Jo
I doubt it, as he was typing at the time! Simultaneous rubbing would have to make for lotsa typoz…
😉
Excellent!