On The AMO+PDO Dataset

Bob Tisdale suggests that the way some folks have combined the PDO and AMO datasets t produce a new curve is wrong, and here is his supporting analysis. – Anthony

Guest post by Bob Tisdale

Including A Discussion Of Its Use In Wyatt el al (2011)

REFER TO THE UPDATE AT THE END OF THE POST

####################

UPDATE 2 (July 15, 2011): This update clarifies that my comments about Wyatt et al (2011) pertained only to an illustration in the poster and not to the paper itself. The illustration in the poster does not appear in the paper. And the update also provides links to the comments by Marcia Wyatt (the lead author of the paper) on the cross post at WattsUpWithThat.  This update begins after Figure 6, under the heading of “WYATT ET AL (2011)”.

####################

INTRODUCTION

Graphs that illustrate the sum of the Atlantic Multidecadal Oscillation (AMO) and Pacific Decadal Oscillation (PDO) data, Figure 1, have appeared in blog posts for more than three years. The first example I can find appeared in a pdf document written by Joe D’Aleo of IceCap: US Temperatures and Climate Factors since 1895. It appeared shortly after in the January 25, 2008 post Warming Trend: PDO And Solar Correlate Better Than CO2 at Watts Up With That? and in numerous posts since then. More recently, the AMO+PDO dataset appeared in the May 22, 2011 post Arctic Cycles – AMO+PDO corresponds to Arctic station group and was referred to in the June 2, 2011 post “Earth itself is telling us there’s nothing to worry about in doubled, or even quadrupled, atmospheric CO2″, which was also posted at Jeff Id’s blog The Air Vent as Future Perfect. A description of the “AMO+PDO” dataset and a link to a spreadsheet can be found at the January 25, 2008 at 9:13 pm comment from the first post at WUWT. A variation on the AMO+PDO graph has also recently found its way into a poster for Wyatt et al (2011) paper Atlantic Multidecadal Oscillation and Northern Hemisphere’s climate variability.

Figure 1

The AMO+PDO curve has been compared to a number of surface temperature variables. Unfortunately, the AMO and PDO datasets cannot be summed.

THE AMO IS DETRENDED SST ANOMALY DATA, BUT THE PDO IS NOT

The AMO data through the NOAA Earth System Research Laboratory (ESRL) AMO webpageis detrended North Atlantic Sea Surface Temperature (SST) Anomalies. (For those who would like an explanation of detrending, refer to the discussion of Figure 6 below.) The PDO, on the other hand, is the product of a principal component analysis of detrended North Pacific SST anomalies, north of 20N. Basically, the PDO represents the spatial patterns of the North Pacific SST anomalies that are similar to those created by El Niño and La Niña events. Since the responses of the North Pacific SST anomalies to El Niño and La Niña events are also impacted by Sea Level Pressure, the PDO and El Niño-Southern Oscillation (ENSO) proxies like NINO3.4 SST anomalies can differ at times.

If one were to detrend the SST anomalies of the North Pacific, north of 20N (the same method used to create the AMO data), standardize it, and compare it to the PDO, the two curves (smoothed with an 11-year filter) appear to be inversely related, Figure 2.

Figure 2

In fact, if we invert the PDO data, multiply it by -1, Figure 3, we can see that they are inversely related and that the detrended North Pacific SST anomalies lead the inverted PDO data for much of the time. That inverse relationship indicates that, over decadal time periods, when the PDO is rising, the detrended SST anomalies are falling and vice versa.

Figure 3

In short, the PDO is an abstract form of North Pacific Sea Surface Temperature data that does not represent the Sea Surface Temperature of the North Pacific. For that reason, it cannot be used to determine the impact of the North Pacific SST on Global Temperatures.

THE “AMO+PDO” DATA AND ITS COMPONENTS

There’s another curious thing about the “AMO+PDO” dataset that can be seen if we plot it along with the AMO and the PDO data used to create it. Refer to Figure 4. Notice how the AMO minimum in the early 1900s is much lower than the minimum in the 1970s. It should not be if the North Atlantic SST anomalies have been detrended.

Figure 4

Figure 5 shows the current AMO data from the NOAA/ESRL website smoothed with an 11-year filter. The early 20thCentury minimum should be comparable to the 1970s minimum.

Figure 5

THE AMO DATA USED IN THE “AMO+PDO” SPREADSHEET IS ACTUALLY NORTH ATLANTIC SST DATA

As noted earlier, the NOAA Earth System Research Laboratory (ESRL) calculates the Atlantic Multidecadal Oscillation (AMO) data by detrending North Atlantic SST anomalies. They use the coordinates of 0-70N, 80W-0 for the North Atlantic. The current version of the ESRL AMO data can be found at ESRL : PSD : Download Climate Timeseries: AMO SST. It’s identified on the webpage as the “AMO (Atlantic Multidecadal Oscillation) Index”.

The AMO data used in the “AMO+PDO” spreadsheet and graphs has not been detrended. In other words, it’s “raw” North Atlantic SST anomaly data. The NOAA ESRL/PSD appears to have changed how they present AMO data sometime between 2007/08 and now. They note on the Atlantic Multi-decadal Oscillation portion of their Climate Indices webpage, “this index is newly computed from a new dataset. Please use it and note that it supersedes the old indices. The data is calculated from the Kalplan SST. See the AMO webpagefor more details.” Or the ESRL had two AMO datasets available online back in 2007/08.

The older version of the ESRL/PSD AMO data used in the AMO+PDO dataset (through 2006) is still available online: AMO(unsmoothed): Standard PSD Format. It’s linked to the AMO – NOAA Earth System Research Laboratorywebpage. They list the source as “Calculated from the HadISST1.” That’s wrong. The linked data is based on Kaplan SST data, not HADISST. They also note that the data is “Area averaged SST in the Atlantic north of 0”. There’s no mention of detrending.

A NOTE ABOUT DETRENDING

For those who are unsure what I’ve meant by detrending, refer to Figure 6. It’s a graph borrowed from my post An Introduction To ENSO, AMO, and PDO — Part 2.The trend of the SST anomalies is determined, and the trend values are subtracted from the SST anomaly data, “flattening” the trend.

Figure 6

WYATT ET AL (2011)

############################

UPDATE 2 (July 15, 2011): The following discusses an illustration from the poster for Wyatt et al (2011). In an earlier update that I placed at the end of this post, I had noted that the illustration from the poster does not appear in the paper, but since that update is at the end of the post, many readers may have missed the clarification. With this update, I wanted to reinforce that my comments are not about the Wyatt et al (2011) paper; they are about an illustration from the poster that did not appear in the paper.

I also want to call your attention to the comments by Marcia Wyatt (lead author of Wyatt et al) on the WattsUpWithThat cross post of On The AMO+PDO Dataset. Marcia’s first comment appears at June 8, 2011 at 8:52 pm . And for those interested, I replied to Marcia here: June 8, 2011 at 10:26 pm. Refer also to her additional comments at June 11, 2011 at 9:30 am , and recently on the thread starting at July 6, 2011 at 7:47 am .

Back to the original post.

#############################

I was asked to comment on the Wyatt et al (2011) AMO+PDO graph included in their poster, Figure 7. Unfortunately, there’s very little discussion of the graph on the poster and there’s a paywall on the paper, so I have no means of verifying the sources of the data. But…

Figure 7

The same basic problems (the PDO does not represent the SST anomalies of the North Pacific and the PDO is inversely related to the detrended SST anomalies of the North Pacific) apply to the Wyatt et al (2011) AMO+PDO graph.

In addition to that, the note in the poster that “the NH [Northern Hemisphere] surface temperature time series can be nearly perfectly represented as the weighted sum of the AMO and PDO reconstructions” raises a red flag for me. Nearly perfectly? There are significant differences between SST datasets. The Sea Surface Temperature dataset that’s part of the combined surface temperature dataset must be used if a nearly perfect fit is to have any meaning. That is, for example, when referring to the Hadley Centre’s HADCRUT Land+Sea Surface Temperature data, AMO and PDO data based on HADSST2 should be used. Since there’s the paywall on the paper, I can’t confirm if Wyatt et al used the related SST data to create their AMO and PDO data, so the following portion of this discussion (Figures 8 and 9) is for example only.

For AMO data, Wyatt et al refer to Enfield (2001), which used detrended Kaplan SST anomaly data for the North Atlantic. But there are no surface temperature datasets that use Kaplan SST. (This was one of the problems that Tamino had encountered in his AMO post.) ERSST.v3b data is used by NCDC. GISS uses HADISST and Reynolds OI.v2 SST data for their combined surface temperature products. And HADSST2 is used in the Hadley Centre’s HADCRUT. And the differences between Kaplan and the three SST datasets used in Surface Temperature data can be significant, as shown in Figure 8. (For those wondering why the AMO minimums in the 1970s is lower than the early 20thCentury minimums in this graph, I’ve detrended the data starting in 1900.)

Figure 8

If the PDO could be combined with the AMO data (it can’t), using the correct PDO dataset would also be important. Unfortunately, the PDO data was not referenced in the Wyatt et al poster or their guest post at Roger Pielke Sr’s blog. The most-often-used PDO dataset referred to and used in climate studies is the one available through the JISAO website. In fact, Marcia Wyatt’s co-authors Tsonis and Kravtsov referred to the JISAO PDO data in their 2007 paper A new dynamical mechanism for major climate shifts. But, the JISAO PDO data is based on two obsolete SST datasets (UKMO and Reynolds OI.v1) from 1900 to 2001. None of the current surface temperature datasets use UKMO SST or the obsolete Reynolds OI.v1 SST data. And there are again significant differences between the JISAO PDO data and the 1stPrincipal Components of the detrended North Pacific SST data used in the Surface Temperature products, Figure 9.

Figure 9

The other curiosity about the Wyatt et al “AMO+PDO” graph is the weighting: the AMO is multiplied by 0.83 and the PDO by 0.44. The surface area of the North Pacific (20N-65N, 100E-100W) used for the PDO is slightly larger than the North Atlantic (0-70N, 80W-0) surface area used in the AMO. Based on the surface areas, one would expect a weighting of 53% Pacific and 47% Atlantic, or some similarly weighted factors. Again, since the paper is paywalled, I have no idea how Wyatt et al explain the graph, its components or the weighting.

Wyatt et al could replace the PDO data in their AMO+PDO graph with an SST-based ENSO index like NINO3.4 or Cold Tongue Index (CTI) SST anomalies and wind up with similar results. An AMO+ENSO Proxy curve may not fit nearly perfectly with the Northern Hemisphere Temperature anomalies, but that combination should better represent the two indices that impact Northern Hemisphere surface temperature anomalies.

CLOSING QUESTION

The Pacific Decadal Oscillation is a well-established climate index that’s used for many variables other than surface temperature. Unfortunately, many people mistakenly believe it is calculated the same as (and is therefore comparable to) the Atlantic Multidecadal Oscillation. Do we need a new index to represent the multidecadal variability of North Pacific Sea Surface Temperatures? The amplitude of the multidecadal variations in detrended North Pacific SST anomalies is less than the variations in the North Atlantic, Figure 10. And the frequencies are somewhat different, meaning the two datasets can run in and out of synch.

Figure 10

UPDATE (June 8, 2011)

Here’s a curiosity: I just checked all of the illustrations for Wyatt et al (2011). Figure 2 from the poster, which is Figure 7 in this post, the graph that includes the weighted AMO+PDO dataset, does not appear in the paper. I double checked by having Adobe Acrobat do a word search and the phrases “weighted sum” and “AMO and PDO reconstructions” do not appear in the paper.

And for those interested, Wyatt et al used the ESRL AMO data, the JISAO PDO data, and HADCRUT NH surface temperature data.

SOURCES

The current NOAA/ESRL AMO data is available here:

http://www.esrl.noaa.gov/psd/data/timeseries/AMO/

Specifically:

http://www.esrl.noaa.gov/psd/data/correlation/amon.us.long.data

The PDO data is available through the JISAO PDO website:

http://jisao.washington.edu/pdo/

Specifically:

http://jisao.washington.edu/pdo/PDO.latest

All other data is available through the KNMI Climate Explorer:

http://climexp.knmi.nl/selectfield_obs.cgi?someone@somewhere

0 0 votes
Article Rating

Discover more from Watts Up With That?

Subscribe to get the latest posts sent to your email.

58 Comments
Inline Feedbacks
View all comments
tallbloke
June 8, 2011 11:35 am

Isn’t it about time someone produced datasets of the major oceanic oscillations which *can* be combined?
What are they afraid of?

June 8, 2011 12:00 pm

So the implications of this on Pat Franks recent post are …

Edward
June 8, 2011 12:04 pm

So as shown the are not directly additive. But if we could come up with another term that could put them on the same basis such as dPDO (dT/dPDO) = dT for a given change of PDO in a given region and then the same for AMO maybe then they could be added. This could be viewed for whole world, North America, Eastern North America, etc. Maybe someone could coax the numbers from as far back as one can go.

wsbriggs
June 8, 2011 12:13 pm

I would think that a new PDO* would be useful, simply because it would be clean, and comparable to the AMO, not that they should be combined, just that having the equivalent information for the Pacific is necessary to get the fill picture. As you show in figure 10, there is information there, even if there is a lead or a lag effect.

Edward
June 8, 2011 12:24 pm

From my above comment on dTs, Another thought is that the data might show a crossover effect like mutual inductance in a transformer circuit. Lets call it mutual north american oscillation where the PDO and AMO are multiplied together with mutual coefficient as an additional term.

NikFromNYC
June 8, 2011 12:29 pm

If AMO is simply detrended SST then what support is there for calling it an “oscillation?” Shall I detrend the GISS US chart and call it the “US Multidecadal Oscillation?” just because I don’t know what caused the sine wave but wish to discount AGW claims? Can more cycles be reconstructed further back than a century?

June 8, 2011 12:42 pm

Since there’s the paywall on the paper, I can’t confirm if Wyatt et al used the related SST data to create their AMO and PDO data, so the following portion of this discussion (Figures 8 and 9) is for example only.

Why not just pay the 35 dollars and make this a complete article and not leave suppositions in place? It seems a minor expense to complete an article for thousands or tens of thousands of readers. I’m sure someone here would donate and Anthony could pass it along. Seriously, all this hand-wringing over paywalls instead of just paying for the real item in order to perform a proper critique seems petty. I know no one here gets paid, but c’mon, 35 dollars is going to stop you from making sure?
This is widespread problem in this community, and the solution is not necessarily to scream for open science. It is not a big deal to occasionally take out your credit card to help you with your work, even unpaid work.

Douglas Dc
June 8, 2011 12:42 pm

not being an expert, but AMO and PDO are not -mutually exclusive.But there are so many other variables
combining the two in one dataset isn’t a good idea.
Bob’s right…

Editor
June 8, 2011 1:02 pm

Doug Proctor says: “So the implications of this on Pat Franks recent post are …”
How much of Frank’s post depended on his reference to the AMO+PDO dataset?

Paul Vaughan
June 8, 2011 1:05 pm

Request:
Graph of this [ http://i56.tinypic.com/xoibyx.jpg ] format for North Pacific [i.e. showing the variation between datasets].

Editor
June 8, 2011 1:08 pm

Edward says: “Eastern North America, etc. Maybe someone could coax the numbers from as far back as one can go.”
The data is readily available for anyone to analyse as they seem fit. The KNMI Climate Explorer is a great sorce for the data:
http://climexp.knmi.nl/selectfield_obs.cgi?someone@somewhere

Rhoda Ramirez
June 8, 2011 1:29 pm

Jeez, you’re awfully free with other people’s money.

Editor
June 8, 2011 1:30 pm

I’ll have to read this closer tonight, as Joe D’Aleo’s AMO+PDO article was one of the things that made me an active skeptic. (Let’s see, I guess I was waiting SC23 to end and for the PDO to go negative. Joe pointed out that the Sun couldn’t get much less active and that the PDO had gone negative and BTW, the PDO correlates with temperature better than CO2 and temperature.
Then Leif comes along and messes up my simple concept of solar activity and climate, and now this! Actually, it occurred to me a while back that if AMO data is largely temperature anomaly data, then a correlation shouldn’t be much of a surprise if sea water temps affects air temp.
Fortunately, there’s a lot of other factors to be studied from temperature data quality to Livingston and Penn’s warming and fading sunspots. Does it make sense to look at non-detrended Pacific/Atlantic data and compare that to non-detrended temperature data?
Oh – I’ll add this to my “WUWT Classics” – I have http://wattsupwiththat.com/2008/01/25/warming-trend-pdo-and-solar-correlate-better-than-co2/ and http://wattsupwiththat.com/2010/09/30/amopdo-temperature-variation-one-graph-says-it-all/ listed there, so I guess I better add this.
BTW, from the latter page comes these from William Briggs:

Unless the data is measured with error, you never, ever, for no reason, under no threat, SMOOTH the series! And if for some bizarre reason you do smooth it, you absolutely on pain of death do NOT use the smoothed series as input for other analyses!

I want to stress that if D&E did not smooth their data, the correlation would not have been as high; but as high as it would have been, it would still have been expected. All that smoothing has done here is artificially inflated the confidence D&E have in their results. It does not change the fact that AMO + PDO is well correlated with air temperature.

A lot to mull over tonight….

Editor
June 8, 2011 1:41 pm

NikFromNYC says: “If AMO is simply detrended SST then what support is there for calling it an ‘oscillation?'”
The support is the quasi-periodic nature of the cycle in North Atlantic SST. There are a number of studies that evaluate this, including the Gray et al (2004) paleoclimatological reconstruction of the AMO:
http://www.nrmsc.usgs.gov/files/norock/products/GCC/GeophysResLetters_Gray_04.pdf

Editor
June 8, 2011 1:50 pm

jeez says: “Why not just pay the 35 dollars and make this a complete article and not leave suppositions in place? It seems a minor expense to complete an article for thousands or tens of thousands of readers.”
Let me turn your question around, jeez. Since the AMO and PDO can’t be combined, why waste $35 to confirm which datasets they used? As I noted, I provided the graphs and discussion as a reference–to show that there are significant differences between SST datasets.

David Baigent
June 8, 2011 1:56 pm

While the signal produced from a combination of data sets may or may not be additive, the error components are ALWAYS additive.
db..

Margaret
June 8, 2011 3:38 pm

jeez says: “Why not just pay the 35 dollars and make this a complete article and not leave suppositions in place? It seems a minor expense to complete an article for thousands or tens of thousands of readers.”
Perhaps because this is only one of many 35 dollars that need to be spent and the big oil money has not filtered down yet?
On the other hand YOU could pay the 35 dollars and then write a comment here that fills in the gap.

June 8, 2011 3:40 pm

Its also worth pointing out that linear de-trending over century periods is of limited use if forcings were not linearly changing over the period in question, at least if you are trying to extract the unforced variability.
I blogged about this awhile back (though as Bob mentions, using different SST series can produce different results): http://rankexploits.com/musings/2011/the-atlantic-multidecadal-oscillation-and-modern-warming/

Editor
June 8, 2011 3:40 pm

Paul Vaughan requested, “Graph of this [ http://i56.tinypic.com/xoibyx.jpg ] format for North Pacific [i.e. showing the variation between datasets].”
How would you have known that I would have prepared that graph for this post? (The Kaplan data ends in 2002)
http://oi51.tinypic.com/2vll8xl.jpg

Alan S. Blue
June 8, 2011 4:25 pm

You can, indeed, form a model from two discrete datasets that are not, themselves, directly comparable or ‘addable’.
Particularly when you’re flailing around with the explicit goal of an empirical model.
If I’m studying ‘failure modes of Joe’s bookcases’ through the question “How much weight can it support?” and decide the two crucial variables are “What day of the week was it constructed on?” and “Did it get wet?”, I can, arrive at a functional predictive model. Without having the foggiest notion – or even a completely erroneous notion – of what the underlying physics or chemistry is – pretty much identically to how pre-Kepler/Copernicus models -did- actually do a decent job of predicting the locations of the planets. While being fundamentally wrong.
You can’t “add” days of the week to wetness – they’re literally completely different things. The -reasoning- behind some of the items in an empirical model might be completely hidden, like perhaps Joe buys his wood in different places on different days of the week.
The crucial test of an empirical model is through predictive tests on unexposed data.

John F. Hultquist
June 8, 2011 5:05 pm

Sarcasm for the education of young researchers:
Here’s the plan: Have a person go through a city’s west side neighborhoods and record the age in years of all the autos visible from the streets. Then the mean age is calculated. Have another person go to the east side neighborhoods and measures all the people and calculate mean height in feet. Now add the mean age and the mean height and compare this number to the business bankruptcies in the city in the previous year. After many years — predicting bankruptcies will be a piece of cake. S/off

Paul Vaughan
June 8, 2011 5:22 pm

Ric Werme (June 8, 2011 at 1:30 pm)
“Does it make sense to look at non-detrended Pacific/Atlantic data and compare that to non-detrended temperature data?”

Finally, common sense. [Note: Not all definitions of AMO include detrending. It’s easy to make a strong case against linear detrending.]

Bob, there’s much to discuss, but before we get started, we really do need the comparative graph of North Pacific SST across different data sources to put things in the same perspective as your AMO framing.
Best Regards.

Alex Heyworth
June 8, 2011 5:24 pm

How about applying Empirical Mode Decomposition to SST data? http://thegwpf.org/the-observatory/3151-solar-statistics.html

wermet
June 8, 2011 5:58 pm

jeez says: June 8, 2011 at 12:42 pm

Since there’s the paywall on the paper, I can’t confirm if Wyatt et al used the related SST data to create their AMO and PDO data, so the following portion of this discussion (Figures 8 and 9) is for example only.
Why not just pay the 35 dollars and make this a complete article and not leave suppositions in place? It seems a minor expense …

I case you didn’t realize it we’re not just talking about $35. This is just one example of a $35 paper for sale. From following the links in WUWT, I have encountered at least 10 or 15 pay-walled papers in the past month. Would I like to be able to read these articles, you betcha! But that would have cost me between $350 to $525. And there is still the economic downturn to contend with. Plus [self imposed long snip] expenses!
Since you seem to be so free with other peoples’ money, I can only assume that you are a liberal and have never had to manage your own limited funds.
jeez, prove me wrong by offering to pay for all of us to have access to these papers!

Editor
June 8, 2011 6:26 pm

Here’s a curiosity: I just checked all of the illustrations for Wyatt et al (2011). Figure 2 from the poster, which is Figure 7 in this post, that includes the weighted AMO+PDO dataset does not appear in the paper. I double checked by having Adobe Acrobat do a word search and the phrases “weighted sum” and “AMO and PDO reconstructions” do not appear in the paper.
Also, Wyatt et al used the ESRL AMO data, the JISAO PDO data, and HADCRUT NH surface temperature data.

1 2 3