Uncertainties in Model Predictions of Future Climate

To Charles Jackson's webpage

Uncertainties in Model Predictions of Future Climate

[click here for project web site (password protected)]

Atmosphere Model Working Group Diagnostics

Default CAM3.1 as compared to observations

Line23 (best performance) CAM3.1 as compared to observations

Line23 minus Default

    A large disparity exists among various climate models in their prediction of global mean surface air temperature when atmospheric CO2 has doubled from present concentrations (figure 1). There are an overwhelming number of reasons why these differences could exist.  Although each climate model has been optimized to reproduce observational means, each model contains slightly different choices of model parameter values as well as different parameterizations of under-resolved physics. The need to understand the sources and impacts of these differences was recently emphasized within the 2001 Third Assessment Report of the Intergovernmental Panel on Climate Change that called for more quantitative evaluations of modeling uncertainty. [read section from IPCC report]

A selection of climate models and their prediction of globally averaged surface air temperature change

Figure 1. A selection of climate models and their prediction of globally averaged surface air temperature change in response to emissions scenario A2 of IPCC Special Report on Emission Scenarios. CO2 is ~doubled present concentrations by year 2100. Figure reproduced from Cubasch et al. (2001).

    There are good reasons why the climate modeling community is behind in this important endeavor. In order to quantify the uncertainty resulting from a realistic range of model configurations, one needs to estimate a multi-dimensional probability distribution that quantifies how likely different model parameter combinations are given knowledge of the uncertainties in our observations. The computational cost of mapping a multi-dimensional probability distribution for a climate model using traditional means (e.g. Monte-Carlo or Importance Sampling) is impractical requiring 104 to 106 model evaluations for problems involving less than ten parameters. 

Research Plans
Over the past decade, there has been significant progress within the mathematical geophysics community for solving non-linear problems in geophysical inversion using statistical methods to account for the possibility of multiple solutions (interpretations) of geophysical data (for a review, see Barhen et al., 2000).  The Institute for Geophysics has been at the forefront of these efforts. Like climate models, geophysical models are complex, computationally expensive, and involve many potential degrees of freedom. Within the geophysics community, particular emphasis has been placed on efficiency, although with some measured compromises.  Similarly dramatic advances have taken place within the statistics community over the past decade on a class of methods of statistical inference known as Monte-Carlo Markov Chain (MCMC). In particular, greater awareness now exists for how different challenges in robust statistical inference can be addressed with a variety of sampling rules that obey the properties of a Markov chain. Our present goal is to advance the feasibility of quantifying climate model uncertainties that stem from multiple, non-linearly related parameters. We have submitted a proposal to NSF to continue the work on testing a variety of statistical sampling strategies for idealized and state-of-the-art climate models, including the most efficient sampling strategies that are found to work well for geophysics problems, while simultaneously reformulating the statistical foundation of these methods from a MCMC perspective to ensure that the estimated uncertainties are robust and are well suited for the class of problems that climate models represent.

We hope to address these questions:

  1. How does uncertainty in parameters affecting clouds, convection, and radiation affect a climate model's sensitivity to CO2 forcing? 

    • How well do observational data constrain parameter values? 

    • What physical processes create differences in sensitivity?

  2. What is the potential for reducing systematic biases between model predictions and observations through careful selection of parameter values? 

  3. What sampling strategy provides the most efficient and robust strategy for estimating climate model parameter uncertainties?

Publications

Jackson, C. S., Q. Mu, and P. L. Stoffa, Observations of modern climate provide non-unique constraints for key sources of climate model uncertainty (submitted to Journal of Climate, 2004)

Mu, Q., C. S. Jackson, P. L. Stoffa (2004) A multivariate empirical-orthogonal-function-based measure of climate model performance,  J. Geophys. Res., 109, D15101, doi:10.1029/2004JD004584.

Jackson, C., M. Sen, and P. Stoffa (2004) An Efficient Stochastic Bayesian Approach to Optimal Parameter and Uncertainty Estimation for Climate Model Predictions, Journal of Climate, 17(14), 2828-2841. 

Jackson, C., Y. Xia, M. Sen, and P. Stoffa (2003) Optimal parameter and uncertainty estimation of a land surface model: A case example using data from Cabauw, Netherlands, Journal of Geophysical Research, 108 (D18), 4583 10.1029/2002JD002991.

Links of Interest

www.climateprediction.net

The MIT program in Global Change Science and associated Climate Modeling Initiative.