Uncertainties in Model Predictions of Future Climate
[click here for project web site (password protected)]
Atmosphere Model Working Group Diagnostics
Default CAM3.1 as compared to observations
Line23 (best performance) CAM3.1 as compared to observations
A large disparity exists among various climate models in their prediction of global mean surface air temperature when atmospheric CO2 has doubled from present concentrations (figure 1). There are an overwhelming number of reasons why these differences could exist. Although each climate model has been optimized to reproduce observational means, each model contains slightly different choices of model parameter values as well as different parameterizations of underresolved physics. The need to understand the sources and impacts of these differences was recently emphasized within the 2001 Third Assessment Report of the Intergovernmental Panel on Climate Change that called for more quantitative evaluations of modeling uncertainty. [read section from IPCC report]
Figure 1. A selection of climate models and their prediction of globally averaged surface air temperature change in response to emissions scenario A2 of IPCC Special Report on Emission Scenarios. CO2 is ~doubled present concentrations by year 2100. Figure reproduced from Cubasch et al. (2001). 
There are good reasons why the climate modeling community is behind in this important endeavor. In order to quantify the uncertainty resulting from a realistic range of model configurations, one needs to estimate a multidimensional probability distribution that quantifies how likely different model parameter combinations are given knowledge of the uncertainties in our observations. The computational cost of mapping a multidimensional probability distribution for a climate model using traditional means (e.g. MonteCarlo or Importance Sampling) is impractical requiring 10^{4} to 10^{6} model evaluations for problems involving less than ten parameters.
Research Plans
Over the past decade, there has been significant progress within the
mathematical geophysics community for solving nonlinear problems in geophysical
inversion using statistical methods to account for the possibility of multiple
solutions (interpretations) of geophysical data (for a review, see Barhen et
al., 2000). The Institute for
Geophysics has been at the forefront of these efforts. Like climate models,
geophysical models are complex, computationally expensive, and involve many
potential degrees of freedom. Within the geophysics community, particular
emphasis has been placed on efficiency, although with some measured compromises.
Similarly dramatic advances have taken place within the statistics
community over the past decade on a class of methods of statistical inference
known as MonteCarlo Markov Chain (MCMC). In particular, greater awareness now
exists for how different challenges in robust statistical inference can be
addressed with a variety of sampling rules that obey the properties of a Markov
chain. Our present goal is to advance the feasibility of quantifying climate
model uncertainties that stem from multiple, nonlinearly related parameters. We
have submitted a proposal to NSF to continue the work on testing a
variety of statistical sampling strategies for idealized and stateoftheart
climate models, including the most efficient sampling strategies that are found
to work well for geophysics problems, while simultaneously reformulating the
statistical foundation of these methods from a MCMC perspective to ensure that
the estimated uncertainties are robust and are well suited for the class of
problems that climate models represent.
We hope to address these questions:

How does uncertainty in parameters affecting clouds, convection, and radiation affect a climate model's sensitivity to CO2 forcing?

How well do observational data constrain parameter values?

What physical processes create differences in sensitivity?


What is the potential for reducing systematic biases between model predictions and observations through careful selection of parameter values?

What sampling strategy provides the most efficient and robust strategy for estimating climate model parameter uncertainties?
Publications
Jackson, C. S., Q. Mu, and P. L. Stoffa, Observations of modern climate provide nonunique constraints for key sources of climate model uncertainty (submitted to Journal of Climate, 2004)
Mu, Q., C. S. Jackson, P. L. Stoffa (2004) A multivariate empiricalorthogonalfunctionbased measure of climate model performance, J. Geophys. Res., 109, D15101, doi:10.1029/2004JD004584.
Jackson, C., M. Sen, and P. Stoffa (2004) An Efficient Stochastic Bayesian Approach to Optimal Parameter and Uncertainty Estimation for Climate Model Predictions, Journal of Climate, 17(14), 28282841.
Jackson, C., Y. Xia, M. Sen, and P. Stoffa (2003) Optimal parameter and uncertainty estimation of a land surface model: A case example using data from Cabauw, Netherlands, Journal of Geophysical Research, 108 (D18), 4583 10.1029/2002JD002991.
Links of Interest
The MIT program in Global Change Science and associated Climate Modeling Initiative.