What do we mean by sensitivity analysis? the need for comprehensive characterization of "global" sensitivity in Earth and Environmental systems models

Saman Razavi, Hoshin Vijai Gupta

Research output: Contribution to journalArticle

97 Citations (Scopus)

Abstract

Sensitivity analysis is an essential paradigm in Earth and Environmental Systems modeling. However, the term "sensitivity" has a clear definition, based in partial derivatives, only when specified locally around a particular point (e.g., optimal solution) in the problem space. Accordingly, no unique definition exists for "global sensitivity" across the problem space, when considering one or more model responses to different factors such as model parameters or forcings. A variety of approaches have been proposed for global sensitivity analysis, based on different philosophies and theories, and each of these formally characterizes a different "intuitive" understanding of sensitivity. These approaches focus on different properties of the model response at a fundamental level and may therefore lead to different (even conflicting) conclusions about the underlying sensitivities. Here we revisit the theoretical basis for sensitivity analysis, summarize and critically evaluate existing approaches in the literature, and demonstrate their flaws and shortcomings through conceptual examples. We also demonstrate the difficulty involved in interpreting "global" interaction effects, which may undermine the value of existing interpretive approaches. With this background, we identify several important properties of response surfaces that are associated with the understanding and interpretation of sensitivities in the context of Earth and Environmental System models. Finally, we highlight the need for a new, comprehensive framework for sensitivity analysis that effectively characterizes all of the important sensitivity-related properties of model response surfaces.

Original languageEnglish (US)
Pages (from-to)3070-3092
Number of pages23
JournalWater Resources Research
Volume51
Issue number5
DOIs
StatePublished - May 1 2015

Fingerprint

sensitivity analysis
need
modeling

Keywords

  • Earth and Environmental system models
  • interaction effect
  • Morris
  • response surface
  • sensitivity analysis
  • Sobol

ASJC Scopus subject areas

  • Water Science and Technology

Cite this

@article{aade1cf3dc20433aa197bb037437b8cf,
title = "What do we mean by sensitivity analysis? the need for comprehensive characterization of {"}global{"} sensitivity in Earth and Environmental systems models",
abstract = "Sensitivity analysis is an essential paradigm in Earth and Environmental Systems modeling. However, the term {"}sensitivity{"} has a clear definition, based in partial derivatives, only when specified locally around a particular point (e.g., optimal solution) in the problem space. Accordingly, no unique definition exists for {"}global sensitivity{"} across the problem space, when considering one or more model responses to different factors such as model parameters or forcings. A variety of approaches have been proposed for global sensitivity analysis, based on different philosophies and theories, and each of these formally characterizes a different {"}intuitive{"} understanding of sensitivity. These approaches focus on different properties of the model response at a fundamental level and may therefore lead to different (even conflicting) conclusions about the underlying sensitivities. Here we revisit the theoretical basis for sensitivity analysis, summarize and critically evaluate existing approaches in the literature, and demonstrate their flaws and shortcomings through conceptual examples. We also demonstrate the difficulty involved in interpreting {"}global{"} interaction effects, which may undermine the value of existing interpretive approaches. With this background, we identify several important properties of response surfaces that are associated with the understanding and interpretation of sensitivities in the context of Earth and Environmental System models. Finally, we highlight the need for a new, comprehensive framework for sensitivity analysis that effectively characterizes all of the important sensitivity-related properties of model response surfaces.",
keywords = "Earth and Environmental system models, interaction effect, Morris, response surface, sensitivity analysis, Sobol",
author = "Saman Razavi and Gupta, {Hoshin Vijai}",
year = "2015",
month = "5",
day = "1",
doi = "10.1002/2014WR016527",
language = "English (US)",
volume = "51",
pages = "3070--3092",
journal = "Water Resources Research",
issn = "0043-1397",
publisher = "American Geophysical Union",
number = "5",

}

TY - JOUR

T1 - What do we mean by sensitivity analysis? the need for comprehensive characterization of "global" sensitivity in Earth and Environmental systems models

AU - Razavi, Saman

AU - Gupta, Hoshin Vijai

PY - 2015/5/1

Y1 - 2015/5/1

N2 - Sensitivity analysis is an essential paradigm in Earth and Environmental Systems modeling. However, the term "sensitivity" has a clear definition, based in partial derivatives, only when specified locally around a particular point (e.g., optimal solution) in the problem space. Accordingly, no unique definition exists for "global sensitivity" across the problem space, when considering one or more model responses to different factors such as model parameters or forcings. A variety of approaches have been proposed for global sensitivity analysis, based on different philosophies and theories, and each of these formally characterizes a different "intuitive" understanding of sensitivity. These approaches focus on different properties of the model response at a fundamental level and may therefore lead to different (even conflicting) conclusions about the underlying sensitivities. Here we revisit the theoretical basis for sensitivity analysis, summarize and critically evaluate existing approaches in the literature, and demonstrate their flaws and shortcomings through conceptual examples. We also demonstrate the difficulty involved in interpreting "global" interaction effects, which may undermine the value of existing interpretive approaches. With this background, we identify several important properties of response surfaces that are associated with the understanding and interpretation of sensitivities in the context of Earth and Environmental System models. Finally, we highlight the need for a new, comprehensive framework for sensitivity analysis that effectively characterizes all of the important sensitivity-related properties of model response surfaces.

AB - Sensitivity analysis is an essential paradigm in Earth and Environmental Systems modeling. However, the term "sensitivity" has a clear definition, based in partial derivatives, only when specified locally around a particular point (e.g., optimal solution) in the problem space. Accordingly, no unique definition exists for "global sensitivity" across the problem space, when considering one or more model responses to different factors such as model parameters or forcings. A variety of approaches have been proposed for global sensitivity analysis, based on different philosophies and theories, and each of these formally characterizes a different "intuitive" understanding of sensitivity. These approaches focus on different properties of the model response at a fundamental level and may therefore lead to different (even conflicting) conclusions about the underlying sensitivities. Here we revisit the theoretical basis for sensitivity analysis, summarize and critically evaluate existing approaches in the literature, and demonstrate their flaws and shortcomings through conceptual examples. We also demonstrate the difficulty involved in interpreting "global" interaction effects, which may undermine the value of existing interpretive approaches. With this background, we identify several important properties of response surfaces that are associated with the understanding and interpretation of sensitivities in the context of Earth and Environmental System models. Finally, we highlight the need for a new, comprehensive framework for sensitivity analysis that effectively characterizes all of the important sensitivity-related properties of model response surfaces.

KW - Earth and Environmental system models

KW - interaction effect

KW - Morris

KW - response surface

KW - sensitivity analysis

KW - Sobol

UR - http://www.scopus.com/inward/record.url?scp=85027950072&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85027950072&partnerID=8YFLogxK

U2 - 10.1002/2014WR016527

DO - 10.1002/2014WR016527

M3 - Article

AN - SCOPUS:85027950072

VL - 51

SP - 3070

EP - 3092

JO - Water Resources Research

JF - Water Resources Research

SN - 0043-1397

IS - 5

ER -