Reconciling theory with observations: Elements of a diagnostic approach to model evaluation

Hoshin Vijai Gupta, Thorsten Wagener, Yuqiong Liu

Research output: Contribution to journalArticle

321 Citations (Scopus)

Abstract

This paper discusses the need for a well-considered approach to reconciling environmental theory with observations that has clear and compelling diagnostic power. This need is well recognized by the scientific community in the context of the 'Predictions in Ungaged Basins' initiative and the National Science Foundation sponsored 'Environmental Observatories' initiative, among others. It is suggested that many current strategies for confronting environmental process models with observational data are inadequate in the face of the highly complex and high order models becoming central to modern environmental science, and steps are proposed towards the development of a robust and powerful 'Theory of Evaluation'. This paper presents the concept of a diagnostic evaluation approach rooted in information theory and employing the notion of signature indices that measure theoretically relevant system process behaviours. The signature-based approach addresses the issue of degree of system complexity resolvable by a model. Further, it can be placed in the context of Bayesian inference to facilitate uncertainty analysis, and can be readily applied to the problem of process evaluation leading to improved predictions in ungaged basins.

Original languageEnglish (US)
Pages (from-to)3802-3813
Number of pages12
JournalHydrological Processes
Volume22
Issue number18
DOIs
StatePublished - Aug 30 2008

Fingerprint

uncertainty analysis
prediction
basin
observatory
evaluation
need
environmental science
index
science

Keywords

  • Diagnosis
  • Evaluation
  • Information
  • Model identification
  • Signatures
  • Uncertainty

ASJC Scopus subject areas

  • Water Science and Technology

Cite this

Reconciling theory with observations : Elements of a diagnostic approach to model evaluation. / Gupta, Hoshin Vijai; Wagener, Thorsten; Liu, Yuqiong.

In: Hydrological Processes, Vol. 22, No. 18, 30.08.2008, p. 3802-3813.

Research output: Contribution to journalArticle

@article{99d756d1567340949eb74b74e7f31c9b,
title = "Reconciling theory with observations: Elements of a diagnostic approach to model evaluation",
abstract = "This paper discusses the need for a well-considered approach to reconciling environmental theory with observations that has clear and compelling diagnostic power. This need is well recognized by the scientific community in the context of the 'Predictions in Ungaged Basins' initiative and the National Science Foundation sponsored 'Environmental Observatories' initiative, among others. It is suggested that many current strategies for confronting environmental process models with observational data are inadequate in the face of the highly complex and high order models becoming central to modern environmental science, and steps are proposed towards the development of a robust and powerful 'Theory of Evaluation'. This paper presents the concept of a diagnostic evaluation approach rooted in information theory and employing the notion of signature indices that measure theoretically relevant system process behaviours. The signature-based approach addresses the issue of degree of system complexity resolvable by a model. Further, it can be placed in the context of Bayesian inference to facilitate uncertainty analysis, and can be readily applied to the problem of process evaluation leading to improved predictions in ungaged basins.",
keywords = "Diagnosis, Evaluation, Information, Model identification, Signatures, Uncertainty",
author = "Gupta, {Hoshin Vijai} and Thorsten Wagener and Yuqiong Liu",
year = "2008",
month = "8",
day = "30",
doi = "10.1002/hyp.6989",
language = "English (US)",
volume = "22",
pages = "3802--3813",
journal = "Hydrological Processes",
issn = "0885-6087",
publisher = "John Wiley and Sons Ltd",
number = "18",

}

TY - JOUR

T1 - Reconciling theory with observations

T2 - Elements of a diagnostic approach to model evaluation

AU - Gupta, Hoshin Vijai

AU - Wagener, Thorsten

AU - Liu, Yuqiong

PY - 2008/8/30

Y1 - 2008/8/30

N2 - This paper discusses the need for a well-considered approach to reconciling environmental theory with observations that has clear and compelling diagnostic power. This need is well recognized by the scientific community in the context of the 'Predictions in Ungaged Basins' initiative and the National Science Foundation sponsored 'Environmental Observatories' initiative, among others. It is suggested that many current strategies for confronting environmental process models with observational data are inadequate in the face of the highly complex and high order models becoming central to modern environmental science, and steps are proposed towards the development of a robust and powerful 'Theory of Evaluation'. This paper presents the concept of a diagnostic evaluation approach rooted in information theory and employing the notion of signature indices that measure theoretically relevant system process behaviours. The signature-based approach addresses the issue of degree of system complexity resolvable by a model. Further, it can be placed in the context of Bayesian inference to facilitate uncertainty analysis, and can be readily applied to the problem of process evaluation leading to improved predictions in ungaged basins.

AB - This paper discusses the need for a well-considered approach to reconciling environmental theory with observations that has clear and compelling diagnostic power. This need is well recognized by the scientific community in the context of the 'Predictions in Ungaged Basins' initiative and the National Science Foundation sponsored 'Environmental Observatories' initiative, among others. It is suggested that many current strategies for confronting environmental process models with observational data are inadequate in the face of the highly complex and high order models becoming central to modern environmental science, and steps are proposed towards the development of a robust and powerful 'Theory of Evaluation'. This paper presents the concept of a diagnostic evaluation approach rooted in information theory and employing the notion of signature indices that measure theoretically relevant system process behaviours. The signature-based approach addresses the issue of degree of system complexity resolvable by a model. Further, it can be placed in the context of Bayesian inference to facilitate uncertainty analysis, and can be readily applied to the problem of process evaluation leading to improved predictions in ungaged basins.

KW - Diagnosis

KW - Evaluation

KW - Information

KW - Model identification

KW - Signatures

KW - Uncertainty

UR - http://www.scopus.com/inward/record.url?scp=49449115848&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=49449115848&partnerID=8YFLogxK

U2 - 10.1002/hyp.6989

DO - 10.1002/hyp.6989

M3 - Article

AN - SCOPUS:49449115848

VL - 22

SP - 3802

EP - 3813

JO - Hydrological Processes

JF - Hydrological Processes

SN - 0885-6087

IS - 18

ER -