Model performance, model robustness, and model fitness scores: A new method for identifying good land-surface models

Lindsey E. Gulden, Enrique Rosero, Zong Liang Yang, Thorsten Wagener, Guo Yue Niu

Research output: Contribution to journalArticle

22 Scopus citations

Abstract

We introduce three metrics for rigorous evaluation of land-surface models (LSMs). This framework explicitly acknowledges perennial sources of uncertainty in LSM output. The model performance score (ζ) quantifies the likelihood that a representative model ensemble will bracket most observations and be highly skilled with low spread. The robustness score (ρ) quantifies the sensitivity of performance to parameter and/or data error. The fitness score (φ) combines performance and robustness, ranking models' suitability for broad application. We demonstrate the use of the metrics by comparing three versions of the Noah LSM. Using time-varying ζ for hypothesis testing and model development, we show that representing short-term phenological change improves Noah's simulation of surface energy partitioning and subsurface water dynamics at a semi-humid site. The least complex version of Noah is most fit for broad application. The framework and metrics presented here can significantly improve the confidence that can be placed in LSM predictions.

Original languageEnglish (US)
Article numberL11404
JournalGeophysical Research Letters
Volume35
Issue number11
DOIs
StatePublished - Jun 16 2008
Externally publishedYes

ASJC Scopus subject areas

  • Geophysics
  • Earth and Planetary Sciences(all)

Fingerprint Dive into the research topics of 'Model performance, model robustness, and model fitness scores: A new method for identifying good land-surface models'. Together they form a unique fingerprint.

  • Cite this