Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling

Hoshin V. Gupta, Harald Kling, Koray K. Yilmaz, Guillermo F. Martinez

Research output: Contribution to journalArticle

1190 Scopus citations

Abstract

The mean squared error (MSE) and the related normalization, the Nash-Sutcliffe efficiency (NSE), are the two criteria most widely used for calibration and evaluation of hydrological models with observed data. Here, we present a diagnostically interesting decomposition of NSE (and hence MSE), which facilitates analysis of the relative importance of its different components in the context of hydrological modelling, and show how model calibration problems can arise due to interactions among these components. The analysis is illustrated by calibrating a simple conceptual precipitation-runoff model to daily data for a number of Austrian basins having a broad range of hydro-meteorological characteristics. Evaluation of the results clearly demonstrates the problems that can be associated with any calibration based on the NSE (or MSE) criterion. While we propose and test an alternative criterion that can help to reduce model calibration problems, the primary purpose of this study is not to present an improved measure of model performance. Instead, we seek to show that there are systematic problems inherent with any optimization based on formulations related to the MSE. The analysis and results have implications to the manner in which we calibrate and evaluate environmental models; we discuss these and suggest possible ways forward that may move us towards an improved and diagnostically meaningful approach to model performance evaluation and identification.

Original languageEnglish (US)
Pages (from-to)80-91
Number of pages12
JournalJournal of Hydrology
Volume377
Issue number1-2
DOIs
StatePublished - Oct 20 2009

Keywords

  • Calibration
  • Criteria decomposition
  • Mean squared error
  • Model performance evaluation
  • Multiple criteria
  • Nash-Sutcliffe efficiency

ASJC Scopus subject areas

  • Water Science and Technology

Fingerprint Dive into the research topics of 'Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling'. Together they form a unique fingerprint.

  • Cite this