Use of an entropy-based metric in multiobjective calibration to improve model performance

I. G. Pechlivanidis, B. Jackson, H. McMillan, Hoshin Vijai Gupta

Research output: Contribution to journalArticle

18 Citations (Scopus)

Abstract

Parameter estimation for hydrological models is complicated for many reasons, one of which is the arbitrary emphasis placed, by most traditional measures of fit, on various magnitudes of the model residuals. Recent research has called for the development of robust diagnostic measures that provide insights into which model structural components and/or data may be inadequate. In this regard, the flow duration curve (FDC) represents the historical variability of flow and is considered to be an informative signature of catchment behavior. Here we investigate the potential of using the recently developed conditioned entropy difference metric (CED) in combination with the Kling-Gupta efficiency (KGE). The CED respects the static information contained in the flow frequency distribution (and hence the FDC), but does not explicitly characterize temporal dynamics. The KGE reweights the importance of various hydrograph components (correlation, bias, variability) in a way that has been demonstrated to provide better model calibrations than the commonly used Nash-Sutcliffe efficiency, while being explicitly time sensitive. We employ both measures within a multiobjective calibration framework and achieve better performance over the full range of flows than obtained by single-criteria approaches, or by the common multiobjective approach that uses log-transformed and untransformed data to balance fitting of low and high flow periods. The investigation highlights the potential of CED to complement KGE (and vice versa) during model identification. It is possible that some of the complementarity is due to CED representing more information from moments >2 than KGE or other common metrics. We therefore suggest that an interesting way forward would be to extend KGE to include higher moments, i.e., use different moments as multiple criteria. Key Points CED provides an appropriate quantitative measure of fit to the FDC Complements between CED and KGE extracted flow information CED-KGE achieves better performance than single or common multiobjectives

Original languageEnglish (US)
Pages (from-to)8066-8083
Number of pages18
JournalWater Resources Research
Volume50
Issue number10
DOIs
StatePublished - Oct 1 2014

Fingerprint

entropy
calibration
structural component
complementarity
hydrograph
catchment

Keywords

  • calibration
  • conditioned entropy difference
  • flow duration curve
  • Kling-Gupta efficiency
  • model evaluation
  • multiple criteria

ASJC Scopus subject areas

  • Water Science and Technology

Cite this

Use of an entropy-based metric in multiobjective calibration to improve model performance. / Pechlivanidis, I. G.; Jackson, B.; McMillan, H.; Gupta, Hoshin Vijai.

In: Water Resources Research, Vol. 50, No. 10, 01.10.2014, p. 8066-8083.

Research output: Contribution to journalArticle

Pechlivanidis, I. G. ; Jackson, B. ; McMillan, H. ; Gupta, Hoshin Vijai. / Use of an entropy-based metric in multiobjective calibration to improve model performance. In: Water Resources Research. 2014 ; Vol. 50, No. 10. pp. 8066-8083.
@article{f0737aaaf96141119bf8312e058d17c4,
title = "Use of an entropy-based metric in multiobjective calibration to improve model performance",
abstract = "Parameter estimation for hydrological models is complicated for many reasons, one of which is the arbitrary emphasis placed, by most traditional measures of fit, on various magnitudes of the model residuals. Recent research has called for the development of robust diagnostic measures that provide insights into which model structural components and/or data may be inadequate. In this regard, the flow duration curve (FDC) represents the historical variability of flow and is considered to be an informative signature of catchment behavior. Here we investigate the potential of using the recently developed conditioned entropy difference metric (CED) in combination with the Kling-Gupta efficiency (KGE). The CED respects the static information contained in the flow frequency distribution (and hence the FDC), but does not explicitly characterize temporal dynamics. The KGE reweights the importance of various hydrograph components (correlation, bias, variability) in a way that has been demonstrated to provide better model calibrations than the commonly used Nash-Sutcliffe efficiency, while being explicitly time sensitive. We employ both measures within a multiobjective calibration framework and achieve better performance over the full range of flows than obtained by single-criteria approaches, or by the common multiobjective approach that uses log-transformed and untransformed data to balance fitting of low and high flow periods. The investigation highlights the potential of CED to complement KGE (and vice versa) during model identification. It is possible that some of the complementarity is due to CED representing more information from moments >2 than KGE or other common metrics. We therefore suggest that an interesting way forward would be to extend KGE to include higher moments, i.e., use different moments as multiple criteria. Key Points CED provides an appropriate quantitative measure of fit to the FDC Complements between CED and KGE extracted flow information CED-KGE achieves better performance than single or common multiobjectives",
keywords = "calibration, conditioned entropy difference, flow duration curve, Kling-Gupta efficiency, model evaluation, multiple criteria",
author = "Pechlivanidis, {I. G.} and B. Jackson and H. McMillan and Gupta, {Hoshin Vijai}",
year = "2014",
month = "10",
day = "1",
doi = "10.1002/2013WR014537",
language = "English (US)",
volume = "50",
pages = "8066--8083",
journal = "Water Resources Research",
issn = "0043-1397",
publisher = "American Geophysical Union",
number = "10",

}

TY - JOUR

T1 - Use of an entropy-based metric in multiobjective calibration to improve model performance

AU - Pechlivanidis, I. G.

AU - Jackson, B.

AU - McMillan, H.

AU - Gupta, Hoshin Vijai

PY - 2014/10/1

Y1 - 2014/10/1

N2 - Parameter estimation for hydrological models is complicated for many reasons, one of which is the arbitrary emphasis placed, by most traditional measures of fit, on various magnitudes of the model residuals. Recent research has called for the development of robust diagnostic measures that provide insights into which model structural components and/or data may be inadequate. In this regard, the flow duration curve (FDC) represents the historical variability of flow and is considered to be an informative signature of catchment behavior. Here we investigate the potential of using the recently developed conditioned entropy difference metric (CED) in combination with the Kling-Gupta efficiency (KGE). The CED respects the static information contained in the flow frequency distribution (and hence the FDC), but does not explicitly characterize temporal dynamics. The KGE reweights the importance of various hydrograph components (correlation, bias, variability) in a way that has been demonstrated to provide better model calibrations than the commonly used Nash-Sutcliffe efficiency, while being explicitly time sensitive. We employ both measures within a multiobjective calibration framework and achieve better performance over the full range of flows than obtained by single-criteria approaches, or by the common multiobjective approach that uses log-transformed and untransformed data to balance fitting of low and high flow periods. The investigation highlights the potential of CED to complement KGE (and vice versa) during model identification. It is possible that some of the complementarity is due to CED representing more information from moments >2 than KGE or other common metrics. We therefore suggest that an interesting way forward would be to extend KGE to include higher moments, i.e., use different moments as multiple criteria. Key Points CED provides an appropriate quantitative measure of fit to the FDC Complements between CED and KGE extracted flow information CED-KGE achieves better performance than single or common multiobjectives

AB - Parameter estimation for hydrological models is complicated for many reasons, one of which is the arbitrary emphasis placed, by most traditional measures of fit, on various magnitudes of the model residuals. Recent research has called for the development of robust diagnostic measures that provide insights into which model structural components and/or data may be inadequate. In this regard, the flow duration curve (FDC) represents the historical variability of flow and is considered to be an informative signature of catchment behavior. Here we investigate the potential of using the recently developed conditioned entropy difference metric (CED) in combination with the Kling-Gupta efficiency (KGE). The CED respects the static information contained in the flow frequency distribution (and hence the FDC), but does not explicitly characterize temporal dynamics. The KGE reweights the importance of various hydrograph components (correlation, bias, variability) in a way that has been demonstrated to provide better model calibrations than the commonly used Nash-Sutcliffe efficiency, while being explicitly time sensitive. We employ both measures within a multiobjective calibration framework and achieve better performance over the full range of flows than obtained by single-criteria approaches, or by the common multiobjective approach that uses log-transformed and untransformed data to balance fitting of low and high flow periods. The investigation highlights the potential of CED to complement KGE (and vice versa) during model identification. It is possible that some of the complementarity is due to CED representing more information from moments >2 than KGE or other common metrics. We therefore suggest that an interesting way forward would be to extend KGE to include higher moments, i.e., use different moments as multiple criteria. Key Points CED provides an appropriate quantitative measure of fit to the FDC Complements between CED and KGE extracted flow information CED-KGE achieves better performance than single or common multiobjectives

KW - calibration

KW - conditioned entropy difference

KW - flow duration curve

KW - Kling-Gupta efficiency

KW - model evaluation

KW - multiple criteria

UR - http://www.scopus.com/inward/record.url?scp=84911191293&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84911191293&partnerID=8YFLogxK

U2 - 10.1002/2013WR014537

DO - 10.1002/2013WR014537

M3 - Article

AN - SCOPUS:84911191293

VL - 50

SP - 8066

EP - 8083

JO - Water Resources Research

JF - Water Resources Research

SN - 0043-1397

IS - 10

ER -