An approach to quantifying the efficiency of a Bayesian filter

Grey S. Nearing, Hoshin Vijai Gupta, Wade T. Crow, Wei Gong

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

Data assimilation is the Bayesian conditioning of uncertain model simulations on observations to reduce uncertainty about model states. In practice, it is common to make simplifying assumptions about the prior and posterior state distributions, and to employ approximations of the likelihood function, which can reduce the efficiency of the filter. We propose metrics that quantify how much of the uncertainty in a Bayesian posterior state distribution is due to (i) the observation operator, (ii) observation error, and (iii) approximations of Bayes' Law. Our approach uses discrete Shannon entropy to quantify uncertainty, and we define the utility of an observation (for reducing uncertainty about a model state) as the ratio of the mutual information between the state and observation to the entropy of the state prior. These metrics make it possible to analyze the efficiency of a proposed observation system and data assimilation strategy, and provide a way to examine the propagation of information through the dynamic system model. We demonstrate the procedure on the problem of estimating profile soil moisture from observations at the surface (top 5 cm). The results show that when synthetic observations of 5 cm soil moisture are assimilated into a three-layer model of soil hydrology, the ensemble Kalman filter does not use all of the information available in observations.

Original languageEnglish (US)
Pages (from-to)2164-2173
Number of pages10
JournalWater Resources Research
Volume49
Issue number4
DOIs
StatePublished - 2013

Fingerprint

filter
data assimilation
entropy
soil moisture
Kalman filter
conditioning
hydrology
simulation
soil
distribution

Keywords

  • data assimilation
  • information theory

ASJC Scopus subject areas

  • Water Science and Technology

Cite this

An approach to quantifying the efficiency of a Bayesian filter. / Nearing, Grey S.; Gupta, Hoshin Vijai; Crow, Wade T.; Gong, Wei.

In: Water Resources Research, Vol. 49, No. 4, 2013, p. 2164-2173.

Research output: Contribution to journalArticle

Nearing, Grey S. ; Gupta, Hoshin Vijai ; Crow, Wade T. ; Gong, Wei. / An approach to quantifying the efficiency of a Bayesian filter. In: Water Resources Research. 2013 ; Vol. 49, No. 4. pp. 2164-2173.
@article{5b91c1a2f30a4ab0bdbdfc8cf9e74c05,
title = "An approach to quantifying the efficiency of a Bayesian filter",
abstract = "Data assimilation is the Bayesian conditioning of uncertain model simulations on observations to reduce uncertainty about model states. In practice, it is common to make simplifying assumptions about the prior and posterior state distributions, and to employ approximations of the likelihood function, which can reduce the efficiency of the filter. We propose metrics that quantify how much of the uncertainty in a Bayesian posterior state distribution is due to (i) the observation operator, (ii) observation error, and (iii) approximations of Bayes' Law. Our approach uses discrete Shannon entropy to quantify uncertainty, and we define the utility of an observation (for reducing uncertainty about a model state) as the ratio of the mutual information between the state and observation to the entropy of the state prior. These metrics make it possible to analyze the efficiency of a proposed observation system and data assimilation strategy, and provide a way to examine the propagation of information through the dynamic system model. We demonstrate the procedure on the problem of estimating profile soil moisture from observations at the surface (top 5 cm). The results show that when synthetic observations of 5 cm soil moisture are assimilated into a three-layer model of soil hydrology, the ensemble Kalman filter does not use all of the information available in observations.",
keywords = "data assimilation, information theory",
author = "Nearing, {Grey S.} and Gupta, {Hoshin Vijai} and Crow, {Wade T.} and Wei Gong",
year = "2013",
doi = "10.1002/wrcr.20177",
language = "English (US)",
volume = "49",
pages = "2164--2173",
journal = "Water Resources Research",
issn = "0043-1397",
publisher = "American Geophysical Union",
number = "4",

}

TY - JOUR

T1 - An approach to quantifying the efficiency of a Bayesian filter

AU - Nearing, Grey S.

AU - Gupta, Hoshin Vijai

AU - Crow, Wade T.

AU - Gong, Wei

PY - 2013

Y1 - 2013

N2 - Data assimilation is the Bayesian conditioning of uncertain model simulations on observations to reduce uncertainty about model states. In practice, it is common to make simplifying assumptions about the prior and posterior state distributions, and to employ approximations of the likelihood function, which can reduce the efficiency of the filter. We propose metrics that quantify how much of the uncertainty in a Bayesian posterior state distribution is due to (i) the observation operator, (ii) observation error, and (iii) approximations of Bayes' Law. Our approach uses discrete Shannon entropy to quantify uncertainty, and we define the utility of an observation (for reducing uncertainty about a model state) as the ratio of the mutual information between the state and observation to the entropy of the state prior. These metrics make it possible to analyze the efficiency of a proposed observation system and data assimilation strategy, and provide a way to examine the propagation of information through the dynamic system model. We demonstrate the procedure on the problem of estimating profile soil moisture from observations at the surface (top 5 cm). The results show that when synthetic observations of 5 cm soil moisture are assimilated into a three-layer model of soil hydrology, the ensemble Kalman filter does not use all of the information available in observations.

AB - Data assimilation is the Bayesian conditioning of uncertain model simulations on observations to reduce uncertainty about model states. In practice, it is common to make simplifying assumptions about the prior and posterior state distributions, and to employ approximations of the likelihood function, which can reduce the efficiency of the filter. We propose metrics that quantify how much of the uncertainty in a Bayesian posterior state distribution is due to (i) the observation operator, (ii) observation error, and (iii) approximations of Bayes' Law. Our approach uses discrete Shannon entropy to quantify uncertainty, and we define the utility of an observation (for reducing uncertainty about a model state) as the ratio of the mutual information between the state and observation to the entropy of the state prior. These metrics make it possible to analyze the efficiency of a proposed observation system and data assimilation strategy, and provide a way to examine the propagation of information through the dynamic system model. We demonstrate the procedure on the problem of estimating profile soil moisture from observations at the surface (top 5 cm). The results show that when synthetic observations of 5 cm soil moisture are assimilated into a three-layer model of soil hydrology, the ensemble Kalman filter does not use all of the information available in observations.

KW - data assimilation

KW - information theory

UR - http://www.scopus.com/inward/record.url?scp=84877942372&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84877942372&partnerID=8YFLogxK

U2 - 10.1002/wrcr.20177

DO - 10.1002/wrcr.20177

M3 - Article

AN - SCOPUS:84877942372

VL - 49

SP - 2164

EP - 2173

JO - Water Resources Research

JF - Water Resources Research

SN - 0043-1397

IS - 4

ER -