A flexible method of estimating luminosity functions

Brandon C. Kelly, Xiaohui Fan, Marianne Vestergaard

Research output: Contribution to journalArticle

34 Citations (Scopus)

Abstract

We describe a Bayesian approach to estimating luminosity functions. We derive the likelihood function and posterior probability distribution for the luminosity function, given the observed data, and we compare the Bayesian approach with maximum likelihood by simulating sources from a Schechter function. For our simulations confidence intervals derived from bootstrapping the maximum likelihood estimate can be too narrow, while confidence intervals derived from the Bayesian approach are valid. We develop our statistical approach for a flexible model where the luminosity function is modeled as a mixture of Gaussian functions. Statistical inference is performed using Markov chain Monte Carlo ( MCMC) methods, and we describe a Metropolis-Hastings algorithm to perform the MCMC. The MCMC simulates random draws from the probability distribution of the luminosity function parameters, given the data, and we use a simulated data set to show how these random draws may be used to estimate the probability distribution for the luminosity function. In addition, we show how the MCMC output may be used to estimate the probability distribution of any quantities derived from the luminosity function, such as the peak in the space density of quasars. The Bayesian method we develop has the advantage that it is able to place accurate constraints on the luminosity function even beyond the survey detection limits, and that it provides a natural way of estimating the probability distribution of any quantities derived from the luminosity function, including those that rely on information beyond the survey detection limits.

Original languageEnglish (US)
Pages (from-to)874-895
Number of pages22
JournalAstrophysical Journal
Volume682
Issue number2
DOIs
StatePublished - Aug 1 2008

Fingerprint

estimating
luminosity
Markov chain
Markov chains
confidence interval
confidence
bootstrapping
method
maximum likelihood estimates
intervals
space density
estimates
distribution
inference
quasars
Monte Carlo method
simulation
output

Keywords

  • Methods: data analysis
  • Methods: numerical
  • Methods: statistical

ASJC Scopus subject areas

  • Space and Planetary Science
  • Astronomy and Astrophysics

Cite this

A flexible method of estimating luminosity functions. / Kelly, Brandon C.; Fan, Xiaohui; Vestergaard, Marianne.

In: Astrophysical Journal, Vol. 682, No. 2, 01.08.2008, p. 874-895.

Research output: Contribution to journalArticle

Kelly, Brandon C. ; Fan, Xiaohui ; Vestergaard, Marianne. / A flexible method of estimating luminosity functions. In: Astrophysical Journal. 2008 ; Vol. 682, No. 2. pp. 874-895.
@article{668ab91714fd4d828573a82b605c5281,
title = "A flexible method of estimating luminosity functions",
abstract = "We describe a Bayesian approach to estimating luminosity functions. We derive the likelihood function and posterior probability distribution for the luminosity function, given the observed data, and we compare the Bayesian approach with maximum likelihood by simulating sources from a Schechter function. For our simulations confidence intervals derived from bootstrapping the maximum likelihood estimate can be too narrow, while confidence intervals derived from the Bayesian approach are valid. We develop our statistical approach for a flexible model where the luminosity function is modeled as a mixture of Gaussian functions. Statistical inference is performed using Markov chain Monte Carlo ( MCMC) methods, and we describe a Metropolis-Hastings algorithm to perform the MCMC. The MCMC simulates random draws from the probability distribution of the luminosity function parameters, given the data, and we use a simulated data set to show how these random draws may be used to estimate the probability distribution for the luminosity function. In addition, we show how the MCMC output may be used to estimate the probability distribution of any quantities derived from the luminosity function, such as the peak in the space density of quasars. The Bayesian method we develop has the advantage that it is able to place accurate constraints on the luminosity function even beyond the survey detection limits, and that it provides a natural way of estimating the probability distribution of any quantities derived from the luminosity function, including those that rely on information beyond the survey detection limits.",
keywords = "Methods: data analysis, Methods: numerical, Methods: statistical",
author = "Kelly, {Brandon C.} and Xiaohui Fan and Marianne Vestergaard",
year = "2008",
month = "8",
day = "1",
doi = "10.1086/589501",
language = "English (US)",
volume = "682",
pages = "874--895",
journal = "Astrophysical Journal",
issn = "0004-637X",
publisher = "IOP Publishing Ltd.",
number = "2",

}

TY - JOUR

T1 - A flexible method of estimating luminosity functions

AU - Kelly, Brandon C.

AU - Fan, Xiaohui

AU - Vestergaard, Marianne

PY - 2008/8/1

Y1 - 2008/8/1

N2 - We describe a Bayesian approach to estimating luminosity functions. We derive the likelihood function and posterior probability distribution for the luminosity function, given the observed data, and we compare the Bayesian approach with maximum likelihood by simulating sources from a Schechter function. For our simulations confidence intervals derived from bootstrapping the maximum likelihood estimate can be too narrow, while confidence intervals derived from the Bayesian approach are valid. We develop our statistical approach for a flexible model where the luminosity function is modeled as a mixture of Gaussian functions. Statistical inference is performed using Markov chain Monte Carlo ( MCMC) methods, and we describe a Metropolis-Hastings algorithm to perform the MCMC. The MCMC simulates random draws from the probability distribution of the luminosity function parameters, given the data, and we use a simulated data set to show how these random draws may be used to estimate the probability distribution for the luminosity function. In addition, we show how the MCMC output may be used to estimate the probability distribution of any quantities derived from the luminosity function, such as the peak in the space density of quasars. The Bayesian method we develop has the advantage that it is able to place accurate constraints on the luminosity function even beyond the survey detection limits, and that it provides a natural way of estimating the probability distribution of any quantities derived from the luminosity function, including those that rely on information beyond the survey detection limits.

AB - We describe a Bayesian approach to estimating luminosity functions. We derive the likelihood function and posterior probability distribution for the luminosity function, given the observed data, and we compare the Bayesian approach with maximum likelihood by simulating sources from a Schechter function. For our simulations confidence intervals derived from bootstrapping the maximum likelihood estimate can be too narrow, while confidence intervals derived from the Bayesian approach are valid. We develop our statistical approach for a flexible model where the luminosity function is modeled as a mixture of Gaussian functions. Statistical inference is performed using Markov chain Monte Carlo ( MCMC) methods, and we describe a Metropolis-Hastings algorithm to perform the MCMC. The MCMC simulates random draws from the probability distribution of the luminosity function parameters, given the data, and we use a simulated data set to show how these random draws may be used to estimate the probability distribution for the luminosity function. In addition, we show how the MCMC output may be used to estimate the probability distribution of any quantities derived from the luminosity function, such as the peak in the space density of quasars. The Bayesian method we develop has the advantage that it is able to place accurate constraints on the luminosity function even beyond the survey detection limits, and that it provides a natural way of estimating the probability distribution of any quantities derived from the luminosity function, including those that rely on information beyond the survey detection limits.

KW - Methods: data analysis

KW - Methods: numerical

KW - Methods: statistical

UR - http://www.scopus.com/inward/record.url?scp=53549097958&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=53549097958&partnerID=8YFLogxK

U2 - 10.1086/589501

DO - 10.1086/589501

M3 - Article

VL - 682

SP - 874

EP - 895

JO - Astrophysical Journal

JF - Astrophysical Journal

SN - 0004-637X

IS - 2

ER -