TY - JOUR
T1 - Predictive Inference and Scientific Reproducibility
AU - Billheimer, Dean
N1 - Publisher Copyright:
© 2019, © 2019 The Authors. Published with license by Taylor & Francis Group, LLC.
Copyright:
Copyright 2019 Elsevier B.V., All rights reserved.
PY - 2019/3/29
Y1 - 2019/3/29
N2 - Most statistical analyses use hypothesis tests or estimation about parameters to form inferential conclusions. I think this is noble, but misguided. The point of view expressed here is that observables are fundamental, and that the goal of statistical modeling should be to predict future observations, given the current data and other relevant information. Further, the prediction of future observables provides multiple advantages to practicing scientists, and to science in general. These include an interpretable numerical summary of a quantity of direct interest to current and future researchers, a calibrated prediction of what’s likely to happen in future experiments, a prediction that can be either “corroborated” or “refuted” through experimentation, and avoidance of inference about parameters; quantities that exists only as convenient indices of hypothetical distributions. Finally, the predictive probability of a future observable can be used as a standard for communicating the reliability of the current work, regardless of whether confirmatory experiments are conducted. Adoption of this paradigm would improve our rigor for scientific accuracy and reproducibility by shifting our focus from “finding differences” among hypothetical parameters to predicting observable events based on our current scientific understanding.
AB - Most statistical analyses use hypothesis tests or estimation about parameters to form inferential conclusions. I think this is noble, but misguided. The point of view expressed here is that observables are fundamental, and that the goal of statistical modeling should be to predict future observations, given the current data and other relevant information. Further, the prediction of future observables provides multiple advantages to practicing scientists, and to science in general. These include an interpretable numerical summary of a quantity of direct interest to current and future researchers, a calibrated prediction of what’s likely to happen in future experiments, a prediction that can be either “corroborated” or “refuted” through experimentation, and avoidance of inference about parameters; quantities that exists only as convenient indices of hypothetical distributions. Finally, the predictive probability of a future observable can be used as a standard for communicating the reliability of the current work, regardless of whether confirmatory experiments are conducted. Adoption of this paradigm would improve our rigor for scientific accuracy and reproducibility by shifting our focus from “finding differences” among hypothetical parameters to predicting observable events based on our current scientific understanding.
KW - Observables
KW - Prediction
KW - Predictive distribution
KW - Scientific inference
UR - http://www.scopus.com/inward/record.url?scp=85063204638&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85063204638&partnerID=8YFLogxK
U2 - 10.1080/00031305.2018.1518270
DO - 10.1080/00031305.2018.1518270
M3 - Article
AN - SCOPUS:85063204638
VL - 73
SP - 291
EP - 295
JO - American Statistician
JF - American Statistician
SN - 0003-1305
IS - sup1
ER -