Sloppy-model universality class and the vandermonde matrix

Joshua J. Waterfall, Fergal P. Casey, Ryan N Gutenkunst, Kevin S. Brown, Christopher R. Myers, Piet W. Brouwer, Veit Elser, James P. Sethna

Research output: Contribution to journalArticle

69 Citations (Scopus)

Abstract

In a variety of contexts, physicists study complex, nonlinear models with many unknown or tunable parameters to explain experimental data. We explain why such systems so often are sloppy: the system behavior depends only on a few "stiff" combinations of the parameters and is unchanged as other "sloppy" parameter combinations vary by orders of magnitude. We observe that the eigenvalue spectra for the sensitivity of sloppy models have a striking, characteristic form with a density of logarithms of eigenvalues which is roughly constant over a large range. We suggest that the common features of sloppy models indicate that they may belong to a common universality class. In particular, we motivate focusing on a Vandermonde ensemble of multiparameter nonlinear models and show in one limit that they exhibit the universal features of sloppy models.

Original languageEnglish (US)
Article number150601
JournalPhysical Review Letters
Volume97
Issue number15
DOIs
StatePublished - 2006
Externally publishedYes

Fingerprint

matrices
eigenvalues
logarithms
sensitivity

ASJC Scopus subject areas

  • Physics and Astronomy(all)

Cite this

Waterfall, J. J., Casey, F. P., Gutenkunst, R. N., Brown, K. S., Myers, C. R., Brouwer, P. W., ... Sethna, J. P. (2006). Sloppy-model universality class and the vandermonde matrix. Physical Review Letters, 97(15), [150601]. https://doi.org/10.1103/PhysRevLett.97.150601

Sloppy-model universality class and the vandermonde matrix. / Waterfall, Joshua J.; Casey, Fergal P.; Gutenkunst, Ryan N; Brown, Kevin S.; Myers, Christopher R.; Brouwer, Piet W.; Elser, Veit; Sethna, James P.

In: Physical Review Letters, Vol. 97, No. 15, 150601, 2006.

Research output: Contribution to journalArticle

Waterfall, JJ, Casey, FP, Gutenkunst, RN, Brown, KS, Myers, CR, Brouwer, PW, Elser, V & Sethna, JP 2006, 'Sloppy-model universality class and the vandermonde matrix', Physical Review Letters, vol. 97, no. 15, 150601. https://doi.org/10.1103/PhysRevLett.97.150601
Waterfall, Joshua J. ; Casey, Fergal P. ; Gutenkunst, Ryan N ; Brown, Kevin S. ; Myers, Christopher R. ; Brouwer, Piet W. ; Elser, Veit ; Sethna, James P. / Sloppy-model universality class and the vandermonde matrix. In: Physical Review Letters. 2006 ; Vol. 97, No. 15.
@article{5649829c9f9a4eafbfed9ab50b527138,
title = "Sloppy-model universality class and the vandermonde matrix",
abstract = "In a variety of contexts, physicists study complex, nonlinear models with many unknown or tunable parameters to explain experimental data. We explain why such systems so often are sloppy: the system behavior depends only on a few {"}stiff{"} combinations of the parameters and is unchanged as other {"}sloppy{"} parameter combinations vary by orders of magnitude. We observe that the eigenvalue spectra for the sensitivity of sloppy models have a striking, characteristic form with a density of logarithms of eigenvalues which is roughly constant over a large range. We suggest that the common features of sloppy models indicate that they may belong to a common universality class. In particular, we motivate focusing on a Vandermonde ensemble of multiparameter nonlinear models and show in one limit that they exhibit the universal features of sloppy models.",
author = "Waterfall, {Joshua J.} and Casey, {Fergal P.} and Gutenkunst, {Ryan N} and Brown, {Kevin S.} and Myers, {Christopher R.} and Brouwer, {Piet W.} and Veit Elser and Sethna, {James P.}",
year = "2006",
doi = "10.1103/PhysRevLett.97.150601",
language = "English (US)",
volume = "97",
journal = "Physical Review Letters",
issn = "0031-9007",
publisher = "American Physical Society",
number = "15",

}

TY - JOUR

T1 - Sloppy-model universality class and the vandermonde matrix

AU - Waterfall, Joshua J.

AU - Casey, Fergal P.

AU - Gutenkunst, Ryan N

AU - Brown, Kevin S.

AU - Myers, Christopher R.

AU - Brouwer, Piet W.

AU - Elser, Veit

AU - Sethna, James P.

PY - 2006

Y1 - 2006

N2 - In a variety of contexts, physicists study complex, nonlinear models with many unknown or tunable parameters to explain experimental data. We explain why such systems so often are sloppy: the system behavior depends only on a few "stiff" combinations of the parameters and is unchanged as other "sloppy" parameter combinations vary by orders of magnitude. We observe that the eigenvalue spectra for the sensitivity of sloppy models have a striking, characteristic form with a density of logarithms of eigenvalues which is roughly constant over a large range. We suggest that the common features of sloppy models indicate that they may belong to a common universality class. In particular, we motivate focusing on a Vandermonde ensemble of multiparameter nonlinear models and show in one limit that they exhibit the universal features of sloppy models.

AB - In a variety of contexts, physicists study complex, nonlinear models with many unknown or tunable parameters to explain experimental data. We explain why such systems so often are sloppy: the system behavior depends only on a few "stiff" combinations of the parameters and is unchanged as other "sloppy" parameter combinations vary by orders of magnitude. We observe that the eigenvalue spectra for the sensitivity of sloppy models have a striking, characteristic form with a density of logarithms of eigenvalues which is roughly constant over a large range. We suggest that the common features of sloppy models indicate that they may belong to a common universality class. In particular, we motivate focusing on a Vandermonde ensemble of multiparameter nonlinear models and show in one limit that they exhibit the universal features of sloppy models.

UR - http://www.scopus.com/inward/record.url?scp=33750016873&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33750016873&partnerID=8YFLogxK

U2 - 10.1103/PhysRevLett.97.150601

DO - 10.1103/PhysRevLett.97.150601

M3 - Article

VL - 97

JO - Physical Review Letters

JF - Physical Review Letters

SN - 0031-9007

IS - 15

M1 - 150601

ER -