Measuring decision weights in recognition experiments with multiple response alternatives: Comparing the correlation and multinomial-logistic- regression methods

Huanping Dai, Christophe Micheyl

Research output: Contribution to journalArticle

Abstract

Psychophysical reverse-correlation methods allow researchers to gain insight into the perceptual representations and decision weighting strategies of individual subjects in perceptual tasks. Although these methods have gained momentum, until recently their development was limited to experiments involving only two response categories. Recently, two approaches for estimating decision weights in m-Alternative experiments have been put forward. One approach extends the two-category correlation method to m > 2 alternatives; the second uses multinomial logistic regression (MLR). In this article, the relative merits of the two methods are discussed, and the issues of convergence and statistical efficiency of the methods are evaluated quantitatively using Monte Carlo simulations. The results indicate that, for a range of values of the number of trials, the estimated weighting patterns are closer to their asymptotic values for the correlation method than for the MLR method. Moreover, for the MLR method, weight estimates for different stimulus components can exhibit strong correlations, making the analysis and interpretation of measured weighting patterns less straightforward than for the correlation method. These and other advantages of the correlation method, which include computational simplicity and a close relationship to other well-established psychophysical reverse-correlation methods, make it an attractive tool to uncover decision strategies in m-Alternative experiments.

Original languageEnglish (US)
Pages (from-to)3418-3427
Number of pages10
JournalJournal of the Acoustical Society of America
Volume132
Issue number5
DOIs
StatePublished - Nov 2012

Fingerprint

logistics
regression analysis
Experiment
Logistic Regression
stimuli
estimating
momentum
estimates
simulation

ASJC Scopus subject areas

  • Acoustics and Ultrasonics
  • Arts and Humanities (miscellaneous)

Cite this

@article{57264a3fe1c14655bafd4e356015c66e,
title = "Measuring decision weights in recognition experiments with multiple response alternatives: Comparing the correlation and multinomial-logistic- regression methods",
abstract = "Psychophysical reverse-correlation methods allow researchers to gain insight into the perceptual representations and decision weighting strategies of individual subjects in perceptual tasks. Although these methods have gained momentum, until recently their development was limited to experiments involving only two response categories. Recently, two approaches for estimating decision weights in m-Alternative experiments have been put forward. One approach extends the two-category correlation method to m > 2 alternatives; the second uses multinomial logistic regression (MLR). In this article, the relative merits of the two methods are discussed, and the issues of convergence and statistical efficiency of the methods are evaluated quantitatively using Monte Carlo simulations. The results indicate that, for a range of values of the number of trials, the estimated weighting patterns are closer to their asymptotic values for the correlation method than for the MLR method. Moreover, for the MLR method, weight estimates for different stimulus components can exhibit strong correlations, making the analysis and interpretation of measured weighting patterns less straightforward than for the correlation method. These and other advantages of the correlation method, which include computational simplicity and a close relationship to other well-established psychophysical reverse-correlation methods, make it an attractive tool to uncover decision strategies in m-Alternative experiments.",
author = "Huanping Dai and Christophe Micheyl",
year = "2012",
month = "11",
doi = "10.1121/1.4754523",
language = "English (US)",
volume = "132",
pages = "3418--3427",
journal = "Journal of the Acoustical Society of America",
issn = "0001-4966",
publisher = "Acoustical Society of America",
number = "5",

}

TY - JOUR

T1 - Measuring decision weights in recognition experiments with multiple response alternatives

T2 - Comparing the correlation and multinomial-logistic- regression methods

AU - Dai, Huanping

AU - Micheyl, Christophe

PY - 2012/11

Y1 - 2012/11

N2 - Psychophysical reverse-correlation methods allow researchers to gain insight into the perceptual representations and decision weighting strategies of individual subjects in perceptual tasks. Although these methods have gained momentum, until recently their development was limited to experiments involving only two response categories. Recently, two approaches for estimating decision weights in m-Alternative experiments have been put forward. One approach extends the two-category correlation method to m > 2 alternatives; the second uses multinomial logistic regression (MLR). In this article, the relative merits of the two methods are discussed, and the issues of convergence and statistical efficiency of the methods are evaluated quantitatively using Monte Carlo simulations. The results indicate that, for a range of values of the number of trials, the estimated weighting patterns are closer to their asymptotic values for the correlation method than for the MLR method. Moreover, for the MLR method, weight estimates for different stimulus components can exhibit strong correlations, making the analysis and interpretation of measured weighting patterns less straightforward than for the correlation method. These and other advantages of the correlation method, which include computational simplicity and a close relationship to other well-established psychophysical reverse-correlation methods, make it an attractive tool to uncover decision strategies in m-Alternative experiments.

AB - Psychophysical reverse-correlation methods allow researchers to gain insight into the perceptual representations and decision weighting strategies of individual subjects in perceptual tasks. Although these methods have gained momentum, until recently their development was limited to experiments involving only two response categories. Recently, two approaches for estimating decision weights in m-Alternative experiments have been put forward. One approach extends the two-category correlation method to m > 2 alternatives; the second uses multinomial logistic regression (MLR). In this article, the relative merits of the two methods are discussed, and the issues of convergence and statistical efficiency of the methods are evaluated quantitatively using Monte Carlo simulations. The results indicate that, for a range of values of the number of trials, the estimated weighting patterns are closer to their asymptotic values for the correlation method than for the MLR method. Moreover, for the MLR method, weight estimates for different stimulus components can exhibit strong correlations, making the analysis and interpretation of measured weighting patterns less straightforward than for the correlation method. These and other advantages of the correlation method, which include computational simplicity and a close relationship to other well-established psychophysical reverse-correlation methods, make it an attractive tool to uncover decision strategies in m-Alternative experiments.

UR - http://www.scopus.com/inward/record.url?scp=84869137945&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84869137945&partnerID=8YFLogxK

U2 - 10.1121/1.4754523

DO - 10.1121/1.4754523

M3 - Article

C2 - 23145622

AN - SCOPUS:84869137945

VL - 132

SP - 3418

EP - 3427

JO - Journal of the Acoustical Society of America

JF - Journal of the Acoustical Society of America

SN - 0001-4966

IS - 5

ER -