Listener agreement for auditory-perceptual ratings of dysarthria

Kate E Bunton, Raymond D. Kent, Joseph R. Duffy, John C. Rosenbek, Jane F. Kent

Research output: Contribution to journalArticle

58 Citations (Scopus)

Abstract

Purpose: Darley, Aronson, and Brown (1969a, 1969b) detailed methods and results of auditory-perceptual assessment for speakers with dysarthrias of varying etiology. They reported adequate listener reliability for use of the rating system as a tool for differential diagnosis, but several more recent studies have raised concerns about listener reliability using this approach. Method: In the present study, the authors examined intrarater and interrater agreement for perceptual ratings of 47 speakers with various dysarthria types by 2 listener groups (inexperienced and experienced). The entire set of perceptual features proposed by Darley et al. was rated based on a 40-s conversational speech sample. Results: No differences in levels of agreement were found between the listener groups. Agreement was within 1 scale value or better for 67% of the pairwise comparisons. Levels of agreement were lower when the average rating fell in the mid-range of the scale compared with samples that had an average rating near either of the scale endpoints; agreement was above chance level. No significant differences in agreement were found between the perceptual features. Discussion: The levels of listener agreement that were found indicate that auditory-perceptual ratings show promise during clinical assessment for identifying salient features of dysarthria for speakers with various etiologies.

Original languageEnglish (US)
Pages (from-to)1481-1495
Number of pages15
JournalJournal of Speech, Language, and Hearing Research
Volume50
Issue number6
DOIs
StatePublished - Dec 1 2007

Fingerprint

Dysarthria
listener
rating
etiology
Differential Diagnosis
Group
Listeners
Hearing
Rating
Values

Keywords

  • Auditory-perceptual ratings
  • Dysarthria
  • Listener agreement

ASJC Scopus subject areas

  • Rehabilitation
  • Health Professions(all)
  • Linguistics and Language

Cite this

Listener agreement for auditory-perceptual ratings of dysarthria. / Bunton, Kate E; Kent, Raymond D.; Duffy, Joseph R.; Rosenbek, John C.; Kent, Jane F.

In: Journal of Speech, Language, and Hearing Research, Vol. 50, No. 6, 01.12.2007, p. 1481-1495.

Research output: Contribution to journalArticle

Bunton, Kate E ; Kent, Raymond D. ; Duffy, Joseph R. ; Rosenbek, John C. ; Kent, Jane F. / Listener agreement for auditory-perceptual ratings of dysarthria. In: Journal of Speech, Language, and Hearing Research. 2007 ; Vol. 50, No. 6. pp. 1481-1495.
@article{796e4869406f4e5a864d82cb49d63547,
title = "Listener agreement for auditory-perceptual ratings of dysarthria",
abstract = "Purpose: Darley, Aronson, and Brown (1969a, 1969b) detailed methods and results of auditory-perceptual assessment for speakers with dysarthrias of varying etiology. They reported adequate listener reliability for use of the rating system as a tool for differential diagnosis, but several more recent studies have raised concerns about listener reliability using this approach. Method: In the present study, the authors examined intrarater and interrater agreement for perceptual ratings of 47 speakers with various dysarthria types by 2 listener groups (inexperienced and experienced). The entire set of perceptual features proposed by Darley et al. was rated based on a 40-s conversational speech sample. Results: No differences in levels of agreement were found between the listener groups. Agreement was within 1 scale value or better for 67{\%} of the pairwise comparisons. Levels of agreement were lower when the average rating fell in the mid-range of the scale compared with samples that had an average rating near either of the scale endpoints; agreement was above chance level. No significant differences in agreement were found between the perceptual features. Discussion: The levels of listener agreement that were found indicate that auditory-perceptual ratings show promise during clinical assessment for identifying salient features of dysarthria for speakers with various etiologies.",
keywords = "Auditory-perceptual ratings, Dysarthria, Listener agreement",
author = "Bunton, {Kate E} and Kent, {Raymond D.} and Duffy, {Joseph R.} and Rosenbek, {John C.} and Kent, {Jane F.}",
year = "2007",
month = "12",
day = "1",
doi = "10.1044/1092-4388(2007/102)",
language = "English (US)",
volume = "50",
pages = "1481--1495",
journal = "Journal of Speech, Language, and Hearing Research",
issn = "1092-4388",
publisher = "American Speech-Language-Hearing Association (ASHA)",
number = "6",

}

TY - JOUR

T1 - Listener agreement for auditory-perceptual ratings of dysarthria

AU - Bunton, Kate E

AU - Kent, Raymond D.

AU - Duffy, Joseph R.

AU - Rosenbek, John C.

AU - Kent, Jane F.

PY - 2007/12/1

Y1 - 2007/12/1

N2 - Purpose: Darley, Aronson, and Brown (1969a, 1969b) detailed methods and results of auditory-perceptual assessment for speakers with dysarthrias of varying etiology. They reported adequate listener reliability for use of the rating system as a tool for differential diagnosis, but several more recent studies have raised concerns about listener reliability using this approach. Method: In the present study, the authors examined intrarater and interrater agreement for perceptual ratings of 47 speakers with various dysarthria types by 2 listener groups (inexperienced and experienced). The entire set of perceptual features proposed by Darley et al. was rated based on a 40-s conversational speech sample. Results: No differences in levels of agreement were found between the listener groups. Agreement was within 1 scale value or better for 67% of the pairwise comparisons. Levels of agreement were lower when the average rating fell in the mid-range of the scale compared with samples that had an average rating near either of the scale endpoints; agreement was above chance level. No significant differences in agreement were found between the perceptual features. Discussion: The levels of listener agreement that were found indicate that auditory-perceptual ratings show promise during clinical assessment for identifying salient features of dysarthria for speakers with various etiologies.

AB - Purpose: Darley, Aronson, and Brown (1969a, 1969b) detailed methods and results of auditory-perceptual assessment for speakers with dysarthrias of varying etiology. They reported adequate listener reliability for use of the rating system as a tool for differential diagnosis, but several more recent studies have raised concerns about listener reliability using this approach. Method: In the present study, the authors examined intrarater and interrater agreement for perceptual ratings of 47 speakers with various dysarthria types by 2 listener groups (inexperienced and experienced). The entire set of perceptual features proposed by Darley et al. was rated based on a 40-s conversational speech sample. Results: No differences in levels of agreement were found between the listener groups. Agreement was within 1 scale value or better for 67% of the pairwise comparisons. Levels of agreement were lower when the average rating fell in the mid-range of the scale compared with samples that had an average rating near either of the scale endpoints; agreement was above chance level. No significant differences in agreement were found between the perceptual features. Discussion: The levels of listener agreement that were found indicate that auditory-perceptual ratings show promise during clinical assessment for identifying salient features of dysarthria for speakers with various etiologies.

KW - Auditory-perceptual ratings

KW - Dysarthria

KW - Listener agreement

UR - http://www.scopus.com/inward/record.url?scp=36749089473&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=36749089473&partnerID=8YFLogxK

U2 - 10.1044/1092-4388(2007/102)

DO - 10.1044/1092-4388(2007/102)

M3 - Article

C2 - 18055769

AN - SCOPUS:36749089473

VL - 50

SP - 1481

EP - 1495

JO - Journal of Speech, Language, and Hearing Research

JF - Journal of Speech, Language, and Hearing Research

SN - 1092-4388

IS - 6

ER -