Auditory-perceptual rating of connected speech in Aphasia

Marianne Casilio, Kindle Rising, Pelagie M Beeson, Kate E Bunton, Stephen M Wilson

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Purpose: Auditory-perceptual assessment, in which trained listeners rate a large number of perceptual features of speech samples, is the gold standard for the differential diagnosis of motor speech disorders. The goal of this study was to investigate the feasibility of applying a similar, formalized auditory-perceptual approach to the assessment of language deficits in connected speech samples from individuals with aphasia. Method: Twenty-seven common features of connected speech in aphasia were defined, each of which was rated on a 5-point scale. Three experienced researchers evaluated 24 connected speech samples from the AphasiaBank database, and 12 student clinicians evaluated subsets of 8 speech samples each. We calculated interrater reliability for each group of raters and investigated the validity of the auditory-perceptual approach by comparing feature ratings to related quantitative measures derived from transcripts and clinical measures, and by examining patterns of feature co-occurrence. Results: Most features were rated with good-to-excellent interrater reliability by researchers and student clinicians. Most features demonstrated strong concurrent validity with respect to quantitative connected speech measures computed from AphasiaBank transcripts and/or clinical aphasia battery subscores. Factor analysis showed that 4 underlying factors, which we labeled Paraphasia, Logopenia, Agrammatism, and Motor Speech, accounted for 79% of the variance in connected speech profiles. Examination of individual patients’ factor scores revealed striking diversity among individuals classified with a given aphasia type. Conclusion: Auditory-perceptual rating of connected speech in aphasia shows potential to be a comprehensive, efficient, reliable, and valid approach for characterizing connected speech in aphasia.

Original languageEnglish (US)
Pages (from-to)550-568
Number of pages19
JournalAmerican journal of speech-language pathology
Volume28
Issue number2
DOIs
StatePublished - May 1 2019

Fingerprint

Aphasia
speech disorder
rating
Research Personnel
Broca Aphasia
Students
Speech Disorders
gold standard
listener
Statistical Factor Analysis
factor analysis
deficit
Differential Diagnosis
Language
student
Databases
examination

ASJC Scopus subject areas

  • Otorhinolaryngology
  • Developmental and Educational Psychology
  • Linguistics and Language
  • Speech and Hearing

Cite this

Auditory-perceptual rating of connected speech in Aphasia. / Casilio, Marianne; Rising, Kindle; Beeson, Pelagie M; Bunton, Kate E; Wilson, Stephen M.

In: American journal of speech-language pathology, Vol. 28, No. 2, 01.05.2019, p. 550-568.

Research output: Contribution to journalArticle

@article{d028f176ccf340c5a1935c0ac4b84389,
title = "Auditory-perceptual rating of connected speech in Aphasia",
abstract = "Purpose: Auditory-perceptual assessment, in which trained listeners rate a large number of perceptual features of speech samples, is the gold standard for the differential diagnosis of motor speech disorders. The goal of this study was to investigate the feasibility of applying a similar, formalized auditory-perceptual approach to the assessment of language deficits in connected speech samples from individuals with aphasia. Method: Twenty-seven common features of connected speech in aphasia were defined, each of which was rated on a 5-point scale. Three experienced researchers evaluated 24 connected speech samples from the AphasiaBank database, and 12 student clinicians evaluated subsets of 8 speech samples each. We calculated interrater reliability for each group of raters and investigated the validity of the auditory-perceptual approach by comparing feature ratings to related quantitative measures derived from transcripts and clinical measures, and by examining patterns of feature co-occurrence. Results: Most features were rated with good-to-excellent interrater reliability by researchers and student clinicians. Most features demonstrated strong concurrent validity with respect to quantitative connected speech measures computed from AphasiaBank transcripts and/or clinical aphasia battery subscores. Factor analysis showed that 4 underlying factors, which we labeled Paraphasia, Logopenia, Agrammatism, and Motor Speech, accounted for 79{\%} of the variance in connected speech profiles. Examination of individual patients’ factor scores revealed striking diversity among individuals classified with a given aphasia type. Conclusion: Auditory-perceptual rating of connected speech in aphasia shows potential to be a comprehensive, efficient, reliable, and valid approach for characterizing connected speech in aphasia.",
author = "Marianne Casilio and Kindle Rising and Beeson, {Pelagie M} and Bunton, {Kate E} and Wilson, {Stephen M}",
year = "2019",
month = "5",
day = "1",
doi = "10.1044/2018_AJSLP-18-0192",
language = "English (US)",
volume = "28",
pages = "550--568",
journal = "American Journal of Speech-Language Pathology",
issn = "1058-0360",
publisher = "American Speech-Language-Hearing Association (ASHA)",
number = "2",

}

TY - JOUR

T1 - Auditory-perceptual rating of connected speech in Aphasia

AU - Casilio, Marianne

AU - Rising, Kindle

AU - Beeson, Pelagie M

AU - Bunton, Kate E

AU - Wilson, Stephen M

PY - 2019/5/1

Y1 - 2019/5/1

N2 - Purpose: Auditory-perceptual assessment, in which trained listeners rate a large number of perceptual features of speech samples, is the gold standard for the differential diagnosis of motor speech disorders. The goal of this study was to investigate the feasibility of applying a similar, formalized auditory-perceptual approach to the assessment of language deficits in connected speech samples from individuals with aphasia. Method: Twenty-seven common features of connected speech in aphasia were defined, each of which was rated on a 5-point scale. Three experienced researchers evaluated 24 connected speech samples from the AphasiaBank database, and 12 student clinicians evaluated subsets of 8 speech samples each. We calculated interrater reliability for each group of raters and investigated the validity of the auditory-perceptual approach by comparing feature ratings to related quantitative measures derived from transcripts and clinical measures, and by examining patterns of feature co-occurrence. Results: Most features were rated with good-to-excellent interrater reliability by researchers and student clinicians. Most features demonstrated strong concurrent validity with respect to quantitative connected speech measures computed from AphasiaBank transcripts and/or clinical aphasia battery subscores. Factor analysis showed that 4 underlying factors, which we labeled Paraphasia, Logopenia, Agrammatism, and Motor Speech, accounted for 79% of the variance in connected speech profiles. Examination of individual patients’ factor scores revealed striking diversity among individuals classified with a given aphasia type. Conclusion: Auditory-perceptual rating of connected speech in aphasia shows potential to be a comprehensive, efficient, reliable, and valid approach for characterizing connected speech in aphasia.

AB - Purpose: Auditory-perceptual assessment, in which trained listeners rate a large number of perceptual features of speech samples, is the gold standard for the differential diagnosis of motor speech disorders. The goal of this study was to investigate the feasibility of applying a similar, formalized auditory-perceptual approach to the assessment of language deficits in connected speech samples from individuals with aphasia. Method: Twenty-seven common features of connected speech in aphasia were defined, each of which was rated on a 5-point scale. Three experienced researchers evaluated 24 connected speech samples from the AphasiaBank database, and 12 student clinicians evaluated subsets of 8 speech samples each. We calculated interrater reliability for each group of raters and investigated the validity of the auditory-perceptual approach by comparing feature ratings to related quantitative measures derived from transcripts and clinical measures, and by examining patterns of feature co-occurrence. Results: Most features were rated with good-to-excellent interrater reliability by researchers and student clinicians. Most features demonstrated strong concurrent validity with respect to quantitative connected speech measures computed from AphasiaBank transcripts and/or clinical aphasia battery subscores. Factor analysis showed that 4 underlying factors, which we labeled Paraphasia, Logopenia, Agrammatism, and Motor Speech, accounted for 79% of the variance in connected speech profiles. Examination of individual patients’ factor scores revealed striking diversity among individuals classified with a given aphasia type. Conclusion: Auditory-perceptual rating of connected speech in aphasia shows potential to be a comprehensive, efficient, reliable, and valid approach for characterizing connected speech in aphasia.

UR - http://www.scopus.com/inward/record.url?scp=85067299736&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85067299736&partnerID=8YFLogxK

U2 - 10.1044/2018_AJSLP-18-0192

DO - 10.1044/2018_AJSLP-18-0192

M3 - Article

VL - 28

SP - 550

EP - 568

JO - American Journal of Speech-Language Pathology

JF - American Journal of Speech-Language Pathology

SN - 1058-0360

IS - 2

ER -