Narrative transcription accuracy and reliability in two languages

John Heilmann, Jon F. Miller, Aquiles Iglesias, Leah C Fabiano-Smith, Ann Nockerts, Karen Digney Andriacchi

Research output: Contribution to journalArticle

42 Citations (Scopus)

Abstract

Recent research documents the power of oral narrative language samples to predict reading achievement in both Spanish and English in English language learners (ELLs; J. ). To document their clinical utility, this article addresses issues of accuracy and reliability for transcription and analysis of oral narratives elicited from Spanishĝ€"English bilingual children. We first reviewed the unique considerations that must be made when transcribing narratives elicited from ELLs. To demonstrate that narrative transcription is clinically feasible, we documented that a single clinician can accurately transcribe children's oral narratives and that the measures acquired from these samples are reliable. Forty oral narratives were first transcribed by a single transcriber, and then checked and retranscribed by additional transcribers. High levels of accuracy and agreement between transcribers were observed across both the English and the Spanish transcripts. Testĝ€"retest reliability was documented for 241 transcripts produced by the ELL children. Significant correlations were observed between Time 1 and Time 2 for 4 narrative measures. These data demonstrate that oral narrative data from ELL children can be accurately transcribed and the narrative measures are stable over time, providing the research foundation for clinical use of narrative language samples.

Original languageEnglish (US)
Pages (from-to)178-188
Number of pages11
JournalTopics in Language Disorders
Volume28
Issue number2
DOIs
StatePublished - Apr 2008
Externally publishedYes

Fingerprint

Language
narrative
language
Research
Reproducibility of Results
Reading
Oral Narrative
Transcription
English language
Narrative Language
time

Keywords

  • Bilingual
  • Language sample analysis
  • Measurement properties
  • Narrative
  • Reliability

ASJC Scopus subject areas

  • Rehabilitation
  • Health Professions(all)
  • Language and Linguistics

Cite this

Narrative transcription accuracy and reliability in two languages. / Heilmann, John; Miller, Jon F.; Iglesias, Aquiles; Fabiano-Smith, Leah C; Nockerts, Ann; Andriacchi, Karen Digney.

In: Topics in Language Disorders, Vol. 28, No. 2, 04.2008, p. 178-188.

Research output: Contribution to journalArticle

Heilmann, J, Miller, JF, Iglesias, A, Fabiano-Smith, LC, Nockerts, A & Andriacchi, KD 2008, 'Narrative transcription accuracy and reliability in two languages', Topics in Language Disorders, vol. 28, no. 2, pp. 178-188. https://doi.org/10.1097/01.TLD.0000318937.39301.76
Heilmann, John ; Miller, Jon F. ; Iglesias, Aquiles ; Fabiano-Smith, Leah C ; Nockerts, Ann ; Andriacchi, Karen Digney. / Narrative transcription accuracy and reliability in two languages. In: Topics in Language Disorders. 2008 ; Vol. 28, No. 2. pp. 178-188.
@article{4317f16897e040198df6c1f3ed11008e,
title = "Narrative transcription accuracy and reliability in two languages",
abstract = "Recent research documents the power of oral narrative language samples to predict reading achievement in both Spanish and English in English language learners (ELLs; J. ). To document their clinical utility, this article addresses issues of accuracy and reliability for transcription and analysis of oral narratives elicited from Spanishĝ€{"}English bilingual children. We first reviewed the unique considerations that must be made when transcribing narratives elicited from ELLs. To demonstrate that narrative transcription is clinically feasible, we documented that a single clinician can accurately transcribe children's oral narratives and that the measures acquired from these samples are reliable. Forty oral narratives were first transcribed by a single transcriber, and then checked and retranscribed by additional transcribers. High levels of accuracy and agreement between transcribers were observed across both the English and the Spanish transcripts. Testĝ€{"}retest reliability was documented for 241 transcripts produced by the ELL children. Significant correlations were observed between Time 1 and Time 2 for 4 narrative measures. These data demonstrate that oral narrative data from ELL children can be accurately transcribed and the narrative measures are stable over time, providing the research foundation for clinical use of narrative language samples.",
keywords = "Bilingual, Language sample analysis, Measurement properties, Narrative, Reliability",
author = "John Heilmann and Miller, {Jon F.} and Aquiles Iglesias and Fabiano-Smith, {Leah C} and Ann Nockerts and Andriacchi, {Karen Digney}",
year = "2008",
month = "4",
doi = "10.1097/01.TLD.0000318937.39301.76",
language = "English (US)",
volume = "28",
pages = "178--188",
journal = "Topics in Language Disorders",
issn = "0271-8294",
publisher = "Lippincott Williams and Wilkins",
number = "2",

}

TY - JOUR

T1 - Narrative transcription accuracy and reliability in two languages

AU - Heilmann, John

AU - Miller, Jon F.

AU - Iglesias, Aquiles

AU - Fabiano-Smith, Leah C

AU - Nockerts, Ann

AU - Andriacchi, Karen Digney

PY - 2008/4

Y1 - 2008/4

N2 - Recent research documents the power of oral narrative language samples to predict reading achievement in both Spanish and English in English language learners (ELLs; J. ). To document their clinical utility, this article addresses issues of accuracy and reliability for transcription and analysis of oral narratives elicited from Spanishĝ€"English bilingual children. We first reviewed the unique considerations that must be made when transcribing narratives elicited from ELLs. To demonstrate that narrative transcription is clinically feasible, we documented that a single clinician can accurately transcribe children's oral narratives and that the measures acquired from these samples are reliable. Forty oral narratives were first transcribed by a single transcriber, and then checked and retranscribed by additional transcribers. High levels of accuracy and agreement between transcribers were observed across both the English and the Spanish transcripts. Testĝ€"retest reliability was documented for 241 transcripts produced by the ELL children. Significant correlations were observed between Time 1 and Time 2 for 4 narrative measures. These data demonstrate that oral narrative data from ELL children can be accurately transcribed and the narrative measures are stable over time, providing the research foundation for clinical use of narrative language samples.

AB - Recent research documents the power of oral narrative language samples to predict reading achievement in both Spanish and English in English language learners (ELLs; J. ). To document their clinical utility, this article addresses issues of accuracy and reliability for transcription and analysis of oral narratives elicited from Spanishĝ€"English bilingual children. We first reviewed the unique considerations that must be made when transcribing narratives elicited from ELLs. To demonstrate that narrative transcription is clinically feasible, we documented that a single clinician can accurately transcribe children's oral narratives and that the measures acquired from these samples are reliable. Forty oral narratives were first transcribed by a single transcriber, and then checked and retranscribed by additional transcribers. High levels of accuracy and agreement between transcribers were observed across both the English and the Spanish transcripts. Testĝ€"retest reliability was documented for 241 transcripts produced by the ELL children. Significant correlations were observed between Time 1 and Time 2 for 4 narrative measures. These data demonstrate that oral narrative data from ELL children can be accurately transcribed and the narrative measures are stable over time, providing the research foundation for clinical use of narrative language samples.

KW - Bilingual

KW - Language sample analysis

KW - Measurement properties

KW - Narrative

KW - Reliability

UR - http://www.scopus.com/inward/record.url?scp=44349096260&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=44349096260&partnerID=8YFLogxK

U2 - 10.1097/01.TLD.0000318937.39301.76

DO - 10.1097/01.TLD.0000318937.39301.76

M3 - Article

AN - SCOPUS:44349096260

VL - 28

SP - 178

EP - 188

JO - Topics in Language Disorders

JF - Topics in Language Disorders

SN - 0271-8294

IS - 2

ER -