Acoustic cues to place of articulation and the McGurk effect: The role of release bursts, aspiration, and formant transitions

Kerry P. Green, Linda W Norrix

Research output: Contribution to journalArticle

25 Citations (Scopus)

Abstract

The McGurk effect demonstrates that the perceived place of articulation of an auditory consonant (such as /bi/) can be influenced by the simultaneous presentation of a videotape of a talker saying a conflicting consonant such as /gi/. Usually, such a presentation is perceived by observers as 'di' or 'δi' (known as fusion responses). The reverse pairing (auditory /gi/ paired with a visual /bi/) results in 'bgi' percepts. These are known as combination responses. In the current study, three experiments examined how acoustic information about place of articulation contained within the release bursts, aspiration, and voiced formants and transitions of a consonant contribute to the McGurk effect. In the first experiment, the release bursts and aspiration were deleted from the acoustic signal. This manipulation resulted in a smaller impact on McGurk 'fusion' tokens relative to the McGurk 'combination' tokens. This asymmetry may be related to the perceptual salience of the release bursts and aspiration for velar compared to the bilabial tokens used in this experiment and their importance for obtaining the combination percept. In Experiment 2, the release bursts and aspiration were increased in amplitude. Results revealed either no effect or a stronger. McGurk effect for the manipulated tokens than for the intact tokens. This finding suggests that the McGurk effect for fusion tokens does not occur simply because the release bursts and aspiration are weak. In Experiment 3, low-pass filtering the second and higher formants and transitions was associated with the largest overall impact on the McGurk effect. This suggests that dynamic information contained within these formants is of primary importance in obtaining the McGurk effect. These cues are, however, context-dependent and vary as a function of talker and vowel context.

Original languageEnglish (US)
Pages (from-to)646-665
Number of pages20
JournalJournal of Speech, Language, and Hearing Research
Volume40
Issue number3
StatePublished - Jun 1997

Fingerprint

Acoustics
acoustics
Cues
experiment
Videotape Recording
Aspirations (Psychology)
Aspiration
McGurk Effect
Acoustic Cues
Formants
Place of Articulation
asymmetry
manipulation
Experiment
Consonant
Fusion

Keywords

  • Auditory/visual speech
  • McGurk effect
  • Place of articulation

ASJC Scopus subject areas

  • Rehabilitation
  • Health Professions(all)
  • Linguistics and Language

Cite this

@article{4c179c919a7b43ed8033f4c4b1a298c0,
title = "Acoustic cues to place of articulation and the McGurk effect: The role of release bursts, aspiration, and formant transitions",
abstract = "The McGurk effect demonstrates that the perceived place of articulation of an auditory consonant (such as /bi/) can be influenced by the simultaneous presentation of a videotape of a talker saying a conflicting consonant such as /gi/. Usually, such a presentation is perceived by observers as 'di' or 'δi' (known as fusion responses). The reverse pairing (auditory /gi/ paired with a visual /bi/) results in 'bgi' percepts. These are known as combination responses. In the current study, three experiments examined how acoustic information about place of articulation contained within the release bursts, aspiration, and voiced formants and transitions of a consonant contribute to the McGurk effect. In the first experiment, the release bursts and aspiration were deleted from the acoustic signal. This manipulation resulted in a smaller impact on McGurk 'fusion' tokens relative to the McGurk 'combination' tokens. This asymmetry may be related to the perceptual salience of the release bursts and aspiration for velar compared to the bilabial tokens used in this experiment and their importance for obtaining the combination percept. In Experiment 2, the release bursts and aspiration were increased in amplitude. Results revealed either no effect or a stronger. McGurk effect for the manipulated tokens than for the intact tokens. This finding suggests that the McGurk effect for fusion tokens does not occur simply because the release bursts and aspiration are weak. In Experiment 3, low-pass filtering the second and higher formants and transitions was associated with the largest overall impact on the McGurk effect. This suggests that dynamic information contained within these formants is of primary importance in obtaining the McGurk effect. These cues are, however, context-dependent and vary as a function of talker and vowel context.",
keywords = "Auditory/visual speech, McGurk effect, Place of articulation",
author = "Green, {Kerry P.} and Norrix, {Linda W}",
year = "1997",
month = "6",
language = "English (US)",
volume = "40",
pages = "646--665",
journal = "Journal of Speech, Language, and Hearing Research",
issn = "1092-4388",
publisher = "American Speech-Language-Hearing Association (ASHA)",
number = "3",

}

TY - JOUR

T1 - Acoustic cues to place of articulation and the McGurk effect

T2 - The role of release bursts, aspiration, and formant transitions

AU - Green, Kerry P.

AU - Norrix, Linda W

PY - 1997/6

Y1 - 1997/6

N2 - The McGurk effect demonstrates that the perceived place of articulation of an auditory consonant (such as /bi/) can be influenced by the simultaneous presentation of a videotape of a talker saying a conflicting consonant such as /gi/. Usually, such a presentation is perceived by observers as 'di' or 'δi' (known as fusion responses). The reverse pairing (auditory /gi/ paired with a visual /bi/) results in 'bgi' percepts. These are known as combination responses. In the current study, three experiments examined how acoustic information about place of articulation contained within the release bursts, aspiration, and voiced formants and transitions of a consonant contribute to the McGurk effect. In the first experiment, the release bursts and aspiration were deleted from the acoustic signal. This manipulation resulted in a smaller impact on McGurk 'fusion' tokens relative to the McGurk 'combination' tokens. This asymmetry may be related to the perceptual salience of the release bursts and aspiration for velar compared to the bilabial tokens used in this experiment and their importance for obtaining the combination percept. In Experiment 2, the release bursts and aspiration were increased in amplitude. Results revealed either no effect or a stronger. McGurk effect for the manipulated tokens than for the intact tokens. This finding suggests that the McGurk effect for fusion tokens does not occur simply because the release bursts and aspiration are weak. In Experiment 3, low-pass filtering the second and higher formants and transitions was associated with the largest overall impact on the McGurk effect. This suggests that dynamic information contained within these formants is of primary importance in obtaining the McGurk effect. These cues are, however, context-dependent and vary as a function of talker and vowel context.

AB - The McGurk effect demonstrates that the perceived place of articulation of an auditory consonant (such as /bi/) can be influenced by the simultaneous presentation of a videotape of a talker saying a conflicting consonant such as /gi/. Usually, such a presentation is perceived by observers as 'di' or 'δi' (known as fusion responses). The reverse pairing (auditory /gi/ paired with a visual /bi/) results in 'bgi' percepts. These are known as combination responses. In the current study, three experiments examined how acoustic information about place of articulation contained within the release bursts, aspiration, and voiced formants and transitions of a consonant contribute to the McGurk effect. In the first experiment, the release bursts and aspiration were deleted from the acoustic signal. This manipulation resulted in a smaller impact on McGurk 'fusion' tokens relative to the McGurk 'combination' tokens. This asymmetry may be related to the perceptual salience of the release bursts and aspiration for velar compared to the bilabial tokens used in this experiment and their importance for obtaining the combination percept. In Experiment 2, the release bursts and aspiration were increased in amplitude. Results revealed either no effect or a stronger. McGurk effect for the manipulated tokens than for the intact tokens. This finding suggests that the McGurk effect for fusion tokens does not occur simply because the release bursts and aspiration are weak. In Experiment 3, low-pass filtering the second and higher formants and transitions was associated with the largest overall impact on the McGurk effect. This suggests that dynamic information contained within these formants is of primary importance in obtaining the McGurk effect. These cues are, however, context-dependent and vary as a function of talker and vowel context.

KW - Auditory/visual speech

KW - McGurk effect

KW - Place of articulation

UR - http://www.scopus.com/inward/record.url?scp=0030835529&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0030835529&partnerID=8YFLogxK

M3 - Article

C2 - 9210121

AN - SCOPUS:0030835529

VL - 40

SP - 646

EP - 665

JO - Journal of Speech, Language, and Hearing Research

JF - Journal of Speech, Language, and Hearing Research

SN - 1092-4388

IS - 3

ER -