Rapid recalibration to audiovisual asynchrony follows the physical—not the perceived—temporal order

Erik Van der Burg, David Alais, John Cass

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

In natural scenes, audiovisual events deriving from the same source are synchronized at their origin. However, from the perspective of the observer, there are likely to be significant multisensory delays due to physical and neural latencies. Fortunately, our brain appears to compensate for the resulting latency differences by rapidly adapting to asynchronous audiovisual events by shifting the point of subjective synchrony (PSS) in the direction of the leading modality of the most recent event. Here we examined whether it is the perceived modality order of this prior lag or its physical order that determines the direction of the subsequent rapid recalibration. On each experimental trial, a brief tone pip and flash were presented across a range of stimulus onset asynchronies (SOAs). The participants’ task alternated over trials: On adaptor trials, audition either led or lagged vision with fixed SOAs, and participants judged the order of the audiovisual event; on test trials, the SOA as well as the modality order varied randomly, and participants judged whether or not the event was synchronized. For test trials, we showed that the PSS shifted in the direction of the physical rather than the perceived (reported) modality order of the preceding adaptor trial. These results suggest that rapid temporal recalibration is determined by the physical timing of the preceding events, not by one’s prior perceptual decisions.

LanguageEnglish
Pages2060-2068
Number of pages9
JournalAttention, Perception, and Psychophysics
Volume80
Issue number8
Early online date2 Jul 2018
DOIs
Publication statusPublished - Nov 2018

Fingerprint

event
stimulus
Hearing
Brain
Direction compound
Physical
brain
Modality
Onset
Stimulus
Latency
Synchrony

Keywords

  • Audition
  • Awareness
  • Multisensory processing
  • Temporal order
  • Temporal recalibration
  • Vision

Cite this

@article{294a274db18042ec91fee0ffcc415b12,
title = "Rapid recalibration to audiovisual asynchrony follows the physical—not the perceived—temporal order",
abstract = "In natural scenes, audiovisual events deriving from the same source are synchronized at their origin. However, from the perspective of the observer, there are likely to be significant multisensory delays due to physical and neural latencies. Fortunately, our brain appears to compensate for the resulting latency differences by rapidly adapting to asynchronous audiovisual events by shifting the point of subjective synchrony (PSS) in the direction of the leading modality of the most recent event. Here we examined whether it is the perceived modality order of this prior lag or its physical order that determines the direction of the subsequent rapid recalibration. On each experimental trial, a brief tone pip and flash were presented across a range of stimulus onset asynchronies (SOAs). The participants’ task alternated over trials: On adaptor trials, audition either led or lagged vision with fixed SOAs, and participants judged the order of the audiovisual event; on test trials, the SOA as well as the modality order varied randomly, and participants judged whether or not the event was synchronized. For test trials, we showed that the PSS shifted in the direction of the physical rather than the perceived (reported) modality order of the preceding adaptor trial. These results suggest that rapid temporal recalibration is determined by the physical timing of the preceding events, not by one’s prior perceptual decisions.",
keywords = "Audition, Awareness, Multisensory processing, Temporal order, Temporal recalibration, Vision",
author = "{Van der Burg}, Erik and David Alais and John Cass",
year = "2018",
month = "11",
doi = "10.3758/s13414-018-1540-9",
language = "English",
volume = "80",
pages = "2060--2068",
journal = "Attention, Perception & Psychophysics",
issn = "1943-3921",
publisher = "Springer New York",
number = "8",

}

Rapid recalibration to audiovisual asynchrony follows the physical—not the perceived—temporal order. / Van der Burg, Erik; Alais, David; Cass, John.

In: Attention, Perception, and Psychophysics, Vol. 80, No. 8, 11.2018, p. 2060-2068.

Research output: Contribution to JournalArticleAcademicpeer-review

TY - JOUR

T1 - Rapid recalibration to audiovisual asynchrony follows the physical—not the perceived—temporal order

AU - Van der Burg, Erik

AU - Alais, David

AU - Cass, John

PY - 2018/11

Y1 - 2018/11

N2 - In natural scenes, audiovisual events deriving from the same source are synchronized at their origin. However, from the perspective of the observer, there are likely to be significant multisensory delays due to physical and neural latencies. Fortunately, our brain appears to compensate for the resulting latency differences by rapidly adapting to asynchronous audiovisual events by shifting the point of subjective synchrony (PSS) in the direction of the leading modality of the most recent event. Here we examined whether it is the perceived modality order of this prior lag or its physical order that determines the direction of the subsequent rapid recalibration. On each experimental trial, a brief tone pip and flash were presented across a range of stimulus onset asynchronies (SOAs). The participants’ task alternated over trials: On adaptor trials, audition either led or lagged vision with fixed SOAs, and participants judged the order of the audiovisual event; on test trials, the SOA as well as the modality order varied randomly, and participants judged whether or not the event was synchronized. For test trials, we showed that the PSS shifted in the direction of the physical rather than the perceived (reported) modality order of the preceding adaptor trial. These results suggest that rapid temporal recalibration is determined by the physical timing of the preceding events, not by one’s prior perceptual decisions.

AB - In natural scenes, audiovisual events deriving from the same source are synchronized at their origin. However, from the perspective of the observer, there are likely to be significant multisensory delays due to physical and neural latencies. Fortunately, our brain appears to compensate for the resulting latency differences by rapidly adapting to asynchronous audiovisual events by shifting the point of subjective synchrony (PSS) in the direction of the leading modality of the most recent event. Here we examined whether it is the perceived modality order of this prior lag or its physical order that determines the direction of the subsequent rapid recalibration. On each experimental trial, a brief tone pip and flash were presented across a range of stimulus onset asynchronies (SOAs). The participants’ task alternated over trials: On adaptor trials, audition either led or lagged vision with fixed SOAs, and participants judged the order of the audiovisual event; on test trials, the SOA as well as the modality order varied randomly, and participants judged whether or not the event was synchronized. For test trials, we showed that the PSS shifted in the direction of the physical rather than the perceived (reported) modality order of the preceding adaptor trial. These results suggest that rapid temporal recalibration is determined by the physical timing of the preceding events, not by one’s prior perceptual decisions.

KW - Audition

KW - Awareness

KW - Multisensory processing

KW - Temporal order

KW - Temporal recalibration

KW - Vision

UR - http://www.scopus.com/inward/record.url?scp=85049573878&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85049573878&partnerID=8YFLogxK

U2 - 10.3758/s13414-018-1540-9

DO - 10.3758/s13414-018-1540-9

M3 - Article

VL - 80

SP - 2060

EP - 2068

JO - Attention, Perception & Psychophysics

T2 - Attention, Perception & Psychophysics

JF - Attention, Perception & Psychophysics

SN - 1943-3921

IS - 8

ER -