Auditory and visual scene analysis: an overview

Hirohito M Kondo, Anouk M van Loon, Jun-Ichiro Kawahara, Brian C J Moore

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

We perceive the world as stable and composed of discrete objects even though auditory and visual inputs are often ambiguous owing to spatial and temporal occluders and changes in the conditions of observation. This raises important questions regarding where and how 'scene analysis' is performed in the brain. Recent advances from both auditory and visual research suggest that the brain does not simply process the incoming scene properties. Rather, top-down processes such as attention, expectations and prior knowledge facilitate scene perception. Thus, scene analysis is linked not only with the extraction of stimulus features and formation and selection of perceptual objects, but also with selective attention, perceptual binding and awareness. This special issue covers novel advances in scene-analysis research obtained using a combination of psychophysics, computational modelling, neuroimaging and neurophysiology, and presents new empirical and theoretical approaches. For integrative understanding of scene analysis beyond and across sensory modalities, we provide a collection of 15 articles that enable comparison and integration of recent findings in auditory and visual scene analysis.This article is part of the themed issue 'Auditory and visual scene analysis'.

Original languageEnglish
JournalPhilosophical Transactions of the Royal Society B. Biological Sciences
Volume372
Issue number1714
DOIs
Publication statusPublished - 19 Feb 2017

Fingerprint

Brain
Neurophysiology
Psychophysics
Neuroimaging
brain
neurophysiology
Research
Observation
psychophysics

Keywords

  • Journal Article

Cite this

Kondo, Hirohito M ; van Loon, Anouk M ; Kawahara, Jun-Ichiro ; Moore, Brian C J. / Auditory and visual scene analysis : an overview. In: Philosophical Transactions of the Royal Society B. Biological Sciences. 2017 ; Vol. 372, No. 1714.
@article{8daf98b3267146a8947fb93fa24d1cd2,
title = "Auditory and visual scene analysis: an overview",
abstract = "We perceive the world as stable and composed of discrete objects even though auditory and visual inputs are often ambiguous owing to spatial and temporal occluders and changes in the conditions of observation. This raises important questions regarding where and how 'scene analysis' is performed in the brain. Recent advances from both auditory and visual research suggest that the brain does not simply process the incoming scene properties. Rather, top-down processes such as attention, expectations and prior knowledge facilitate scene perception. Thus, scene analysis is linked not only with the extraction of stimulus features and formation and selection of perceptual objects, but also with selective attention, perceptual binding and awareness. This special issue covers novel advances in scene-analysis research obtained using a combination of psychophysics, computational modelling, neuroimaging and neurophysiology, and presents new empirical and theoretical approaches. For integrative understanding of scene analysis beyond and across sensory modalities, we provide a collection of 15 articles that enable comparison and integration of recent findings in auditory and visual scene analysis.This article is part of the themed issue 'Auditory and visual scene analysis'.",
keywords = "Journal Article",
author = "Kondo, {Hirohito M} and {van Loon}, {Anouk M} and Jun-Ichiro Kawahara and Moore, {Brian C J}",
note = "{\circledC} 2017 The Author(s).",
year = "2017",
month = "2",
day = "19",
doi = "10.1098/rstb.2016.0099",
language = "English",
volume = "372",
journal = "Philosophical Transactions of the Royal Society B. Biological Sciences",
issn = "0962-8436",
publisher = "Royal Society of London",
number = "1714",

}

Auditory and visual scene analysis : an overview. / Kondo, Hirohito M; van Loon, Anouk M; Kawahara, Jun-Ichiro; Moore, Brian C J.

In: Philosophical Transactions of the Royal Society B. Biological Sciences, Vol. 372, No. 1714, 19.02.2017.

Research output: Contribution to JournalArticleAcademicpeer-review

TY - JOUR

T1 - Auditory and visual scene analysis

T2 - an overview

AU - Kondo, Hirohito M

AU - van Loon, Anouk M

AU - Kawahara, Jun-Ichiro

AU - Moore, Brian C J

N1 - © 2017 The Author(s).

PY - 2017/2/19

Y1 - 2017/2/19

N2 - We perceive the world as stable and composed of discrete objects even though auditory and visual inputs are often ambiguous owing to spatial and temporal occluders and changes in the conditions of observation. This raises important questions regarding where and how 'scene analysis' is performed in the brain. Recent advances from both auditory and visual research suggest that the brain does not simply process the incoming scene properties. Rather, top-down processes such as attention, expectations and prior knowledge facilitate scene perception. Thus, scene analysis is linked not only with the extraction of stimulus features and formation and selection of perceptual objects, but also with selective attention, perceptual binding and awareness. This special issue covers novel advances in scene-analysis research obtained using a combination of psychophysics, computational modelling, neuroimaging and neurophysiology, and presents new empirical and theoretical approaches. For integrative understanding of scene analysis beyond and across sensory modalities, we provide a collection of 15 articles that enable comparison and integration of recent findings in auditory and visual scene analysis.This article is part of the themed issue 'Auditory and visual scene analysis'.

AB - We perceive the world as stable and composed of discrete objects even though auditory and visual inputs are often ambiguous owing to spatial and temporal occluders and changes in the conditions of observation. This raises important questions regarding where and how 'scene analysis' is performed in the brain. Recent advances from both auditory and visual research suggest that the brain does not simply process the incoming scene properties. Rather, top-down processes such as attention, expectations and prior knowledge facilitate scene perception. Thus, scene analysis is linked not only with the extraction of stimulus features and formation and selection of perceptual objects, but also with selective attention, perceptual binding and awareness. This special issue covers novel advances in scene-analysis research obtained using a combination of psychophysics, computational modelling, neuroimaging and neurophysiology, and presents new empirical and theoretical approaches. For integrative understanding of scene analysis beyond and across sensory modalities, we provide a collection of 15 articles that enable comparison and integration of recent findings in auditory and visual scene analysis.This article is part of the themed issue 'Auditory and visual scene analysis'.

KW - Journal Article

U2 - 10.1098/rstb.2016.0099

DO - 10.1098/rstb.2016.0099

M3 - Article

VL - 372

JO - Philosophical Transactions of the Royal Society B. Biological Sciences

JF - Philosophical Transactions of the Royal Society B. Biological Sciences

SN - 0962-8436

IS - 1714

ER -