Multisensory integration with a head-mounted display: background visual motion and sound motion.

Citation:

Harrison, W.J., Thompson, M.B. & Sanderson, P.M. Multisensory integration with a head-mounted display: background visual motion and sound motion. Human factors 52, 78–91 (2010). Copy at https://j.mp/2nArd0T

Abstract:

{OBJECTIVE:The aim of this study was to assess how background visual motion and the relative movement of sound affect a head-mounted display (HMD) wearer's performance at a task requiring integration of auditory and visual information. BACKGROUND:HMD users are often mobile. A commercially available speaker in a fixed location delivers auditory information affordably to the HMD user. However, previous research has shown that mobile HMD users perform poorly at tasks that require integration of visual and auditory information when sound comes from a free-field speaker. The specific cause of the poor task performance is unknown. METHOD:Participants counted audiovisual events that required integration of sounds delivered via a free-field speaker and vision on an HMD. Participants completed the task while either walking around a room, sitting in the room, or sitting inside a mobile room that allowed separate manipulation of background visual motion and speaker motion. RESULTS:Participants' accuracy at counting target audiovisual events was worse when participants were walking than when sitting at a desk

Website

Last updated on 04/12/2013