Direct eye gaze enhances the ventriloquism effect

Journal article


Lavan, N., Chan, Wing Yue, Zhuang, Yongping, Mareschal, Isabelle and Shergill, Sukhwinder S. 2022. Direct eye gaze enhances the ventriloquism effect. Attention, Perception & Psychophysics. https://doi.org/10.3758/s13414-022-02468-5
AuthorsLavan, N., Chan, Wing Yue, Zhuang, Yongping, Mareschal, Isabelle and Shergill, Sukhwinder S.
AbstractThe "ventriloquism effect" describes an illusory phenomenon where the perceived location of an auditory stimulus is pulled toward the location of a visual stimulus. Ventriloquists use this phenomenon to create an illusion where an inanimate puppet is perceived to speak. Ventriloquists use the expression and suppression of their own and the puppet's mouth movements as well the direction of their respective eye gaze to maximize the illusion. While the puppet's often exaggerated mouth movements have been demonstrated to enhance the ventriloquism effect, the contribution of direct eye gaze remains unknown. In Experiment 1, participants viewed an image of a person's face while hearing a temporally synchronous recording of a voice originating from different locations on the azimuthal plane. The eyes of the facial stimuli were either looking directly at participants or were closed. Participants were more likely to misperceive the location of a range of voice locations as coming from a central position when the eye gaze of the facial stimuli were directed toward them. Thus, direct gaze enhances the ventriloquist effect by attracting participants' perception of the voice locations toward the location of the face. In an exploratory analysis, we furthermore found no evidence for an other-race effect between White vs Asian listeners. In Experiment 2, we replicated the effect of direct eye gaze on the ventriloquism effect, also showing that faces per se attract perceived sound locations compared with audio-only sound localization. Showing a modulation of the ventriloquism effect by socially-salient eye gaze information thus adds to previous findings reporting top-down influences on this effect. [Abstract copyright: © 2022. The Author(s).]
KeywordsEye gaze; Sound localization; Voice; Direct gaze; Ventriloquism effect
Year2022
JournalAttention, Perception & Psychophysics
ISSN1943-393X
Digital Object Identifier (DOI)https://doi.org/10.3758/s13414-022-02468-5
Official URLhttps://link.springer.com/content/pdf/10.3758/s13414-022-02468-5.pdf
FunderWellcome Trust
Publication dates
Online31 Mar 2022
Publication process dates
Accepted23 Feb 2022
Deposited20 Apr 2022
Publisher's version
License
Output statusPublished
Permalink -

https://repository.canterbury.ac.uk/item/90y91/direct-eye-gaze-enhances-the-ventriloquism-effect

Download files


Publisher's version
  • 29
    total views
  • 11
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Do loneliness and social exclusion breed paranoia? An experience sampling investigation across the psychosis continuum.
Bell, Victoria, Velthorst, Eva, Almansa, Jorge, Myin-Germeys, Inez, Shergill, Sukhi and Fett, Anne-Kathrin 2023. Do loneliness and social exclusion breed paranoia? An experience sampling investigation across the psychosis continuum. Schizophrenia Research: Cognition. 33, p. 100282. https://doi.org/10.1016/j.scog.2023.100282
Automatic detection of cognitive impairment with virtual reality
Mannan, Farzana A, Porffy, Lilla A, Joyce, Dan W, Shergill, Sukhwinder S and Celiktutan, O. 2023. Automatic detection of cognitive impairment with virtual reality. Sensors. 23 (2), p. 1026. https://doi.org/10.3390/s23021026
Neuroimaging oxytocin modulation of social reward learning in schizophrenia.
Mouchlianitis, Elias D, Tracy, D., Wigton, Rebekah, Vanes, Lucy D, Fett, A. and Shergill, Sukhi S 2022. Neuroimaging oxytocin modulation of social reward learning in schizophrenia. BJPsych Open. 8 (5), p. e175. https://doi.org/10.1192/bjo.2022.577
Cognitive bias modification for paranoia (CBM-pa): a randomised controlled feasibility study in patients with distressing paranoid beliefs.
Yiend, Jenny, Lam, C., Schmidt, Nora, Crane, Bryony, Heslin, Margaret, Kabir, Thomas, McGuire, Philip, Meek, Christopher, Mouchlianitis, Elias, Peters, Emmanuelle, Stahl, Daniel, Trotta, Antonella and Shergill, Sukhwinder 2022. Cognitive bias modification for paranoia (CBM-pa): a randomised controlled feasibility study in patients with distressing paranoid beliefs. Psychological Medicine. https://doi.org/10.1017/S0033291722001520
The importance of pro-social processing, and ameliorating dysfunction in schizophrenia. An FMRI study of oxytocin
Shergill, S., Rebekah Wigton, Derek K. Tracy, Tess M. Verneuil, Michaela Johns, Thomas White, Panayiota G. Michalopoulou, Bruno Averbeck and Sukhwinder Shergill 2022. The importance of pro-social processing, and ameliorating dysfunction in schizophrenia. An FMRI study of oxytocin. Schizophrenia Research: Cognition. 27. https://doi.org/10.1016/j.scog.2021.100221
Stimulating learning: A functional MRI and behavioral investigation of the effects of transcranial direct current stimulation on stochastic learning in schizophrenia
Natasza D. Orlov, Syed Ali Muqtadir, Hooman Oroojeni, Bruno Averbeck, John Rothwell and Sukhi S. Shergill 2022. Stimulating learning: A functional MRI and behavioral investigation of the effects of transcranial direct current stimulation on stochastic learning in schizophrenia. Psychiatry Research. 317, p. 114908. https://doi.org/10.1016/j.psychres.2022.114908
A novel virtual reality assessment of functional cognition: Validation study
Lilla Alexandra Porffy, Mitul A Mehta, Joel Patchit, Celia Boussebaa, Jack Brett, Teresa D’Oliveira, Elias Mouchlianitis and Sukhi Shergill. 2022. A novel virtual reality assessment of functional cognition: Validation study. Journal of Medical Internet Research. 24 (1), p. e27641. https://doi.org/10.2196/27641
Relaxation of the criteria for entry to the UK Clozapine Central Non-Rechallenge Database: a modelling study
Ebenezer Oloyede, Eromona Whiskey, Cecilia Casetta, Olubanke Dzahini, Danielle Dunnett, Shreyans Gandhi, Prof Fiona Gaughran, Prof Sukhi Shergill, Prof Philip McGuire, Prof James H MacCabe and Prof David Taylor 2022. Relaxation of the criteria for entry to the UK Clozapine Central Non-Rechallenge Database: a modelling study. The Lancet: Psychiatry. 9 (8), pp. 636-644. https://doi.org/10.1016/S2215-0366(22)00188-2
VStore: Feasibility and acceptability of a novel virtual reality functional cognition task
Lilla A. Porffy, Mitul A. Mehta, Elias Mouchlianitis and Sukhi S. Shergill 2022. VStore: Feasibility and acceptability of a novel virtual reality functional cognition task. Frontiers in Virtual Reality.
Alpha3/alpha2 power ratios relate to performance on a virtual reality shopping task in ageing adults
Patchitt, Joel, Porffy, Lilla A., Whomersley, Gabriella, Szentgyorgyi, Timea, Brett, Jack, Mouchlianitis, Elias, Mehta, Mitul A., Nottage, Judith F. and Shergill, Sukhi S. 2022. Alpha3/alpha2 power ratios relate to performance on a virtual reality shopping task in ageing adults. Frontiers in Aging Neuroscience. 14, p. 876832. https://doi.org/10.3389/fnagi.2022.876832
The influence of trial-by-trial feedback on trust in health, first-episode and chronic psychosis
Lemmers-Jansen, I., Wichmann, Rune J., Perizonius, Sophie and Shergill, Sukhi S. 2022. The influence of trial-by-trial feedback on trust in health, first-episode and chronic psychosis. Games. 13 (5), p. e59. https://doi.org/10.3390/g13050059
Vortioxetine as adjunctive therapy in the treatment of schizophrenia
Redaelli, Sofia, Porffy, Lilla, Oloyede, Ebenezer, Dzahini, O., Lewis, Gabriella, Lobo, Maria, Whiskey, E. and Shergill, Sukhi S. 2022. Vortioxetine as adjunctive therapy in the treatment of schizophrenia. Therapeutic Advances in Psychopharmacology. 12, p. 204512532211100. https://doi.org/10.1177/20451253221110014
The role of cognitive control in the positive symptoms of psychosis
Horne, Charlotte M., Sahni, Angad, Pang, Sze W., Vanes, Lucy D., Szentgyorgyi, Timea, Averbeck, Bruno, Moran, Rosalyn J. and Shergill, Sukhwinder S. 2022. The role of cognitive control in the positive symptoms of psychosis. NeuroImage. Clinical. 34, p. 103004. https://doi.org/S2213-1582(22)00069-9
Preliminary evidence for the phosphodiesterase type-4 inhibitor, roflumilast, in ameliorating cognitive flexibility deficits in patients with schizophrenia
Nicholas R Livingston, Peter CT Hawkins, James Gilleen, Rong Ye, Lorena Valdearenas, Sukhi Shergill and Mitul A Mehta 2021. Preliminary evidence for the phosphodiesterase type-4 inhibitor, roflumilast, in ameliorating cognitive flexibility deficits in patients with schizophrenia. Journal of Psychopharmacology. 35 (9). https://doi.org/10.1177/02698811211000778
Contextual perception under active inference
Berk Mirza, M., Cullen, M., Parr, T., Shergill, S. and Moran, R. 2021. Contextual perception under active inference. Scientific Reports. 11 (16223). https://doi.org/s41598-021-95510-9
Outcomes in treatment-resistant schizophrenia: symptoms, function and clozapine plasma concentrations
Shergill, S., Amir Krivoy, Eromona Whiskey, Henrietta Webb-Wilson, Dan Joyce, Derek K. Tracy, Fiona Gaughran, James H. MacCabe and Sukhwinder S. Shergill 2021. Outcomes in treatment-resistant schizophrenia: symptoms, function and clozapine plasma concentrations. Therapeutic Advances in Psychopharmacology. 11. https://doi.org/10.1177/20451253211037179
New approaches to antipsychotic medication adherence – safety, tolerability and acceptability
Taub, Sharon, Krivoy, Amir, Whiskey, Eromona and Shergill, Sukhi S. 2021. New approaches to antipsychotic medication adherence – safety, tolerability and acceptability. Expert Opinion on Drug Safety. 21 (4), pp. 517-524. https://doi.org/10.1080/14740338.2021.1983540
A systematic review of TMS and neurophysiological biometrics in patients with schizophrenia
di Hou, Meng, Santoro, Viviana, Biondi, Andrea, Shergill, Sukhi S and Premoli, Isabella 2021. A systematic review of TMS and neurophysiological biometrics in patients with schizophrenia. Journal of psychiatry & neuroscience : JPN. 46 (6), pp. E675-E701. https://doi.org/10.1503/jpn.210006