Publications related to McGurk effect

Robotically-induced auditory-verbal hallucinations: combining self-monitoring and strong perceptual priors

Olaf Blanke, Fosco Bernasconi, Melissa Faggella, Nathan Quentin Faivre, Pavo Orepic

Background. Inducing hallucinations under controlled experimental conditions in nonhallucinating individuals represents a novel research avenue oriented toward understanding complex hallucinatory phenomena, avoiding confounds observed in patients. Audito ...

2024

Selective attention involves a feature-specific sequential release from inhibitory gating

David Pascucci, Gijs Plomp

Selective attention is a fundamental cognitive mechanism that allows our brain to preferentially process relevant sensory information, while filtering out distracting information. Attention is thought to flexibly gate the communication of irrelevant inform ...

2022

Interoception and Empathy Impact Perspective Taking

Olaf Blanke, Bruno Herbelin, Jane Aspell, Lukas Heydrich

Adopting the perspective of another person is an important aspect of social cognition and has been shown to depend on multisensory signals from one's own body. Recent work suggests that interoceptive signals not only contribute to own-body perception and s ...

Frontiers Media2021

Dissecting self-voice perception: From bone conduction to robotically-induced self-other voice misattribution in healthy listeners

Pavo Orepic

Inspired by the prominent theory suggesting that auditory-verbal hallucinations (AVH) - the sensation of hearing voices without present speakers - arise as misattribution of inner speech towards external agents, my thesis revolved around self-voice percept ...

EPFL2020

Congruency effects can compensate for deficits of healthy older adults in crossmodal integration

Friedhelm Christoph Hummel

One of the pivotal challenges of aging is to maintain independence in the activities of daily life. In order to adapt to changes in the environment, it is crucial to continuously process and accurately combine simultaneous input from different sensory syst ...

2019

Deep Learning of Human Perception in Audio Event Classification

Samuel Denys Beuret, Yi Yu

In this paper, we introduce our recent studies on human perception in audio event classification. In particular, the pre-trained model VGGish is used as feature extractor to process audio data, and DenseNet is trained by and used as feature extractor for o ...

IEEE2018

Towards an implicit time-continuous assessment of Quality of Experience for immersive multimedia

Touradj Ebrahimi, Anne-Flore Nicole Marie Perrin

Quality of Experience (QoE) is a time-varying perceptual process. Despite its complexity and numerous impacting factors, recent efforts have been made to come up with subjective assessment methodologies of QoE. However, no time-continuous variant of subjec ...

2017

Word pair classification during imagined speech using direct brain recordings

José del Rocio Millán Ruiz, Inaki Asier Iturrate Gil, Stéphanie Martin

People that cannot communicate due to neurological disorders would benefit from an internal speech decoder. Here, we showed the ability to classify individual words during imagined speech from electrocorticographic signals. In a word imagery task, we used ...

Nature Research2016

"Can you hear me now?" : Automatic assessment of background noise intrusiveness and speech intelligibility in telecommunications

Raphaël Marc Ullmann

This thesis deals with signal-based methods that predict how listeners perceive speech quality in telecommunications. Such tools, called objective quality measures, are of great interest in the telecommunications industry to evaluate how new or deployed sy ...

EPFL2016

Imagined own-body transformations during passive self-motion

Olaf Blanke, Michiel van Elk

Spatial perspective taking is a crucial social skill that underlies many of our everyday interactions. Previous studies have suggested that spatial perspective taking is an embodied process that involves the integration of both motor and proprioceptive inf ...

2014

Anatomically plausible illusory posture affects mental rotation of body parts

Olaf Blanke, Silvio Ionta, Anna Sforza, Mariko Funato

During mental rotation (MR) of body parts, people internally simulate the movement of their corresponding body segments. These sensory-motor mechanisms render MR sensitive to proprioceptive information (e.g., posture). Similar mechanisms can alter illusory ...

Springer2013

Electrical neuroimaging of memory discrimination based on single-trial multisensory learning

Micah Murray, Antonia Thelen

Multisensory experiences influence subsequent memory performance and brain responses. Studies have thus far concentrated on semantically congruent pairings, leaving unresolved the influence of stimulus pairing and memory sub-types. Here, we paired images w ...

Elsevier2012

Quantifying target conspicuity in contextual modulation by visual search

Michael Herzog, Bilge Sayim

Contextual elements can strongly modulate visual performance. For example, performance deteriorates when a vernier is flanked by neighboring lines. On a neural level, such contextual modulation is often explained by local spatial interactions such as later ...

Association for Research in Vision and Ophthalmology2011

Balancing Attended and Global Stimuli in Perceived Video Quality Assessment

Touradj Ebrahimi

The visual attention mechanism plays a key role in the human perception system and it has a significant impact on our assessment of perceived video quality. In spite of receiving less attention from the viewers, unattended stimuli can still contribute to t ...

2011

A 3-D Audio-Visual Corpus of Affective Communication

Communication between humans deeply relies on the capability of expressing and recognizing feelings. For this reason, research on human-machine interaction needs to focus on the recognition and simulation of emotional states, prerequisite of which is the c ...

2010

Enhancing posterior based speech recognition systems

Hamed Ketabdar

The use of local phoneme posterior probabilities has been increasingly explored for improving speech recognition systems. Hybrid hidden Markov model / artificial neural network (HMM/ANN) and Tandem are the most successful examples of such systems. In this ...

EPFL2008