Publications related to Motor theory of speech perception

Towards Motion Forecasting with Real-World Perception Inputs: Are End-to-End Approaches Competitive?

Motion forecasting is crucial in enabling autonomous vehicles to anticipate the future trajectories of surrounding agents. To do so, it requires solving mapping, detection, tracking, and then forecasting problems, in a multi-step pipeline. In this complex ...

2024

Automatic pathological speech assessment

Parvaneh Janbakhshi

Many pathologies cause impairments in the speech production mechanism resulting in reduced speech intelligibility and communicative ability. To assist the clinical diagnosis, treatment and management of speech disorders, automatic pathological speech asses ...

EPFL2022

A guideline for linking brain wave findings to the various aspects of discrete perception

Michael Herzog, Lukas Vogelsang, Maëlan Quentin Menétrey

Brain waves, determined by electrical and magnetic brain recordings (e.g., EEG and MEG), and fluctuating behavioral responses, determined by response time or accuracy measures, are frequently taken to support discrete perception. For example, it has been p ...

2021

Many Are The Ways to Learn: Identifying multi-modal behavioral profiles of collaborative learning in constructivist activities

Pierre Dillenbourg, Barbara Bruno, Jauwairia Nasir, Aditi Kothiyal

Understanding how learners engage with learning technologies, and its relation with their learning, is crucial to the design of effective learning interventions. Assessing the learners’ state however, is non-trivial. Research suggests that performance is n ...

2021

Unraveling brain interactions in vision: the example of crowding

Michael Herzog, Vitaly Chicherov, Bogdan Draganski, Maya Anna Jastrzebowska

Crowding, the impairment of target discrimination in clutter, is the standard situation in vision. Traditionally, crowding is explained with (feedforward) models, in which only neighboring elements interact, leading to a “bottleneck” at the earliest stages ...

2021

Review of multi-domain approaches to indoor environmental perception and behaviour

Verena Marie Barthelmes, Matteo Favero

Building occupants are continuously exposed to multiple indoor environmental stimuli, including thermal, visual, acoustic, and air quality related factors. Moreover, personal and contextual aspects can be regarded as additional domains influencing occupant ...

2020

Peri-personal space encoding in patients with disorders of consciousness and cognitive-motor dissociation

José del Rocio Millán Ruiz, Serafeim Perdikis, Maria Manuela da Silva Marques, Andrea Serino, Jean-Paul Noel

Behavioral assessments of consciousness based on overt command following cannot differentiate patients with disorders of consciousness (DOC) from those who demonstrate a dissociation between intent/awareness and motor capacity: cognitive motor dissociation ...

2019

End-to-End Acoustic Modeling using Convolutional Neural Networks for HMM-based Automatic Speech Recognition

Mathew Magimai Doss, Ronan Collobert, Dimitri Palaz

In hidden Markov model (HMM) based automatic speech recognition (ASR) system, modeling the statistical relationship between the acoustic speech signal and the HMM states that represent linguistically motivated subword units such as phonemes is a crucial st ...

ELSEVIER SCIENCE BV2019

Non-invasive, Brain-controlled Functional Electrical Stimulation for Locomotion Rehabilitation in Individuals with Paraplegia

Mohamed Bouri, Solaiman Shokur, Miguel Nicolelis

Spinal cord injury (SCI) impairs the flow of sensory and motor signals between the brain and the areas of the body located below the lesion level. Here, we describe a neurorehabilitation setup combining several approaches that were shown to have a positive ...

Nature Research2019

Spatiotemporal feature integration within discrete time windows provides evidence for discrete perception

Michael Herzog, Adrien Christophe Doerig, Leila Drissi Daoudi - Kleinbauer

Intuitively, consciousness seems to be a continuous stream of percepts. Here, contrary to intuition, we show evidence for discrete consciousness, occurring only at certain moments of time. We presented a Vernier followed by a sequence of flanking lines on ...

2018

Quasi-continuous unconscious processing precedes discrete conscious perception

Michael Herzog, Adrien Christophe Doerig

Perception seems to be a continuous stream and, for this reason, we often implicitly assume that perception is continuous. In fact, many models of vision rely explicitly and implicitly on continuous perception. However, continuous perception is challenged ...

2017

Template-matching for text-dependent speaker verification

Petr Motlicek, Subhadeep Dey

In the last decade, i-vector and Joint Factor Analysis (JFA) approaches to speaker modeling have become ubiquitous in the area of automatic speaker recognition. Both of these techniques involve the computation of posterior probabilities, using either Gauss ...

2017

Understanding and Decoding Imagined Speech using Electrocorticographic Recordings in Humans

Stéphanie Martin

Certain brain disorders, resulting from brainstem infarcts, traumatic brain injury, stroke and amyotrophic lateral sclerosis, limit verbal communication despite the patient being fully aware. People that cannot communicate due to neurological disorders wou ...

EPFL2017

Multiscale body maps in the human brain

Michel Akselrod

A large number of brain regions are dedicated to processing information from the body in order to enable interactions with the environment. During my thesis, I studied the functional organization of brain networks involved in processing bodily information. ...

EPFL2017

Perceptual Dynamics of Daylight in Architecture

Siobhan Francois Rockcastle

In our experience of daylit architecture, our visual perception is greatly impacted by the ephemeral and inherently dynamic conditions of the surrounding environment. Driven by changes in sky type, time-of-day, and time-of-year, these variable conditions c ...

EPFL2017

Word pair classification during imagined speech using direct brain recordings

José del Rocio Millán Ruiz, Inaki Asier Iturrate Gil, Stéphanie Martin

People that cannot communicate due to neurological disorders would benefit from an internal speech decoder. Here, we showed the ability to classify individual words during imagined speech from electrocorticographic signals. In a word imagery task, we used ...

Nature Research2016

Changing motor perception by sensorimotor conflicts and body ownership

Olaf Blanke, Roy Salomon, Michiel van Elk, Joan Llobera Mahy, Natalia Fernandez

Experimentally induced sensorimotor conflicts can result in a loss of the feeling of control over a movement (sense of agency). These findings are typically interpreted in terms of a forward model in which the predicted sensory consequences of the movement ...

Nature Research2016

The use of intracranial recordings to decode human language: Challenges and opportunities

José del Rocio Millán Ruiz, Stéphanie Martin

Decoding speech from intracranial recordings serves two main purposes: understanding the neural correlates of speech processing and decoding speech features for targeting speech neuroprosthetic devices. Intracranial recordings have high spatial and tempora ...

Elsevier2019

Testing the Role of Dorsal Premotor Cortex in Auditory-Motor Association Learning Using Transcranical Magnetic Stimulation (TMS)

Interactions between the auditory and the motor systems are critical in music as well as in other domains, such as speech. The premotor cortex, specifically the dorsal premotor cortex (dPMC), seems to play a key role in auditory-motor integration, and in m ...

Public Library Science2016

On Structured Sparsity of Phonological Posteriors for Linguistic Parsing

Hervé Bourlard, Afsaneh Asaei, Milos Cernak

The speech signal conveys information on different time scales from short (20--40 ms) time scale or segmental, associated to phonological and phonetic information to long (150--250 ms) time scale or supra segmental, associated to syllabic and prosodic info ...

2016