Publications related to Nystagmus

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, Nuno Ricardo Ferreira Duarte, José Santos-Victor

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Modeling Object Dissimilarity for Deep Saliency Prediction

Sabine Süsstrunk, Mathieu Salzmann, Tong Zhang, Seungryong Kim, Deblina Bhattacharjee, Bahar Aydemir

Saliency prediction has made great strides over the past two decades, with current techniques modeling low-level information, such as color, intensity and size contrasts, and high-level ones, such as attention and gaze direction for entire objects. Despite ...

2022

Modeling and Inferring Attention between Humans or for Human-Robot Interactions

Rémy Alain Siegfried

More and more intelligent systems have to interact with humans. In order to communicate efficiently, these systems need to perceive and understand us. A key factor of communication is the people's visual focus of attention (VFOA), which is useful to estima ...

EPFL2021

Perceptual Quality of Point Clouds with application to Compression

Evangelos Alexiou

Modern information technologies and human-centric communication systems employ advanced content representations for richer portrayals of the real world. The newly adopted imaging modalities offer additional information cues and permit the depiction of real ...

EPFL2021

A Differential Approach for Gaze Estimation

Jean-Marc Odobez, Yu Yu, Gang Liu

Most non-invasive gaze estimation methods regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain limited accuracies and t ...

2021

ManiGaze: a Dataset for Evaluating Remote Gaze Estimator in Object Manipulation Situations

Jean-Marc Odobez, Rémy Alain Siegfried, Bozorgmehr Aminian

Gaze estimation allows robots to better understand users and thus to more precisely meet their needs. In this paper, we are interested in gaze sensing for analyzing collaborative tasks and manipulation behaviors in human-robot interactions (HRI), which dif ...

ACM2020

Virtual reality simulation of epiretinal stimulation highlights the relevance of the visual angle in prosthetic vision

Diego Ghezzi, Enrico Migliorini, Jacob Thomas Thorn

Objective. Retinal prostheses hold the potential to restore artificial vision in blind patients suffering from outer retinal dystrophies. The optimal number, density and coverage of the electrodes that a retinal prosthesis should have to provide adequate a ...

2020

Long-lasting feature integration

Leila Drissi Daoudi - Kleinbauer

In the classic model of vision, processing is local, feedforward and hierarchical. The first stages of the visual system are retinotopic, i.e., neighboring points in the outside world are mapped onto neighboring photoreceptors of the retina and this is pre ...

EPFL2020

Towards Modelling of Visual Saliency in Point Clouds for Immersive Applications

Touradj Ebrahimi, Evangelos Alexiou, Peisen Xu

Modelling human visual attention is of great importance in the field of computer vision and has been widely explored for 3D imaging. Yet, in the absence of ground truth data, it is unclear whether such predictions are in alignment with the actual human vie ...

2019

Improving Few-Shot User-Specific Gaze Adaptation via Gaze Redirection Synthesis

Jean-Marc Odobez, Yu Yu, Gang Liu

As an indicator of human attention gaze is a subtle behavioral cue which can be exploited in many applications. However, inferring 3D gaze direction is challenging even for deep neural networks given the lack of large amount of data (groundtruthing gaze is ...

IEEE2019

Vestibular modulation of peripersonal space boundaries

Olaf Blanke, Christian Pfeiffer, Andrea Serino, Jean-Paul Noel

Human-environment interactions are mediated through the body and occur within the peripersonal space (PPS), the space immediately adjacent to and surrounding the body. The PPS is taken to be a critical interface between the body and the environment, and in ...

2018

Modulation of vection latencies in the full-body illusion

Olaf Blanke, Bruno Herbelin, Alessandro Nesti, Giulio Rognini

Current neuroscientific models of bodily self-consciousness (BSC) argue that inaccurate integration of sensory signals leads to altered states of BSC. Indeed, using virtual reality technology, observers viewing a fake or virtual body while being exposed to ...

2018

Towards the Use of Social Interaction Conventions as Prior for Gaze Model Adaptation

Jean-Marc Odobez, Rémy Alain Siegfried, Yu Yu

Gaze is an important non-verbal cue involved in many facets of social interactions like communication, attentiveness or attitudes. Nevertheless, extracting gaze directions visually and remotely usually suffers large errors because of low resolution images, ...

ACM2017

Gaze and discomfort glare, Part 1: Development of a gaze-driven photometry

Marilyne Andersen, Jan Wienold, Mandana Sarey Khanie

Discomfort glare is a major challenge for the design of workplaces. The existing metrics for discomfort glare prediction share the limitation that they do not take gaze direction into account. In order to overcome this limitation, we developed a ‘gaze-driv ...

2017

The role of one-shot learning in #TheDress

Michael Herzog, Adrien Christophe Doerig, Leila Drissi Daoudi - Kleinbauer

The first amazing effect with #TheDress is that a large number of people perceive it as white and gold even though the true colors of the dress are black and blue. Such apparent changes in color are common in many illusions. What makes #TheDress even more ...

2017

Sleep-dependent consolidation of face recognition and its relationship to REM sleep duration, REM density and Stage 2 sleep spindles

Christian O'Reilly

Face recognition is a highly specialized capability that has implicit and explicit memory components. Studies show that learning tasks with facial components are dependent on rapid eye movement and non-rapid eye movement sleep features, including rapid eye ...

Wiley2017

Retina Color-Opponency Based Pursuit Implemented Through Spiking Neural Networks in the Neurorobotics Platform

Marc-Oliver Gewaltig, Egidio Falotico, Lorenzo Vannucci, Paul Levi, Georg Hinkel, Stefan Ulbrich, Alessandro Ambrosano, Ugo Albanese, Murat Kirtay

The 'red-green' pathway of the retina is classically recognized as one of the retinal mechanisms allowing humans to gather color information from light, by combining information from L-cones and M-cones in an opponent way. The precise retinal circuitry tha ...

Springer Int Publishing Ag2016

A Novel Recessive RPGRIP1 Mutation Causing Leber Congenital Amaurosis

Background: Leber congenital amaurosis is an early-onset childhood severe retinal dystrophy, of significant genetic heterogeneity. RPGRIP1 is ubiquitously expressed, but mutations in RPGRIP1 lead to a retina-restricted phenotype, such as Leber congenital a ...

Georg Thieme Verlag Kg2016

Visual Augmentation of Deictic Gestures in MOOC Videos

Pierre Dillenbourg, Kshitij Sharma

We present an eye-tracking study to compare different modalities for visual augmentations of the teacher’s explicit deictic gestures on a video lecture. We compared three visualizations: 1) hand gestures with a pointer, 2) gaze overlay, and 3) no-augmentat ...

2016

Multisensory effects on somatosensation: a trimodal visuo-vestibular-tactile interaction

Olaf Blanke, Bruno Herbelin, Mariia Kaliuzhna

Vestibular information about self-motion is combined with other sensory signals. Previous research described both visuo-vestibular and vestibular-tactile bilateral interactions, but the simultaneous interaction between all three sensory modalities has not ...

Nature Research2016