Publications associées à Oculométrie

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Chenglin Li, Li Wei, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Effects of Head-Tracking Artefacts on Externalization and Localization in Azimuth With Binaural Wearable Devices

Hervé Lissek, Gilles André Courtois, Vincent Pierre Olivier Grimaldi

Head tracking combined with head movements have been shown to improve auditory externalization of a virtual sound source and contribute to the performance in localization. With certain technically constrained head-tracking algorithms, as can be found in we ...

Audio Engineering Soc2023

Discomfort glare from daylight: Influence of transmitted color and the eye's macular pigment

Sneha Jain

Designing architectural façades that allow sufficient daylight to create visually comfortable and pleasant environments is a challenging aspect of building design. It requires accounting for visual comfort and discomfort glare risks and understanding the f ...

EPFL2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Caroline Karmann, Kynthia Chamilothori, Seungryong Kim, Bahar Aydemir

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

A multimodal measurement of the impact of deepfakes on the ethical reasoning and affective reactions of students

Touradj Ebrahimi, Patrick Jermann, Roland John Tormey, Cécile Hardebolle, Nihat Kotluk, Vivek Ramachandran

Deepfakes - synthetic videos generated by machine learning models - are becoming increasingly sophisticated. While they have several positive use cases, their potential for harm is also high. Deepfake production involves input from multiple engineers, maki ...

2023

Non-verbal Communication between Humans and Robots: Imitation, Mutual Understanding and Inferring Object Properties

Nuno Ricardo Ferreira Duarte

Humans can express their actions and intentions, resorting to verbal and/or non-verbal communication. In verbal communication, humans use language to express, in structured linguistic terms, the desired action they wish to perform. Non-verbal communication ...

EPFL2023

Assessing Experiences and Visual Perception in Train Station Environments with a Mobile Application and Eye Tracking

Andrea Regula Schneider

The Customer Experience Management at the Swiss Federal Railways (SBB) experiments with new technologies and methods to capture experiences and perceptions of passengers to design safe and customer friendly environments. First, a new methodological approac ...

2022

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, Nuno Ricardo Ferreira Duarte, José Santos-Victor

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Multi-animal pose estimation, identification and tracking with DeepLabCut

Alexander Mathis, Mackenzie Mathis, Steffen Schneider, Shaokai Ye, Tanmay Nath, Jessy Lauer

Estimating the pose of multiple animals is a challenging computer vision problem: frequent interactions cause occlusions and complicate the association of detected keypoints to the correct individuals, as well as having highly similar looking animals that ...

NATURE PORTFOLIO2022

Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention Priors

Jean-Marc Odobez, Rémy Alain Siegfried

Gaze estimation is a difficult task, even for humans. However, as humans, we are good at understanding a situation and exploiting it to guess the expected visual focus of attention of people, and we usually use this information to retrieve people's gaze. I ...

ASSOC COMPUTING MACHINERY2022

Humans are Poor Few-Shot Classifiers for Sentinel-2 Land Cover

Devis Tuia, Marc Conrad Russwurm

Learning to predict accurately from a few data samples is a central challenge in modern data-hungry machine learning. On natural images, human vision typically outperforms deep learning approaches on few-shot learning. However, we hypothesize that aerial a ...

IEEE2022

Comparison between CIE 2° and 10° field photopic luminosity functions V(λ) for calculating daylight discomfort glare metrics

Marilyne Andersen, Jan Wienold, Sneha Jain

The spectral sensitivity of the average human eye in photopic conditions is represented by the photopic luminosity function V (λ). The CIE has established the photopic luminosity functions for the 2o and 10o visual fields for a standard observer applicable ...

2022

Modeling and Inferring Attention between Humans or for Human-Robot Interactions

Rémy Alain Siegfried

More and more intelligent systems have to interact with humans. In order to communicate efficiently, these systems need to perceive and understand us. A key factor of communication is the people's visual focus of attention (VFOA), which is useful to estima ...

EPFL2021

The time course of serial dependence: an interplay between perceptual decisions and task relevant representations

Michael Herzog, David Pascucci, Gizay Ceylan

In serial dependence (SD), features of a present stimulus are judged as similar to previously presented ones. This bias is often explained by a continuity field (CF) in perception, combining similar stimuli in an extended region of space (∼ 15°) and time ( ...

SAGE Publishing2021

Homogeneous light stimulation of melanopsin and cones with a Maxwellian view device for the human eye

Gilles Evéquoz, Patrick Robert Flückiger

We designed and tested a device to stimulate specifically one photoreceptor type, or a combination of some of them, of the human eye by using up to six primaries. The device produces a homogeneous light field over 40 degrees which is projected onto the ret ...

IEEE2021

How Florist Apprentices Explore Bouquet Designs: Supporting Design Space Exploration for Vocational Students

Pierre Dillenbourg, Kevin Gonyop Kim, Catharine Regina Monika Maria Oertel Genannt Bierbach

Context: Exploring the design space is an important process in a design task. In this study, we considered design space exploration for the learners in vocational education and training (VET). The goal of the study was to investigate how they explore the d ...

2021

Eye-tracking and artificial intelligence to enhance motivation and learning

Pierre Dillenbourg, Kshitij Sharma

The interaction with the various learners in a Massive Open Online Course (MOOC) is often complex. Contemporary MOOC learning analytics relate with click-streams, keystrokes and other user-input variables. Such variables however, do not always capture user ...

SPRINGER HEIDELBERG2020

Eye Thought You Were Sick! Exploring Eye Behaviors for Cybersickness Detection in VR

Ronan Boulic, Nana Tian

Cybersickness induced through Virtual Reality (VR) applications is still one of its main barriers as it can induce unwanted side-effects in players, significantly hindering the overall experience. Despite the wealth of research available on this topic, it ...

ACM2020

A Differential Approach for Gaze Estimation

Jean-Marc Odobez, Yu Yu, Gang Liu

Most non-invasive gaze estimation methods regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain limited accuracies and t ...

2021

3-Dimensional magnetic resonance imaging of the freely moving human eye

Jérôme Yerly, João Pedro Forjaco Jorge, Lorenzo Di Sopra, Josefina Adriana Maria Bastiaansen, Silvio Ionta, Benedetta Franceschiello, David Zeugin

Eye motion is a major confound for magnetic resonance imaging (MRI) in neuroscience or ophthalmology. Currently, solutions toward eye stabilisation include participants fixating or administration of paralytics/anaesthetics. We developed a novel MRI protoco ...

PERGAMON-ELSEVIER SCIENCE LTD2020