Publications associées à Regard (sciences sociales)

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Chenglin Li, Li Wei, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention Priors

Jean-Marc Odobez, Rémy Alain Siegfried

Gaze estimation is a difficult task, even for humans. However, as humans, we are good at understanding a situation and exploiting it to guess the expected visual focus of attention of people, and we usually use this information to retrieve people's gaze. I ...

ASSOC COMPUTING MACHINERY2022

How daylight representation in architectural competitions images can lead to an erroneous interpretation of projects

Bernard Paule, Joshua Pereira

The digital world we are living in today offers viewers an experience of buildings before they even exist. This experience is no longer just geometric or descriptive, but also sensory. It generates emotions through fixed or animated images of 3 dimensional ...

IOP PUBLISHING LTD2021

Modeling and Inferring Attention between Humans or for Human-Robot Interactions

Rémy Alain Siegfried

More and more intelligent systems have to interact with humans. In order to communicate efficiently, these systems need to perceive and understand us. A key factor of communication is the people's visual focus of attention (VFOA), which is useful to estima ...

EPFL2021

Unsupervised Representation Learning for Gaze Estimation

Jean-Marc Odobez, Yu Yu

Although automatic gaze estimation is very important to a large variety of application areas, it is difficult to train accurate and robust gaze models, in great part due to the difficulty in collecting large and diverse data (annotating 3D gaze is expensiv ...

IEEE2020

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Intent Prediction Based on Biomechanical Coordination of EMG and Vision-Filtered Gaze for End-Point Control of an Arm Prosthesis

Aude Billard, Silvestro Micera, Iason Batzianoulis, Nili Eliana Krausz

We propose a novel controller for powered prosthetic arms, where fused EMG and gaze data predict the desired end-point for a full arm prosthesis, which could drive the forward motion of individual joints. We recorded EMG, gaze, and motion-tracking during p ...

2020

On the Use of Gaze as a Measure for Performance in a Visual Exploration Task

Pierre Dillenbourg, Jennifer Kaitlyn Olsen, Catharine Regina Monika Maria Oertel Genannt Bierbach

Visual exploration skill acquisition is important for many vocational professions, yet many apprentices struggle to acquire these skills, impacting both their grades and practical work. Traditionally, the learning of visual skills is facilitated through ex ...

Springer2019

A Gaze Visualizer Tool Implementation Of Gaze Data Into Lighting Rendering Tools Using Radiance And Honeybee For Grasshopper3D

Marilyne Andersen, Jan Wienold, Mandana Sarey Khanie

The Gaze Visualizer tool is an implementation of eyetracking (gaze) data and a preliminary gaze responsive light driven (GRL) model, which enables to visualize gaze behavior in a 3D space, in Grasshopper3D. The workflow from obtaining the relevant photomet ...

AMER SOC HEATING, REFRIGERATING AND AIR-CONDITIONING ENGS2018

Gaze and discomfort glare, Part 1: Development of a gaze-driven photometry

Marilyne Andersen, Jan Wienold, Mandana Sarey Khanie

Discomfort glare is a major challenge for the design of workplaces. The existing metrics for discomfort glare prediction share the limitation that they do not take gaze direction into account. In order to overcome this limitation, we developed a ‘gaze-driv ...

2017

Towards the Use of Social Interaction Conventions as Prior for Gaze Model Adaptation

Jean-Marc Odobez, Rémy Alain Siegfried, Yu Yu

Gaze is an important non-verbal cue involved in many facets of social interactions like communication, attentiveness or attitudes. Nevertheless, extracting gaze directions visually and remotely usually suffers large errors because of low resolution images, ...

ACM2017

Role of Gaze Cues in Interpersonal Motor Coordination: Towards Higher Affiliation in Human-Robot Interaction

Aude Billard, Mahdi Khoramshahi, Ashwini Shukla

Background The ability to follow one another's gaze plays an important role in our social cognition; especially when we synchronously perform tasks together. We investigate how gaze cues can improve performance in a simple coordination task (i.e., the mirr ...

Public Library of Science2016

Gaze Responsive Visual Comfort: New Findings On Gaze Behaviour In A Daylit Office Space In Relation To Glare

Marilyne Andersen, Jan Wienold, Mandana Sarey Khanie

Using a newly developed gaze-driven methodology for discomfort glare assessments, we studied gaze behaviour in different glare conditions. The study was done in a series of experiments where gaze behaviour of the participants were recorded using eye-tracki ...

Cie Central Bureau2016

Estimating Fusion Weights of a Multi-Camera Eye Tracking System by Leveraging User Calibration Data

Jean-Philippe Thiran, Nuri Murat Arar

Cross-ratio (CR)-based eye tracking has been attracting much interest due to its simple setup, yet its accuracy is lower than that of the model-based approaches. In order to improve the estimation accuracy, a multi-camera setup can be exploited rather than ...

Assoc Computing Machinery2016

3D Gaze Estimation from Remote RGB-D Sensors

Kenneth Alberto Funes Mora

The development of systems able to retrieve and characterise the state of humans is important for many applications and fields of study. In particular, as a display of attention and interest, gaze is a fundamental cue in understanding people activities, be ...

EPFL2015

Human responsive daylighting in offices : a gaze-driven approach for dynamic discomfort glare assessment

Mandana Sarey Khanie

This dissertation proposes a novel gaze-driven approach for dynamic discomfort glare assessments as a first step towards understanding human responsive comfort with respect to daylight. The objective was to observe the natural gaze behaviour in relation to ...

EPFL2015

Investigating the midline effect for visual focus of attention recognition

Jean-Marc Odobez, Samira Sheikhi

This paper addresses the recognition of people’s visual focus of attention (VFOA), the discrete version of gaze indicating who is looking at whom or what. In absence of high def- inition images, we rely on people’s head pose to recognize the VFOA. To the c ...

ACM2012

Predictive Gaze Stabilization During Periodic Locomotion Based On Adaptive Frequency Oscillators

Auke Ijspeert, Sébastien Gay

In this paper we present an approach to the problem of stabilizating the gaze of legged robots using Adaptive Frequency Oscillators to learn the frequency, phase and amplitude of the optical flow and generate compensatory commands during robot locomotion. ...

Ieee2012

Effects of sharing text selections on gaze recurrence and interaction quality in a pair programming task

Patrick Jermann, Marc-Antoine Nüssli

We present experimental findings from a dual eye-tracking study that illustrate the effect of different ways of sharing se- lection in remote pair-programming scenario. Forty pairs of engineering students had to complete several program under- standing tas ...

2012

A Wearable Gaze Tracking System for Children in Unconstrained Environments

Aude Billard, Basilio Noris, Jean-Baptiste Keller

We present here a head-mounted gaze tracking system for the study of visual behavior in unconstrained environments. The system is designed both for adults and for infants as young as 1 year of age. The system uses two CCD cameras to record a very wide fiel ...

2011