Publications associées à Investigating the midline effect for visual focus of attention recognition

SVGC-AVA: 360-Degree Video Saliency Prediction With Spherical Vector-Based Graph Convolution and Audio-Visual Attention

Pascal Frossard, Li Wei, Chenglin Li, Qin Yang, Yuelei Li

Viewers of 360-degree videos are provided with both visual modality to characterize their surrounding views and audio modality to indicate the sound direction. Though both modalities are important for saliency prediction, little work has been done by joint ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Exploration-based model learning with self-attention for risk-sensitive robot control

Sudong Lee

Model-based reinforcement learning for robot control offers the advantages of overcoming concerns on data collection and iterative processes for policy improvement in model-free methods. However, both methods use exploration strategy relying on heuristics ...

2023

Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention Priors

Jean-Marc Odobez, Rémy Alain Siegfried

Gaze estimation is a difficult task, even for humans. However, as humans, we are good at understanding a situation and exploiting it to guess the expected visual focus of attention of people, and we usually use this information to retrieve people's gaze. I ...

ASSOC COMPUTING MACHINERY2022

The Gaze Dialogue Model: Nonverbal Communication in HHI and HRI

Aude Billard, José Santos-Victor, Nuno Ricardo Ferreira Duarte

When humans interact with each other, eye gaze movements have to support motor control as well as communication. On the one hand, we need to fixate the task goal to retrieve visual information required for safe and precise action-execution. On the other ha ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Audio-Visual Object Classification For Human-Robot Collaboration

Andrea Cavallaro

Human-robot collaboration requires the contactless estimation of the physical properties of containers manipulated by a person, for example while pouring content in a cup or moving a food box. Acoustic and visual signals can be used to estimate the physica ...

IEEE2022

Modeling and Inferring Attention between Humans or for Human-Robot Interactions

Rémy Alain Siegfried

More and more intelligent systems have to interact with humans. In order to communicate efficiently, these systems need to perceive and understand us. A key factor of communication is the people's visual focus of attention (VFOA), which is useful to estima ...

EPFL2021

Crowding and the importance of grouping and segmentation processes in human vision

Alban Bornet

Human vision has evolved to make sense of a world in which elements almost never appear in isolation. Surprisingly, the recognition of an element in a visual scene is strongly limited by the presence of other nearby elements, a phenomenon known as visual c ...

EPFL2021

Beyond Soft Hands: Efficient Grasping With Non-Anthropomorphic Soft Grippers

Yufei Hao

Grasping and manipulation are challenging tasks that are nonetheless critical for many robotic systems and applications. A century ago, robots were conceived as humanoid automata. While conceptual at the time, this viewpoint remains influential today. Many ...

FRONTIERS MEDIA SA2021

Long-lasting feature integration

Leila Drissi Daoudi - Kleinbauer

In the classic model of vision, processing is local, feedforward and hierarchical. The first stages of the visual system are retinotopic, i.e., neighboring points in the outside world are mapped onto neighboring photoreceptors of the retina and this is pre ...

EPFL2020

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Visual Attention and Perceptual Quality in Omnidirectional Imaging

Evgeniy Upenik

Omnidirectional imaging has reached a level of widespread availability driven by recent advances in integrated circuit technology, image sensors, and computer graphics which allow now capturing, rendering and displaying of such type of immersive content in ...

EPFL2020

Towards Modelling of Visual Saliency in Point Clouds for Immersive Applications

Touradj Ebrahimi, Evangelos Alexiou, Peisen Xu

Modelling human visual attention is of great importance in the field of computer vision and has been widely explored for 3D imaging. Yet, in the absence of ground truth data, it is unclear whether such predictions are in alignment with the actual human vie ...

2019

SCALAR: Simultaneous Calibration of 2-D Laser and Robot Kinematic Parameters Using Planarity and Distance Constraints

Teguh Santoso Lembono

In this paper, we propose SCALAR, a calibration method to simultaneously calibrate the kinematic parameters of a 6-DoF robot and the extrinsic parameters of a 2-D laser range finder (LRF) attached to the robot's flange. The calibration setup requires only ...

2019

Beyond Bouma's window: How to explain global aspects of crowding?

Michael Herzog, Gregory Francis, Alban Bornet, Adrien Christophe Doerig, Aaron Michael Clarke

In crowding, perception of an object deteriorates in the presence of nearby elements. Although crowding is a ubiquitous phenomenon, since elements are rarely seen in isolation, to date there exists no consensus on how to model it. Previous experiments show ...

2019

Microsaccades Distinguish Looking From Seeing

Andreas Sonderegger, Andrea Regula Schneider

Understanding our visual world requires both looking and seeing. Dissociation of these processes can result in the phenomenon of inattentional blindness or 'looking without seeing'. Concomitant errors in applied settings can be serious, and even deadly. Cu ...

INT GROUP EYE MOVEMENT RESEARCH2019

Control of Bio-Inspired Sprawling Posture Quadruped Robots with an Actuated Spine

Tomislav Horvat

Sprawling posture robots are characterized by upper limb segments protruding horizontally from the body, resulting in lower body height and wider support on the ground. Combined with an actuated segmented spine and tail, such morphology resembles that of s ...

EPFL2018

Sensitivity To Perceived Mutual Understanding In Human-Robot Collaborations

Pierre Dillenbourg, Ana Paiva, Alexis David Jacq

In order to collaborate with humans, robots are often provided with a Theory of Mind (ToM) architecture. Such architectures can be evaluated by humans perception of the robot's adaptations. However, humans sensitivities to these adaptations are not the one ...

ASSOC COMPUTING MACHINERY2018

A simple method to obtain visual attention data in head mounted virtual reality

Touradj Ebrahimi, Evgeniy Upenik

Automatic prediction of salient regions in images is a well developed topic in the field of computer vision. Yet, virtual reality omnidirectional visual content brings new challenges to this topic, due to a different representation of visual information an ...

IEEE2017

Towards the Use of Social Interaction Conventions as Prior for Gaze Model Adaptation

Jean-Marc Odobez, Rémy Alain Siegfried, Yu Yu

Gaze is an important non-verbal cue involved in many facets of social interactions like communication, attentiveness or attitudes. Nevertheless, extracting gaze directions visually and remotely usually suffers large errors because of low resolution images, ...

ACM2017

From retinotopic processing to nonretinotopic representation

Marc Michael Lauffs

Encoding of visual information in the brain is retinotopic: Neighboring points in the visual field are mapped onto neighboring photoreceptors in the retina, and these neighborhood relations are maintained in the early stages of cortical processing. However ...

EPFL2017