Publications by Jean-Marc Odobez

Giving Sense to Inputs: Toward an Accessible Control Framework for Shared Autonomy

While shared autonomy offers significant potential for assistive robotics, key questions remain about how to effectively map 2D control inputs to 6D robot motions. An intuitive framework should allow users to input commands effortlessly, with the robot res ...

IEEE2025

ChildPlay-Hand: A Dataset of Hand Manipulations in the Wild

Jean-Marc Odobez, Samy Tafasca

Hand-Object Interaction (HOI) is gaining significant attention, particularly with the creation of numerous egocentric datasets driven by AR/VR applications. However, third-person view HOI has received less attention, especially in terms of datasets. Most t ...

Springer Science and Business Media Deutschland GmbH2025

From Forest to Zoo: Great Ape Behavior Recognition with Chimpbehave

Jean-Marc Odobez

This paper addresses the significant challenge of recognizing behaviors in non-human primates, specifically focusing on chimpanzees. Automated behavior recognition is crucial for both conservation efforts and the advancement of behavioral research. However ...

SPRINGER2025

A Unified Model for Gaze Following and Social Gaze Prediction

Jean-Marc Odobez, Anshul Gupta, Samy Tafasca, Naravich Chutisilp

Human gaze plays a crucial role in communication and social interaction. Many recent studies have focused on predicting the 2D pixel location of a person's gaze target in an image. However, this approach has limitations when it comes to studying gaze for d ...

IEEE2024

CCDb-HG: Novel Annotations and Gaze-Aware Representations for Head Gesture Recognition

Jean-Marc Odobez

Despite remarkable progress in various human behavior perception tasks, head gesture recognition (HGR) has received limited attention in terms of datasets, benchmarks, and methods. In this work, we aim to address this gap and make two main contributions. F ...

IEEE2024

ChildPlay: A New Benchmark for Understanding Children's Gaze Behaviour

Jean-Marc Odobez, Anshul Gupta, Samy Tafasca

Gaze behaviors such as eye-contact or shared attention are important markers for diagnosing developmental disorders in children. While previous studies have looked at some of these elements, the analysis is usually performed on private datasets and is rest ...

Ieee Computer Soc2023

A Modular Multimodal Architecture for Gaze Target Prediction: Application to Privacy-Sensitive Settings

Jean-Marc Odobez, Anshul Gupta, Samy Tafasca

Predicting where a person is looking is a complex task, requiring to understand not only the person's gaze and scene content, but also the 3D scene structure and the person's situation (are they manipulating? interacting or observing others? attentive?) to ...

IEEE2022

Robust Unsupervised Gaze Calibration Using Conversation and Manipulation Attention Priors

Jean-Marc Odobez, Rémy Alain Siegfried

Gaze estimation is a difficult task, even for humans. However, as humans, we are good at understanding a situation and exploiting it to guess the expected visual focus of attention of people, and we usually use this information to retrieve people's gaze. I ...

ASSOC COMPUTING MACHINERY2022

Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformers

Jean-Marc Odobez, Michael Villamizar

We propose to leverage Transformer architectures for non-autoregressive human motion prediction. Our approach decodes elements in parallel from a query sequence, instead of conditioning on previous predictions such as in state-of-the-art RNN-based approach ...

IEEE COMPUTER SOC2021

Neural Network Adaptation and Data Augmentation for Multi-Speaker Direction-of-Arrival Estimation

Jean-Marc Odobez, Petr Motlicek, Weipeng He

IEEE2021

Multi-task Neural Network for Robust Multiple Speaker Embedding Extraction

Jean-Marc Odobez, Petr Motlicek, Weipeng He

This paper introduces a novel approach for extracting speaker embeddings from audio mixtures of multiple overlapping voices. This approach is based on a multi-task neural network. The network first extracts a latent feature for each direction. This feature ...

ISCA-INT SPEECH COMMUNICATION ASSOC2021

Active Learning of Bayesian Probabilistic Movement Primitives

Sylvain Calinon, Jean-Marc Odobez, Hakan Girgin, Thibaut Antoine Kulak

Learning from Demonstration permits non-expert users to easily and intuitively reprogram robots. Among approaches embracing this paradigm, probabilistic movement primitives (ProMPs) are a well-established and widely used method to learn trajectory distribu ...

IEEE2021

Visual Focus of Attention Estimation in 3D Scene with an Arbitrary Number of Targets

Jean-Marc Odobez, Rémy Alain Siegfried

Visual Focus of Attention (VFOA) estimation in conversation is challenging as it relies on difficult to estimate information (gaze) combined with scene features like target positions and other contextual information (speaking status) allowing to disambigua ...

IEEE COMPUTER SOC2021

Multi-scale sequential network for semantic text segmentation and localization

Jean-Marc Odobez, Olivier Canévet, Michael Villamizar

We present a novel method for semantic text document analysis which in addition to localizing text it labels the text in user-defined semantic categories. More precisely, it consists of a fully-convolutional and sequential network that we apply to the part ...

2020

ManiGaze: a Dataset for Evaluating Remote Gaze Estimator in Object Manipulation Situations

Jean-Marc Odobez, Bozorgmehr Aminian, Rémy Alain Siegfried

Gaze estimation allows robots to better understand users and thus to more precisely meet their needs. In this paper, we are interested in gaze sensing for analyzing collaborative tasks and manipulation behaviors in human-robot interactions (HRI), which dif ...

ACM2020

A Differential Approach for Gaze Estimation

Jean-Marc Odobez, Yu Yu, Gang Liu

Most non-invasive gaze estimation methods regress gaze directions directly from a single face or eye image. However, due to important variabilities in eye shapes and inner eye structures amongst individuals, universal models obtain limited accuracies and t ...

2021

Residual Pose: A Decoupled Approach for Depth-based 3D Human Pose Estimation

Jean-Marc Odobez, Olivier Canévet, Michael Villamizar

IEEE2020

Unsupervised Representation Learning for Gaze Estimation

Jean-Marc Odobez, Yu Yu

Although automatic gaze estimation is very important to a large variety of application areas, it is difficult to train accurate and robust gaze models, in great part due to the difficulty in collecting large and diverse data (annotating 3D gaze is expensiv ...

IEEE2020

WatchNet plus plus : efficient and accurate depth-based network for detecting people attacks and intrusion

Jean-Marc Odobez, Olivier Canévet, Michael Villamizar

We present an efficient and accurate people detection approach based on deep learning to detect people attacks and intrusion in video surveillance scenarios Unlike other approaches using background segmentation and pre-processing techniques, which are not ...

2020

The MuMMER Data Set for Robot Perception in Multi-party HRI Scenarios

Jean-Marc Odobez, Petr Motlicek, Olivier Canévet

This paper presents the MuMMER data set, a data set for human-robot interaction scenarios that is available for research purposes% It comprises 1 h 29 min of multimodal recordings of people interacting with the social robot Pepper in entertainment scenario ...

IEEE2020