Publications associées à Online Generative Model Personalization for Hand Tracking

From finger animation to full-body embodiment of avatars with different morphologies and proportions

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

Real-time Self-contact Retargeting of Avatars down to Finger Level

Ronan Boulic, Bruno Herbelin, Mathias Guy Delahaye

We interact with the world through a body that includes hands and fingers. Likewise, providing an avatar allowing the control of a virtual body with fingers is an important step to improve the user experience in VR. When the user and their avatar skeleton ...

The Eurographics Association2023

Indoor Real-time localization system design for Internet of Things applications

Pooneh Mohaghegh

With the prevalence of smartphones, watches, and Internet of Things (IoT) devices, the ability to track their positions is becoming increasingly important. For many indoor positioning systems (IPSs), providing an uninterrupted flow of information in real-t ...

EPFL2023

Diff3DHPE: A Diffusion Model for 3D Human Pose Estimation

Tong Zhang

Accurately estimating 3D human pose (3D HPE) and joint locations using only 2D keypoints is challenging. The noise in the predictions produced by conventional 2D human pose estimators often impeded the accuracy. In this paper, we present a diffusion-based ...

Ieee Computer Soc2023

On the benefit of concurrent adjustment of active and passive optical sensors with GNSS & raw inertial data

Jan Skaloud, Davide Antonio Cucci, Kyriaki Mouzakidou

In airborne laser scanning a high-frequency trajectory solution is typically determined from inertial sensors and employed to directly geo-reference the acquired laser points. When low-cost MEMS inertial sensors are used, such as in lightweight unmanned ae ...

2022

Tracking and Relative Localization of Drone Swarms With a Vision-Based Headset

Dario Floreano, Giuseppe Loianno, Maxim Pavliv, Fabrizio Schiano

We address the detection, tracking, and relative localization of the agents of a drone swarm from a human perspective using a headset equipped with a single camera and an Inertial Measurement Unit (IMU). We train and deploy a deep neural network detector o ...

2021

UWB-based system for UAV Localization in GNSS-Denied Environments: Characterization and Dataset

Dario Floreano, Fabrizio Schiano

Small unmanned aerial vehicles (UAV) have penetrated multiple domains over the past years. In GNSS-denied or indoor environments, aerial robots require a robust and stable localization system, often with external feedback, in order to fly safely. Motion ca ...

2020

Drift-Free Foot Orientation Estimation in Running Using Wearable IMU

Kamiar Aminian, Frédéric Meyer, Benoît Mariani, Grégoire Millet, Mathieu Pascal Falbriard

This study aimed to introduce and validate a new method to estimate and correct the orientation drift measured from foot-worn inertial sensors. A modified strap-down integration (MSDI) was proposed to decrease the orientation drift, which, in turn, was fur ...

2020

Compressed sensing with signal averaging for improved sensitivity and motion artifact reduction in fluorine-19 MRI

Jérôme Yerly, Ruud van Heeswijk, Elena Najdenovska, Tobias Kober, Tom Hilbert

Fluorine-19 (F-19) MRI of injected perfluorocarbon emulsions (PFCs) allows for the non-invasive quantification of inflammation and cell tracking, but suffers from a low signal-to-noise ratio and extended scan time. To address this limitation, we tested the ...

WILEY2020

Real-time camera pose estimation for sports fields

Pascal Fua, Charles Dubout, Horesh Beny Ben Shitrit, Pablo Marquez Neila, Stefano Savarè, Leonardo Citraro

Given an image sequence featuring a portion of a sports field filmed by a moving and uncalibrated camera, such as the one of the smartphones, our goal is to compute automatically in real time the focal length and extrinsic camera parameters for each image ...

2020

Intent Prediction Based on Biomechanical Coordination of EMG and Vision-Filtered Gaze for End-Point Control of an Arm Prosthesis

Aude Billard, Silvestro Micera, Iason Batzianoulis, Nili Eliana Krausz

We propose a novel controller for powered prosthetic arms, where fused EMG and gaze data predict the desired end-point for a full arm prosthesis, which could drive the forward motion of individual joints. We recorded EMG, gaze, and motion-tracking during p ...

2020

Beyond Cameras: Real-Time High-Resolution 3D and Panoramic MultiView Vision Systems with Their Applications

Bilal Demir

The cameras are invented by imitating the human visual system to capture the scene. The camera technologies have been substantially advanced in recent years. 108 MP resolution with 100x hybrid zoom has become standard features for smartphone flagships. In ...

EPFL2020

Training Algorithms for Multiple Object Tracking

Andrii Maksai

Multiple object tracking is a crucial Computer Vision Task. It aims at locating objects of interest in the image sequences, maintaining their identities, and identifying their trajectories over time. A large portion of current research focuses on tracking ...

EPFL2019

Head motion measurement and correction using FID navigators

Tobias Kober, Maryna Volodimirivna Waszak

Purpose: To develop a novel framework for rapid, intrinsic head motion measurement in MRI using FID navigators (FIDnavs) from a multichannel head coil array. ...

WILEY2019

Reconciling Being in-Control vs. Being Helped for the Execution of Complex Movements in VR

Ronan Boulic, Bruno Herbelin, Thibault Serge Mario Porssut

Performing motor tasks in virtual environments is best achieved with motion capture and animation of a 3D character that participants control in real time and perceive as being their avatar in the virtual environment. A strong Sense of Embodiment (SoE) for ...

IEEE2019

No time for drifting: Comparing performance and applicability of signal detrending algorithms for real-time fMRI

Dimitri Nestor Alice Van De Ville, Frank Scharnowski, Yury Koush, Rotem Roza Kopel

As a consequence of recent technological advances in the field of functional magnetic resonance imaging (fMRI), results can now be made available in real-time. This allows for novel applications such as online quality assurance of the acquisition, intra-op ...

2019

Mo(2)Cap(2): Real-time Mobile 3D Motion Capture with a Cap-mounted Fisheye Camera

Pascal Fua, Helge Jochen Rhodin

We propose the first real-time system for the egocentric estimation of 3D human body pose in a wide range of unconstrained everyday activities. This setting has a unique set of challenges, such as mobility of the hardware setup, and robustness to long capt ...

2019

Subjective Evaluation of 360-degree Sensory Experiences

Pascal Frossard, Roberto Gerson De Albuquerque Azevedo

Traditionally, most multimedia content has been developed to stimulate two of the human senses, i.e., sight and hearing. Due to recent technological advancements, however, innovative services have been developed that provide more realistic, immersive, and ...

IEEE2019

Real-Time Generative Hand Modeling and Tracking

Anastasia Tkach

In our everyday life we interact with the surrounding environment using our hands. A main focus of recent research has been to bring such interaction to virtual objects, such as the ones projected in virtual reality devices, or super-imposed as holograms i ...

EPFL2018

Learning Monocular 3D Human Pose Estimation from Multi-view Images

Pascal Fua, Mathieu Salzmann, Frédéric Meyer, Victor Constantin, Isinsu Katircioglu, Helge Jochen Rhodin

Accurate 3D human pose estimation from single images is possible with sophisticated deep-net architectures that have been trained on very large datasets. However, this still leaves open the problem of capturing motions for which no such database exists. Ma ...

IEEE2018