Publications related to Facial motion capture

Formal Foundations of Capture Tracking

Type systems are a device for verifying properties of programs without running them. Many programming languages used in the industry have always had a type system, while others were initially created without a type system and later adopted one, when the ad ...

EPFL2024

MaskCLR: Attention-Guided Contrastive Learning for Robust Action Representation Learning

Alexandre Massoud Alahi, Mohamed Ossama Ahmed Abdelfattah, Mariam Ahmed Mahmoud Hegazy Hassan

Current transformer-based skeletal action recognition models tend to focus on a limited set of joints and low-level motion patterns to predict action classes. This results in significant performance degradation under small skeleton perturbations or changin ...

2024

Real-time Self-contact Retargeting of Avatars down to Finger Level

Ronan Boulic, Bruno Herbelin, Mathias Guy Delahaye

We interact with the world through a body that includes hands and fingers. Likewise, providing an avatar allowing the control of a virtual body with fingers is an important step to improve the user experience in VR. When the user and their avatar skeleton ...

The Eurographics Association2023

From finger animation to full-body embodiment of avatars with different morphologies and proportions

Mathias Guy Delahaye

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

How to Boost Face Recognition with StyleGAN?

Nikita Durasov

State-of-the-art face recognition systems require vast amounts of labeled training data. Given the priority of privacy in face recognition applications, the data is limited to celebrity web crawls, which have issues such as limited numbers of identities. O ...

Ieee Computer Soc2023

Real-time actuation of a dielectric elastomer actuator neuroprosthesis for facial paralysis

Yves Perriard, Yoan René Cyrille Civet, Thomas Guillaume Martinez, Stefania Maria Aliki Konstantinidi, Armando Matthieu Walter, Amine Benouhiba

Facial paralysis is a highly burdening condition, resulting in a patient's inability to move his mimic musculature on one or both sides of his face. This condition compromises the patient's communication and facial expressions, and thus dramatically reduce ...

2023

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

Temporal Representation Learning on Monocular Videos for 3D Human Pose Estimation

Pascal Fua, Mathieu Salzmann, Helge Jochen Rhodin, Victor Constantin, Sina Honari

In this paper we propose an unsupervised feature extraction method to capture temporal information on monocular videos, where we detect and encode subject of interest in each frame and leverage contrastive self-supervised (CSS) learning to extract rich lat ...

2022

A Novel Framework for Assessment of Deep Face Recognition Systems in Realistic Conditions

Touradj Ebrahimi, Yuhang Lu, Luca Barras

Deep convolutional neural networks have shown remarkable results on face recognition (FR). Despite their significant progress, the performance of current face recognition techniques is often assessed in benchmarks under not always realistic conditions. The ...

2022

Virtual Safety Assistant: An Efficient Tool for Ensuring Safety During Covid-19 Pandemic

Daniel Thalmann

Using intelligent virtual assistants for controlling employee population in workspaces is a research area that remains unexplored. This paper presents a novel application of virtual humans to enforce Covid-19 safety measures in a corporate workplace. For t ...

SPRINGER INTERNATIONAL PUBLISHING AG2022

Preventing Breaks in Embodiment in Immersive Virtual Reality

Thibault Serge Mario Porssut

Virtual reality (VR) is immersive not only because of visual integration, but because we can act and perform in a virtual environment (VE). Beyond the mere fact that a VR system provides images computed directly from the users' viewpoint in stereoscopy, it ...

EPFL2021

Matching Seqlets: An Unsupervised Approach for Locality Preserving Sequence Matching

Pascal Fua, Xinchao Wang

In this paper, we propose a novel unsupervised approach for sequence matching by explicitly accounting for the locality properties in the sequences. In contrast to conventional approaches that rely on frame-to-frame matching, we conduct matching using sequ ...

2021

Cross Modal Focal Loss for RGBD Face Anti-Spoofing

Sébastien Marcel

Automatic methods for detecting presentation attacks are essential to ensure the reliable use of facial recognition technology. Most of the methods available in the litera- ture for presentation attack detection (PAD) fails in gen- eralizing to unseen atta ...

IEEE2021

Tracking and Relative Localization of Drone Swarms With a Vision-Based Headset

Dario Floreano, Maxim Pavliv, Fabrizio Schiano, Giuseppe Loianno

We address the detection, tracking, and relative localization of the agents of a drone swarm from a human perspective using a headset equipped with a single camera and an Inertial Measurement Unit (IMU). We train and deploy a deep neural network detector o ...

2021

Model-based 3D Face Reconstruction

Christophe René Joseph Ecabert

The human face plays an essential role in social interactions as it brings information about someone's identity, state of mind, or mood. People are, by nature, very good at catching this non-spoken information. Therefore, scientists have been interested in ...

EPFL2021

3D Printed Motor-Sensory Module Prototype for Facial Rehabilitation

Jamie Paik, Amir Firouzeh, Matthew Aaron Robertson

This work demonstrates the first 3D printed wearable motor-sensory module prototype designed for facial rehabilitation, focusing on facial paralysis. The novelty of the work lies in the fast fabrication of the first fully soft working prototype, including ...

MARY ANN LIEBERT, INC2022

ActiveMoCap: Optimized Viewpoint Selection for Active Human Motion Capture

Pascal Fua, Mathieu Salzmann, Helge Jochen Rhodin, Sena Kiciroglu, Sudipta Sinha

The accuracy of monocular 3D human pose estimation depends on the viewpoint from which the image is captured. While freely moving cameras, such as on drones, provide control over this viewpoint, automatically positioning them at the location which will yie ...

IEEE2020

Multi-Modal Recurrent Attention Networks for Facial Expression Recognition

Seungryong Kim, Jiyoung Lee

Recent deep neural networks based methods have achieved state-of-the-art performance on various facial expression recognition tasks. Despite such progress, previous researches for facial expression recognition have mainly focused on analyzing color recordi ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2020

Compressed sensing with signal averaging for improved sensitivity and motion artifact reduction in fluorine-19 MRI

Tobias Kober, Tom Hilbert, Jérôme Yerly, Ruud van Heeswijk, Elena Najdenovska

Fluorine-19 (F-19) MRI of injected perfluorocarbon emulsions (PFCs) allows for the non-invasive quantification of inflammation and cell tracking, but suffers from a low signal-to-noise ratio and extended scan time. To address this limitation, we tested the ...

WILEY2020

Drift-Free Foot Orientation Estimation in Running Using Wearable IMU

Kamiar Aminian, Frédéric Meyer, Mathieu Pascal Falbriard, Grégoire Millet, Benoît Mariani

This study aimed to introduce and validate a new method to estimate and correct the orientation drift measured from foot-worn inertial sensors. A modified strap-down integration (MSDI) was proposed to decrease the orientation drift, which, in turn, was fur ...

2020