Publications associées à Dynamic 3D Avatar Creation from Hand-held Video Input

From finger animation to full-body embodiment of avatars with different morphologies and proportions

VR (Virtual Reality) is a real-time simulation that creates the subjective illusion of being in a virtual world. This thesis explores how integrating the user's body and fingers can be achieved and beneficial for the user to experience VR. At the advent of ...

EPFL2023

Real-time Self-contact Retargeting of Avatars down to Finger Level

Ronan Boulic, Bruno Herbelin, Mathias Guy Delahaye

We interact with the world through a body that includes hands and fingers. Likewise, providing an avatar allowing the control of a virtual body with fingers is an important step to improve the user experience in VR. When the user and their avatar skeleton ...

The Eurographics Association2023

Deep Learning for 3D Surface Modelling and Reconstruction

Benoît Alain René Guillard

In recent years, there has been a significant revolution in the field of deep learning, which has demonstrated its effectiveness in automatically capturing intricate patterns from large datasets. However, the majority of these successes in Computer Vision ...

EPFL2023

Automated neuron tracking inside moving and deforming C. elegans using deep learning and targeted augmentation

Sahand Jamal Rahi, Kseniia Korchagina

Reading out neuronal activity from three-dimensional (3D) functional imaging requires segmenting and tracking individual neurons. This is challenging in behaving animals if the brain moves and deforms. The traditional approach is to train a convolutional n ...

Nature Portfolio2023

Robust Isometric Non-Rigid Structure-From-Motion

Shaifali Parashar

Non-Rigid Structure-from-Motion (NRSfM) reconstructs a deformable 3D object from keypoint correspondences established between monocular 2D images. Current NRSfM methods lack statistical robustness, which is the ability to cope with correspondence errors. T ...

IEEE COMPUTER SOC2022

Synthesis and Analysis of 3D shapes with Geometric Deep Learning in Computer-Aided Engineering

Edoardo Remelli

In this thesis, we advocate that Computer-Aided Engineering could benefit from a Geometric Deep Learning revolution, similarly to the way that Deep Learning revolutionized Computer Vision. To do so, we consider a variety of Computer-Aided Engineering pr ...

EPFL2022

Evaluating CO2 breakthrough in a shaly a caprock material: a multi-scale experimental approach

Lyesse Laloui, Eleni Stavropoulou

The potential of underground CO2 storage relies on the sealing efficiency of an overlaying caprock that acts as a geological barrier. Shales are considered as potential caprock formations thanks to their favourable hydro-mechanical properties. In this work ...

Nature Research2022

Efficient and Accurate Physically-Based Differentiable Rendering

Delio Aleardo Vicini

Physically-based rendering algorithms generate photorealistic images of virtual scenes. By simulating light paths in a scene, complex physical effects such as shadows, reflections and volumetric scattering can be reproduced. Over the last decade, physicall ...

EPFL2022

Image-based geometric digital twinning for stone masonry elements

Katrin Beyer, Bryan German Pantoja Rosero, Savvas Saloustros

We present an image-based pipeline for generating geometrical digital twins (GDTs) of stone masonry elements with detail down to the stone level. For this purpose, we acquire RGB images of the individual stones and of the wall during the construction phase ...

2022

Sketch2Mesh: Reconstructing and Editing 3D Shapes from Sketches

Pascal Fua, Edoardo Remelli, Benoît Alain René Guillard, Pierre Mathieu Yvernay

Reconstructing 3D shape from 2D sketches has long been an open problem because the sketches only provide very sparse and ambiguous information. In this paper, we use an encoder/decoder architecture for the sketch to mesh translation. When integrated into a ...

IEEE2021

All-Solid-State Ion-Selective Electrodes: A Tutorial for Correct Practice

Giovanni De Micheli, Sandro Carrara, Irene Taurino, Mandresy Ivan Ny Hanitra, Francesca Criscuolo

The research on ion-measuring devices has seen a rapid expansion in the last years as a consequence of the growing interest in wearable sensors for biofluids analysis and in portable devices for remote or in-line water and food quality monitoring. As a res ...

2021

System and method for user data input to modify operating mode configurations

Semyon Malamud

A computer-implemented method, computer program product and computer system (100) for editing a configuration of a physical entity (30) to configure a future operating mode of a physical entity. A GUI component (200) provides a visual representation of a t ...

2020

Physics of optically driven nanojunctions

Philippe Andreas Rölli

Recent years have seen spectacular developments in the domain of nano-optics. Alongside the well-known techniques of super-resolution microscopy progress in nanofabrication has enabled important improvements in the fields of optical imaging and spectros ...

EPFL2020

Reconciling Being in-Control vs. Being Helped for the Execution of Complex Movements in VR

Ronan Boulic, Bruno Herbelin, Thibault Serge Mario Porssut

Performing motor tasks in virtual environments is best achieved with motion capture and animation of a 3D character that participants control in real time and perceive as being their avatar in the virtual environment. A strong Sense of Embodiment (SoE) for ...

IEEE2019

Wearable Technologies for Embodied Human-Robot Interaction

Carine Rognon

Robotic teleoperation is fundamental to augment the resilience, precision, and force of robots with the cognition of the operator. However, current interfaces, such as joysticks and remote controllers, are often complicated to handle since they require cog ...

EPFL2019

An open platform for Aerosol InfraRed Spectroscopy analysis - AIRSpec

Satoshi Takahama, Rudolf Höhn, Matteo Reggente

AIRSpec is a platform consisting of several chemometric packages developed for analysis of Fourier transform infrared (FTIR) spectra of atmospheric aerosols. The packages are accessible through a browser-based interface, which also generates the necessary ...

2019

HapTwist: Creating Interactive Haptic Proxies in Virtual Reality Using Low-cost Twistable Artefacts

Yi-Shiun Wu

In this paper, we present a series of studies on using Rubik's Twist, a type of low-cost twistable artefact, to create haptic proxies for various hand-graspable VR objects. Our pilot studies validated the feasibility and effectiveness of Rubik's-Twist-base ...

ASSOC COMPUTING MACHINERY2019

Physics-based Reconstruction and Animation of Humans

Alexandru Eugen Ichim

Creating digital representations of humans is of utmost importance for applications ranging from entertainment (video games, movies) to human-computer interaction and even psychiatrical treatments. What makes building credible digital doubles difficult is ...

EPFL2017

SPA: Sparse Photorealistic Animation Using a Single RGB-D Camera

Ronan Boulic, Eray Molla, Jingyu Yang, Kun Li

Photorealistic animation is a desirable technique for computer games and movie production. We propose a new method to synthesize plausible videos of human actors with new motions using a single cheap RGB-D camera. A small database is captured in a usual of ...

Ieee-Inst Electrical Electronics Engineers Inc2017

Phace: Physics-based Face Modeling and Animation

Ladislav Kavan, Mark Pauly, Alexandru Eugen Ichim

We present a novel physics-based approach to facial animation. Contrary to commonly used generative methods, our solution computes facial expressions by minimizing a set of non-linear potential energies that model the physical interaction of passive flesh, ...

2017