Publications associées à A Virtual Keyboard Based on True-3D Optical Ranging

Customizing the human-avatar mapping based on EEG error related potentials during avatar-based interaction

Ronan Boulic, Ricardo Andres Chavarriaga Lozano, Bruno Herbelin, José del Rocio Millán Ruiz, Olaf Blanke, Fumiaki Iwane, Thibault Serge Mario Porssut

Objective. A key challenge of virtual reality (VR) applications is to maintain a reliable human-avatar mapping. Users may lose the sense of controlling (sense of agency), owning (sense of body ownership), or being located (sense of self-location) inside th ...

2024

A geometric optimal control approach for imitation and generalization of manipulation skills

Sylvain Calinon, Amirreza Razmjoo Fard, Jie Zhao

Daily manipulation tasks are characterized by regular features associated with the task structure, which can be described by multiple geometric primitives related to actions and object shapes. Only using Cartesian coordinate systems cannot fully represent ...

Elsevier2023

Learning Linearized Degradation of Health Indicators using Deep Koopman Operator Approach

Olga Fink, Sergei Garmaev

With the current trend of increasing complexity of industrial systems, the construction and monitoring of health indicators becomes even more challenging. Given that health indicators are commonly employed to predict the end of life, a crucial criterion fo ...

Research Publishing2023

3D reconstruction of curvilinear one-dimensional objects viewed in transmission electron microscopy

Gulnaz Ganeeva

To obtain a more complete understanding of material microstructure at the nanoscale and to gain profound insights into their properties, there is a growing need for more efficient and precise methods that can streamline the process of 3D imaging using a tr ...

EPFL2023

Media Coverage of 3D Visual Tools Used in Urban Participatory Planning

Jens Ingensand, Thibaud Nicolas Chassin

The opportunities provided by adopting digitally-generated visual tools in urban participatory planning are compelling. These visual tools can promote interactions between authorities and citizens and among citizens. However, the urban participatory practi ...

IGI GLOBAL2023

Ex uno plures: how to construct high-speed movies of collapsing cavitation bubbles from a single image

Mohamed Farhat, Armand Baptiste Sieber, Davide Bernardo Preso

The time-resolved visualization of the dynamics of a cavitation bubble usually requires the use of expensive high-speed cameras, which often provide a limited spatial resolution. In the present study, we propose an alternative to these high-speed imaging t ...

Springer2023

Towards a Framework for Estimation of User Susceptibility to Cybersickness

Nana Tian

Cybersickness still poses a significant challenge to the widespread usage of virtual reality (VR), leading to different levels of discomfort and potentially breaking the immersive experience. Researchers have attempted to discover the possible fundamental ...

EPFL2023

Systematic design of a multi-input multi-output controller by model-based decoupling: a demonstration on TCV using multi-species gas injection

Basil Duval, Christian Gabriel Theiler, Cristian Galperti, Artur Perek

In this paper, we present the first results of a systematically designed multi-input multi-output gas-injection controller on Tokamak a Configuration Variable (TCV). We demonstrate the simultaneous real-time control of the NII emission front position and l ...

IOP Publishing Ltd2023

Saliency prediction in 360° architectural scenes: Performance and impact of daylight variations

Marilyne Andersen, Sabine Süsstrunk, Kynthia Chamilothori, Bahar Aydemir, Caroline Karmann, Seungryong Kim

Saliency models are image-based prediction models that estimate human visual attention. Such models, when applied to architectural spaces, could pave the way for design decisions where visual attention is taken into account. In this study, we tested the pe ...

2023

An immersive virtual reality system for ecological assessment of peripersonal and extrapersonal unilateral spatial neglect

Ravi Tej Sai Giridhar Tadi, Olaf Blanke, Andrea Serino, Roberta Ronchi

BackgroundUnilateral spatial neglect (USN) is a debilitating neuropsychological syndrome that often follows brain injury, in particular a stroke affecting the right hemisphere. In current clinical practice, the assessment of neglect is based on old-fashion ...

BioMed Central2023

VIDEZZO: Dependency-aware Virtual Device Fuzzing

Mathias Josef Payer, Qiang Liu, Flavio Toffalini

A virtual machine interacts with its host environment through virtual devices, driven by virtual device messages, e.g., I/O operations. By issuing crafted messages, an adversary can exploit a vulnerability in a virtual device to escape the virtual machine, ...

Institute of Electrical and Electronics Engineers Inc.2023

Robust Isometric Non-Rigid Structure-From-Motion

Shaifali Parashar

Non-Rigid Structure-from-Motion (NRSfM) reconstructs a deformable 3D object from keypoint correspondences established between monocular 2D images. Current NRSfM methods lack statistical robustness, which is the ability to cope with correspondence errors. T ...

IEEE COMPUTER SOC2022

Reaching articular limits can negatively impact embodiment in virtual reality

Ronan Boulic, Bruno Herbelin, Olaf Blanke, Thibault Serge Mario Porssut

Providing Virtual Reality(VR) users with a 3D representation of their body complements the experience of immersion and presence in the virtual world with the experience of being physically located and more personally involved. A full-body avatar representa ...

2022

Learning to Represent and Reconstruct 3D Deformable Objects

Jan Bednarík

Representing and reconstructing 3D deformable shapes are two tightly linked problems that have long been studied within the computer vision field. Deformable shapes are truly ubiquitous in the real world, whether be it specific object classes such as human ...

EPFL2022

Weakly Supervised Volumetric Image Segmentation with Deformed Templates

Pascal Fua, Pamuditha Udaranga Wickramasinghe, Patrick Moller Jensen, Mian Akbar Shah

There are many approaches to weakly-supervised training of networks to segment 2D images. By contrast, existing approaches to segmenting volumetric images rely on full-supervision of a subset of 2D slices of the 3D volume. We propose an approach to volume ...

Springer2022

Fast 3D Modeling of Prosthetic Robotic Hands Based on a Multi-Layer Deformable Design

Daniel Thalmann

Current research of designing prosthetic robotic hands mainly focuses on improving their functionality by devising new mechanical structures and actuation systems. Most of existing work relies on a single structure/system (e.g., bone-only or tissue-only) a ...

WHIOCE PUBLISHING PTE LTD, SINGAPORE2022

Preventing Breaks in Embodiment in Immersive Virtual Reality

Thibault Serge Mario Porssut

Virtual reality (VR) is immersive not only because of visual integration, but because we can act and perform in a virtual environment (VE). Beyond the mere fact that a VR system provides images computed directly from the users' viewpoint in stereoscopy, it ...

EPFL2021

Tracking and Relative Localization of Drone Swarms With a Vision-Based Headset

Dario Floreano, Giuseppe Loianno, Maxim Pavliv, Fabrizio Schiano

We address the detection, tracking, and relative localization of the agents of a drone swarm from a human perspective using a headset equipped with a single camera and an Inertial Measurement Unit (IMU). We train and deploy a deep neural network detector o ...

2021

LiftPose3D, a deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animals

Pascal Fua, Pavan P Ramdya, Helge Jochen Rhodin, Semih Günel, Victor Lobato Rios, Daniel Eduardo Morales Garza, Marco Pietro Abrate, Adám Gosztolai

LiftPose3D infers three-dimensional poses from two-dimensional data or from limited three-dimensional data. The approach is illustrated for videos of behaving Drosophila, mice, rats and macaques. ...

NATURE PORTFOLIO2021

Towards Quantum 3D Imaging Devices

Claudio Bruschini, Edoardo Charbon, Samuel Burri, Arin Can Ülkü, Paul Mos, Michael Alan Wayne

We review the advancement of the research toward the design and implementation of quantum plenoptic cameras, radically novel 3D imaging devices that exploit both momentum–position entanglement and photon–number correlations to provide the typical refocusin ...

2021