Publications associées à Carte de disparité

Learning to Represent and Reconstruct 3D Deformable Objects

Representing and reconstructing 3D deformable shapes are two tightly linked problems that have long been studied within the computer vision field. Deformable shapes are truly ubiquitous in the real world, whether be it specific object classes such as human ...

EPFL2022

NTIRE 2021 Depth Guided Image Relighting Challenge

Sabine Süsstrunk, Majed El Helou, Ruofan Zhou, Radu Timofte

Image relighting is attracting increasing interest due to its various applications. From a research perspective, image relighting can be exploited to conduct both image normalization for domain adaptation, and also for data augmentation. It also has multip ...

IEEE COMPUTER SOC2021

Direct time-of-flight SPAD image sensors for light detection and ranging

Preethi Padmanabhan

Depth sensing is an increasingly important feature in many applications of consumer, automotive, augmented/virtual reality (AR-VR), space and bio-medical imaging. Long range, high depth resolution, high spatial resolution, and high frame rates are often co ...

EPFL2021

Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networks

Angelos Katharopoulos, Andreas Geiger, Despoina Paschalidou

Impressive progress in 3D shape extraction led to representations that can capture object geometries with high fidelity. In parallel, primitive-based methods seek to represent objects as semantically consistent part arrangements. However, due to the simpli ...

IEEE COMPUTER SOC2021

Multi-View Shape Estimation of Transparent Containers

Pascal Frossard, Andrea Cavallaro, Apostolos Modas

The 3D localisation of an object and the estimation of its properties, such as shape and dimensions, are challenging under varying degrees of transparency and lighting conditions. In this paper, we propose a method for jointly localising container-like obj ...

IEEE2020

Graph-based regularization of inverse problems in imaging

Mattia Rossi

As of today, the extension of the human visual capabilities to machines remains both a cornerstone and an open challenge in the attempt to develop intelligent systems. On the one hand, the development of more and more sophisticated imaging devices, capable ...

EPFL2020

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Global Auto-regressive Depth Recovery via Iterative Non-local Filtering

Pascal Frossard, Jingyu Yang, Xinchen Ye

Existing depth sensing techniques have many shortcomings in terms of resolution, completeness, and accuracy. The performance of 3-D broadcasting systems is therefore limited by the challenges of capturing high-resolution depth data. In this paper, we prese ...

IEEE2019

Solving the Depth Ambiguity in Single-Perspective Images

Sabine Süsstrunk, Majed El Helou, Marjan Shahpaski

Scene depth estimation is gaining in importance as more and more AR/VR and robot vision applications are developed. Conventional depth-from-defocus techniques can passively provide depth maps from a single image. This is especially advantageous for moving ...

2019

Real-Time 3D Hand Pose Estimation with 3D Convolutional Neural Networks

Daniel Thalmann, Hui Liang

In this paper, we present a novel method for real-time 3D hand pose estimation from single depth images using 3D Convolutional Neural Networks (CNNs). Image-based features extracted by 2D CNNs are not directly suitable for 3D hand pose estimation due to th ...

IEEE COMPUTER SOC2019

3D Box Proposals from a Single Monocular Image of an Indoor Scene

Mathieu Salzmann, Wei Zhuo

Modern object detection methods typically rely on bounding box proposals as input. While initially popularized in the 2D case, this idea has received increasing attention for 3D bounding boxes. Nevertheless, existing 3D box proposal techniques all assume h ...

ASSOC ADVANCEMENT ARTIFICIAL INTELLIGENCE2018

Learning to Reconstruct Texture-less Deformable Surfaces from a Single View

Pascal Fua, Mathieu Salzmann, Jan Bednarík

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an open problem, a ...

2018

Learning to Reconstruct Texture-less Deformable Surfaces from a Single View

Pascal Fua, Mathieu Salzmann, Jan Bednarík

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an open problem, a ...

IEEE2018

Sampling Models in Light Fields

Zhou Xue

What is the actual information contained in light rays filling the 3-D world? Leonardo da Vinci saw the world as an infinite number of radiant pyramids caused by the objects located in it. Nowadays, the radiant pyramid is usually described as a set of ligh ...

EPFL2016

A Combined Approach Toward Consistent Reconstructions of Indoor Spaces Based on 6D RGB-D Odometry and KinectFusion

Nadia Barbara Figueroa Fernandez

We propose a 6D RGB-D odometry approach that finds the relative camera pose between consecutive RGB-D frames by keypoint extraction and feature matching both on the RGB and depth image planes. Furthermore, we feed the estimated pose to the highly accurate ...

Assoc Computing Machinery2015

Real-Time High-Resolution Multiple-Camera Depth Map Estimation Hardware and Its Applications

Abdulkadir Akin

Depth information is used in a variety of 3D based signal processing applications such as autonomous navigation of robots and driving systems, object detection and tracking, computer games, 3D television, and free view-point synthesis. These applications r ...

EPFL2015

Realtime Face Tracking and Animation

Sofien Bouaziz

Capturing and processing human geometry, appearance, and motion is at the core of computer graphics, computer vision, and human-computer interaction. The high complexity of human geometry and motion dynamics, and the high sensitivity of the human visual sy ...

EPFL2015

3D Geometry Representation using Multiview Coding of Image Tiles

Pascal Frossard, Thomas Maugey, Yu Gao

Compression of dynamic 3D geometry obtained from depth sensors is challenging, because noise and temporal inconsistency inherent in acquisition of depth data means there is no one-to-one correspondence between sets of 3D points in consecutive time instants ...

2014

RD optimized auxiliary information for inpainting-based view synthesis

Pascal Frossard, Thomas Maugey

Texture and depth maps of two neighboring camera viewpoints are typically required for synthesis of an intermediate virtual view via depth-image-based rendering (DIBR). However, the bitrate overhead required for reconstruction ofmultiple texture and depth ...

2012

Realtime Performance-Based Facial Animation

Mark Pauly, Sofien Bouaziz, Hao Li

This paper presents a system for performance-based character animation that enables any user to control the facial expressions of a digital avatar in realtime. The user is recorded in a natural environment using a non-intrusive, commercially available 3D s ...

2011