Publications related to Stereoscopy

Neural Distributed Image Compression with Cross-Attention Feature Alignment

We consider the problem of compressing an information source when a correlated one is available as side information only at the decoder side, which is a special case of the distributed source coding problem in information theory. In particular, we consider ...

IEEE COMPUTER SOC2023

3D reconstruction of curvilinear one-dimensional objects viewed in transmission electron microscopy

Gulnaz Ganeeva

To obtain a more complete understanding of material microstructure at the nanoscale and to gain profound insights into their properties, there is a growing need for more efficient and precise methods that can streamline the process of 3D imaging using a tr ...

EPFL2023

AutoSynth: Learning to Generate 3D Training Data for Object Point Cloud Registration

Mathieu Salzmann, Zheng Dang

In the current deep learning paradigm, the amount and quality of training data are as critical as the network architecture and its training details. However, collecting, processing, and annotating real data at scale is difficult, expensive, and time-consum ...

Ieee Computer Soc2023

Detecting Anomalies and Obstacles in Road Scenes

Krzysztof Maciej Lis

We address the problem of segmenting anomalies and unusual obstacles in road scenes for the purpose of self-driving safety. The objects in question are not present in the common training sets as it is not feasible to collect and annotate examples for every ...

EPFL2023

Automated neuron tracking inside moving and deforming C. elegans using deep learning and targeted augmentation

Sahand Jamal Rahi, Kseniia Korchagina

Reading out neuronal activity from three-dimensional (3D) functional imaging requires segmenting and tracking individual neurons. This is challenging in behaving animals if the brain moves and deforms. The traditional approach is to train a convolutional n ...

Nature Portfolio2023

Correlated-photon imaging at 10 volumetric images per second

Edoardo Charbon, Claudio Bruschini, Paul Mos, Arin Can Ülkü

The correlation properties of light provide an outstanding tool to overcome the limitations of traditional imaging techniques. A relevant case is represented by correlation plenoptic imaging (CPI), a quantum-inspired volumetric imaging protocol employing s ...

Nature Portfolio2023

Robust Isometric Non-Rigid Structure-From-Motion

Shaifali Parashar

Non-Rigid Structure-from-Motion (NRSfM) reconstructs a deformable 3D object from keypoint correspondences established between monocular 2D images. Current NRSfM methods lack statistical robustness, which is the ability to cope with correspondence errors. T ...

IEEE COMPUTER SOC2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

MonStereo: When Monocular and Stereo Meet at the Tail of 3D Human Localization

Alexandre Massoud Alahi, Sven Kreiss, Taylor Ferdinand Mordan, Lorenzo Bertoni

Monocular and stereo visions are cost-effective solutions for 3D human localization in the context of self-driving cars or social robots. However, they are usually developed independently and have their respective strengths and limitations. We propose a no ...

IEEE2021

3DPD: A photogrammetric pipeline for a PUSH frame stereo cameras

Nicolas Le Thomas

An innovative photogrammetric pipeline has been developed by INAF-Padova for the processing of the stereo images from the CaSSIS (Colour and Stereo Imaging System) (Thomas et al., 2014). CaSSIS is the multispectral stereo push frame camera on board ExoMars ...

PERGAMON-ELSEVIER SCIENCE LTD2021

Deep eyes: Joint depth inference using monocular and binocular cues

Siyuan Li, Chen Zhang, Yang Yang

Human visual system relies on both monocular focusness cues and binocular stereo cues to gain effective 3D perception. Correspondingly, depth from focus/defocus (DfF/DfD) and stereo matching are two most studied passive depth sensing schemes, which are tra ...

ELSEVIER2021

VIODE: A Simulated Dataset to Address the Challenges of Visual-Inertial Odometry in Dynamic Environments

Dario Floreano, Valentin Wüest, Fabian Maximilian Schilling, Koji Minoda

Dynamic environments such as urban areas are still challenging for popular visual-inertial odometry (VIO) algorithms. Existing datasets typically fail to capture the dynamic nature of these environments, therefore making it difficult to quantitatively eval ...

2021

Towards quantum 3D imaging devices

Edoardo Charbon, Claudio Bruschini, Paul Mos, Samuel Burri, Arin Can Ülkü, Michael Alan Wayne

We introduce a new generation of 3D imaging devices based on quantum plenoptic imaging. Position-momentum entanglement and photon number correlations are exploited to provide a scan-free 3D image after post-processing of the collected light intensity signa ...

2021

Model-based 3D Face Reconstruction

Christophe René Joseph Ecabert

The human face plays an essential role in social interactions as it brings information about someone's identity, state of mind, or mood. People are, by nature, very good at catching this non-spoken information. Therefore, scientists have been interested in ...

EPFL2021

Towards Quantum 3D Imaging Devices

Edoardo Charbon, Claudio Bruschini, Samuel Burri, Paul Mos, Michael Alan Wayne, Arin Can Ülkü

We review the advancement of the research toward the design and implementation of quantum plenoptic cameras, radically novel 3D imaging devices that exploit both momentum–position entanglement and photon–number correlations to provide the typical refocusin ...

2021

Unsupervised Stereo Matching Using Confidential Correspondence Consistency

Seungryong Kim

Stereo matching aims to perceive the 3D geometric configuration of scenes and facilitates a variety of computer vision in advanced driver assistance systems (ADAS) applications. Recently, deep convolutional neural networks (CNNs) have shown dramatic perfor ...

IEEE Institute of Electrical and Electronics Engineers2020

Beyond Cameras: Real-Time High-Resolution 3D and Panoramic MultiView Vision Systems with Their Applications

Bilal Demir

The cameras are invented by imitating the human visual system to capture the scene. The camera technologies have been substantially advanced in recent years. 108 MP resolution with 100x hybrid zoom has become standard features for smartphone flagships. In ...

EPFL2020

WatchNet plus plus : efficient and accurate depth-based network for detecting people attacks and intrusion

Jean-Marc Odobez, Olivier Canévet, Michael Villamizar

We present an efficient and accurate people detection approach based on deep learning to detect people attacks and intrusion in video surveillance scenarios Unlike other approaches using background segmentation and pre-processing techniques, which are not ...

2020

CNN Patch Pooling for Detecting 3D Mask Presentation Attacks in NIR

Sébastien Marcel

Presentation attacks using 3D masks pose a serious threat to face recognition systems. Automatic detection of these attacks is challenging due to hyper-realistic nature of masks. In this work, we consider presentations acquired in near infrared (NIR) imagi ...

IEEE2020

Biaxial flexural fatigue behavior of strain-hardening UHPFRC thin slab elements

Eugen Brühwiler, Xiujiang Shen

The biaxial flexural fatigue behavior of thin slab elements made of strain-hardening Ultra High Performance Fiber Reinforced Cementitious Composite (UHPFRC) is investigated experimentally by means of the ring-on-ring test method. Fourteen flexural fatigue ...

2020