Publications related to Camera resectioning

Airborne sensor fusion: Expected accuracy and behavior of a concurrent adjustment

Jan Skaloud, Davide Antonio Cucci, Aurélien Arnaud Brun, Kyriaki Mouzakidou

Tightly-coupled sensor orientation, i.e. the simultaneous processing of temporal (GNSS and raw inertial) and spatial (image and lidar) constraints in a common adjustment, has demonstrated significant improvement in the quality of attitude determination wit ...

2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Automated Human Motion Analysis and Synthesis

Sena Kiciroglu

Human motion analysis and synthesis is integral to many computer vision applications, from autonomous driving to sports analysis. In this thesis, we address several problems in this domain. First we consider active viewpoint selection for pose estimation w ...

EPFL2023

Real-Time Localization for Closed-Loop Control of Assistive Furniture

Auke Ijspeert, Alexandre Massoud Alahi, Lixuan Tang, Anastasia Bolotnikova, George Adaimi, Chuanfang Ning

For people with limited mobility, navigating in cluttered indoor environment is challenging. In this work, we propose a mobile assistive furniture suite that is designed to ease the life of people with special needs in indoor movement. To enable intelligen ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Diff3DHPE: A Diffusion Model for 3D Human Pose Estimation

Tong Zhang

Accurately estimating 3D human pose (3D HPE) and joint locations using only 2D keypoints is challenging. The noise in the predictions produced by conventional 2D human pose estimators often impeded the accuracy. In this paper, we present a diffusion-based ...

Ieee Computer Soc2023

Improving Object Detection under Domain Shifts

Vidit Vidit

Object detection plays a critical role in various computer vision applications, encompassing domains like autonomous vehicles, object tracking, and scene understanding. These applica- tions rely on detectors that generate bounding boxes around known object ...

EPFL2023

Burst Vision Using Single-Photon Cameras

Edoardo Charbon, Paul Mos, Mohit Gupta

Single-photon avalanche diodes (SPADs) are novel image sensors that record the arrival of individual photons at extremely high temporal resolution. In the past, they were only available as single pixels or small-format arrays, for various active imaging ap ...

IEEE COMPUTER SOC2023

CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Data

Iordan Doytchinov, Qi Yan, Shanci Li, Jianhao Zheng

We present a visual localization system that learns to estimate camera poses in the real world with the help of synthetic data. Despite significant progress in recent years, most learning-based approaches to visual localization target at a single domain an ...

IEEE COMPUTER SOC2022

Digital twins for post-earthquake damage assessment of free-standing buildings including damage information

Katrin Beyer, Radhakrishna Achanta, Bryan German Pantoja Rosero, Amir Rezaie

We present a pipeline for the automatic generation of digital twins of free-standing buildings for damage assessment. Our method takes multiple view images of the target building as input and processes them to produce a 3D model in levels of detail (LOD) f ...

2022

VL4Pose: Active Learning Through Out-Of-Distribution Detection For Pose Estimation

Alexandre Massoud Alahi, Megh Hiren Shukla

Advances in computing have enabled widespread access to pose estimation, creating new sources of data streams. Unlike mock set-ups for data collection, tapping into these data streams through on-device active learning allows us to directly sample from the ...

BMVA Press2022

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

Progressive Correspondence Pruning by Consensus Learning

Mathieu Salzmann, Chenxu Zhao, Hongwei Li, Feng Zhu, Rui Zhao

Correspondence pruning aims to correctly remove false matches (outliers) from an initial set of putative correspondences. The pruning process is challenging since putative matches are typically extremely unbalanced, largely dominated by outliers, and the r ...

IEEE2021

LiftPose3D, a deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animals

Pascal Fua, Pavan P Ramdya, Adám Gosztolai, Victor Lobato Rios, Helge Jochen Rhodin, Semih Günel, Daniel Eduardo Morales Garza, Marco Pietro Abrate

LiftPose3D infers three-dimensional poses from two-dimensional data or from limited three-dimensional data. The approach is illustrated for videos of behaving Drosophila, mice, rats and macaques. ...

NATURE PORTFOLIO2021

DepthInSpace: Exploitation and Fusion of Multiple Video Frames for Structured-Light Depth Estimation

François Fleuret, Camilla Carta

We present DepthInSpace, a self-supervised deep-learning method for depth estimation using a structured-light camera. The design of this method is motivated by the commercial use case of embedded depth sensors in nowadays smartphones. We first propose to u ...

IEEE2021

Joint Human Pose Estimation and Stereo 3D Localization

Alexandre Massoud Alahi, Sven Kreiss, Lorenzo Bertoni, Wenlong Deng

We present an end-to-end trainable Neural Network architecture for stereo imaging that jointly locates and estimates human body poses in 3D. Our method defines a 2D pose for each human in a stereo pair of images and uses a correlation layer with a composit ...

IEEE2020

Multi-View Triangulation: Systematic Comparison and an Improved Method

Peng Song

Triangulation is an important task in the 3D reconstruction of computer vision. It seems simple to find the position of a point in 3D space when its 2D perspective projections in multi-view images are given and the corresponding camera projection matrices ...

2020

Real-time camera pose estimation for sports fields

Pascal Fua, Charles Dubout, Leonardo Citraro, Horesh Beny Ben Shitrit, Stefano Savarè, Pablo Marquez Neila

Given an image sequence featuring a portion of a sports field filmed by a moving and uncalibrated camera, such as the one of the smartphones, our goal is to compute automatically in real time the focal length and extrinsic camera parameters for each image ...

2020

Accurate Nod and 3D Gaze Estimation for Social Interaction Analysis

Yu Yu

Non-verbal behaviours play an important role in human communication since it can indicate human attention, serve as communication cue in interactions, or even reveal higher level personal constructs. For instance, head nod, a common non-verbal behaviour, c ...

EPFL2020

Deformation-aware Unpaired Image Translation for Pose Estimation on Laboratory Animals

Pascal Fua, Pavan P Ramdya, Helge Jochen Rhodin, Semih Günel, Siyuan Li, Mirela Ostrek

Our goal is to capture the pose of neuroscience model organisms, without using any manual supervision, to be able to study how neural circuits orchestrate behaviour. Human pose estimation attains remarkable accuracy when trained on real or simulated datase ...

2020

Learning stereo reconstruction with deep neural networks

Stepan Tulyakov

Stereo reconstruction is a problem of recovering a 3d structure of a scene from a pair of images of the scene, acquired from different viewpoints. It has been investigated for decades and many successful methods were developed. The main drawback of these ...

EPFL2020