Publications associées à Pose (computer vision)

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Real-Time Localization for Closed-Loop Control of Assistive Furniture

Auke Ijspeert, Alexandre Massoud Alahi, Lixuan Tang, Anastasia Bolotnikova, George Adaimi, Chuanfang Ning

For people with limited mobility, navigating in cluttered indoor environment is challenging. In this work, we propose a mobile assistive furniture suite that is designed to ease the life of people with special needs in indoor movement. To enable intelligen ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Diff3DHPE: A Diffusion Model for 3D Human Pose Estimation

Tong Zhang

Accurately estimating 3D human pose (3D HPE) and joint locations using only 2D keypoints is challenging. The noise in the predictions produced by conventional 2D human pose estimators often impeded the accuracy. In this paper, we present a diffusion-based ...

Ieee Computer Soc2023

Automated Human Motion Analysis and Synthesis

Sena Kiciroglu

Human motion analysis and synthesis is integral to many computer vision applications, from autonomous driving to sports analysis. In this thesis, we address several problems in this domain. First we consider active viewpoint selection for pose estimation w ...

EPFL2023

Burst Vision Using Single-Photon Cameras

Edoardo Charbon, Paul Mos, Mohit Gupta

Single-photon avalanche diodes (SPADs) are novel image sensors that record the arrival of individual photons at extremely high temporal resolution. In the past, they were only available as single pixels or small-format arrays, for various active imaging ap ...

IEEE COMPUTER SOC2023

Learning to Represent and Reconstruct 3D Deformable Objects

Jan Bednarík

Representing and reconstructing 3D deformable shapes are two tightly linked problems that have long been studied within the computer vision field. Deformable shapes are truly ubiquitous in the real world, whether be it specific object classes such as human ...

EPFL2022

CrossLoc: Scalable Aerial Localization Assisted by Multimodal Synthetic Data

Iordan Doytchinov, Qi Yan, Shanci Li, Jianhao Zheng

We present a visual localization system that learns to estimate camera poses in the real world with the help of synthetic data. Despite significant progress in recent years, most learning-based approaches to visual localization target at a single domain an ...

IEEE COMPUTER SOC2022

Digital twins for post-earthquake damage assessment of free-standing buildings including damage information

Katrin Beyer, Radhakrishna Achanta, Bryan German Pantoja Rosero, Amir Rezaie

We present a pipeline for the automatic generation of digital twins of free-standing buildings for damage assessment. Our method takes multiple view images of the target building as input and processes them to produce a 3D model in levels of detail (LOD) f ...

2022

LSSANet: A Long Short Slice-Aware Network for Pulmonary Nodule Detection

Jiancheng Yang, Bo Du, Rui Xu

Convolutional neural networks (CNNs) have been demonstrated to be highly effective in the field of pulmonary nodule detection. However, existing CNN based pulmonary nodule detection methods lack the ability to capture long-range dependencies, which is vita ...

SPRINGER INTERNATIONAL PUBLISHING AG2022

Multi-animal pose estimation, identification and tracking with DeepLabCut

Alexander Mathis, Mackenzie Mathis, Steffen Schneider, Shaokai Ye, Tanmay Nath, Jessy Lauer

Estimating the pose of multiple animals is a challenging computer vision problem: frequent interactions cause occlusions and complicate the association of detected keypoints to the correct individuals, as well as having highly similar looking animals that ...

NATURE PORTFOLIO2022

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

VL4Pose: Active Learning Through Out-Of-Distribution Detection For Pose Estimation

Alexandre Massoud Alahi, Megh Hiren Shukla

Advances in computing have enabled widespread access to pose estimation, creating new sources of data streams. Unlike mock set-ups for data collection, tapping into these data streams through on-device active learning allows us to directly sample from the ...

BMVA Press2022

LiftPose3D, a deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animals

Pascal Fua, Pavan P Ramdya, Adám Gosztolai, Victor Lobato Rios, Helge Jochen Rhodin, Semih Günel, Daniel Eduardo Morales Garza, Marco Pietro Abrate

LiftPose3D infers three-dimensional poses from two-dimensional data or from limited three-dimensional data. The approach is illustrated for videos of behaving Drosophila, mice, rats and macaques. ...

NATURE PORTFOLIO2021

Progressive Correspondence Pruning by Consensus Learning

Mathieu Salzmann, Chenxu Zhao, Hongwei Li, Feng Zhu, Rui Zhao

Correspondence pruning aims to correctly remove false matches (outliers) from an initial set of putative correspondences. The pruning process is challenging since putative matches are typically extremely unbalanced, largely dominated by outliers, and the r ...

IEEE2021

Pretraining boosts out-of-domain robustness for pose estimation

Alexander Mathis, Mackenzie Mathis, Steffen Schneider, Matthias Bethge, Thomas Ray Biasi, Mert Yüksekgönül

Neural networks are highly effective tools for pose estimation. However, as in other computer vision tasks, robustness to out-of-domain data remains a challenge, especially for small training sets that are common for real-world applications. Here, we probe ...

IEEE COMPUTER SOC2021

Robust Differentiable SVD

Pascal Fua, Mathieu Salzmann, Zheng Dang, Wei Wang, Yinlin Hu

Eigendecomposition of symmetric matrices is at the heart of many computer vision algorithms. However, the derivatives of the eigenvectors tend to be numerically unstable, whether using the SVD to compute them analytically or using the Power Iteration (PI) ...

2021

Measuring and modeling the motor system with machine learning

Alexander Mathis, Mackenzie Mathis, Alessandro Marin Vargas

The utility of machine learning in understanding the motor system is promising a revolution in how to collect, measure, and analyze data. The field of movement science already elegantly incorporates theory and engineering principles to guide experimental w ...

2021

Automatic detection of hand hygiene using computer vision technology

Alexandre Massoud Alahi

Hand hygiene is essential for preventing hospital-acquired infections but is difficult to accurately track. The gold-standard (human auditors) is insufficient for assessing true overall compliance. Computer vision technology has the ability to perform more ...

2020

Deformation-aware Unpaired Image Translation for Pose Estimation on Laboratory Animals

Pascal Fua, Pavan P Ramdya, Helge Jochen Rhodin, Semih Günel, Siyuan Li, Mirela Ostrek

Our goal is to capture the pose of neuroscience model organisms, without using any manual supervision, to be able to study how neural circuits orchestrate behaviour. Human pose estimation attains remarkable accuracy when trained on real or simulated datase ...

2020

Real-time camera pose estimation for sports fields

Pascal Fua, Charles Dubout, Leonardo Citraro, Horesh Beny Ben Shitrit, Stefano Savarè, Pablo Marquez Neila

Given an image sequence featuring a portion of a sports field filmed by a moving and uncalibrated camera, such as the one of the smartphones, our goal is to compute automatically in real time the focal length and extrinsic camera parameters for each image ...

2020