Publications associées à Dense image registration and deformable surface reconstruction in presence of occlusions and minimal texture

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Self-supervised Dense Representation Learning for Live-Cell Microscopy with Time Arrow Prediction

Max Stieber, Martin Weigert, Benjamin Tobias Gallusser

State-of-the-art object detection and segmentation methods for microscopy images rely on supervised machine learning, which requires laborious manual annotation of training data. Here we present a self-supervised method based on time arrow prediction pre-t ...

Springer International Publishing Ag2023

Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification

Seyedbehzad Bozorgtabar

Robustness of medical image classification models is limited by its exposure to the candidate disease classes. Generalized zero shot learning (GZSL) aims at correctly predicting seen and unseen classes and most current GZSL approaches have focused on the s ...

Springer International Publishing Ag2023

How deep convolutional neural networks lose spatial information with training

Matthieu Wyart, Leonardo Petrini, Umberto Maria Tomasini, Francesco Cagnetta

A central question of machine learning is how deep nets manage to learn tasks in high dimensions. An appealing hypothesis is that they achieve this feat by building a representation of the data where information irrelevant to the task is lost. For image da ...

Iop Publishing Ltd2023

State of the Art in Dense Monocular Non-Rigid 3D Reconstruction

Pascal Fua

3D reconstruction of deformable (or non-rigid) scenes from a set of monocular 2D image observations is a long-standing and actively researched area of computer vision and graphics. It is an ill-posed inverse problem, since-without additional prior assumpti ...

WILEY2023

Detecting Anomalies and Obstacles in Road Scenes

Krzysztof Maciej Lis

We address the problem of segmenting anomalies and unusual obstacles in road scenes for the purpose of self-driving safety. The objects in question are not present in the common training sets as it is not feasible to collect and annotate examples for every ...

EPFL2023

Weakly Supervised Volumetric Image Segmentation with Deformed Templates

Pascal Fua, Pamuditha Udaranga Wickramasinghe, Patrick Moller Jensen, Mian Akbar Shah

There are many approaches to weakly-supervised training of networks to segment 2D images. By contrast, existing approaches to segmenting volumetric images rely on full-supervision of a subset of 2D slices of the 3D volume. We propose an approach to volume ...

Springer2022

Learning to Represent and Reconstruct 3D Deformable Objects

Jan Bednarík

Representing and reconstructing 3D deformable shapes are two tightly linked problems that have long been studied within the computer vision field. Deformable shapes are truly ubiquitous in the real world, whether be it specific object classes such as human ...

EPFL2022

Image-based geometric digital twinning for stone masonry elements

Katrin Beyer, Bryan German Pantoja Rosero, Savvas Saloustros

We present an image-based pipeline for generating geometrical digital twins (GDTs) of stone masonry elements with detail down to the stone level. For this purpose, we acquire RGB images of the individual stones and of the wall during the construction phase ...

2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

Improving the Training of Compact Neural Networks for Visual Recognition

Shuxuan Guo

During the Artificial Intelligence (AI) revolution of the past decades, deep neural networks have been widely used and have achieved tremendous success in visual recognition. Unfortunately, deploying deep models is challenging because of their huge model s ...

EPFL2022

Multiscale light-sheet organoid imaging framework

Raphaël Ortiz, Petr Strnad, Andrea Boni

Live imaging of organoid growth remains a challenge: it requires long-term imaging of several samples simultaneously and dedicated analysis pipelines. Here the authors report an experimental and image processing framework to turn long-term light-sheet imag ...

Nature Portfolio2022

Vascular-targeted micelles as a specific MRI contrast agent for molecular imaging of fibrin clots and cancer cells

Anne-Sophie Chauvin, Vassily Vorobiev, Aurélien Thomas

Molecular medical imaging is intended to increase the accuracy of diagnosis, particularly in cardiovascular and cancer-related diseases, where early detection could significantly increase the treatment success rate. In this study, we present mixed micelles ...

ELSEVIER2021

High-Resolution Multi-Spectral Imaging With Diffractive Lenses and Learned Reconstruction

Oguzhan Fatih Kar, Can Deniz Bezek

Spectral imaging is a fundamental diagnostic technique with widespread application. Conventional spectral imaging approaches have intrinsic limitations on spatial and spectral resolutions due to the physical components they rely on. To overcome these physi ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

A deep learning framework for matching of SAR and optical imagery

Devis Tuia, Sylvain Lobry, Lloyd Haydn Hughes

SAR and optical imagery provide highly complementary information about observed scenes. A combined use of these two modalities is thus desirable in many data fusion scenarios. However, any data fusion task requires measurements to be accurately aligned. Wh ...

2020

Beyond Cameras: Real-Time High-Resolution 3D and Panoramic MultiView Vision Systems with Their Applications

Bilal Demir

The cameras are invented by imitating the human visual system to capture the scene. The camera technologies have been substantially advanced in recent years. 108 MP resolution with 100x hybrid zoom has become standard features for smartphone flagships. In ...

EPFL2020

Image Matching Across Wide Baselines: From Paper to Practice

Pascal Fua, Jiri Matas, Kwang Moo Yi, Eduard Trulls Fortuny, Anastasiia Mishchuk

We introduce a comprehensive benchmark for local features and robust estimation algorithms, focusing on the downstream task-the accuracy of the reconstructed camera pose-as our primary metric. Our pipeline's modular structure allows easy integration, confi ...

2021

Automated CT bone segmentation using statistical shape modelling and local template matching

Alexandre Terrier, Philippe Büchler, Alain Farron, Elham Taghizadeh

Accurate CT bone segmentation is essential to develop chair-side manufacturing of implants based on additive manufacturing. We herewith present an automated method able to accurately segment challenging bone regions, while simultaneously providing anatomic ...

2019

Achieving high-resolution thermal imagery in low-contrast lake surface waters by aerial remote sensing and image registration

Ulrich Lemmin, Daniel Sage, David Andrew Barry, Abolfazl Irani Rahaghi

A two-platform measurement system for realizing airborne thermography of the Lake Surface Water Temperature (LSWT) with ~0.8 m pixel resolution (sub-pixel satellite scale) is presented. It consists of a tethered Balloon Launched Imaging and Monitoring Plat ...

2019

NRStitcher: non-rigid stitching of terapixel-scale volumetric images

Anne Bonnin, Marco Stampanoni

A Summary: In modern microscopy, the field of view is often increased by obtaining an image mosaic, where multiple sub-images are taken side-by-side and combined post-acquisition. Mosaic imaging often leads to long imaging times that can increase the proba ...

2019