Publications associées à Learning to Find Unpaired Cross-Spectral Correspondences

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Fast and Future: Towards Efficient Forecasting in Video Semantic Segmentation

Evann Pierre Guy Courdier

Deep learning has revolutionized the field of computer vision, a success largely attributable to the growing size of models, datasets, and computational power. Simultaneously, a critical pain point arises as several computer vision applications are deploye ...

EPFL2024

Development and clinical validation of computational imaging biomarkers for neurodegenerative diseases

Veronica Lily Ravano

Neurodegenerative and neuroinflammatory disorders often involve complex pathophysiological mechanisms that are â to this date â only partially understood. A more comprehensive understanding of those microstructural processes and their characterization ...

EPFL2024

Segmenting Without Annotating: Crack Segmentation and Monitoring via Post-Hoc Classifier Explanations

Devis Tuia, Hugo Laurent Pascal Porta, Florent Evariste Forest, Olga Fink

Monitoring the cracks in walls, roads and other types of infrastructure is essential to ensure the safety of a structure, and plays an important role in structural health monitoring. Automatic visual inspection allows an efficient, costeffective and safe h ...

Research Publishing2023

Detecting Anomalies and Obstacles in Road Scenes

Krzysztof Maciej Lis

We address the problem of segmenting anomalies and unusual obstacles in road scenes for the purpose of self-driving safety. The objects in question are not present in the common training sets as it is not feasible to collect and annotate examples for every ...

EPFL2023

The JPEG AI Standard: Providing Efficient Human and Machine Visual Data Consumption

Touradj Ebrahimi

The Joint Photographic Experts Group (JPEG) AI learning-based image coding system is an ongoing joint standardization effort between International Organization for Standardization (ISO), International Electrotechnical Commission (IEC), and International Te ...

IEEE COMPUTER SOC2023

Transformer Models for Vision

Jean-Baptiste Francis Marie Juliette Cordonnier

The recent developments of deep learning cover a wide variety of tasks such as image classification, text translation, playing go, and folding proteins. All these successful methods depend on a gradient-based learning algorithm to train a model on massive ...

EPFL2023

SAGTTA: SALIENCY GUIDED TEST TIME AUGMENTATION FOR MEDICAL IMAGE SEGMENTATION ACROSS VENDOR DOMAIN SHIFT

Seyedbehzad Bozorgtabar, Devavrat Tomar

Test time augmentation has been shown to be an effective approach to combat domain shifts in deep learning. Despite their promising performance levels, the interpretability of the underlying used models is however low. Saliency maps have been widely used i ...

IEEE2023

Neural Distributed Image Compression with Cross-Attention Feature Alignment

Ali Garjani

We consider the problem of compressing an information source when a correlated one is available as side information only at the decoder side, which is a special case of the distributed source coding problem in information theory. In particular, we consider ...

IEEE COMPUTER SOC2023

Two-level Data Augmentation for Calibrated Multi-view Detection

Pascal Fua, Martin Pierre Engilberge, Zhiye Wang, Haixin Shi

Data augmentation has proven its usefulness to improve model generalization and performance. While it is commonly applied in computer vision application when it comes to multi-view systems, it is rarely used. Indeed geometric data augmentation can break th ...

IEEE COMPUTER SOC2023

Exploiting Explanations to Detect Misclassifications of Deep Learning Models in Power Grid Visual Inspection

Olga Fink, Giovanni Floreale

In the context of automatic visual inspection of infrastructures by drones, Deep Learning (DL) models are used to automatically process images for fault diagnostics. While explainable Artificial Intelligence (AI) algorithms can provide explanations to asse ...

Research Publishing2023

Dense Image-based Predictions for Comics Analysis

Deblina Bhattacharjee

Dense image-based prediction methods have advanced tremendously in recent years. Their remarkable development has been possible due to the ample availability of real-world imagery. While these methods work well on photographs, their abilities do not genera ...

EPFL2023

Class Specific Feature Disentanglement and Text Embeddings for Multi-label Generalized Zero Shot CXR Classification

Seyedbehzad Bozorgtabar

Robustness of medical image classification models is limited by its exposure to the candidate disease classes. Generalized zero shot learning (GZSL) aims at correctly predicting seen and unseen classes and most current GZSL approaches have focused on the s ...

Springer International Publishing Ag2023

AN UNSUPERVISED METHOD FOR THE DETECTION OF AND TRACKING OF TARGETS IN SPOTLIGHT MODE SAR IMAGES

Lloyd Haydn Hughes

Taking advantage of Capella's ability to dwell on a target for an extended period of time (nominally 30s) in its spotlight (SP) mode, an unsupervised methodology for detecting moving targets in this data is presented in this paper. By colourizing short seg ...

IEEE2023

Burst Vision Using Single-Photon Cameras

Edoardo Charbon, Paul Mos, Mohit Gupta

Single-photon avalanche diodes (SPADs) are novel image sensors that record the arrival of individual photons at extremely high temporal resolution. In the past, they were only available as single pixels or small-format arrays, for various active imaging ap ...

IEEE COMPUTER SOC2023

Scale-Aware Test-Time Click Adaptation for Pulmonary Nodule and Mass Segmentation

Bo Du, Li Zhang, Zhigang Li, Jiancheng Yang

Pulmonary nodules and masses are crucial imaging features in lung cancer screening that require careful management in clinical diagnosis. Despite the success of deep learning-based medical image segmentation, the robust performance on various sizes of lesi ...

Springer International Publishing Ag2023

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

Pascal Fua, Sean Lewis Hill, Amos Sironi, Jiancheng Yang, Jian Zhou, Siqi Liu, Xiang Li, Jie Zhou

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in m ...

2023

Automated neuron tracking inside moving and deforming C. elegans using deep learning and targeted augmentation

Sahand Jamal Rahi, Kseniia Korchagina

Reading out neuronal activity from three-dimensional (3D) functional imaging requires segmenting and tracking individual neurons. This is challenging in behaving animals if the brain moves and deforms. The traditional approach is to train a convolutional n ...

Nature Portfolio2023

Weakly supervised joint whole-slide segmentation and classification in prostate cancer

Guillaume Jaume, Pushpak Pati, Zeineb Ayadi, Kevin Thandiackal, Seyedbehzad Bozorgtabar, Maria Gabrani

The identification and segmentation of histological regions of interest can provide significant support to pathologists in their diagnostic tasks. However, segmentation methods are constrained by the difficulty in obtaining pixel-level annotations, which a ...

ELSEVIER2023

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022