Publications associées à Image Based Relighting of Cultural Artifacts

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

Modular segmentation, spatial analysis and visualization of volume electron microscopy datasets

Martin Weigert

Volume electron microscopy is the method of choice for the in situ interrogation of cellular ultrastructure at the nanometer scale, and with the increase in large raw image datasets generated, improving computational strategies for image segmentation and s ...

Nature Portfolio2024

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

Pascal Fua, Sean Lewis Hill, Amos Sironi, Jiancheng Yang, Jian Zhou, Siqi Liu, Xiang Li, Jie Zhou

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in m ...

2023

Automated post-earthquake damage assessment of stone masonry buildings integrating machine learning, computer vision, and physics-based modeling

Bryan German Pantoja Rosero

Current post-earthquake damage assessment methodologies are not only time-consuming but also subjective in nature and difficult to document. Recent advancements in artificial intelligence and technological devices make it possible to accomplish this task a ...

EPFL2023

A Full-Wave Reference Simulator for Computing Surface Reflectance

Mengqi Xia

Computing light reflection from rough surfaces is an important topic in computer graphics. Reflection models developed based on geometric optics fail to capture wave effects such as diffraction and interference, while existing models based on physical opti ...

ASSOC COMPUTING MACHINERY2023

Automated image-based generation of finite element models for masonry buildings

Radhakrishna Achanta, Katrin Beyer, Bryan German Pantoja Rosero

To predict the response of masonry buildings to various types of loads, engineers use finite element models, specifically solid-element and macro-element models. For predicting masonry responses to seismic events in particular, equivalent frame models-a su ...

SPRINGER2023

Plasticity of sensory representations in the posterior insular cortex during fear learning

Denys Osypenko

Aversively-motivated associative learning allows animals to avoid harm and thus ensures survival. Aversive learning can be studied by the fear learning paradigm, in which an innocuous sensory stimulus like a tone (conditioned stimulus, CS), acquires a nega ...

EPFL2023

Differentiable Physically Based Rendering: Algorithms, Systems and Applications

Merlin Eléazar Nimier-David

Physically based rendering methods can create photorealistic images by simulating the propagation and interaction of light in a virtual scene. Given a scene description including the shape of objects, participating media, material properties, etc., the sim ...

EPFL2022

Efficient and Accurate Physically-Based Differentiable Rendering

Delio Aleardo Vicini

Physically-based rendering algorithms generate photorealistic images of virtual scenes. By simulating light paths in a scene, complex physical effects such as shadows, reflections and volumetric scattering can be reproduced. Over the last decade, physicall ...

EPFL2022

Gazebo Fluids: SPH-based simulation of fluid interaction with articulated rigid body dynamics

Auke Ijspeert, Jonathan Patrick Arreguit O'Neill, Wei Wang, Emmanouil Angelidis

Physical simulation is an indispensable component of robotics simulation platforms that serves as the basis for a plethora of research directions. Looking strictly at robotics, the common characteristic of the most popular physics engines, such as ODE, DAR ...

IEEE2022

Sub-micrometer morphology of human atherosclerotic plaque revealed by synchrotron radiation-based mu CT-A comparison with histology

Anne Bonnin, Goran Lovric

Histology is a long standing and well-established gold standard for pathological characterizations. In recent years however, synchrotron radiation-based micro-computed tomography (SR mu CT) has become a tool for extending the imaging of two-dimensional thi ...

PUBLIC LIBRARY SCIENCE2022

Structure-preserving approaches and data-driven closure modeling for model order reduction

Nicolò Ripamonti

In this thesis, we propose model order reduction techniques for high-dimensional PDEs that preserve structures of the original problems and develop a closure modeling framework leveraging the Mori-Zwanzig formalism and recurrent neural networks. Since high ...

EPFL2022

Image-based geometric digital twinning for stone masonry elements

Katrin Beyer, Bryan German Pantoja Rosero, Savvas Saloustros

We present an image-based pipeline for generating geometrical digital twins (GDTs) of stone masonry elements with detail down to the stone level. For this purpose, we acquire RGB images of the individual stones and of the wall during the construction phase ...

2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

Variational Methods For Continuous-Domain Inverse Problems: the Quest for the Sparsest Solution

Thomas Jean Debarre

The goal of this thesis is to study continuous-domain inverse problems for the reconstruction of sparse signals and to develop efficient algorithms to solve such problems computationally. The task is to recover a signal of interest as a continuous function ...

EPFL2022

Differentiable Signed Distance Function Rendering

Sébastien Nicolas Speierer, Wenzel Alban Jakob, Delio Aleardo Vicini

Physically-based differentiable rendering has recently emerged as an attractive new technique for solving inverse problems that recover complete 3D scene representations from images. The inversion of shape parameters is of particular interest but also pose ...

ASSOC COMPUTING MACHINERY2022

A machine learning approach to portfolio pricing and risk management for high-dimensional problems

Damir Filipovic

We present a general framework for portfolio risk management in discrete time, based on a replicating martingale. This martingale is learned from a finite sample in a supervised setting. Our method learns the features necessary for an effective low-dimensi ...

WILEY2022

Importance of 3D radiative transfer effects on high-resolution NO2 remote sensing in cities

Marc Damien Schwärzel

Urban air quality is a major concern in the context of human health since cities are at the same time emission hot spots and home to a large fraction of the world's population. Airborne imaging spectrometers may be a valuable addition to traditional air po ...

EPFL2022

Kernel Memory Networks: A Unifying Framework for Memory Modeling

Wulfram Gerstner, Georgios Iatropoulos, Johanni Michael Brea

We consider the problem of training a neural network to store a set of patterns with maximal noise robustness. A solution, in terms of optimal weights and state update rules, is derived by training each individual neuron to perform either kernel classifica ...

Curran Associates2022