Publications related to An Adaptive Parameterization for Efficient Material Acquisition and Rendering

Aggregating Spatial and Photometric Context for Photometric Stereo

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

Advancing Self-Supervised Deep Learning for 3D Scene Understanding

Seyed Mohammad Mahdi Johari

Recent advancements in deep learning have revolutionized 3D computer vision, enabling the extraction of intricate 3D information from 2D images and video sequences. This thesis explores the application of deep learning in three crucial challenges of 3D com ...

EPFL2024

Modular segmentation, spatial analysis and visualization of volume electron microscopy datasets

Martin Weigert

Volume electron microscopy is the method of choice for the in situ interrogation of cellular ultrastructure at the nanometer scale, and with the increase in large raw image datasets generated, improving computational strategies for image segmentation and s ...

Nature Portfolio2024

A Full-Wave Reference Simulator for Computing Surface Reflectance

Mengqi Xia

Computing light reflection from rough surfaces is an important topic in computer graphics. Reflection models developed based on geometric optics fail to capture wave effects such as diffraction and interference, while existing models based on physical opti ...

ASSOC COMPUTING MACHINERY2023

Differentiable Physically Based Rendering: Algorithms, Systems and Applications

Merlin Eléazar Nimier-David

Physically based rendering methods can create photorealistic images by simulating the propagation and interaction of light in a virtual scene. Given a scene description including the shape of objects, participating media, material properties, etc., the sim ...

EPFL2022

Efficient and Accurate Physically-Based Differentiable Rendering

Delio Aleardo Vicini

Physically-based rendering algorithms generate photorealistic images of virtual scenes. By simulating light paths in a scene, complex physical effects such as shadows, reflections and volumetric scattering can be reproduced. Over the last decade, physicall ...

EPFL2022

Unsupervised Visual Entity Abstraction towards 2D and 3D Compositional Models

Beril Besbinar

Object-centric learning has gained significant attention over the last years as it can serve as a powerful tool to analyze complex scenes as a composition of simpler entities. Well-established tasks in computer vision, such as object detection or instance ...

EPFL2022

Sub-micrometer morphology of human atherosclerotic plaque revealed by synchrotron radiation-based mu CT-A comparison with histology

Anne Bonnin, Goran Lovric

Histology is a long standing and well-established gold standard for pathological characterizations. In recent years however, synchrotron radiation-based micro-computed tomography (SR mu CT) has become a tool for extending the imaging of two-dimensional thi ...

PUBLIC LIBRARY SCIENCE2022

Importance of 3D radiative transfer effects on high-resolution NO2 remote sensing in cities

Marc Damien Schwärzel

Urban air quality is a major concern in the context of human health since cities are at the same time emission hot spots and home to a large fraction of the world's population. Airborne imaging spectrometers may be a valuable addition to traditional air po ...

EPFL2022

Gazebo Fluids: SPH-based simulation of fluid interaction with articulated rigid body dynamics

Auke Ijspeert, Jonathan Patrick Arreguit O'Neill, Wei Wang, Emmanouil Angelidis

Physical simulation is an indispensable component of robotics simulation platforms that serves as the basis for a plethora of research directions. Looking strictly at robotics, the common characteristic of the most popular physics engines, such as ODE, DAR ...

IEEE2022

Modeling specular transmission of complex fenestration systems with data-driven BSDFs

Jan Wienold

A Bidirectional Scattering Distribution Function (BSDF) describes how light from each incident direction is scattered (reflected and transmitted) by a simple or composite surface, such as a window shade. Compact, tabular BSDFs may be derived via interpolat ...

2021

Light Path Gradients for Forward and Inverse Rendering

Tizian Lucien Zeltner

Physically based rendering is a process for photorealistic digital image synthesis and one of the core problems in computer graphics. It involves simulating the light transport, i.e. the emission, propagation, and scattering of light through a virtual scen ...

EPFL2021

Path Replay Backpropagation: Differentiating Light Paths using Constant Memory and Linear Time

Sébastien Nicolas Speierer, Wenzel Alban Jakob, Delio Aleardo Vicini

Differentiable physically-based rendering has become an indispensable tool for solving inverse problems involving light. Most applications in this area jointly optimize a large set of scene parameters to minimize an objective function, in which case revers ...

ASSOC COMPUTING MACHINERY2021

A Non-Exponential Transmittance Model for Volumetric Scene Representations

Wenzel Alban Jakob, Delio Aleardo Vicini

We introduce a novel transmittance model to improve the volumetric representation of 3D scenes. The model can represent opaque surfaces in the volumetric light transport framework. Volumetric representations are useful for complex scenes, and become increa ...

ASSOC COMPUTING MACHINERY2021

Perceptual Quality of Point Clouds with application to Compression

Evangelos Alexiou

Modern information technologies and human-centric communication systems employ advanced content representations for richer portrayals of the real world. The newly adopted imaging modalities offer additional information cues and permit the depiction of real ...

EPFL2021

Raytraverse: Navigating the Lightfield to Enhance Climate-Based Daylight Modeling

Marilyne Andersen, Jan Wienold, Stephen William Wasilewski

We propose a new method for climate-based daylight modeling (CBDM) based on simulating and evaluating only the most important features. By adaptively sampling the temporal lightfield that describes daylight in buildings, our method escapes the curse of dim ...

2021

Monte Carlo Estimators for Differential Light Transport

Sébastien Nicolas Speierer, Wenzel Alban Jakob, Tizian Lucien Zeltner

Physically based differentiable rendering algorithms propagate derivatives through realistic light transport simulations and have applications in diverse areas including inverse reconstruction and machine learning. Recent progress has led to unbiased metho ...

ASSOC COMPUTING MACHINERY2021

Practical Product Path Guiding Using Linearly Transformed Cosines

Wenzel Alban Jakob

Path tracing is now the standard method used to generate realistic imagery in many domains, e.g., film, special effects, architecture etc. Path guiding has recently emerged as a powerful strategy to counter the notoriously long computation times required t ...

WILEY2020

Unified Neural Encoding of BTFs

Wenzel Alban Jakob

Realistic rendering using discrete reflectance measurements is challenging, because arbitrary directions on the light and view hemispheres are queried at render time, incurring large memory requirements and the need for interpolation. This explains the des ...

WILEY2020

Specular Manifold Sampling for Rendering High-Frequency Caustics and Glints

Wenzel Alban Jakob, Tizian Lucien Zeltner

Scattering from specular surfaces produces complex optical effects that are frequently encountered in realistic scenes: intricate caustics due to focused reflection, multiple refraction, and high-frequency glints from specular microstructure. Yet, despite ...

ASSOC COMPUTING MACHINERY2020