Publications related to Light field camera

Towards learning-based denoising of light fields

Touradj Ebrahimi, Michela Testolina, Tomás Soares De Carvalho Feith

In recent years, new emerging immersive imaging modalities, e.g. light fields, have been receiving growing attention, becoming increasingly widespread over the years. Light fields are often captured through multi-camera arrays or plenoptic cameras, with th ...

2023

Nonlinear interactions of ion acoustic waves explored using fast imaging decompositions

Fast camera imaging is used to study ion acoustic waves propagating azimuthally in a magnetized plasma column. The high-speed image sequences are analyzed using proper orthogonal decomposition and 2D Fourier transform, allowing to evaluate the assets and d ...

2023

Thermally reconfigurable metalens

Giulia Tagliabue, Anna Archetti, Nathanaël Restori, Fateme Kiani Shahvandi, Theodoros Tsoulos, Ren-Jie Lin

Reconfigurable metalenses are compact optical components composed by arrays of meta-atoms that offer unique opportunities for advanced optical systems, from microscopy to augmented reality platforms. Although poorly explored in the context of reconfigurabl ...

WALTER DE GRUYTER GMBH2022

Estimating Nonplanar Flow from 2D Motion-blurred Widefield Microscopy Images via Deep Learning

Michael Stefan Daniel Liebling, Adrian Shajkofci

Optical flow is a method aimed at predicting the movement velocity of any pixel in the image and is used in medicine and biology to estimate flow of particles in organs or organelles. However, a precise optical flow measurement requires images taken at hig ...

IEEE2021

Towards Quantum 3D Imaging Devices

Edoardo Charbon, Claudio Bruschini, Samuel Burri, Paul Mos, Michael Alan Wayne, Arin Can Ülkü

We review the advancement of the research toward the design and implementation of quantum plenoptic cameras, radically novel 3D imaging devices that exploit both momentum–position entanglement and photon–number correlations to provide the typical refocusin ...

2021

Towards quantum 3D imaging devices

Edoardo Charbon, Claudio Bruschini, Paul Mos, Samuel Burri, Arin Can Ülkü, Michael Alan Wayne

We introduce a new generation of 3D imaging devices based on quantum plenoptic imaging. Position-momentum entanglement and photon number correlations are exploited to provide a scan-free 3D image after post-processing of the collected light intensity signa ...

2021

LiftPose3D, a deep learning-based approach for transforming two-dimensional to three-dimensional poses in laboratory animals

Pascal Fua, Pavan P Ramdya, Adám Gosztolai, Victor Lobato Rios, Helge Jochen Rhodin, Semih Günel, Daniel Eduardo Morales Garza, Marco Pietro Abrate

LiftPose3D infers three-dimensional poses from two-dimensional data or from limited three-dimensional data. The approach is illustrated for videos of behaving Drosophila, mice, rats and macaques. ...

NATURE PORTFOLIO2021

Depth Camera and Electromagnetic Field Localization System For IoT Application - High level, lightweight data fusion

Yves Perriard, Alexis Boegli, Pooneh Mohaghegh, Rabia Saeed

This article demonstrates person localization using a hybrid system consisting of an electromagnetic positioning system and a depth camera to authorize access control. The ultimate aim of this system is to distinguish moving people in a defined area by tra ...

Association for Computing Machinery2021

Tracking and Relative Localization of Drone Swarms With a Vision-Based Headset

Dario Floreano, Maxim Pavliv, Fabrizio Schiano, Giuseppe Loianno

We address the detection, tracking, and relative localization of the agents of a drone swarm from a human perspective using a headset equipped with a single camera and an Inertial Measurement Unit (IMU). We train and deploy a deep neural network detector o ...

2021

Aliasing mitigation in optical microscopy of dynamic biological samples by use of temporally modulated color illumination and a standard RGB camera

Michael Stefan Daniel Liebling, Christian Jaques

Significance: Despite recent developments in microscopy, temporal aliasing can arise when imaging dynamic samples. Modern sampling frameworks, such as generalized sampling, mitigate aliasing but require measurement of temporally overlapping and potentially ...

SPIE Society of Photo-optical Instrumentation Engineers2020

Graph-based regularization of inverse problems in imaging

Mattia Rossi

As of today, the extension of the human visual capabilities to machines remains both a cornerstone and an open challenge in the attempt to develop intelligent systems. On the one hand, the development of more and more sophisticated imaging devices, capable ...

EPFL2020

Temporal resolution doubling in fluorescence light-sheet microscopy via a hue-encoded shutter and regularization

Michael Stefan Daniel Liebling, Christian Jaques

Studying dynamic biological processes, such as heart development and function in zebrafish embryos, often relies on multi-channel fluorescence labeling to distinguish multiple anatomical features, yet also demands high frame rates to capture rapid cell mot ...

2020

Precise and accurate image-based measurements of optical material properties

Marjan Shahpaski

The appearance of objects is governed by how they reflect, transmit and absorb the light they receive. That, in turn, depends on the material's internal structure, surface structure, and viewing and illumination directions. Changes in those characteristics ...

EPFL2020

Plano-concave mini-lens array for plenoptic imaging applications

Toralf Scharf, Alessandro Grosso

An array of plano-concave mini-lenses is designed to realize a particular version of Light Field camera known as Plenoptic Camera 1.2. The Delano diagram related to the on-axis optical channel of such a camera is computed to show its retro-focus behavior a ...

IEEE2019

Real-time 360 Body Scanning System for Virtual Reality Research Applications

Olaf Blanke, Bruno Herbelin, Florian Lance, Louis Philippe Albert

We present a low-cost solution to perform the online and realistic representation of users using an array of depth cameras. The system is composed of a cluster of 10 Microsoft Kinect 2 cameras, each one associated to a compact NUC PC to stream live depth & ...

2019

Hough Forest With Optimized Leaves for Global Hand Pose Estimation With Arbitrary Postures

Daniel Thalmann, Hui Liang, Jun Lee

Vision-based hand pose estimation is important in human-computer interaction. While many recent works focus on full degree-of-freedom hand pose estimation, robust estimation of global hand pose remains a challenging problem. This paper presents a novel alg ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2019

Are Existing Monocular Computer Vision-Based 3D Motion Capture Approaches Ready for Deployment? A Methodological Study on the Example of Alpine Skiing

Pascal Fua, Helge Jochen Rhodin, Mirela Ostrek

In this study, we compared a monocular computer vision (MCV)-based approach with the golden standard for collecting kinematic data on ski tracks (i.e., video-based stereophotogrammetry) and assessed its deployment readiness for answering applied research q ...

2019

Ambulatory Assessment of the Dynamic Margin of Stability Using an Inertial Sensor Network

Silvestro Micera

Loss of stability is a precursor to falling and therefore represents a leading cause of injury, especially in fragile people. Thus, dynamic stability during activities of daily living (ADLs) needs to be considered to assess balance control and fall risk. T ...

2019

Temporal Super-Resolution Microscopy Using a Hue-Encoded Shutter

Sylvain Calinon, Michael Stefan Daniel Liebling, Emmanuel Pignat, Christian Jaques

Limited time-resolution in microscopy is an obstacle to many biological studies. Despite recent advances in hardware, digital cameras have limited operation modes that constrain frame-rate, integration time, and color sensing patterns. In this paper, we pr ...

2019

Embedded Polarizing Filters to Separate Diffuse and Specular Reflection

Laurent Valentin Jospin, Adam James Scholefield, Gilles Baechler

Polarizing filters provide a powerful way to separate diffuse and specular reflection; however, traditional methods rely on several captures and require proper alignment of the filters. Recently, camera manufacturers have proposed to embed polarizing micro ...

SPRINGER INTERNATIONAL PUBLISHING AG2019