Publications related to How Asynchronous Events Encode Video

Efficient Temporally-Aware DeepFake Detection using H.264 Motion Vectors

Sabine Süsstrunk, Alessio Verardo, Yufan Ren, Peter Arpad Grönquist, Qingyi He

Video DeepFakes are fake media created with Deep Learning (DL) that manipulate a person’s expression or identity. Most current DeepFake detection methods analyze each frame independently, ignoring inconsistencies and unnatural movements between frames. Som ...

2024

Aggregating Spatial and Photometric Context for Photometric Stereo

David Honzátko

Photometric stereo, a computer vision technique for estimating the 3D shape of objects through images captured under varying illumination conditions, has been a topic of research for nearly four decades. In its general formulation, photometric stereo is an ...

EPFL2024

SoDaCam: Software-defined Cameras via Single-Photon Imaging

Claudio Bruschini, Edoardo Charbon, Andrei Ardelean, Mohit Gupta

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon ...

Ieee Computer Soc2023

Computational Imaging SPAD Cameras

Andrei Ardelean

Vision systems built around conventional image sensors have to read, encode and transmit large quantities of pixel information, a majority of which is redundant. As a result, new computational imaging sensor architectures were developed to preprocess the r ...

EPFL2023

LenslessPiCam: A Hardware and Software Platform for Lensless Computational Imaging with a Raspberry Pi

Martin Vetterli, Sepand Kashani, Matthieu Martin Jean-André Simeoni, Eric Bezzam

This toolkit has everything you need to perform imaging with a lensless camera. We make use of a low-cost implementation of DiffuserCam, namely replacing the lens with a piece of tape and using the Raspberry Pi HQ camera sensor. Similar principles and meth ...

Zenodo2023

Practical computational imaging by use of spatiotemporal light modulation: from simulations to applications in biological microscopy

François Thierry M Marelli

Optical microscopy is an essential tool for biologists, who are often faced with the need to overcome the spatial and temporal resolution limitations of their devices to capture finer details. As upgrading imaging hardware is expensive, computational metho ...

EPFL2023

MALTA-Cz: a radiation hard full-size monolithic CMOS sensor with small electrodes on high-resistivity Czochralski substrate

Edoardo Charbon, Ashish Sharma, Francesco Piro

Depleted Monolithic Active Pixel Sensor (DMAPS) sensors developed in the Tower Semiconductor 180 nm CMOS imaging process have been designed in the context of the ATLAS ITk upgrade Phase-II at the HL-LHC and for future collider experiments. The "MALTA-Czoch ...

Iop Publishing Ltd2023

Referencing in YouTube Knowledge Communication Videos

Daniel Gatica-Perez, Haeeun Kim

In recent years, there has been widespread concern about misinformation and hateful content on social media that are damaging societies. Being one of the most influential social media that practically serves as a newsearch engine, YouTube has accepted crit ...

Assoc Computing Machinery2023

Evaluation of HPK n plus -p planar pixel sensors for the CMS Phase-2 upgrade

Rakesh Chawla, Albert Perez, François Robert, Andrea Rizzi, Martin Fuchs, Stefano Michelis, Alexis Kalogeropoulos, Varun Sharma, Davide Ceresa, Ashish Sharma, David Vannerom, David Parker, Alessandro Caratelli, Thomas Muller, Yong Yang, Kai Yi, Andromachi Tsirou, Georgios Anagnostou, Konstantin Androsov, Ajay Kumar, Werner Lustermann, Xin Chen, Jing Li

To cope with the challenging environment of the planned high luminosity upgrade of the Large Hadron Collider (HL-LHC), scheduled to start operation in 2029, CMS will replace its entire tracking system. The requirements for the tracker are largely determine ...

Elsevier2023

Ex uno plures: how to construct high-speed movies of collapsing cavitation bubbles from a single image

Mohamed Farhat, Armand Baptiste Sieber, Davide Bernardo Preso

The time-resolved visualization of the dynamics of a cavitation bubble usually requires the use of expensive high-speed cameras, which often provide a limited spatial resolution. In the present study, we propose an alternative to these high-speed imaging t ...

Springer2023

Performance investigation of cameras using HDR sensors for daylight glare evaluations

Jan Wienold, Geraldine Cai Ting Quek, Dong Hyun Kim

This study presents a novel framework for evaluating the luminance measurement capabilities of High Dynamic Range (HDR) sensor cameras in indoor glare conditions. Results indicate that the practical usage range of the CSEM VIP camera is significantly lower ...

International Commission on Illumination2023

Burst Vision Using Single-Photon Cameras

Edoardo Charbon, Paul Mos, Mohit Gupta

Single-photon avalanche diodes (SPADs) are novel image sensors that record the arrival of individual photons at extremely high temporal resolution. In the past, they were only available as single pixels or small-format arrays, for various active imaging ap ...

IEEE COMPUTER SOC2023

Asynchrony Increases Efficiency: Time Encoding of Videos and Low-Rank Signals

Martin Vetterli, Adam James Scholefield, Karen Adam

In event-based sensing, many sensors independently and asynchronously emit events when there is a change in their input. Event-based sensing can present significant improvements in power efficiency when compared to traditional sampling, because (1) the out ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

AI-based telepresence for broadcast applications

Touradj Ebrahimi, Rayan Daod Nathoo, Laurent Deillon, Henrique Piñeiro Monteagudo

In this paper, we introduce a new solution and underlying architecture that allows remote participants to interact with hosts in a broadcast scenario. To achieve this, background extraction is first applied to video received from remote participants to ext ...

SPIE2022

A 500 x 500 Dual-Gate SPAD Imager With 100% Temporal Aperture and 1 ns Minimum Gate Length for FLIM and Phasor Imaging Applications

Claudio Bruschini, Edoardo Charbon, Arin Can Ülkü, Andrei Ardelean, Paul Mos, Michael Alan Wayne

In this article, we report on SwissSPAD3 (SS3), a 500 x 500 pixel single-photon avalanche diode (SPAD) array, fabricated in 0.18-mu m CMOS technology. In this sensor, we introduce a novel dual-gate architecture with two contiguous temporal windows, or gate ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Recent results with radiation-tolerant TowerJazz 180 nm MALTA sensors

Francesco Piro, Abhishek Sharma

To achieve the physics goals of future colliders, it is necessary to develop novel, radiation-hard silicon sensors for their tracking detectors. We target the replacement of hybrid pixel detectors with Depleted Monolithic Active Pixel Sensors (DMAPS) that ...

ELSEVIER2022

Pixel super-resolution with spatially entangled photons

Edoardo Charbon, Jiuxuan Zhao

Pixelation is common in quantum imaging systems and limit the image spatial resolution. Here, the authors introduce a pixel super-resolution approach based on measuring the full spatially-resolved joint probability distribution of spatially-entangled photo ...

Nature Portfolio2022

Feature-based no-reference video quality assessment using Extra Trees

Arash Amini, Hatef Otroshi Shahreza

With the emergence of social networks and improvements in the internet speed, the video data has become an ever-increasing portion of the global internet traffic. Besides the content, the quality of a video sequence is an important issue at the user end wh ...

WILEY2022

Timing is Everything

Karen Adam

In this thesis, timing is everything. In the first part, we mean this literally, as we tackle systems that encode information using timing alone. In the second part, we adopt the standard, metaphoric interpretation of this saying and show the importance of ...

EPFL2022

Effects of illuminance intensity on the green channel of remote photoplethysmography (rPPG) signals

Ata Jedari Golparvar

Point-of-care remote photoplethysmography (rPPG) devices that utilize low-cost RGB cameras have drawn considerable attention due to their convenience in contactless and non-invasive vital signs monitoring. In rPPG, sufficient lighting conditions are essent ...

SPRINGER2022