Publications related to Frame rate

Computational Imaging SPAD Cameras

Vision systems built around conventional image sensors have to read, encode and transmit large quantities of pixel information, a majority of which is redundant. As a result, new computational imaging sensor architectures were developed to preprocess the r ...

EPFL2023

Seeing Photons in Color

Edoardo Charbon, Claudio Bruschini, Paul Mos, Mohit Gupta

Megapixel single-photon avalanche diode (SPAD) arrays have been developed recently, opening up the possibility of deploying SPADs as general-purpose passive cameras for photography and computer vision. However, most previous work on SPADs has been limited ...

ASSOC COMPUTING MACHINERY2023

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning

Jean-Philippe Thiran, Roser Vinals Terres

Ultrafast ultrasound imaging, characterized by high frame rates, generates low-quality images. Convolutional neural networks (CNNs) have demonstrated great potential to enhance image quality without compromising the frame rate. However, CNNs have been most ...

2023

SoDaCam: Software-defined Cameras via Single-Photon Imaging

Edoardo Charbon, Claudio Bruschini, Andrei Ardelean, Mohit Gupta

Reinterpretable cameras are defined by their post-processing capabilities that exceed traditional imaging. We present "SoDaCam" that provides reinterpretable cameras at the granularity of photons, from photon-cubes acquired by single-photon devices. Photon ...

Ieee Computer Soc2023

Practical computational imaging by use of spatiotemporal light modulation: from simulations to applications in biological microscopy

François Thierry M Marelli

Optical microscopy is an essential tool for biologists, who are often faced with the need to overcome the spatial and temporal resolution limitations of their devices to capture finer details. As upgrading imaging hardware is expensive, computational metho ...

EPFL2023

Asynchrony Increases Efficiency: Time Encoding of Videos and Low-Rank Signals

Martin Vetterli, Adam James Scholefield, Karen Adam

In event-based sensing, many sensors independently and asynchronously emit events when there is a change in their input. Event-based sensing can present significant improvements in power efficiency when compared to traditional sampling, because (1) the out ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Lock-in amplified differential phase contrast

Christophe Moser, Timothé Laforest, Damien Claude-Marie Loterie, Chiara Bonati

We introduce a lock-in method to increase the phase contrast in incoherent Differential Phase Contrast (DPC) imaging. The use of a smart pixel detector with in-pixel signal demodulation, paired with synchronized illumination, provides the basis of a bit-ef ...

SPIE-INT SOC OPTICAL ENGINEERING2022

Lock-in incoherent differential phase contrast imaging

Christophe Moser, Timothé Laforest, Damien Claude-Marie Loterie, Chiara Bonati

We introduce a lock-in method to increase the phase contrast in incoherent differential phase contrast (DPC) imaging. This method improves the phase sensitivity by the analog removal of the background. The use of a smart pixel detector with in-pixel signal ...

CHINESE LASER PRESS2022

CNN-Based Ultrasound Image Reconstruction for Ultrafast Displacement Tracking

Jean-Philippe Thiran, Dimitris Perdios, Marcel Arditi, Florian Martinez, Manuel Vonlanthen

Thanks to its capability of acquiring full-view frames at multiple kilohertz, ultrafast ultrasound imaging unlocked the analysis of rapidly changing physical phenomena in the human body, with pioneering applications such as ultrasensitive flow imaging in t ...

Institute of Electrical and Electronics Engineers2021

How Asynchronous Events Encode Video

Martin Vetterli, Adam James Scholefield, Karen Adam

As event-based sensing gains in popularity, theoretical understanding is needed to harness this technology’s potential. Instead of recording video by capturing frames, event-based cameras have sensors that emit events when their inputs change, thus encodin ...

IEEE2021

High speed, complex wavefront shaping using the digital micro-mirror device

Demetri Psaltis, Ahmed Ayoub

Digital micro-mirror devices (DMDs) have been deployed in many optical applications. As compared to spatial light modulators (SLMs), they are characterized by their much faster refresh rates (full-frame refresh rates up to 32 kHz for binary patterns) compa ...

Nature Portfolio2021

Ultrasound Imaging: From Physical Modeling to Deep Learning

Dimitris Perdios

Among the medical imaging modalities, ultrasound (US) imaging is one of the safest, most widespread, and least expensive method used in medical diagnosis. In the past decades, several technological advances enabled the advent of ultrafast US imaging, an ac ...

EPFL2021

A Pixel Design of a Branching Ultra-Highspeed Image Sensor

Edoardo Charbon

A burst image sensor named Hanabi, meaning fireworks in Japanese, includes a branching CCD and multiple CMOS readout circuits. The sensor is backside-illuminated with a light/charge guide pipe to minimize the temporal resolution by suppressing the horizont ...

2021

Direct time-of-flight SPAD image sensors for light detection and ranging

Preethi Padmanabhan

Depth sensing is an increasingly important feature in many applications of consumer, automotive, augmented/virtual reality (AR-VR), space and bio-medical imaging. Long range, high depth resolution, high spatial resolution, and high frame rates are often co ...

EPFL2021

Theoretical minimum uncertainty of single-molecule localizations using a single-photon avalanche diode array

Edoardo Charbon, Claudio Bruschini, Paul Mos, Arin Can Ülkü, Daniel Fan

Single-photon avalanche diode (SPAD) arrays can be used for single-molecule localization microscopy (SMLM) because of their high frame rate and lack of readout noise. SPAD arrays have a binary frame output, which means photon arrivals should be described a ...

OPTICAL SOC AMER2021

High-Resolution Transmission Electron Microscopy with Bright Microsecond Electron Pulses

Marcel Drabbels, Ulrich Lorenz, Pavel Olshin, Gabriele Bongiovanni

Transmission electron microscopy at atomic-resolution is a crucial tool in a variety of fields, ranging from materials science to biology. [1,2] Fast electron cameras have recently enabled high-speed observations atomic resolution. [3] Moreover, they have ...

2021

A Neuro-Inspired Computational Model for a Visually Guided Robotic Lamprey Using Frame and Event Based Cameras

Auke Ijspeert, Alessandro Crespi, Mehmet Hasan Mutlu, Simon Lukas Hauser, Jorg Conradt, Ibrahim Youssef Youssef, Alexandre Bernardino

The computational load associated with computer vision is often prohibitive, and limits the capacity for on-board image analysis in compact mobile robots. Replicating the kind of feature detection and neural processing that animals excel at remains a chall ...

2020

Temporal resolution doubling in fluorescence light-sheet microscopy via a hue-encoded shutter and regularization

Michael Stefan Daniel Liebling, Christian Jaques

Studying dynamic biological processes, such as heart development and function in zebrafish embryos, often relies on multi-channel fluorescence labeling to distinguish multiple anatomical features, yet also demands high frame rates to capture rapid cell mot ...

2020

Large field of view multi-camera endoscopic apparatus with omni-directional illumination

Yusuf Leblebici, Ömer Cogal

A multi-camera hemispherical very wide field of view imaging apparatus with omnidirectional illumination capability comprises a cylindrical body (4, 4.a, 4.b), a hemispherical mechanical frame (2) arranged on one end of the cylindrical body (4, 4.a, 4.b), ...

2020

Cathodoluminescent screen imaging system for seeded blob detection in toroidal plasma experiment

Ambrogio Fasoli, Ivo Furno, Paolo Ricci, Paul Bowen, Marcelo Baquero Ruiz, Carlos Morais, Fabian Manke

We designed and built a diagnostic based on a cathodoluminescent screen for the detection of turbulent plasma structures with high spatial resolution. The screen is coated with a low threshold energy cathodoluminescent powder that emits light when exposed ...

2020