Publications related to Reservoir computing

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

Edoardo Charbon, Claudio Bruschini, Andrei Ardelean, Paul Mos, Yang Lin

Fluorescence lifetime imaging (FLI) has been receiving increased attention in recent years as a powerful diagnostic technique in biological and medical research. However, existing FLI systems often suffer from a tradeoff between processing speed, accuracy, ...

Nature Portfolio2024

Sparse autoregressive neural networks for classical spin systems

Giuseppe Carleo, Dian Wu, Indaco Biazzo

Efficient sampling and approximation of Boltzmann distributions involving large sets of binary variables, or spins, are pivotal in diverse scientific fields even beyond physics. Recent advances in generative neural networks have significantly impacted this ...

Iop Publishing Ltd2024

Continuous-variable neural network quantum states and the quantum rotor model

Giuseppe Carleo

We initiate the study of neural network quantum state algorithms for analyzing continuous-variable quantum systems in which the quantum degrees of freedom correspond to coordinates on a smooth manifold. A simple family of continuous-variable trial wavefunc ...

SPRINGERNATURE2023

Automated Human Motion Analysis and Synthesis

Sena Kiciroglu

Human motion analysis and synthesis is integral to many computer vision applications, from autonomous driving to sports analysis. In this thesis, we address several problems in this domain. First we consider active viewpoint selection for pose estimation w ...

EPFL2023

Phenomenological theory of variational quantum ground-state preparation

Ivano Tavernelli, Giuseppe Carleo

The variational approach is a cornerstone of computational physics, considering both conventional and quantum computing computational platforms. The variational quantum eigensolver algorithm aims to prepare the ground state of a Hamiltonian exploiting para ...

Amer Physical Soc2023

Robust Training and Verification of Deep Neural Networks

Fabian Ricardo Latorre Gomez

According to the proposed Artificial Intelligence Act by the European Comission (expected to pass at the end of 2023), the class of High-Risk AI Systems (Title III) comprises several important applications of Deep Learning like autonomous driving vehicles ...

EPFL2023

An exact mapping from ReLU networks to spiking neural networks

Wulfram Gerstner, Stanislaw Andrzej Wozniak, Ana Stanojevic, Giovanni Cherubini, Angeliki Pantazi

Deep spiking neural networks (SNNs) offer the promise of low-power artificial intelligence. However, training deep SNNs from scratch or converting deep artificial neural networks to SNNs without loss of performance has been a challenge. Here we propose an ...

2023

A Machine Learning-based Framework for Forecasting Sales of New Products With Short Life Cycles Using Deep Neural Networks

Ralf Seifert, Yara Kayyali El Alem

Demand forecasting is becoming increasingly important as firms launch new products with short life cycles more frequently. This paper provides a framework based on state-of-the-art techniques that enables firms to use quantitative methods to forecast sales ...

2022

Neural-network quantum states for periodic systems in continuous space

Giuseppe Carleo, Gabriel Maria Pescia

We introduce a family of neural quantum states for the simulation of strongly interacting systems in the presence of spatial periodicity. Our variational state is parametrized in terms of a permutationally invariant part described by the Deep Sets neural-n ...

AMER PHYSICAL SOC2022

A Critical Re-evaluation of Neural Methods for Entity Alignment

Robert West, Akhil Arora, Manuel Leone, Alberto Garcia Duran, Stefano Huber

Neural methods have become the de-facto choice for the vast majority of data analysis tasks, and entity alignment (EA) is no exception. Not surprisingly, more than 50 different neural EA methods have been published since 2017. However, surprisingly, an ana ...

ASSOC COMPUTING MACHINERY2022

Hidden-nucleons neural-network quantum states for the nuclear many-body problem

Giuseppe Carleo

We generalize the hidden-fermion family of neural network quantum states to encompass both continuous and discrete degrees of freedom and solve the nuclear many-body Schrodinger equation in a systematically improvable fashion. We demonstrate that adding hi ...

AMER PHYSICAL SOC2022

Geometry-Aware Deep Recurrent Neural Networks for Hyperspectral Image Classification

Mathieu Salzmann, Wei Wang, Siyuan Hao

Variants of deep networks have been widely used for hyperspectral image (HSI)-classification tasks. Among them, in recent years, recurrent neural networks (RNNs) have attracted considerable attention in the remote sensing community. However, complex geomet ...

2021

Lifelong Machine Learning with Data Efficiency and Knowledge Retention

Fei Mi

Artificial intelligence (AI) and machine learning (ML) have become de facto tools in many real-life applications to offer a wide range of benefits for individuals and our society. A classic ML model is typically trained with a large-scale static dataset in ...

EPFL2021

Neural interface systems with on-device computing: machine learning and neuromorphic architectures

Mahsa Shoaran

Development of neural interface and brain-machine interface (BMI) systems enables the treatment of neurological disorders including cognitive, sensory, and motor dysfunctions. While neural interfaces have steadily decreased in form factor, recent developme ...

CURRENT BIOLOGY LTD2021

Networks of Coupled VO2 Oscillators for Neuromorphic Computing

Elisabetta Corti

Neuromorphic computing is a wide research field aimed to the realization of brain-inspired hardware, apt to tackle computation of unstructured data more efficiently than currently done with standard computational units. Oscillatory neural networks are know ...

EPFL2021

Controlling spatiotemporal nonlinearities in multimode fibers with deep neural networks

Demetri Psaltis, Christophe Moser, Navid Borhani, Eirini Kakkava, Babak Rahmani, Ugur Tegin

Spatiotemporal nonlinear interactions in multimode fibers are of interest for beam shaping and frequency conversion by exploiting the nonlinear interaction of different pump modes from quasi-continuous wave to ultrashort pulses centered around visible to i ...

2020

Reservoir Computing meets Recurrent Kernels and Structured Transforms

Florent Gérard Krzakala, Jonathan Yuelin Dong, Ruben Elie Ohana

Reservoir Computing is a class of simple yet efficient Recurrent Neural Networks where internal weights are fixed at random and only a linear output layer is trained. In the large size limit, such random neural networks have a deep connection with kernel m ...

Curran Associates, Inc.2020

Crowding and the Architecture of the Visual System

Adrien Christophe Doerig

Classically, vision is seen as a cascade of local, feedforward computations. This framework has been tremendously successful, inspiring a wide range of ground-breaking findings in neuroscience and computer vision. Recently, feedforward Convolutional Neural ...

EPFL2020

Capsule networks as recurrent models of grouping and segmentation

Michael Herzog, Adrien Christophe Doerig, Bilge Sayim, Mauro Manassi, Lynn Schmittwilken

Classically, visual processing is described as a cascade of local feedforward computations. Feedforward Convolutional Neural Networks (ffCNNs) have shown how powerful such models can be. However, using visual crowding as a well-controlled challenge, we pre ...

2020

Learning Activation Functions in Deep (Spline) Neural Networks

Michaël Unser, Pakshal Narendra Bohra, Shayan Aziznejad, Harshit Gupta, Joaquim Gonçalves Garcia Barreto Campos

We develop an efficient computational solution to train deep neural networks (DNN) with free-form activation functions. To make the problem well-posed, we augment the cost functional of the DNN by adding an appropriate shape regularization: the sum of the ...

2020