Publications related to One-shot learning and behavioral eligibility traces in sequential decision making

Unveiling the complexity of learning and decision-making

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

EPFL2024

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Alireza Modirshanechi

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

EPFL2024

Reliable data-driven decision-making through optimal transport

Bahar Taskesen

Decision-making permeates every aspect of human and societal development, from individuals' daily choices to the complex decisions made by communities and institutions. Central to effective decision-making is the discipline of optimization, which seeks th ...

EPFL2024

Optimal regimes for algorithm-assisted human decision-making

Mats Julius Stensrud, Aaron Leor Sarvet

We consider optimal regimes for algorithm-assisted human decision-making. Such regimes are decision functions of measured pre-treatment variables and, by leveraging natural treatment values, enjoy a superoptimality property whereby they are guaranteed to o ...

2024

Predicting the long-term collective behaviour of fish pairs with deep learning

Francesco Mondada, Alexandre Massoud Alahi, Vaios Papaspyros

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

2024

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

Hearing structure in music: An empirical inquiry into listening as representation and processing

Gabriele Cecchetti

As a universal expression of human creativity, music is capable of conveying great subtlety and complexity. Crucially, this complexity is not encoded in the score or in the sounds, but is rather construed in the mind of the listener in the form of nuanced ...

EPFL2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Devis Tuia, Thiên-Anh Claris Nguyen, Marc Conrad Russwurm, Gaston Jean Lenczner

Monitoring forests, in particular their response to climate and land use change, requires studying long time scales. While efficient deep learning methods have been developed to process short time series of satellite imagery, leveraging long time series of ...

Elsevier Science Inc2024

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Elena Beanato, Esra Neufeld, Friedhelm Christoph Hummel, Takuya Morishita, Maximilian Jonas Wessel, Traian Popa, Pierre Theopistos Vassiliadis, Julie Duqué, Fabienne Windel

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...

Nature Portfolio2024

Fusing Pre-existing Knowledge and Machine Learning for Enhanced Building Thermal Modeling and Control

Loris Di Natale

Buildings play a pivotal role in the ongoing worldwide energy transition, accounting for 30% of the global energy consumption. With traditional engineering solutions reaching their limits to tackle such large-scale problems, data-driven methods and Machine ...

EPFL2024

Thalamic contributions to psychosis susceptibility: Evidence from co-activation patterns accounting for intra-seed spatial variability (μCAPs)

Dimitri Nestor Alice Van De Ville, Thomas William Arthur Bolton, Nada Kojovic, Farnaz Delavari

The temporal variability of the thalamus in functional networks may provide valuable insights into the pathophysiology of schizophrenia. To address the complexity of the role of the thalamic nuclei in psychosis, we introduced micro-co-activation patterns ( ...

Wiley2024

Inverse design of metal-organic frameworks for direct air capture of CO2via deep reinforcement learning

Berend Smit, Sauradeep Majumdar, Xiaoqi Zhang, Hyunsoo Park

The combination of several interesting characteristics makes metal-organic frameworks (MOFs) a highly sought-after class of nanomaterials for a broad range of applications like gas storage and separation, catalysis, drug delivery, and so on. However, the e ...

Royal Soc Chemistry2024

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

Alexander Carl Unnervik

The field of biometrics, and especially face recognition, has seen a wide-spread adoption the last few years, from access control on personal devices such as phones and laptops, to automated border controls such as in airports. The stakes are increasingly ...

EPFL2024

Contextual Stochastic Bilevel Optimization

Daniel Kuhn, Yifan Hu, Andreas Krause, Jie Wang

We introduce contextual stochastic bilevel optimization (CSBO) -- a stochastic bilevel optimization framework with the lower-level problem minimizing an expectation conditioned on some contextual information and the upper-level decision variable. This fram ...

2023

Mechanisms underlying reinforcement learning of motor skills

Pierre Theopistos Vassiliadis

Motor learning allows animals, including human beings, to acquire skills that are es-sential for efficient interactions with the environment. This ability to learn new motor skills is of great practical relevance for daily-life activities (such as when lea ...

EPFL2023

Striatal Dopamine Signals and Reward Learning

Carl Petersen, Sylvain Crochet, Mauro Pulin, Yanqi Liu, Christos Sourmpis, Parviz Ghaderi, Pol Bech Vilaseca, Meriam Malekzadeh, Anthony Pierre Robert Renard, Robin François Virginien Dard

We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuro ...

Oxford Univ Press2023

Neuronal correlates of goal-directed sensorimotor transformation in sensory, motor and higher-order cortical areas

Anastasiia Oryshchuk

An important function of the brain is to interpret incoming sensory information from the outside world to guide adaptive behavior. Understanding how and where sensory information is transformed into motor commands in a context- and learning-dependent manne ...

EPFL2023

Tuning perception and decisions to temporal context

David Pascucci

Recent work suggests that serial dependence, where perceptual decisions are biased toward previous stimuli, arises from the prior that sensory input is temporally correlated. However, existing studies have mostly used random stimulus sequences that do not ...

Cell Press2023

Safety risk management in University laboratories

Anastasia Jung

Risk management has become an essential element in the functioning of modern society. Correct risk identification and assessment are undoubtedly crucial to improving overall safety; nevertheless, often, it is accompanied by the wrong selection of correctiv ...

EPFL2023