Publication

Effects of stress and genotype on meta-parameter dynamics in reinforcement learning

Related publications (31)

Seeking the new, learning from the unexpected: Computational models of surprise and novelty in the brain

Human babies have a natural desire to interact with new toys and objects, through which they learn how the world around them works, e.g., that glass shatters when dropped, but a rubber ball does not. When their predictions are proven incorrect, such as whe ...

EPFL2024

Unveiling the complexity of learning and decision-making

Wei-Hsiang Lin

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

EPFL2024

Social Opinion Formation and Decision Making Under Communication Trends

Ali H. Sayed, Virginia Bordignon, Mert Kayaalp

This work studies the learning process over social networks under partial and random information sharing. In traditional social learning models, agents exchange full belief information with each other while trying to infer the true state of nature. We stud ...

Ieee-Inst Electrical Electronics Engineers Inc2024

Predicting the long-term collective behaviour of fish pairs with deep learning

Francesco Mondada, Alexandre Massoud Alahi, Vaios Papaspyros

Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social in ...

2024

Incorporating Projective Geometry into Deep Learning

Michal Jan Tyszkiewicz

In this thesis we explore the applications of projective geometry, a mathematical theory of the relation between 3D scenes and their 2D images, in modern learning-based computer vision systems. This is an interesting research question which contradicts the ...

EPFL2024

Coupling a recurrent neural network to SPAD TCSPC systems for real-time fluorescence lifetime imaging

Claudio Bruschini, Edoardo Charbon, Andrei Ardelean, Paul Mos, Yang Lin

Fluorescence lifetime imaging (FLI) has been receiving increased attention in recent years as a powerful diagnostic technique in biological and medical research. However, existing FLI systems often suffer from a tradeoff between processing speed, accuracy, ...

Nature Portfolio2024

Resource-Efficient Continual Learning for Personalized Online Seizure Detection

David Atienza Alonso, Giovanni Ansaloni, Flavio Ponzina, Amirhossein Shahbazinia, José Angel Miranda Calero, Jonathan Dan

Epilepsy, a major neurological disease, requires careful diagnosis and treatment. However, the detection of epileptic seizures remains a significant challenge. Current clinical practice relies on expert analysis of EEG signals, a process that is time-consu ...

IEEE2024

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Elena Beanato, Esra Neufeld, Friedhelm Christoph Hummel, Takuya Morishita, Maximilian Jonas Wessel, Traian Popa, Pierre Theopistos Vassiliadis, Julie Duqué, Fabienne Windel

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, ...

Nature Portfolio2024

Understanding generalization and robustness in modern deep learning

Maksym Andriushchenko

In this thesis, we study two closely related directions: robustness and generalization in modern deep learning. Deep learning models based on empirical risk minimization are known to be often non-robust to small, worst-case perturbations known as adversari ...

EPFL2024

Multi-temporal forest monitoring in the Swiss Alps with knowledge-guided deep learning

Devis Tuia, Thiên-Anh Claris Nguyen, Marc Conrad Russwurm, Gaston Jean Lenczner

Monitoring forests, in particular their response to climate and land use change, requires studying long time scales. While efficient deep learning methods have been developed to process short time series of satellite imagery, leveraging long time series of ...

Elsevier Science Inc2024

Inverse design of metal-organic frameworks for direct air capture of CO2via deep reinforcement learning

Berend Smit, Sauradeep Majumdar, Xiaoqi Zhang, Hyunsoo Park

The combination of several interesting characteristics makes metal-organic frameworks (MOFs) a highly sought-after class of nanomaterials for a broad range of applications like gas storage and separation, catalysis, drug delivery, and so on. However, the e ...

Royal Soc Chemistry2024

Fusing Pre-existing Knowledge and Machine Learning for Enhanced Building Thermal Modeling and Control

Loris Di Natale

Buildings play a pivotal role in the ongoing worldwide energy transition, accounting for 30% of the global energy consumption. With traditional engineering solutions reaching their limits to tackle such large-scale problems, data-driven methods and Machine ...

EPFL2024

Involvement of prelimbic cortex neurons and related circuits in the acquisition of a cooperative learning by pairs of rats

Maria del Carmen Sandi Perez, Elias Georges Gebara, Ana del Rocio Conde Moro

Social behaviors such as cooperation are crucial for mammals. A deeper knowledge of the neuronal mechanisms underlying cooperation can be beneficial for people suffering from pathologies with impaired social behavior. Our aim was to study the brain activit ...

Springer2024

Deep learning approach for identification of H II regions during reionization in 21-cm observations - II. Foreground contamination

Michele Bianco, Jean-Paul Richard Kneib, Emma Elizabeth Tolley, Tianyue Chen

The upcoming Square Kilometre Array Observatory will produce images of neutral hydrogen distribution during the epoch of reionization by observing the corresponding 21-cm signal. However, the 21-cm signal will be subject to instrumental limitations such as ...

Oxford Univ Press2024

Glenohumeral joint force prediction with deep learning

Dominique Pioletti, Alexandre Terrier, Philippe Büchler, Patrick Goetti

Deep learning models (DLM) are efficient replacements for computationally intensive optimization techniques. Musculoskeletal models (MSM) typically involve resource-intensive optimization processes for determining joint and muscle forces. Consequently, DLM ...

Elsevier Sci Ltd2024

Generalization and Personalization of Machine Learning for Multimodal Mobile Sensing in Everyday Life

Lakmal Buddika Meegahapola

A range of behavioral and contextual factors, including eating and drinking behavior, mood, social context, and other daily activities, can significantly impact an individual's quality of life and overall well-being. Therefore, inferring everyday life aspe ...

EPFL2024

Towards practical reinforcement learning for tokamak magnetic control

Jonas Buchli, Federico Alberto Alfredo Felici, Cristian Galperti, Brendan Tracey

Reinforcement learning (RL) has shown promising results for real-time control systems, including the domain of plasma magnetic control. However, there are still significant drawbacks compared to traditional feedback control approaches for magnetic confinem ...

Elsevier Science Sa2024

Performing and Detecting Backdoor Attacks on Face Recognition Algorithms

Alexander Carl Unnervik

The field of biometrics, and especially face recognition, has seen a wide-spread adoption the last few years, from access control on personal devices such as phones and laptops, to automated border controls such as in airports. The stakes are increasingly ...

EPFL2024

GANDALF: Graph-based transformer and Data Augmentation Active Learning Framework with interpretable features for multi-label chest Xray classification

Seyedbehzad Bozorgtabar

Informative sample selection in an active learning (AL) setting helps a machine learning system attain optimum performance with minimum labeled samples, thus reducing annotation costs and boosting performance of computer-aided diagnosis systems in the pres ...

Elsevier2024

A KL Divergence-Based Loss for In Vivo Ultrafast Ultrasound Image Enhancement with Deep Learning: Dataset (1/6)

Jean-Philippe Thiran, Roser Vinals Terres

This dataset contains a collection of ultrafast ultrasound acquisitions from nine volunteers and the CIRS 054G phantom. For a comprehensive understanding of the dataset, please refer to the paper: Viñals, R.; Thiran, J.-P. A KL Divergence-Based Loss for In ...

Zenodo2024