Publications associées à Incentives for Answering Hypothetical Questions

White adipose tissue distribution and amount are associated with increased white matter connectivity

Jean-Philippe Thiran, Elda Fischi Gomez, Gabriel Girard, Philipp Johannes Koch, Liana Okudzhava

Obesity represents a significant public health concern and is linked to various comorbidities and cognitive impairments. Previous research indicates that elevated body mass index (BMI) is associated with structural changes in white matter (WM). However, a ...

Wiley2024

Unveiling the complexity of learning and decision-making

Wei-Hsiang Lin

Reinforcement learning (RL) is crucial for learning to adapt to new environments. In RL, the prediction error is an important component that compares the expected and actual rewards. Dopamine plays a critical role in encoding these prediction errors. In my ...

EPFL2024

Striatal Dopamine Signals and Reward Learning

Carl Petersen, Sylvain Crochet, Mauro Pulin, Yanqi Liu, Christos Sourmpis, Parviz Ghaderi, Pol Bech Vilaseca, Meriam Malekzadeh, Anthony Pierre Robert Renard, Robin François Virginien Dard

We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuro ...

Oxford Univ Press2023

Linking connectivity of deep brain stimulation of nucleus accumbens area with clinical depression improvements: a retrospective longitudinal case series

Dimitri Nestor Alice Van De Ville, Katrin Petermann, Thuy Anh Khoa Nguyen, Maria Giulia Preti, Simona Leserri

Treatment-resistant depression is a severe form of major depressive disorder and deep brain stimulation is currently an investigational treatment. The stimulation's therapeutic effect may be explained through the functional and structural connectivities be ...

Springer Heidelberg2024

Learning Robust and Adaptive Representations: from Interactions, for Interactions

Yuejiang Liu

Interactions are ubiquitous in our world, spanning from social interactions between human individuals to physical interactions between robots and objects to mechanistic interactions among different components of an intelligent system. Despite their prevale ...

EPFL2023

Glutathione in the nucleus accumbens regulates motivation to exert reward-incentivized effort

Pascal Steiner, Maria del Carmen Sandi Perez, Lijing Xin, Olivia Zanoletti, Fiona Hollis, Alina Veronika Irene Strasser, Ioannis Zalachoras, Simone Astori, João Pedro de Matos Rodrigues, Eva Ramos Fernandez

Emerging evidence is implicating mitochondrial function and metabolism in the nucleus accumbens in motivated performance. However, the brain is vulnerable to excessive oxidative insults resulting from neurometabolic processes, and whether antioxidant level ...

2022

Dopamine Dynamics in Reward-based Learning

Jun Huang

Dopamine signals are thought to be important for reward-based learning and appear to play important roles in regulating synaptic plasticity in the nucleus accumbens and the striatum. However, the precise neuronal circuit mechanisms underlying the learning ...

EPFL2022

Identifiability and Generalizability from Multiple Experts in Inverse Reinforcement Learning

Boris Nikolov, Volkan Cevher, Paul Thierry Yves Rolland, Luca Viano

While Reinforcement Learning (RL) aims to train an agent from a reward function in a given environment, Inverse Reinforcement Learning (IRL) seeks to recover the reward function from observing an expert’s behavior. It is well known that, in general, variou ...

2022

Regularized Diffusion Adaptation via Conjugate Smoothing

Ali H. Sayed, Stefan Vlaski

The purpose of this article is to develop and study a decentralized strategy for Pareto optimization of an aggregate cost consisting of regularized risks. Each risk is modeled as the expectation of some loss function with unknown probability distribution, ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Scalable Multi-agent Coordination and Resource Sharing

Panayiotis Danassis

A plethora of real world problems consist of a number of agents that interact, learn, cooperate, coordinate, and compete with others in ever more complex environments. Examples include autonomous vehicles, robotic agents, intelligent infrastructure, IoT de ...

EPFL2022

Reward boosts reinforcement-based motor learning

Friedhelm Christoph Hummel, Pierre Theopistos Vassiliadis, Julie Duqué

Besides relying heavily on sensory and reinforcement feedback, motor skill learning may also depend on the level of motivation experienced during training. Yet, how motivation by reward modulates motor learning remains unclear. In 90 healthy subjects, we i ...

2021

The role of medial amygdala inhibitory neurons in regulating social behavior

Aiste Baleisyte

Aggression is an evolutionary conserved social behavior that is necessary for an animalÂŽs survival. The neural substrates coordinating aggression are known to exist in the amygdala and the hypothalamus. While the medial amygdala (MeA) and the ventrolatera ...

EPFL2021

Neural Correlates of Reinforcement Learning: eligibility trace, reward prediction error, novelty and surprise

He Xu

In reinforcement learning (RL), an agent makes sequential decisions to maximise the reward it can obtain from an environment. During learning, the actual and expected outcomes are compared to tell whether a decision was good or bad. The difference between ...

EPFL2020

Risk prediction error signaling: A two-component response?

Michael Herzog, Ophélie Gladys Favrod, Kerstin Preuschoff, Marc Michael Lauffs, Sophie Alberta Catherine Geoghan

Organisms use rewards to navigate and adapt to (uncertain) environments. Error-based learning about rewards issupported by the dopaminergic system, which is thought to signal reward prediction errors to make adjustmentsto past predictions. More recently, t ...

2020

Cortical circuits for transforming whisker sensation into goal-directed licking

Carl Petersen, Sylvain Crochet, Georgios Foustoukos, Vahid Esmaeili, Keita Tamura, Anastasiia Oryshchuk

Animals can learn to use sensory stimuli to generate motor actions in order to obtain rewards. However, the precise neuronal circuits driving learning and execution of a specific goal-directed sensory-to-motor transformation remain to be elucidated. Here, ...

2020

The glucocorticoid receptor in the nucleus accumbens plays a crucial role in social rank attainment in rodents

Maria del Carmen Sandi Perez, Olivia Zanoletti, Jocelin Grosse, Fiona Hollis, Alexandre Claude Gustave Bacq, Ioannis Zalachoras, Thomas Didier Larrieu, Meltem Weger

Social hierarchy in social species is usually established through competitive encounters with conspecifics. It determines the access to limited resources and, thus, leads to reduced fights among individuals within a group. Despite the known importance of s ...

2020

Wasserstein Distributionally Robust Learning

Soroosh Shafieezadeh Abadeh

Many decision problems in science, engineering, and economics are affected by uncertainty, which is typically modeled by a random variable governed by an unknown probability distribution. For many practical applications, the probability distribution is onl ...

EPFL2020

A t-distribution based operator for enhancing out of distribution robustness of neural network classifiers

Philip Neil Garner

Neural Network (NN) classifiers can assign extreme probabilities to samples that have not appeared during training (out-of-distribution samples) resulting in erroneous and unreliable predictions. One of the causes for this unwanted behaviour lies in the us ...

IEEE Institute of Electrical and Electronics Engineers2020

Neuropharmacology of the mesolimbic system and associated circuits on social hierarchies

Maria del Carmen Sandi Perez, Michael van der Kooij, Sriparna Ghosal

Most socially living species are organized hierarchically, primarily based on individual differences in social dominance. Dominant individuals typically gain privileged access to important resources, such as food, mating partners and territories, whereas s ...

2019

Nucleus accumbens neurochemistry in human anxiety: A 7 T 1H-MRS study

Maria del Carmen Sandi Perez, Rolf Gruetter, Lijing Xin, Alina Veronika Irene Strasser

Individual differences in anxiety provide a differential predisposition to develop neuropsychiatric disorders. The neurochemical underpinnings of anxiety remain elusive, particularly in deep structures, such as the nucleus accumbens (NAc) whose involvement ...

2019