Publications de Kerstin Preuschoff

Brain signals of a Surprise-Actor-Critic model: Evidence for multiple learning modules in human decision making

Wulfram Gerstner, Marco Philipp Lehmann, Vasiliki Liakoni, Kerstin Preuschoff, Johanni Michael Brea, Alireza Modirshanechi

Learning how to reach a reward over long series of actions is a remarkable capability of humans, and potentially guided by multiple parallel learning modules. Current brain imaging of learning modules is limited by (i) simple experimental paradigms, (ii) e ...

ACADEMIC PRESS INC ELSEVIER SCIENCE2022

Information Theoretic Characterization of Uncertainty Distinguishes Surprise From Accuracy Signals in the Brain

Kerstin Preuschoff, Leyla Loued-Khenissi

Uncertainty presents a problem for both human and machine decision-making. While utility maximization has traditionally been viewed as the motive force behind choice behavior, it has been theorized that uncertainty minimization may supersede reward motivat ...

2020

Risk prediction error signaling: A two-component response?

Michael Herzog, Ophélie Gladys Favrod, Kerstin Preuschoff, Marc Michael Lauffs, Sophie Alberta Catherine Geoghan

Organisms use rewards to navigate and adapt to (uncertain) environments. Error-based learning about rewards issupported by the dopaminergic system, which is thought to signal reward prediction errors to make adjustmentsto past predictions. More recently, t ...

2020

Anterior insula reflects surprise in value-based decision-making and perception

Kerstin Preuschoff, Leyla Loued-Khenissi

The brain has been theorized to employ inferential processes to overcome the problem of uncertainty. Inference is thought to underlie neural processes, including in disparate domains such as value-based decision-making and perception. Value-based decision- ...

2020

One-shot learning and behavioral eligibility traces in sequential decision making

Wulfram Gerstner, Marco Philipp Lehmann, Michael Herzog, Vasiliki Liakoni, Kerstin Preuschoff, He Xu

In many daily tasks, we make multiple decisions before reaching a goal. In order to learn such sequences of decisions, a mechanism to link earlier actions to later reward is necessary. Reinforcement learning (RL) theory suggests two classes of algorithms s ...

2019

An Overview of Functional Magnetic Resonance Imaging Techniques for Organizational Research

Kerstin Preuschoff, Leyla Loued-Khenissi

Functional magnetic resonance imaging is a galvanizing tool for behavioral scientists. It provides a means by which to see what the brain does while a person thinks, acts, or perceives, without invasive procedures. In this, fMRI affords us a relatively eas ...

SAGE PUBLICATIONS INC2019

Balancing New against Old Information: The Role of Puzzlement Surprise in Learning

Wulfram Gerstner, Mohammadjavad Faraji, Kerstin Preuschoff

2018

Apathy and noradrenaline: silent partners to mild cognitive impairment in Parkinson's disease?

Kerstin Preuschoff, Leyla Loued-Khenissi

Purpose of review Mild cognitive impairment (MCI) is a comorbid factor in Parkinson's disease. The aim of this review is to examine the recent neuroimaging findings in the search for Parkinson's disease MCI (PD-MCI) biomarkers to gain insight on whether MC ...

Lippincott, Williams & Wilkins2015

A biologically plausible 3-factor learning rule for expectation maximization in reinforcement learning and decision making

Wulfram Gerstner, Mohammadjavad Faraji, Kerstin Preuschoff

2015

Investigating signal integration with canonical correlation analysis of fMRI brain activation data

Kerstin Preuschoff

How the brain integrates signals from specific areas has been a longstanding critical question for neurobiologists. Two recent observations suggest a new approach to fMRI data analysis of this question. First, in many instances, the brain analyzes inputs b ...

2008

Human insula activation reflects risk prediction errors as well as risk

Kerstin Preuschoff

Understanding how organisms deal with probabilistic stimulus-reward associations has been advanced by a convergence between reinforcement learning models and primate physiology, which demonstrated that the brain encodes a reward prediction error signal. Ho ...

2008

Explicit neural signals reflecting reward uncertainty

Kerstin Preuschoff

The acknowledged importance of uncertainty in economic decision making has stimulated the search for neural signals that could influence learning and inform decision mechanisms. Current views distinguish two forms of uncertainty, namely risk and ambiguity, ...

2008

Markowitz in the brain?

Kerstin Preuschoff

We review recent rain-scanning (fMRI) evidence that activity in certain sub-cortical structures of the human brain correlate with changes in expected reward, as well as with risk. Risk is measured by variance of payoff, as in Markowitz' theory. The brain s ...

2008