Publications related to Action selection

An Iterative Adaptive Dynamic Programming Approach for Macroscopic Fundamental Diagram-Based Perimeter Control and Route Guidance

Macroscopic fundamental diagrams (MFDs) have been widely adopted to model the traffic flow of large-scale urban networks. Coupling perimeter control and regional route guidance (PCRG) is a promising strategy to decrease congestion heterogeneity and reduce ...

Informs2024

Investigating neural resource allocation in the sensorimotor control of extra limbs

Giulia Dominijanni

The rise of robotic body augmentation brings forth new developments that will transform robotics, human-machine interaction, and wearable electronics. Extra robotic limbs, although building upon restorative technologies, bring their own set of challenges i ...

EPFL2024

Vision Transformer Adapters for Generalizable Multitask Learning

Sabine Süsstrunk, Mathieu Salzmann, Deblina Bhattacharjee

We introduce the first multitasking vision transformer adapters that learn generalizable task affinities which can be applied to novel tasks and domains. Integrated into an off-the-shelf vision transformer backbone, our adapters can simultaneously solve mu ...

Ieee Computer Soc2023

Contrasting action and posture coding with hierarchical deep neural network models of proprioception

Alexander Mathis, Mackenzie Mathis, Kai Jappe Sandbrink, Matthias Bethge, Pranav Mamidanna

Biological motor control is versatile, efficient, and depends on proprioceptive feedback. Muscles are flexible and undergo continuous changes, requiring distributed adaptive control mechanisms that continuously account for the body's state. The canonical r ...

eLIFE SCIENCES PUBL LTD2023

Optimizing in-situ monitoring for laser powder bed fusion process: Deciphering acoustic emission and sensor sensitivity with explainable machine learning

Christian Leinenbach, Sergey Shevchik, Rafal Wróbel

Metal-based Laser Powder Bed Fusion (LPBF) has made fabricating intricate components easier. Yet, assessing part quality is inefficient, relying on costly Computed Tomography (CT) scans or time-consuming destructive tests. Also, intermittent inspection of ...

Elsevier Science Sa2023

Data-enabled Predictive Control for Empty Vehicle Rebalancing

Nikolaos Geroliminis, Giancarlo Ferrari Trecate, Pengbo Zhu

A critical operational challenge in Mobility-on-demand systems is the problem of imbalance between vehicle supply and passenger demand. However, conventional model-based methods require accurate parametric system models with complex nonlinear dynamics that ...

IEEE2023

A theory of memory consolidation and synaptic pruning in cortical circuits

Georgios Iatropoulos

Over the course of a lifetime, the human brain acquires an astonishing amount of semantic knowledge and autobiographical memories, often with an imprinting strong enough to allow detailed information to be recalled many years after the initial learning exp ...

EPFL2023

Using Animal Motion Capture to Learn Neural Representations

Semih Günel

Understanding behavior from neural activity is a fundamental goal in neuroscience. It has practical applications in building robust brain-machine interfaces, human-computer interaction, and assisting patients with neurological disabilities. Despite the eve ...

EPFL2022

SPAHM: the spectrum of approximated Hamiltonian matrices representations

Anne-Clémence Corminboeuf, Ksenia Briling, Alberto Fabrizio

Physics-inspired molecular representations are the cornerstone of similarity-based learning applied to solve chemical problems. Despite their conceptual and mathematical diversity, this class of descriptors shares a common underlying philosophy: they all r ...

2022

Computational model of the dorsal horn circuitry for innocuous touch

Silvestro Micera, Simone Romeni

Providing a naturalistic tactile sensory feedback is currently one of the key challenges in neuroprosthetics. Modeling has played a fundamental role in the development of "biomimetic" stimulation protocols, determining optimal activation patterns to be eli ...

IEEE2021

Fast screening of covariates in population models empowered by machine learning

Jan Sickmann Hesthaven, Nadia Terranova

One of the objectives of Pharmacometry (PMX) population modeling is the identification of significant and clinically relevant relationships between parameters and covariates. Here, we demonstrate how this complex selection task could benefit from supervise ...

2021

Hierarchical Control in Islanded DC Microgrids With Flexible Structures

Giancarlo Ferrari Trecate, Pulkit Nahata, Alessio La Bella

Hierarchical architectures stacking primary, secondary, and tertiary layers are widely employed for the operation and control of islanded dc microgrids (dcmGs) composed of distribution generation units (DGUs), loads, and power lines. However, a comprehensi ...

2020

Learning and leveraging shared domain semantics to counteract visual domain shifts

Róger Bermúdez Chacón

One of the main limitations of artificial intelligence today is its inability to adapt to unforeseen circumstances. Machine Learning (ML), due to its data-driven nature, is particularly susceptible to this. ML relies on observations in order to learn impli ...

EPFL2020

Trajectory Data Analysis on the Spatial and Temporal Influence of Pedestrian Flow on Path Planning Decision

Michel Bierlaire, Jeongyun Kim

The modeling of walking behavior and design of walk-friendly urban pathways have been of interest to many researchers over the past decades. One of the major issues in pedestrian modeling is path planning decision-making in a dynamic walking environment wi ...

2020

Neural Correlates of Reinforcement Learning: eligibility trace, reward prediction error, novelty and surprise

He Xu

In reinforcement learning (RL), an agent makes sequential decisions to maximise the reward it can obtain from an environment. During learning, the actual and expected outcomes are compared to tell whether a decision was good or bad. The difference between ...

EPFL2020

Data driven building of realistic neuron model using IBEA and CMA evolution strategies

Henry Markram, Werner Alfons Hilda Van Geit, Tanguy Pierre Louis Damart

Recently the building of large neuronal circuits from realistic neuron models has gained traction. This bottom-up approach relies on the accurate description of the primitive elements composing the brain such as neurons and astrocytes, that are then aggreg ...

ACM2020

Towards Commoditizing Simulations of System Models Using Recurrent Neural Networks

Ahmet Caner Yüzügüler

System modeling and simulation plays a crucial role in the engineering of large and complex systems from various fields, such as industrial automation or power systems. In this paper, we propose a method that can be used to easily deploy high fidelity simu ...

IEEE2018

Generative Models for Learning Robot Manipulation Skills from Humans

Ajay Kumar Tanwani

A long standing goal in artificial intelligence is to make robots seamlessly interact with humans in performing everyday manipulation skills. Learning from demonstrations or imitation learning provides a promising route to bridge this gap. In contrast to d ...

EPFL2018

Neural Correlates of Sequential Decision Making

Michael Herzog, He Xu

In chess, a series of moves is made until a delayed sparse feedback (win, loss) is issued, which makes it impossible to evaluate the value of a single move. There are powerful reinforcement learning (RL) algorithms, which can cope with these sequential dec ...

2017

Neural Correlates of Sequential Decision Making

Michael Herzog, He Xu

In chess, a series of moves is made until a delayed sparse feedback (win, loss) is issued, which makes it impossible to evaluate the value of a single move. There are powerful reinforcement learning (RL) algorithms, which can cope with these sequential dec ...

2017