Publications related to Multi-agent reinforcement learning

Fusing Pre-existing Knowledge and Machine Learning for Enhanced Building Thermal Modeling and Control

Buildings play a pivotal role in the ongoing worldwide energy transition, accounting for 30% of the global energy consumption. With traditional engineering solutions reaching their limits to tackle such large-scale problems, data-driven methods and Machine ...

EPFL2024

Inverse design of metal-organic frameworks for direct air capture of CO2via deep reinforcement learning

Berend Smit, Xiaoqi Zhang, Sauradeep Majumdar, Hyunsoo Park

The combination of several interesting characteristics makes metal-organic frameworks (MOFs) a highly sought-after class of nanomaterials for a broad range of applications like gas storage and separation, catalysis, drug delivery, and so on. However, the e ...

Royal Soc Chemistry2024

Lessons Learned from Data-Driven Building Control Experiments: Contrasting Gaussian Process-based MPC, Bilevel DeePC, and Deep Reinforcement Learning

Colin Neil Jones, Loris Di Natale, Jicheng Shi, Emilio Maddalena, Yingzhao Lian

This manuscript offers the perspective of experimentalists on a number of modern data-driven techniques: model predictive control relying on Gaussian processes, adaptive data-driven control based on behavioral theory, and deep reinforcement learning. These ...

2023

Multi-agent reinforcement learning with graph convolutional neural networks for optimal bidding strategies of generation units in electricity markets

Olga Fink, Mina Montazeri

Finding optimal bidding strategies for generation units in electricity markets would result in higher profit. However, it is a challenging problem due to the system uncertainty which is due to the lack of knowledge of the strategies of other generation uni ...

PERGAMON-ELSEVIER SCIENCE LTD2023

Safe multi-agent deep reinforcement learning for joint bidding and maintenance scheduling of generation units

Olga Fink, Mina Montazeri

This paper proposes a safe reinforcement learning algorithm for generation bidding decisions and unit maintenance scheduling in a competitive electricity market environment. In this problem, each unit aims to find a bidding strategy that maximizes its reve ...

2023

DIET Controller: Dynamic Indoor Environment using Deep Reinforcement Learning

Arnab Chatterjee

Heating, Ventilation, and Air Conditioning (HVAC) Systems utilize much energy, accounting for 40% of total building energy use. The temperatures in buildings are commonly held within narrow limits, leading to higher energy use. Measurements from office bui ...

EPFL2023

Reinforcement learning approach to control an inverted pendulum: A general framework for educational purposes

Jesus Sanchez Rodriguez

Machine learning is often cited as a new paradigm in control theory, but is also often viewed as empirical and less intuitive for students than classical model-based methods. This is particularly the case for reinforcement learning, an approach that does n ...

PUBLIC LIBRARY SCIENCE2023

Deep Learning for Localized-Haptic Feedback in Tactile Surfaces

Camilo Hernandez Mejia

Touchscreens are nowadays the preferred choice for user interfaces in consumer electronics. Significant technological advances have been made in terms of touch sensing and visual quality. However, the haptic feedback offered by commercial products is still ...

EPFL2023

Real-time model calibration with deep reinforcement learning

Olga Fink

The real-time, and accurate inference of model parameters is of great importance in many scientific and engineering disciplines that use computational models (such as a digital twin) for the analysis and prediction of complex physical processes. However, f ...

2022

CPG-RL: Learning Central Pattern Generators for Quadruped Locomotion

Auke Ijspeert, Guillaume Denis Antoine Bellegarda

In this letter, we present a method for integrating central pattern generators (CPGs), i.e. systems of coupled oscillators, into the deep reinforcement learning (DRL) framework to produce robust and omnidirectional quadruped locomotion. The agent learns to ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

A prescriptive Dirichlet power allocation policy with deep reinforcement learning

Olga Fink

Prescribing optimal operation based on the condition of the system, and thereby potentially prolonging its remaining useful lifetime, has tremendous potential in terms of actively managing the availability, maintenance, and costs of complex systems. Reinfo ...

2022

Scalable Multi-agent Coordination and Resource Sharing

Panayiotis Danassis

A plethora of real world problems consist of a number of agents that interact, learn, cooperate, coordinate, and compete with others in ever more complex environments. Examples include autonomous vehicles, robotic agents, intelligent infrastructure, IoT de ...

EPFL2022

Magnetic control of tokamak plasmas through deep reinforcement learning

Ambrogio Fasoli, Olivier Sauter, Basil Duval, Stefano Coda, Jean-Marc Moret, Federico Alberto Alfredo Felici, Cristian Sommariva, Antoine Pierre Emmanuel Alexis Merle, Cristian Galperti, Francesco Carpanese, Jonas Buchli, Federico Pesamosca, Brendan Tracey, Jonas Degrave

Nuclear fusion using magnetic confinement, in particular in the tokamak configuration, is a promising path towards sustainable energy. A core challenge is to shape and maintain a high-temperature plasma within the tokamak vessel. This requires high-dimensi ...

2022

Learning to sample in Cartesian MRI

Thomas Sanchez

Magnetic Resonance Imaging (MRI) is a non-invasive, non-ionizing imaging modality with unmatched soft tissue contrast. However, compared to imaging methods like X-ray radiography, MRI suffers from long scanning times, due to its inherently sequential acqui ...

EPFL2022

Reinforcement Learning for the occupant-centric operation of building energy systems: Theoretical and experimental investigations

Amirreza Heidari

Occupant behavior, defined as the presence and energy-related actions of occupants, is today known as a key driver of building energy use. Closing the gap between what is provided by building energy systems and what is actually needed by occupants requires ...

EPFL2022

Understanding Deep Neural Function Approximation in Reinforcement Learning via ϵ-Greedy Exploration

Volkan Cevher, Fanghui Liu, Luca Viano

This paper provides a theoretical study of deep neural function approximation in reinforcement learning (RL) with the ϵ-greedy exploration under the online setting. This problem setting is motivated by the successful deep Q-networks (DQN) framework that fa ...

2022

A User Centered News Recommendation System

Denis Gillet, Sandy Ingram, Rania Islambouli

Spending an uncontrolled quantity and quality of time on digital information sites is affecting our well-being and can lead to serious problems in the long term. In this paper, we present a sequential recommendation framework that uses deep reinforcement l ...

ACM2021

Deep Reinforcement Learning for room temperature control: a black-box pipeline from data to policies

Colin Neil Jones, Bratislav Svetozarevic, Loris Di Natale

Deep Reinforcement Learning (DRL) recently emerged as a possibility to control complex systems without the need to model them. However, since weeks long experiments are needed to assess the performance of a building controller, people still have to rely on ...

2021

Practical Low-Rank Communication Compression in Decentralized Deep Learning

Martin Jaggi, Sai Praneeth Reddy Karimireddy, Thijs Vogels

Lossy gradient compression has become a practical tool to overcome the communication bottleneck in centrally coordinated distributed training of machine learning models. However, algorithms for decentralized training with compressed communication over arbi ...

2020

Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learning

Alexandre Massoud Alahi, Sven Kreiss, Yuejiang Liu, Changan Chen

Mobility in an effective and socially-compliant manner is an essential yet challenging task for robots operating in crowded spaces. Recent works have shown the power of deep reinforcement learning techniques to learn socially cooperative policies. However, ...

IEEE2019