Publications associées à Processus de décision markovien

Imitation Learning in Discounted Linear MDPs without exploration assumptions

Volkan Cevher, Efstratios Panteleimon Skoulakis, Luca Viano

We present a new algorithm for imitation learning in infinite horizon linear MDPs dubbed ILARL which greatly improves the bound on the number of trajectories that the learner needs to sample from the environment. In particular, we re- move exploration assu ...

2024

Optimal containment control for a class of heterogeneous multi-agent systems with actuator faults

Ju Wu, Tong Wang

This article investigates the optimal containment control problem for a class of heterogeneous multi-agent systems with time-varying actuator faults and unmatched disturbances based on adaptive dynamic programming. Since there exist unknown input signals i ...

WILEY2023

Multi-robot task allocation for safe planning against stochastic hazard dynamics

Maryam Kamgarpour, Orcun Karaca

We address multi-robot safe mission planning in uncertain dynamic environments. This problem arises in several applications including safety-critical exploration, surveillance, and emergency rescue missions. Computation of a multi-robot optimal control pol ...

IEEE2023

Routing and charging game in ride-hailing service with electric vehicles

John Lygeros, Kenan Zhang

This paper studies the routing and charging behaviors of electric vehicles in a competitive ride-hailing market. When the vehicles are idle, they can choose whether to continue cruising to search for passengers, or move a charging station to recharge. The ...

IEEE2023

On a Finite-Size Neuronal Population Equation

Tilo Schwalger, Valentin Marc Schmutz, Eva Löcherbach

Population equations for infinitely large networks of spiking neurons have a long tradition in theoret-ical neuroscience. In this work, we analyze a recent generalization of these equations to populations of finite size, which takes the form of a nonlinear ...

SIAM PUBLICATIONS2023

Model Predictive Control for Multi-Agent Systems under Limited Communication and Time-Varying Network Topology

Danilo Saccani, Melanie Nicole Zeilinger

In control system networks, reconfiguration of the controller when agents are leaving or joining the network is still an open challenge, in particular when operation constraints that depend on each agent's behavior must be met. Drawing our motivation from ...

IEEE2023

Distributionally Robust Linear Quadratic Control

Daniel Kuhn, Bahar Taskesen, Cagil Kocyigit

Linear-Quadratic-Gaussian (LQG) control is a fundamental control paradigm that is studied in various fields such as engineering, computer science, economics, and neuroscience. It involves controlling a system with linear dynamics and imperfect observations ...

2023

Data-enabled Predictive Control for Empty Vehicle Rebalancing

Nikolaos Geroliminis, Giancarlo Ferrari Trecate, Pengbo Zhu

A critical operational challenge in Mobility-on-demand systems is the problem of imbalance between vehicle supply and passenger demand. However, conventional model-based methods require accurate parametric system models with complex nonlinear dynamics that ...

IEEE2023

Information-Driven Gas Distribution Mapping for Autonomous Mobile Robots

Alcherio Martinoli, Chiara Ercolani, Faezeh Rahbar

The ability to sense airborne pollutants with mobile robots provides a valuable asset for domains such as industrial safety and environmental monitoring. Oftentimes, this involves detecting how certain gases are spread out in the environment, commonly refe ...

MDPI2023

Optimal Combination Policies For Adaptive Social Learning

Virginia Bordignon, Ping Hu, Stefan Vlaski

This paper investigates the effect of combination policies on the performance of adaptive social learning in non-stationary environments. By analyzing the relation between the error probability and the underlying graph topology, we prove that in the slow a ...

IEEE2022

Stochastic Second-Order Methods Improve Best-Known Sample Complexity of SGD for Gradient-Dominated Function

Patrick Thiran, Negar Kiyavash, Saber Salehkaleybar

We study the performance of Stochastic Cubic Regularized Newton (SCRN) on a class of functions satisfying gradient dominance property with

1\le\alpha\le2

which holds in a wide range of applications in machine learning and signal processing. This conditio ...

NeurIPS2022

Learning Robustly Safe Output Feedback Controllers from Noisy Data with Performance Guarantees

Giancarlo Ferrari Trecate, Luca Furieri, Baiwei Guo, Andrea Martin

How can we synthesize a safe and near-optimal control policy for a partially-observed system, if all we are given is one historical input/output trajectory that has been corrupted by noise? To address this challenge, we suggest a novel data-driven controll ...

2021

Exploring policy change through agent-based simulation

Raphaël Klein

Policymaking is a complex process that has been studied using policy process theories almost exclusively. These theories have been built using a large number of qualitative cases. Such methods are useful for theory building but remain limited for theory ex ...

EPFL2021

Decision Learning and Adaptation Over Multi-Task Networks

Ali H. Sayed

This paper studies the operation of multi-agent networks engaged in multi-task decision problems under the paradigm of simultaneous learning and adaptation. Two scenarios are considered:one in which a decision must be taken among multiple states of nature ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Optimal Control Combining Emulation and Imitation to Acquire Physical Assistance Skills

Sylvain Calinon, Amirreza Razmjoo Fard, Teguh Santoso Lembono

paper studies exploiting action-level learning (imitation) in the optimal control problem context. Cost functions defined by the optimal control methods are similar to the goal-level learning (emulation) in animals. However, imitating the robot's or others ...

IEEE2021

A Planner-Trader Decomposition for Multi-Market Hydro Scheduling

Daniel Kuhn, Napat Rujeerapaiboon, Kilian Schindler, Wolfram Wiesemann

Peak/off-peak spreads on European electricity forward and spot markets are eroding due to the ongoing nuclear phaseout and the steady growth in photovoltaic capacity. The reduced profitability of peak/off- peak arbitrage forces hydropower producers to reco ...

2024

Robust Inverse Reinforcement Learning under Transition Dynamics Mismatch

Volkan Cevher, Kamalaruban Parameswaran, Luca Viano, Yu-Ting Huang

We study the inverse reinforcement learning (IRL) problem under a transition dynamics mismatch between the expert and the learner. Specifically, we consider the Maximum Causal Entropy (MCE) IRL learner model and provide a tight upper bound on the learner’s ...

2021

Reference tracking stochastic model predictive control over unreliable channels and bounded control actions

Colin Neil Jones

A stochastic model predictive control framework over unreliable Bernoulli communication channels, in the presence of unbounded process noise and under bounded control inputs, is presented for tracking a reference signal. The data losses in the control chan ...

2021

Model-Free Iterative Learning Control With Nonrepetitive Trajectories for Second-Order MIMO Nonlinear Systems-Application to a Delta Robot

Mohamed Bouri

A model-free iterative learning control strategy (ILC) in nonrepetitive trajectories, applied to robotic manipulators is presented in this article. The development of this ILC controller is derived in general case for second-order nonlinear multi-input mul ...

2021

A first-order primal-dual method with adaptivity to local smoothness

Volkan Cevher, Maria-Luiza Vladarean

We consider the problem of finding a saddle point for the convex-concave objective

\min_x \max_y f(x) + \langle Ax, y\rangle - g^*(y)

, where

f

is a convex function with locally Lipschitz gradient and

g

is convex and possibly non-smooth. We propose an ...

2021