Publications related to Dynamic programming

Primal-Dual Contextual Bayesian Optimization for Control System Online Optimization with Time-Average Constraints

Colin Neil Jones, Yuning Jiang, Wenjie Xu, Bratislav Svetozarevic

This paper studies the problem of online performance optimization of constrained closed-loop control systems, where both the objective and the constraints are unknown black-box functions affected by exogenous time-varying contextual disturbances. A primal- ...

IEEE2023

Unsupervised Electrofacies Clustering Based on Parameterization of Petrophysical Properties: A Dynamic Programming Approach

François Fleuret, Karthigan Sinnathamby

Electrofacies using well logs play a vital role in reservoir characterization. Often, they are sorted into clusters according to the self-similarity of input logs and do not capture the known underlying physical process. In this paper, we propose an unsupe ...

SOC PETROPHYSICISTS & WELL LOG ANALYSTS-SPWLA2023

Dynamic control of high-voltage actuator arrays by light-pattern projection on photoconductive switches

Herbert Shea, Amir Firouzeh, Edouard Franck Vincent Gustave Leroy, Vesna Bacheva, Aiste Balciunaite

The ability to control high-voltage actuator arrays relies, to date, on expensive microelectronic processes or on individual wiring of each actuator to a single off-chip high-voltage switch. Here we present an alternative approach that uses on-chip photoco ...

SPRINGERNATURE2023

A chance-constraint approach for optimizing Social Engagement-based services

Michel Bierlaire, Edoardo Fadda

Social Engagement is a novel business model transforming final users of a service from passive into active components. In this framework, people are contacted by a company and they are asked to perform tasks in exchange for a reward. This arises the compli ...

IEEE2022

High-dimensional optimization under nonconvex excluded volume constraints

Antonio Sclocchi

We consider high-dimensional random optimization problems where the dynamical variables are subjected to nonconvex excluded volume constraints. We focus on the case in which the cost function is a simple quadratic cost and the excluded volume constraints a ...

AMER PHYSICAL SOC2022

Optimal Policies for Age and Distortion in a Discrete-Time Model

Emre Telatar, Yunus Inan, Reka Inovan

We propose a simple model to study the tradeoff between timeliness and distortion, where different pieces of data have a different cost of not being sent. We pose the question of finding the optimal tradeoff as a policy design problem amenable to dynamic p ...

IEEE2021

Logical Team Q-learning: An approach towards factored policies in cooperative MARL

Ali H. Sayed, Lucas Cesar Eduardo Cassano

We address the challenge of learning factored policies in cooperative MARL scenarios. In particular, we consider the situation in which a team of agents collaborates to optimize a common cost. The goal is to obtain factored policies that determine the indi ...

MICROTOME PUBLISHING2021

Efficient Sequential and Parallel Algorithms for Multistage Stochastic Integer Programming Using Proximity

Friedrich Eisenbrand, Moritz Andreas Venzin, Jana Tabea Cslovjecsek

We consider the problem of solving integer programs of the form min {c^⊺ x : Ax = b, x ∈ ℤ_{⩾ 0}}, where A is a multistage stochastic matrix in the following sense: the primal treedepth of A is bounded by a parameter d, which means that the columns of A ca ...

Schloss Dagstuhl - Leibniz-Zentrum für Informatik2021

Optimal Adversarial Policies in the Multiplicative Learning System With a Malicious Expert

Negar Kiyavash, Seyed Jalal Etesami

We consider a learning system based on the conventional multiplicative weight ( MW) rule that combines experts' advice to predict a sequence of true outcomes. It is assumed that one of the experts is malicious and aims to impose the maximum loss on the sys ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Human Detection and Segmentation via Multi-view Consensus

Pascal Fua, Mathieu Salzmann, Isinsu Katircioglu, Helge Jochen Rhodin

Self-supervised detection and segmentation of foreground objects aims for accuracy without annotated training data. However, existing approaches predominantly rely on restrictive assumptions on appearance and motion. For scenes with dynamic activities and ...

IEEE2021

Optimal target assignment for massive spectroscopic surveys

Denis Gillet, Jean-Paul Richard Kneib, Matin Macktoobian

Robotics have recently contributed to cosmological spectroscopy to automatically obtain the map of the observable universe using robotic fiber positioners. For this purpose, an assignment algorithm is required to assign each robotic fiber positioner to a t ...

2020

Dynamic Modeling and Control of a Coupled Reforming/Combustor System for the Production of H2 via Hydrocarbon-Based Fuels

Theodoros Damartzis

The present work aims to provide insights into the dynamic operation of a coupled reformer/combustion unit that can utilize a variety of saturated hydrocarbons (HCs) with 1–4 C atoms towards H2 production (along with CO2). Within this concept, a preselecte ...

2020

Combining Dynamic & Static Scheduling in High-level Synthesis

Paolo Ienne, Lana Josipovic

A central task in high-level synthesis is scheduling: the allocation of operations to clock cycles. The classic approach to scheduling is static, in which each operation is mapped to a clock cycle at compile-time, but recent years have seen the emergence o ...

ASSOC COMPUTING MACHINERY2020

Dynamic Optimization of Reaction Systems via Exact Parsimonious Input Parameterization

Dominique Bonvin, Diogo Filipe Mateus Rodrigues

This paper discusses the use of parsimonious input parameterization for the dynamic optimization of reaction systems. This parameterization is able to represent the optimal inputs with only a few parameters. In the context of batch, semibatch, and continuo ...

AMER CHEMICAL SOC2019

Adaptive model predictive control for linear time varying MIMO systems

Vojislav Gligorovski

A robust, adaptive Model Predictive Control (MPC) approach for asymptotically stable, constrained linear time-varying (LTV) systems with multiple inputs and outputs is proposed. The approach consists of two-steps, carried out on-line with a receding horizo ...

2019

On reducing the number of decision variables for dynamic optimization

Dominique Bonvin, Diogo Filipe Mateus Rodrigues

This paper presents an input parameterization for dynamic optimization that allows reducing the number of decision variables compared to traditional direct methods. A small number of decision variables is likely to be beneficial for various applications su ...

2020

The Decision Rule Approach to Optimisation under Uncertainty: Methodology and Applications

Daniel Kuhn, Wolfram Wiesemann

Dynamic decision-making under uncertainty has a long and distinguished history in operations research. Due to the curse of dimensionality, solution schemes that naively partition or discretize the support of the random problem parameters are limited to sma ...

2019

Out-of-equilibrium dynamical equations of infinite-dimensional particle systems I. The isotropic case

Elisabeth Agoritsas

We consider the Langevin dynamics of a many-body system of interacting particles in d dimensions, in a very general setting suitable to model several out-of-equilibrium situations, such as liquid and glass rheology, active self-propelled particles, and gla ...

2019

Adaptive Streaming in Interactive Multiview Video Systems

Pascal Frossard, Laura Toni, Xue Zhang, Yao Zhao

Multiview applications endow final users with the possibility to freely navigate within 3D scenes with minimum-delay. A real feeling of scene navigation is enabled by transmitting multiple high-quality camera views, which can be used to synthesize addition ...

2019

Robust control for an electromagnetic actuator for a camless engine

Zlatina Kirilova Dimitrova

The increase of the effective efficiency of the internal combustion engines is important for the fuel consumption reduction and the CO2 emission reduction. The variable engine valve trains are important for the gas exchanges and influence directly the effe ...

PERGAMON-ELSEVIER SCIENCE LTD2019