Publications related to Series acceleration

Instabilities in Elastic and Magneto-Elastic Beams and Shells: from Shell Buckling to the Design of a Programmable Braille Reader

In this thesis, we conduct a comprehensive investigation into structural instabilities of both elastic and magneto-elastic beams and shells, resulting in a creative proposal to design a programmable braille reader. Methodologically, we combine numerical si ...

EPFL2024

From low-rank retractions to dynamical low-rank approximation and back

Daniel Kressner, Axel Elie Joseph Séguin, Gianluca Ceruti

In algorithms for solving optimization problems constrained to a smooth manifold, retractions are a well-established tool to ensure that the iterates stay on the manifold. More recently, it has been demonstrated that retractions are a useful concept for ot ...

Springer2024

Optimization Algorithms for Decentralized, Distributed and Collaborative Machine Learning

Anastasiia Koloskova

Distributed learning is the key for enabling training of modern large-scale machine learning models, through parallelising the learning process. Collaborative learning is essential for learning from privacy-sensitive data that is distributed across various ...

EPFL2024

Enabling Uncertainty Estimation in Iterative Neural Networks

Pascal Fua, Nikita Durasov, Doruk Oner, Minh Hieu Lê

Turning pass-through network architectures into iterative ones, which use their own output as input, is a well-known approach for boosting performance. In this paper, we argue that such architectures offer an additional benefit: The convergence rate of the ...

Curran Associates2024

Plane Waves Versus Correlation-Consistent Basis Sets: A Comparison of MP2 Non-Covalent Interaction Energies in the Complete Basis Set Limit

Ursula Röthlisberger, Justin Villard, Martin Peter Bircher

Second-order Moller-Plesset perturbation theory (MP2) is the most expedient wave function-based method for considering electron correlation in quantum chemical calculations and, as such, provides a cost-effective framework to assess the effects of basis se ...

Amer Chemical Soc2023

Thermal conductivity of glasses: first-principles theory and applications

Nicola Marzari, Michele Simoncelli

Predicting the thermal conductivity of glasses from first principles has hitherto been a very complex problem. The established Allen-Feldman and Green-Kubo approaches employ approximations with limited validity-the former neglects anharmonicity, the latter ...

NATURE PORTFOLIO2023

On Preconditioning of Decentralized Gradient-Descent When Solving a System of Linear Equations

Nirupam Gupta

This article considers solving an overdetermined system of linear equations in peer-to-peer multiagent networks. The network is assumed to be synchronous and strongly connected. Each agent has a set of local data points, and their goal is to compute a line ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Faster One-Sample Stochastic Conditional Gradient Method for Composite Convex Minimization

Volkan Cevher, Alp Yurtsever, Maria-Luiza Vladarean

We propose a stochastic conditional gradient method (CGM) for minimizing convex finitesum objectives formed as a sum of smooth and non-smooth terms. Existing CGM variants for this template either suffer from slow convergence rates, or require carefully inc ...

2022

UNDERGRAD: A Universal Black-Box Optimization Method with Almost Dimension-Free Convergence Rate Guarantees

Volkan Cevher, Kimon Antonakopoulos

Universal methods for optimization are designed to achieve theoretically optimal convergence rates without any prior knowledge of the problem’s regularity parameters or the accurarcy of the gradient oracle employed by the optimizer. In this regard, existin ...

2022

Level-set-based Shape Optimization on Soft Magnetic Composites with Isotropy Constraint

Yves Perriard, Adrien Jean-Michel Thabuis, Xiaotao Ren

Soft Magnetic Composites (SMCs) demonstrate excellent potentials for electromagnetic applications. The isotropy is one critical feature in designing the composite. This work presents a shape optimization algorithm for SMCs subject to isotropy and volume co ...

Institute of Electrical and Electronics Engineers2022

Optimal Co-Planning of ESSs and Line Reinforcement Considering the Dispatchability of Active Distribution Networks

Mario Paolone, Sidi-Rachid Cherkaoui, Katarina Knezovic, Ji Hyun Yi

The paper presents a method for the co-optimization of energy storage systems allocation and line reinforcement in active distribution networks. The objective is to guarantee the capability of an active distribution network to follow a dispatch plan by app ...

IEEE Institute of Electrical and Electronics Engineers2022

On The Convergence Of Stochastic Primal-Dual Hybrid Gradient

Volkan Cevher, Ahmet Alacaoglu

In this paper, we analyze the recently proposed stochastic primal-dual hybrid gradient (SPDHG) algorithm and provide new theoretical results. In particular, we prove almost sure convergence of the iterates to a solution with convexity and linear convergenc ...

SIAM PUBLICATIONS2022

Decentralized Proximal Gradient Algorithms With Linear Convergence Rates

Ali H. Sayed, Kun Yuan, Sulaiman A S A E Alghunaim

This article studies a class of nonsmooth decentralized multiagent optimization problems where the agents aim at minimizing a sum of local strongly-convex smooth components plus a common nonsmooth term. We propose a general primal-dual algorithmic framewor ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

Remarks on Poincare and interpolation estimates for Truncated Hierarchical B-splines

Annalisa Buffa

This paper should be considered as an addendum to [A. Buffa and C. Giannelli, Adaptive isogeometric methods with hierarchical splines: Error estimator and convergence, Math. Models Methods Appl. Sci. 26 (2016) 1-25] and [A. Buffa and C. Giannelli, Adaptive ...

2021

Optimization Methods for Control: From Embedded Programmable Hardware to Data-Driven Process Optimization

Harsh Ambarishkumar Shukla

The research community has been making significant progress in hardware implementation, numerical computing and algorithm development for optimization-based control. However, there are two key challenges that still have to be overcome for optimization-base ...

EPFL2021

Optimal Control Combining Emulation and Imitation to Acquire Physical Assistance Skills

Sylvain Calinon, Amirreza Razmjoo Fard, Teguh Santoso Lembono

paper studies exploiting action-level learning (imitation) in the optimal control problem context. Cost functions defined by the optimal control methods are similar to the goal-level learning (emulation) in animals. However, imitating the robot's or others ...

IEEE2021

Multiagent Fully Decentralized Value Function Learning With Linear Convergence Rates

Ali H. Sayed, Kun Yuan, Lucas Cesar Eduardo Cassano

This article develops a fully decentralized multiagent algorithm for policy evaluation. The proposed scheme can be applied to two distinct scenarios. In the first scenario, a collection of agents have distinct datasets gathered by following different behav ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2021

A hybrid collocation-perturbation approach for PDEs with random domains

Fabio Nobile

Consider a linear elliptic PDE defined over a stochastic stochastic geometry a function of N random variables. In many application, quantify the uncertainty propagated to a quantity of interest (QoI) is an important problem. The random domain is split into ...

2021

Sub‐asymptotic motivation for new conditional multivariate extreme models

Anthony Christopher Davison, Thomas Lugrin, Jonathan A. Tawn

Statistical models for extreme values are generally derived from non-degenerate probabilistic limits that can be used to approximate the distribution of events that exceed a selected high threshold. If convergence to the limit distribution is slow, then th ...

2021

SCAFFOLD Stochastic Controlled Averaging for Federated Learning

Sai Praneeth Reddy Karimireddy, Sebastian Urban Stich, Ananda Theertha Suresh

Federated Averaging (FEDAVG) has emerged as the algorithm of choice for federated learning due to its simplicity and low communication cost. However, in spite of recent research efforts, its performance is not fully understood. We obtain tight convergence ...

JMLR-JOURNAL MACHINE LEARNING RESEARCH2020