Publications by Thijs Vogels | EPFL Graph Search

MultiModN- Multimodal, Multi-Task, Interpretable Modular Networks

Mary-Anne Hartley, Thijs Vogels, Thierry Bossy, Martin Jaggi, Tanja Christina Käser Jacober, Vinitra Swamy, Malika Satayeva, Jibril Albachir Frej

Predicting multiple real-world tasks in a single model often requires a particularly diverse feature space. Multimodal (MM) models aim to extract the synergistic predictive potential of multiple data types to create a shared feature space with aligned sema ...

2023

Beyond Spectral Gap: The Role of the Topology in Decentralized Learning

Thijs Vogels, Hadrien Hendrikx, Martin Jaggi

In data-parallel optimization of machine learning models, workers collaborate to improve their estimates of the model: more accurate gradients allow them to use larger learning rates and optimize faster. In the decentralized setting, in which workers commu ...

Microtome Publishing2023

Modular Clinical Decision Support Networks (MoDN)-Updatable, interpretable, and portable predictions for evolving clinical environments

Mary-Anne Hartley, Thijs Vogels, Martin Jaggi

Clinical Decision Support Systems (CDSS) have the potential to improve and standardise care with probabilistic guidance. However, many CDSS deploy static, generic rule-based logic, resulting in inequitably distributed accuracy and inconsistent performance ...

PUBLIC LIBRARY SCIENCE2023

Communication-efficient distributed training of machine learning models

Thijs Vogels

In this thesis, we explore techniques for addressing the communication bottleneck in data-parallel distributed training of deep learning models. We investigate algorithms that either reduce the size of the messages that are exchanged between workers, or th ...

EPFL2023

Deep Compositional Denoising for High-quality Monte Carlo Rendering

Marios Papas, Thijs Vogels, Xianyao Zhang

We propose a deep-learning method for automatically decomposing noisy Monte Carlo renderings into components that kernelpredicting denoisers can denoise more effectively. In our model, a neural decomposition module learns to predict noisy components and co ...

WILEY2021

Practical Low-Rank Communication Compression in Decentralized Deep Learning

Thijs Vogels, Sai Praneeth Reddy Karimireddy, Martin Jaggi

Lossy gradient compression has become a practical tool to overcome the communication bottleneck in centrally coordinated distributed training of machine learning models. However, algorithms for decentralized training with compressed communication over arbi ...

2020

Optimizer Benchmarking Needs to Account for Hyperparameter Tuning

François Fleuret, Thijs Vogels, Prabhu Teja Sivaprasad, Martin Jaggi, Jan Frederik Jonas Florian Mai

The performance of optimizers, particularly in deep learning, depends considerably on their chosen hyperparameter configuration. The efficacy of optimizers is often studied under near-optimal problem-specific hyperparameters, and finding these settings may ...

2020

PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Thijs Vogels, Martin Jaggi

We study lossy gradient compression methods to alleviate the communication bottleneck in data-parallel distributed optimization. Despite the significant attention received, current compression schemes either do not scale well, or fail to achieve the target ...

2019