Recherche

Afficher tous les résultats pour

Accueil

Personne

Martin Jaggi

À propos
Confidentialité
Mentions légales

Graph Chatbot

Publications associées (84)

Forecasting intracranial hypertension using multi-scale waveform metrics

Walter Karlen, Martin Jaggi

Objective: Acute intracranial hypertension is an important risk factor of secondary brain damage after traumatic brain injury. Hypertensive episodes are often diagnosed reactively, leading to late detection and lost time for intervention planning. A pro-ac ...

IOP PUBLISHING LTD2020

Linearly Convergent Frank-Wolfe with Backtracking Line-Search

Martin Jaggi

Structured constraints in Machine Learning have recently brought the Frank-Wolfe (FW) family of algorithms back into the spotlight. While the classical FW algorithm has poor local convergence properties, Away-steps FW and Pairwise FW have emerged as improv ...

ADDISON-WESLEY PUBL CO2020

Ensemble Distillation for Robust Model Fusion in Federated Learning

Tao Lin, Martin Jaggi, Sebastian Urban Stich, Lingjing Kong

Federated Learning (FL) is a machine learning setting where many devices collaboratively train a machine learning model while keeping the training data decentralized. In most of the current training schemes the central model is refined by averaging the par ...

2020

Extrapolation for Large-batch Training in Deep Learning

Tao Lin, Martin Jaggi, Sebastian Urban Stich, Lingjing Kong

Deep learning networks are typically trained by Stochastic Gradient Descent (SGD) methods that iteratively improve the model parameters by estimating a gradient on a very small fraction of the training data. A major roadblock faced when increasing the batc ...

2020

Context Mover's Distance & Barycenters: Optimal Transport of Contexts for Building Representations

Martin Jaggi, Sidak Pal Singh, Aymeric Daphnis Kévin Dieuleveut, Andreas Hug

We present a framework for building unsupervised representations of entities and their compositions, where each entity is viewed as a probability distribution rather than a vector embedding. In particular, this distribution is supported over the contexts w ...

ADDISON-WESLEY PUBL CO2020

Better Word Embeddings by Disentangling Contextual n-Gram Information

Matteo Pagliardini, Prakhar Gupta, Martin Jaggi

Pre-trained word vectors are ubiquitous in Natural Language Processing applications. In this paper, we show how training word embeddings jointly with bigram and even trigram embeddings, results in improved unigram embeddings. We claim that training word em ...

2019

Correlating Twitter Language with Community-Level Health Outcomes

Arno Schneuwly, Martin Jaggi

We study how language on social media is linked to diseases such as atherosclerotic heart disease (AHD), diabetes and various types of cancer. Our proposed model leverages state-of-the-art sentence embeddings, followed by a regression model and clustering, ...

ASSOC COMPUTATIONAL LINGUISTICS-ACL2019

On Linear Learning with Manycore Processors

Martin Jaggi

A new generation of manycore processors is on the rise that offers dozens and more cores on a chip and, in a sense, fuses host processor and accelerator. In this paper we target the efficient training of generalized linear models on these machines. We prop ...

IEEE COMPUTER SOC2019

PowerSGD: Practical Low-Rank Gradient Compression for Distributed Optimization

Thijs Vogels, Martin Jaggi

We study lossy gradient compression methods to alleviate the communication bottleneck in data-parallel distributed optimization. Despite the significant attention received, current compression schemes either do not scale well, or fail to achieve the target ...

2019

Efficient Greedy Coordinate Descent for Composite Problems

Sai Praneeth Reddy Karimireddy, Martin Jaggi, Sebastian Urban Stich, Anastasiia Koloskova

Coordinate descent with random coordinate selection is the current state of the art for many large scale optimization problems. However, greedy selection of the steepest coordinate on smooth problems can yield convergence rates independent of the dimension ...

2019

Open-Vocabulary Keyword Spotting with Audio and Text Embeddings

Milos Cernak, Niccolò Sacchi, Martin Jaggi

Keyword Spotting (KWS) systems allow detecting a set of spoken (pre-defined) keywords. Open-vocabulary KWS systems search for the keywords in the set of word hypotheses generated by an automatic speech recognition (ASR) system which is computationally expe ...

2019

Decentralized deep learning with arbitrary communication compression

Tao Lin, Martin Jaggi, Sebastian Urban Stich, Anastasiia Koloskova

Decentralized training of deep learning models is a key element for enabling data privacy and on-device learning over networks, as well as for efficient scaling to large compute clusters. As current approaches are limited by network bandwidth, we propose t ...

2019

Overcoming Multi-model Forgetting

Anthony Christopher Davison, Mathieu Salzmann, Yassine Benyahia, Claudiu-Cristian Musat, Kaicheng Yu, Martin Jaggi

We identify a phenomenon, which we refer to as multi-model forgetting, that occurs when sequentially training multiple deep networks with partially-shared parameters; the performance of previously-trained models degrades as one optimizes a subsequent one, ...

JMLR2019

Crosslingual Document Embedding as Reduced-Rank Ridge Regression

Martin Jaggi, Robert West, Martin Josifoski, Ivan Paskov

There has recently been much interest in extending vector-based word representations to multiple languages, such that words can be compared across languages. In this paper, we shift the focus from words to documents and introduce a method for embedding doc ...

2019

Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communication

Martin Jaggi, Sebastian Urban Stich, Anastasiia Koloskova

We consider decentralized stochastic optimization with the objective function (e.g. data samples for machine learning task) being distributed over n machines that can only communicate to their neighbors on a fixed communication graph. To reduce the communi ...

2019

Unsupervised Scalable Representation Learning for Multivariate Time Series

Martin Jaggi, Aymeric Daphnis Kévin Dieuleveut

Time series constitute a challenging data type for machine learning algorithms, due to their highly variable lengths and sparse labeling in practice. In this paper, we tackle this challenge by proposing an unsupervised method to learn universal embeddings ...

NEURAL INFORMATION PROCESSING SYSTEMS (NIPS)2019

Unsupervised Robust Nonparametric Learning Of Hidden Community Properties

Akhilesh Deepak Gotmare, Martin Jaggi, Mikhail Langovoy

We consider learning of fundamental properties of communities in large noisy networks, in the prototypical situation where the nodes or users are split into two classes according to a binary property, e.g., according to their opinions or preferences on a t ...

2019

Don't Use Large Mini-Batches, Use Local SGD

Tao Lin, Martin Jaggi, Sebastian Urban Stich

Mini-batch stochastic gradient methods (SGD) are state of the art for distributed training of deep neural networks. Drastic increases in the mini-batch sizes have lead to key efficiency and scalability gains in recent years. However, progress faces a major ...

2019

Error Feedback Fixes SignSGD and other Gradient Compression Schemes

Sai Praneeth Reddy Karimireddy, Martin Jaggi, Sebastian Urban Stich, Quentin Rebjock

Sign-based algorithms (e.g. signSGD) have been proposed as a biased gradient compression technique to alleviate the communication bottleneck in training large neural networks across multiple workers. We show simple convex counter-examples where signSGD doe ...

PMLR2019

Sparsified SGD with Memory

Jean-Baptiste Francis Marie Juliette Cordonnier, Martin Jaggi, Sebastian Urban Stich

Huge scale machine learning problems are nowadays tackled by distributed optimization algorithms, i.e. algorithms that leverage the compute power of many devices for training. The communication overhead is a key bottleneck that hinders perfect scalability. ...

2018

Page 3 sur 5