Publications related to Total correlation

From Generalisation Error to Transportation-cost Inequalities and Back

Michael Christoph Gastpar, Amedeo Roberto Esposito

In this work, we connect the problem of bounding the expected generalisation error with transportation-cost inequalities. Exposing the underlying pattern behind both approaches we are able to generalise them and go beyond Kullback- Leibler Divergences/Mutu ...

2022

Extremal behaviour of aggregated data with an application to downscaling

Sebastian Engelke, Raphaël Gérard Théodore Michel Marie de Deloÿe et Fourcade de Fondeville

The distribution of spatially aggregated data from a stochastic process may exhibit tail behaviour different from that of its marginal distributions. For a large class of aggregating functionals we introduce the -extremal coefficient, which quantifies this ...

OXFORD UNIV PRESS2019

A Gaussian Source Coding Perspective on Caching and Total Correlation

Guillaume Jean Op 't Veld

Communication technology has advanced up to a point where children are getting unfamiliar with themost iconic symbol in IT: the loading icon. We no longer wait for something to come on TV, nor for a download to complete. All the content we desire is availa ...

EPFL2017

Information-Theoretic Caching: Sequential Coding for Computing

Michael Christoph Gastpar, Sung Hoon Lim, Chien-Yi Wang

Under the paradigm of caching, partial data are delivered before the actual requests of users are known. In this paper, this problem is modeled as a canonical distributed source coding problem with side information, where the side information represents th ...

Institute of Electrical and Electronics Engineers2016

Information-Theoretic Caching

Michael Christoph Gastpar, Sung Hoon Lim, Chien-Yi Wang

Motivated by the caching problem introduced by Maddah-Ali and Niesen, a problem of distributed source coding with side information is formulated, which captures a distinct interesting aspect of caching. For the single-user case, a single-letter characteriz ...

2015

Reconstruction of Network Coded Sources From Incomplete Datasets

Pascal Frossard, Nikolaos Thomos, Eirina Bourtsoulatze

We investigate the problem of recovering source information from an incomplete set of network coded data with help of prior information about the sources. This problem naturally arises in wireless networks, where the number of network coded packets availab ...

Institute of Electrical and Electronics Engineers2015

Principal Polynomial Analysis

Devis Tuia

This paper presents a new framework for manifold learning based on a sequence of principal polynomials that capture the possibly nonlinear nature of the data. The proposed Principal Polynomial Analysis (PPA) generalizes PCA by modeling the directions of ma ...

World Scientific Publ Co Pte Ltd2014

Image Reconstruction from Compressed Linear Measurements with Side Information

Pascal Frossard, Vijayaraghavan Thirumalai

This paper proposes a joint reconstruction algorithm for compressed correlated images that are given under the form of linear measurements. We consider the particular problem where one image is selected as the reference image and it is used as the side inf ...

2011

Uncovering the Physics of Frustrated Quantum Magnets using the Correlation Density Matrix Approach

This work is devoted to the study, the development, and the application of a new systematic method yielding the dominant correlations that govern a quantum many-body state in an unbiased way. The dominant correlations between any two disjoint blocks of a s ...

EPFL2010

Partner Modeling is Mutual

Pierre Dillenbourg, Nicolas Nova, Mirweis Sangin, Gaëlle Molinari

Collaborative learning has been hypothesized to be related to the cognitive effort engaged by co-learners to build a shared understanding. The process of constructing this shared understanding requires each team member to build some kind of representation ...

2007

From error probability to information theoretic signal and image processing

Torsten Butz

The signal processing community is increasingly interested in using information theoretic concepts to build signal processing algorithms for a variety of applications. A general theory on how to apply the mathematical concepts of information theory to the ...

EPFL2003