Publications associées à Entropy estimation

Differential Entropy of the Conditional Expectation Under Additive Gaussian Noise

Michael Christoph Gastpar, Alper Köse, Ahmet Arda Atalik

The conditional mean is a fundamental and important quantity whose applications include the theories of estimation and rate-distortion. It is also notoriously difficult to work with. This paper establishes novel bounds on the differential entropy of the co ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Differential Entropy of the Conditional Expectation under Gaussian Noise

Michael Christoph Gastpar, Alper Köse, Ahmet Arda Atalik

This paper considers an additive Gaussian noise channel with arbitrarily distributed finite variance input signals. It studies the differential entropy of the minimum mean-square error (MMSE) estimator and provides a new lower bound which connects the diff ...

IEEE2021

Cities, from Information to Interaction

João Vitor Meirelles de Miranda

From physics to the social sciences, information is now seen as a fundamental component of reality. However, a form of information seems still underestimated, perhaps precisely because it is so pervasive that we take it for granted: the information encoded ...

2018

Dimension-free Information Concentration via Exp-Concavity

Volkan Cevher, Ya-Ping Hsieh

Information concentration of probability measures have important implications in learning theory. Recently, it is discovered that the information content of a log-concave distribution concentrates around their differential entropy, albeit with an unpleasan ...

2018

An ensemble inverse optimal control approach for robotic task learning and adaptation

Aude Billard, Hang Yin, Ana Paiva

This paper contributes a novel framework to efficiently learn cost-to-go function representations for robotic tasks with latent modes. The proposed approach relies on the principle behind ensemble methods, where improved performance is obtained by aggregat ...

2019

Performance assessment of pressurized fluid-distribution networks

Gaudenz Moser

Pressurized fluid-distribution networks are key strategic elements of infrastructure. Drinking water is a precious resource and will become more and more important with the depletion of reserves. With the growth of the human population, challenges related ...

EPFL2015

A New Entropy Power Inequality for Integer-Valued Random Variables

Emmanuel Abbé, Saeid Haghighatshoar

The entropy power inequality (EPI) yields lower bounds on the differential entropy of the sum of two independent real-valued random variables in terms of the individual entropies. Versions of the EPI for discrete random variables have been obtained for spe ...

Institute of Electrical and Electronics Engineers2014

Visualizing street orientation and solar radiation in relation to complex topography

Jean-Louis Scartezzini, Jérôme Henri Kämpf, Nahid Mohajeri Pour Rayeni

Street networks can be visualized in various ways depending on the purpose. Here we introduce (in the present context) a new technique for visualizing the orientation of street networks in relation to complex topography. The technique is tested on the city ...

EuroGraphics Digital Library2014

Hierarchical sensor placement using joint entropy and the effect of modeling error

Ian Smith, Maria Papadopoulou

Good prediction of the behavior of wind around buildings improves designs for natural ventilation in warm climates. However wind modeling is complex, predictions are often inaccurate due to the large uncertainties in parameter values. The goal of this work ...

MDPI AG2014

Quantifying the Differences in Geometry and Size Distributions of Buildings Within Cities

Nahid Mohajeri Pour Rayeni

There have been many studies on the spatial configuration of cities, but few attempts to quantify the difference in building patterns between the old and new parts of cities. This may be partly attributable to lack of suitable study methods. This paper pre ...

Kim Williams Books2014

Real-time Prediction of Fast and Slow Delivery of Mental Commands in a Motor Imagery BCI: An Entropy-based Approach

José del Rocio Millán Ruiz, Michael Christoph Gastpar, Ricardo Andres Chavarriaga Lozano, Sareh Saeedi

Providing adaptive shared control for Brain- Computer Interfaces (BCIs) can result in better performance while reducing the user’s mental workload. In this respect, online estimation of accuracy and speed of command delivery are important factors. This stu ...

2012

An Information Theoretic Combination of MFCC and TDOA Features for Speaker Diarization

Hervé Bourlard, Deepu Vijayasenan, Fabio Valente

This correspondence describes a novel system for speaker diarization of meetings recordings based on the combination of acoustic features (MFCC) and time delay of arrivals (TDOAS). The first part of the paper analyzes differences between MFCC and TDOA feat ...

2011