Publications related to Differential entropy

Pressure-freezing of dodecane: exploring the crystal structures, formation kinetics and phase diagrams for colossal barocaloric effects in n-alkanes

Barocaloric (BC) materials provide cheaper and more energy efficient alternatives to traditional refrigerants. Some liquid alkanes were recently shown to exhibit a colossal BC effect, matching the entropy changes in commercial vapour-liquid refrigerants. D ...

Royal Soc Chemistry2023

Motor-Unit Ordering of Blindly-Separated Surface-EMG Signals for Gesture Recognition

Pasquale Davide Schiavone, Elisa Donati

Hand gestures are one of the most natural and expressive way for humans to convey information, and thus hand gesture recognition has become a research hotspot in the human-machine interface (HMI) field. In particular, biological signals such as surface ele ...

SPRINGER INTERNATIONAL PUBLISHING AG2023

Differential Entropy of the Conditional Expectation Under Additive Gaussian Noise

Michael Christoph Gastpar, Alper Köse, Ahmet Arda Atalik

The conditional mean is a fundamental and important quantity whose applications include the theories of estimation and rate-distortion. It is also notoriously difficult to work with. This paper establishes novel bounds on the differential entropy of the co ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2022

Exploring quantum perceptron and quantum neural network structures with a teacher-student scheme

Near-term quantum devices can be used to build quantum machine learning models, such as quantum kernel methods and quantum neural networks (QNN), to perform classification tasks. There have been many proposals on how to use variational quantum circuits as ...

2022

Differential Entropy of the Conditional Expectation under Gaussian Noise

Michael Christoph Gastpar, Alper Köse, Ahmet Arda Atalik

This paper considers an additive Gaussian noise channel with arbitrarily distributed finite variance input signals. It studies the differential entropy of the minimum mean-square error (MMSE) estimator and provides a new lower bound which connects the diff ...

IEEE2021

Information Theoretic Characterization of Uncertainty Distinguishes Surprise From Accuracy Signals in the Brain

Leyla Loued-Khenissi, Kerstin Preuschoff

Uncertainty presents a problem for both human and machine decision-making. While utility maximization has traditionally been viewed as the motive force behind choice behavior, it has been theorized that uncertainty minimization may supersede reward motivat ...

2020

Entropy in Spin Relaxation, Spintronics, and Magnetic Resonance

Ferenc Simon

The entropy change during spin relaxation for a realistic model system is studied, whose spin dynamics can be handled with the Boltzmann equation. The time evolution of the von Neumann entropy is monitored during the process and is compared with the recent ...

WILEY-V C H VERLAG GMBH2020

Remote Source Coding Under Gaussian Noise: Dueling Roles of Power and Entropy Power

Michael Christoph Gastpar

The distributed remote source coding (the so-called CEO) problem is studied in the case where the underlying source, not necessarily Gaussian, has finite differential entropy and the observation noise is Gaussian. The main result is a new lower bound for t ...

2019

Generalized maximum entropy estimation

Peyman Mohajerin Esfahani, John Lygeros, Tobias Sutter

We consider the problem of estimating a probability distribution that maximizes the entropy while satisfying a finite number of moment constraints, possibly corrupted by noise. Based on duality of convex programming, we present a novel approximation scheme ...

2019

Vase-Kite Equilibrium of Resorcin[4]arene Cavitands Investigated Using Molecular Dynamics Simulations with Ball-and-Stick Local Elevation Umbrella Sampling

Jovana Milic

A key feature of resorcin[4]arene cavitands is their ability to switch between a closed/contracted (Vase) and an open/expanded (Kite) conformation. The mechanism and dynamics of this interconversion remains, however, elusive. In the present study, the Vase ...

2019

A sequence-dependent coarse-grain model of B-DNA with explicit description of bases and phosphate groups parametrised from large scale Molecular Dynamics simulations

Alessandro Samuele Patelli

We introduce a sequence-dependent coarse-grain model of double-stranded DNA with an explicit description of both the bases and the phosphate groups as interacting rigid-bodies. The model parameters are trained on extensive, state-of-the-art large scale mol ...

EPFL2019

Dimension-free Information Concentration via Exp-Concavity

Volkan Cevher, Ya-Ping Hsieh

Information concentration of probability measures have important implications in learning theory. Recently, it is discovered that the information content of a log-concave distribution concentrates around their differential entropy, albeit with an unpleasan ...

2018

Polarization of the Renyi Information Dimension With Applications to Compressed Sensing

Emmanuel Abbé, Saeid Haghighatshoar

In this paper, we show that the Hadamard matrix acts as an extractor over the reals of the Renyi Information Dimension (RID), in an analogous way to how it acts as an extractor of the discrete entropy over finite fields. More precisely, we prove that the R ...

Ieee-Inst Electrical Electronics Engineers Inc2017

Locally differentially-private distribution estimation

Michael Christoph Gastpar, Adriano Pastore

We consider a setup in which confidential i.i.d. samples X1, ..., Xn from an unknown discrete distribution PX are passed through a discrete memoryless privatization channel (a.k.a. mechanism) which guarantees an epsilon-level of local differential privacy. ...

Ieee2016

Spatial Coupling as a Proof Technique and Three Applications

Rüdiger Urbanke, Nicolas Macris, Andrei Giurgiu

The aim of this paper is to show that spatial coupling can be viewed not only as a means to build better graphical models, but also as a tool to better understand uncoupled models. The starting point is the observation that some asymptotic properties of gr ...

Ieee-Inst Electrical Electronics Engineers Inc2016

Performance assessment of pressurized fluid-distribution networks

Gaudenz Moser

Pressurized fluid-distribution networks are key strategic elements of infrastructure. Drinking water is a precious resource and will become more and more important with the depletion of reserves. With the growth of the human population, challenges related ...

EPFL2015

Quantifying snowfall and avalanche release synchronization: a case study

Paolo Perona, Benoît Crouzy, Betty Sovilla, Romain Forclaz

We quantify the synchronization between snowfall and natural avalanches in relation to terrain properties at the detachment zone. We analyze field statistics of 549 avalanche events in terms of slope, aspect, timing, coordinate, and release area, identifie ...

Wiley-Blackwell2015

Quantitative analysis of structural changes during rapid urban growth

Nahid Mohajeri Pour Rayeni

New quantitative measures of urban structural changes are introduced and applied to the fast-growing city of Kerman, Iran. The results of 20,802 street measurements show that the main street orientations are orthogonal, both in the old inner part and in th ...

American Society of Civil Engineers2015

Statistical-thermodynamics modelling of the built environment in relation to urban ecology

Jean-Louis Scartezzini, Nahid Mohajeri Pour Rayeni

Various aspects of the built environment have important effects on ecology. Providing suitable metrics for the built forms so as to quantify and model their internal relations and external ecological footprints, however, remains a challenge. Here we provid ...

Elsevier2015

A New Entropy Power Inequality for Integer-Valued Random Variables

Emmanuel Abbé, Saeid Haghighatshoar

The entropy power inequality (EPI) yields lower bounds on the differential entropy of the sum of two independent real-valued random variables in terms of the individual entropies. Versions of the EPI for discrete random variables have been obtained for spe ...

Institute of Electrical and Electronics Engineers2014