Publications related to Entropy and life

A 3.3-Gb/s SPAD-Based Quantum Random Number Generator

Edoardo Charbon, Pouyan Keshavarzian, Francesco Gramuglia, Mario Stipcevic

Quantum random number generators (QRNGs) are a burgeoning technology used for a variety of applications, including modern security and encryption systems. Typical methods exploit an entropy source combined with an extraction or bit generation circuit in or ...

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC2023

Learning curves for the multi-class teacher-student perceptron

Lenka Zdeborová, Bruno Loureiro, Elisabetta Cornacchia, Bruno Loureiro, Francesca Mignacco

One of the most classical results in high-dimensional learning theory provides a closed-form expression for the generalisation error of binary classification with a single-layer teacher-student perceptron on i.i.d. Gaussian inputs. Both Bayes-optimal (BO) ...

IOP Publishing Ltd2023

Towards Interactions Through Differentiable-Non-Differentiable Scale Transitions In Scale Relativity Theory

Maria-Alexandra Paun

It is shown that, in the framework of Scale Relativity Theory, correlations of type informational entropy/cross entropy - probability density, in the description of the dynamics of any complex system, can be perceived as interactions. Explaining these inte ...

UNIV POLITEHNICA BUCHAREST, SCI BULL2021

Differential Entropy of the Conditional Expectation under Gaussian Noise

Michael Christoph Gastpar, Alper Köse, Ahmet Arda Atalik

This paper considers an additive Gaussian noise channel with arbitrarily distributed finite variance input signals. It studies the differential entropy of the minimum mean-square error (MMSE) estimator and provides a new lower bound which connects the diff ...

IEEE2021

Gaussian Process Regression for Maximum Entropy Distribution

Mohammadhossein Gorji, Mohsen Sadr

Maximum-Entropy Distributions offer an attractive family of probability densities suitable for moment closure problems. Yet finding the Lagrange multipliers which parametrize these distributions, turns out to be a computational bottleneck for practical clo ...

2020

Theory of screw dislocation strengthening in random BCC alloys from dilute to "High-Entropy" alloys

William Curtin, Francesco Maresca

Random body-centered-cubic (BCC) "High Entropy" alloys are a new class of alloys, some having high strength and good ductility at room temperature and some having exceptional high-temperature strength. There are no theories of strengthening of screw disloc ...

PERGAMON-ELSEVIER SCIENCE LTD2020

Coarse-grained entropy production with multiple reservoirs: Unraveling the role of time scales and detailed balance in biology-inspired systems

Daniel Maria Busiello, Amos Maritan, Deepak Gupta

A general framework to describe a vast majority of biology-inspired systems is to model them as stochastic processes in which multiple couplings are in play at the same time. Molecular motors, chemical reaction networks, catalytic enzymes, and particles ex ...

2020

Entropy production for coarse-grained dynamics

Daniel Maria Busiello, Amos Maritan

Systems out of equilibrium exhibit a net production of entropy. We study the dynamics of a stochastic system represented by a Master equation (ME) that can be modeled by a Fokker-Planck equation in a coarse-grained, mesoscopic description. We show that the ...

2019

Gaussian Process Regression for Maximum Entropy Distribution

Mohsen Sadr

Maximum-Entropy Distributions offer an attractive family of probability densities suitable for moment closure problems. Yet finding the Lagrange multipliers which parametrize these distributions, turns out to be a computational bottleneck for practical clo ...

2019

Coding for Communications and Secrecy

Mani Bastaniparizi

Shannon, in his landmark 1948 paper, developed a framework for characterizing the fundamental limits of information transmission. Among other results, he showed that reliable communication over a channel is possible at any rate below its capacity. In 2008, ...

EPFL2017

Energy efficiency as an example of cross-discipline collaboration in chemical engineering

François Maréchal

This paper summarizes the round-table discussion that was held during the European Congress of Chemical Engineering (ECCE) in Nice, France, in October 2015 on this topic. The panellists come from different fields of chemical engineering and have thus broug ...

2017

Optimal Search Strategies for Pollutant Source Localization

Auke Ijspeert, Howard Li

This paper is aimed at developing optimal motion planning for a single autonomous surface vehicle (ASV) equipped with an on-board pollutant sensor that will maximize the sensor-related information available for source seeking. The ASV uses a nonlinear diff ...

Ieee2016

Anomaly detection in elderly daily behavior in ambient sensing environments

Daniel Gatica-Perez, Oya Aran, Dairazalia Sanchez Cortes

Current ubiquitous computing applications for smart homes aim to enhance people’s daily living respecting age span. Among the target groups of people, elderly are a population eager for “choices for living arrangements”, which would allow them to continue ...

Springer Int Publishing Ag2016

Quantitative analysis of structural changes during rapid urban growth

Nahid Mohajeri Pour Rayeni

New quantitative measures of urban structural changes are introduced and applied to the fast-growing city of Kerman, Iran. The results of 20,802 street measurements show that the main street orientations are orthogonal, both in the old inner part and in th ...

American Society of Civil Engineers2015

Advancing catchment hydrology to deal with predictions under change

Steven Vincent Weijs

Throughout its historical development, hydrology as an earth science, but especially as a problem-centred engineering discipline has largely relied (quite successfully) on the assumption of stationarity. This includes assuming time invariance of boundary c ...

Copernicus Gesellschaft Mbh2014

Data Compression via Logic Synthesis

Giovanni De Micheli, Andreas Peter Burg, Pierre-Emmanuel Julien Marc Gaillardon, Luca Gaetano Amarù

Nowadays, most software and hardware applications are committed to reduce the footprint and resource usage of data. In this general context, lossless data compression is a beneficial technique that encodes information using fewer (or at most equal number o ...

2014

An information-theoretical perspective on weighted ensemble forecasts

Steven Vincent Weijs, Nicolaas Cornelis van de Giesen

This paper presents an information--theoretical method for weighting ensemble forecasts with new information. Weighted ensemble forecasts can be used to adjust the distribution that an existing ensemble of time series represents, without modifying the valu ...

Elsevier2013

Quantum distillation: Dynamical generation of low-entropy states of strongly correlated fermions in an optical lattice

Salvatore Manmana

Correlations between particles can lead to subtle and sometimes counterintuitive phenomena. We analyze one such case, occurring during the sudden expansion of fermions in a lattice when the initial state has a strong admixture of double occupancies. We pro ...

2009

Beamforming with a Maximum Negentropy Criterion

Weifeng Li, Philip Neil Garner

In this paper, we address a beamforming application based on the capture of far-field speech data from a single speaker in a real meeting room. After the position of the speaker is estimated by a speaker tracking system, we construct a subband-domain beamf ...

2009

Quasi-steady and steady states in global gyrokinetic particle-in-cell simulations

Laurent Villard, Alberto Bottino, Sébastien Jolliet, Paolo Angelino, Ben McMillan, Thibaut Vernay

Collisionless delta-f gyrokinetic particle-in-cell simulations suffer from the entropy paradox, in which the entropy grows linearly in time while low-order moments are saturated. As a consequence, these simulations do not reach a steady state and are unsui ...

American Institute of Physics (AIP)2009