In this thesis, timing is everything. In the first part, we mean this literally, as we tackle systems that encode information using timing alone. In the second part, we adopt the standard, metaphoric interpretation of this saying and show the importance of ...
A computer-implemented method for reconstructing/recovering high-resolution visible light spectral data at a target resolution d, that comprises obtaining a configuration of a low- resolution multi-channel imaging sensor of resolution p, the configuration ...
Understanding how proteins fold into their native structure is a fundamental problem in biophysics, crucial for protein design. It has been hypothesized that the formation of a molten globule intermediate precedes folding to the native conformation of glob ...
Surprise-based learning allows agents to rapidly adapt to nonstationary stochastic environments characterized by sudden changes. We show that exact Bayesian inference in a hierarchical model gives rise to a surprise-modulated trade-off between forgetting o ...
This paper considers an additive Gaussian noise channel with arbitrarily distributed finite variance input signals. It studies the differential entropy of the minimum mean-square error (MMSE) estimator and provides a new lower bound which connects the diff ...
It is shown that, in the framework of Scale Relativity Theory, correlations of type informational entropy/cross entropy - probability density, in the description of the dynamics of any complex system, can be perceived as interactions. Explaining these inte ...
Wyner's common information is a measure that quantifies and assesses the commonality between two random variables. Based on this, we introduce a novel two-step procedure to construct features from data, referred to as Common Information Components Analysis ...
We investigate a species selective cooling process of a trapped SU(N) Fermi gas using entropy redistribution during adiabatic loading of an optical lattice. Using high-temperature expansion of the Hubbard model, we show that when a subset N-A < N of the si ...
The concentration-mass (c-M) relation encodes key information about the assembly history of dark matter halos. However, its behavior at the high mass end has not been measured precisely in observations yet. In this paper, we report the measurement of the h ...
Network information theory studies the communication of information in a network and considers its fundamental limits. Motivating from the extensive presence of the networks in the daily life, the thesis studies the fundamental limits of particular network ...
