Publications by Jonathan Mark Scarlett

An Introductory Guide to Fano's Inequality with Applications in Statistical Estimation

Information theory plays an indispensable role in the development of algorithm-independent impossibility results, both for communication problems and for seemingly distinct areas such as statistics and machine learning. While numerous information-theoretic ...

Cambridge University Press2021

Overlapping Multi-Bandit Best Arm Identification

Volkan Cevher, Ilija Bogunovic, Jonathan Mark Scarlett

In the multi-armed bandit literature, the multi-bandit best-arm identification problem consists of determining each best arm in a number of disjoint groups of arms, with as few total arm pulls as possible. In this paper, we introduce a variant of the multi ...

IEEE2019

High Dimensional Bayesian Optimization via Additive Models with Overlapping Groups

Volkan Cevher, Ilija Bogunovic, Paul Thierry Yves Rolland, Jonathan Mark Scarlett

Bayesian optimization (BO) is a popular technique for sequential black-box function optimization, with applications including parameter tuning, robotics, environmental monitoring, and more. One of the most important challenges in BO is the development of a ...

2018

Near-Optimal Noisy Group Testing via Separate Decoding of Items

Volkan Cevher, Jonathan Mark Scarlett

In this paper, we revisit an efficient algorithm for noisy group testing in which each item is decoded separately (Malyutov and Mateev, 1980), and develop novel performance guarantees via an information-theoretic framework for general noise models. For the ...

IEEE2018

Adversarially Robust Optimization with Gaussian Processes

Volkan Cevher, Ilija Bogunovic, Jonathan Mark Scarlett

In this paper, we consider the problem of Gaussian process (GP) optimization with an added robustness requirement: The returned point may be perturbed by an adversary, and we require the function value to remain as high as possible even after this perturba ...

2018

Adversarially Robust Optimization with Gaussian Processes

Volkan Cevher, Ilija Bogunovic, Jonathan Mark Scarlett

In this paper, we consider the problem of Gaussian process (GP) optimization with an added robustness requirement: The returned point may be perturbed by an adversary, and we require the function value to remain as high as possible even after this perturba ...

NEURAL INFORMATION PROCESSING SYSTEMS (NIPS)2018

Near-Optimal Noisy Group Testing via Separate Decoding of Items

Volkan Cevher, Jonathan Mark Scarlett

The group testing problem consists of determining a small set of defective items from a larger set of items based on a number of tests, and is relevant in applications such as medical testing, communication protocols, pattern matching, and more. In this pa ...

2018

Learning-Based Compressive MRI

Volkan Cevher, Baran Gözcü, Yen-Huan Li, Rabeeh Karimi Mahabadi, Jonathan Mark Scarlett

In the area of magnetic resonance imaging (MRI), an extensive range of non-linear reconstruction algorithms have been proposed that can be used with general Fourier subsampling patterns. However, the design of these subsampling patterns has typically been ...

Institute of Electrical and Electronics Engineers2018

Learning-based subsampling

Volkan Cevher, Ilija Bogunovic, Baran Gözcü, Yen-Huan Li, Luca Baldassarre, Jonathan Mark Scarlett

The present invention concerns a method of sampling a test signal. The method comprises: acquiring (21) training signals sampled at a plurality of sampling locations; running (23) an optimization procedure for determining an index set of n indices, represe ...

2017

Lower Bounds on Active Learning for Graphical Model Selection

Volkan Cevher, Jonathan Mark Scarlett

We consider the problem of estimating the underlying graph associated with a Markov random field, with the added twist that the decoding algorithm can iteratively choose which subsets of nodes to sample based on the previous samples, resulting in an active ...

2017

An Adaptive Sublinear-Time Block Sparse Fourier Transform

Mikhail Kapralov, Volkan Cevher, Jonathan Mark Scarlett, Amir Zandieh

The problem of approximately computing the

k

dominant Fourier coefficients of a vector

X

quickly, and using few samples in time domain, is known as the Sparse Fourier Transform (sparse FFT) problem. A long line of work on the sparse FFT has resulted in ...

2017

A Distributed Algorithm for Partitioned Robust Submodular Maximization

Volkan Cevher, Ilija Bogunovic, Slobodan Mitrovic, Jonathan Mark Scarlett

In this paper, we consider the problem of maximizing a monotone submodular function subject to a cardinality constraint, with two added twists: The computation is distributed across a number of machines, and we require the solution to be robust against adv ...

2017

Lower Bounds on Regret for Noisy Gaussian Process Bandit Optimization

Volkan Cevher, Ilija Bogunovic, Jonathan Mark Scarlett

In this paper, we consider the problem of sequentially optimizing a black-box function

f

based on noisy samples and bandit feedback. We assume that

f

is smooth in the sense of having a bounded norm in some reproducing kernel Hilbert space (RKHS), yield ...

2017

Limits on Support Recovery With Probabilistic Models: An Information-Theoretic Framework

Volkan Cevher, Jonathan Mark Scarlett

The support recovery problem consists of determining a sparse subset of a set of variables that is relevant in generating a set of observations, and arises in a diverse range of settings, such as compressive sensing, subset selection in regression, and gro ...

Institute of Electrical and Electronics Engineers2017

Phase Transitions in the Pooled Data Problem

Volkan Cevher, Jonathan Mark Scarlett

In this paper, we study the {\em pooled data} problem of identifying the labels associated with a large collection of items, based on a sequence of pooled tests revealing the counts of each label within the pool. In the noiseless setting, we identify an ex ...

2017

How little does non-exact recovery help in group testing?

Volkan Cevher, Jonathan Mark Scarlett

We consider the group testing problem, in which one seeks to identify a subset of defective items within a larger set of items based on a number of tests. We characterize the information-theoretic performance limits in the presence of list decoding, in whi ...

Ieee2017

Robust Submodular Maximization: A Non-Uniform Partitioning Approach

Volkan Cevher, Ilija Bogunovic, Slobodan Mitrovic, Jonathan Mark Scarlett

We study the problem of maximizing a monotone submodular function subject to a cardinality constraint

k

, with the added twist that a number of items

\tau

from the returned set may be removed. We focus on the worst-case setting considered in Orlin et al ...

2017

Converse Bounds for Noisy Group Testing with Arbitrary Measurement Matrices

Volkan Cevher, Jonathan Mark Scarlett

We consider the group testing problem, in which one seeks to identify a subset of defective items within a larger set of items based on a number of noisy tests. While matching achievability and converse bounds are known in several cases of interest for i.i ...

Ieee2016

Phase Transitions in Group Testing

Volkan Cevher, Jonathan Mark Scarlett

The group testing problem consists of determining a sparse subset of a set of items that are ``defective'' based on a set of possibly noisy tests, and arises in areas such as medical testing, fault detection, communication protocols, pattern matching, and ...

2016

Limits on Sparse Support Recovery via Linear Sketching with Random Expander Matrices

Volkan Cevher, Jonathan Mark Scarlett

Linear sketching is a powerful tool for the problem of sparse signal recovery, having numerous applications such as compressive sensing, data stream computing, graph sketching, and routing. Motivated by applications where the \emph{positions} of the non-ze ...

2016