Structured Sub-Nyquist Sampling with Applications in Compressive Toeplitz Covariance Estimation, Super-Resolution and Phase Retrieval

Structured Sub-Nyquist Sampling with Applications in Compressive Toeplitz Covariance Estimation, Super-Resolution and Phase Retrieval

Author: Heng Qiao

Publisher:

Published: 2019

Total Pages: 243

ISBN-13:

DOWNLOAD EBOOK

Sub-Nyquist sampling has received a huge amount of interest in the past decade. In classical compressed sensing theory, if the measurement procedure satisfies a particular condition known as Restricted Isometry Property (RIP), we can achieve stable recovery of signals of low-dimensional intrinsic structures with an order-wise optimal sample size. Such low-dimensional structures include sparse and low rank for both vector and matrix cases. The main drawback of conventional compressed sensing theory is that random measurements are required to ensure the RIP property. However, in many applications such as imaging and array signal processing, applying independent random measurements may not be practical as the systems are deterministic. Moreover, random measurements based compressed sensing always exploits convex programs for signal recovery even in the noiseless case, and solving those programs is computationally intensive if the ambient dimension is large, especially in the matrix case. The main contribution of this dissertation is that we propose a deterministic sub-Nyquist sampling framework for compressing the structured signal and come up with computationally efficient algorithms. Besides widely studied sparse and low-rank structures, we particularly focus on the cases that the signals of interest are stationary or the measurements are of Fourier type. The key difference between our work from classical compressed sensing theory is that we explicitly exploit the second-order statistics of the signals, and study the equivalent quadratic measurement model in the correlation domain. The essential observation made in this dissertation is that a difference/sum coarray structure will arise from the quadratic model if the measurements are of Fourier type. With these observations, we are able to achieve a better compression rate for covariance estimation, identify more sources in array signal processing or recover the signals of larger sparsity. In this dissertation, we will first study the problem of Toeplitz covariance estimation. In particular, we will show how to achieve an order-wise optimal compression rate using the idea of sparse arrays in both general and low-rank cases. Then, an analysis framework of super-resolution with positivity constraint is established. We will present fundamental robustness guarantees, efficient algorithms and applications in practices. Next, we will study the problem of phase-retrieval for which we successfully apply the sparse array ideas by fully exploiting the quadratic measurement model. We achieve near-optimal sample complexity for both sparse and general cases with practical Fourier measurements and provide efficient and deterministic recovery algorithms. In the end, we will further elaborate on the essential role of non-negative constraint in underdetermined inverse problems. In particular, we will analyze the nonlinear co-array interpolation problem and develop a universal upper bound of the interpolation error. Bilinear problem with non-negative constraint will be considered next and the exact characterization of the ambiguous solutions will be established for the first time in literature. At last, we will show how to apply the nested array idea to solve real problems such as Kriging. Using spatial correlation information, we are able to have a stable estimate of the field of interest with fewer sensors than classic methodologies. Extensive numerical experiments are implemented to demonstrate our theoretical claims.


The Dynamic Sub-nyquist Sampling Model for Compressive Sampling Based Music Information Retrieval -

The Dynamic Sub-nyquist Sampling Model for Compressive Sampling Based Music Information Retrieval -

Author:

Publisher:

Published: 2012

Total Pages: 478

ISBN-13:

DOWNLOAD EBOOK

Audio identification is a task that can be accomplished through the use of various methods, including tagging, encryption, watermarking and so on. Fingerprinting however, is one method that has several advantages over the other approaches. Audio fingerprinting systems consist of two phases: the preparation phase and the recognition phase. The first phase involves building a database with the audio fmgerprints of many songs and their associated metadata. In the second phase, the fingerprint of an unknown song is extracted and compared with those in the database. What is the best method for extracting data from a piece of unknown audio? Compressive sensing (CS) (also referred to as compressive sampling) has attracted increasing interest from a wide range of researchers in various fields including signal processing, image processing, information theory, mathematics, computer vision, pattern recognition and so on. The basic principle of CS is that it exploits signal sparsity to reduce the number of measurements needed for digital acquisition, thus enabling low-rate sampling and high-resolution sensing. In other words, CS theory provides a possible way of recovering sparse signals by projecting them onto a small number of random vectors. This dissertation proposes the use of compressive sensing (or compressive sampling) for audio extraction, based on a compact and robust audio fmgerprint system. We begin by investigating the fundamental aspects of building such a system. Next, we construct a practical implementation of an analogue signal-to-information converter to acquire the sub-Nyquist sampling data. Thirdly, we identify efficient features, which are invariant to time and frequency distortions, and test different data search algorithms to optimise search efficiency. Finally, we conduct various simulations to establish the feasibility and efficiency of the proposed approach.


Subsampling in Information Theory and Data Processing

Subsampling in Information Theory and Data Processing

Author: Yuxin Chen

Publisher:

Published: 2014

Total Pages:

ISBN-13:

DOWNLOAD EBOOK

An ubiquitous challenge in modern data and signal acquisition arises from the ever-growing size of the object under study. Hardware and power limitations often preclude sampling with the desired rate and precision, which motivates the exploitation of signal and/or channel structures in order to enable reduced-rate sampling while preserving information integrity. This thesis is devoted to understanding the fundamental interplay between the underlying signal structures and the data acquisition paradigms, as well as developing efficient and provably effective algorithms for data reconstruction. The main contributions of this thesis are as follows. (1) We investigate the effect of sub-Nyquist sampling upon the capacity of a continuous-time channel. We start by deriving the sub-Nyquist sampled channel capacity under periodic sampling systems that subsume three canonical sampling structures, and then characterize the fundamental upper limit on the capacity achievable by general time-preserving sub-Nyquist sampling methods. Our findings indicate that the optimal sampling structures extract out the set of frequencies that exhibits the highest signal-to-noise ratio and is alias-suppressing. In addition, we illuminate an intriguing connection between sampled channels and MIMO channels, as well as a new connection between sampled capacity and MMSE. (2) We study the universal sub-Nyquist design when the sampler is designed to operate independent of instantaneous channel realizations, under a sparse multiband channel model. We evaluate the sampler design based on the capacity loss due to channel-independent sub-Nyquist sampling, and characterize the minimax capacity loss. This fundamental minimax limit can be approached by random sampling in the high-SNR regime, which demonstrates the optimality of random sampling schemes. (3) We explore the problem of recovering a spectrally sparse signal from a few random time-domain samples, where the underlying frequencies of the signal can assume any continuous values in a unit disk. To address a basis mismatch issue that arises in conventional compressed sensing methods, we develop a novel convex program by exploiting the equivalence between (off-the-grid) spectral sparsity and Hankel low-rank structure. The algorithm exploits sparsity while enforcing physically meaningful constraints. Under mild incoherence conditions, our algorithm allows perfect recovery as soon as the sample complexity exceeds the spectral sparsity level (up to a logarithmic gap). (4) We consider the task of covariance estimation with limited storage and low computational complexity. We focus on a quadratic random measurement scheme in processing data streams and high-frequency signals, which is shown to impose a minimal memory requirement and low computational complexity. Three structural assumptions of covariance matrices, including low rank, Toeplitz low rank, and jointly rank-one and sparse structure, are investigated. We show that a covariance matrix with any of these structures can be universally and faithfully recovered from near-minimal sub-Gaussian quadratic measurements via efficient convex programs for the respective structure. All in all, the central theme of this thesis is on the interplay between economical subsampling schemes and the structures of the object under investigation, from both information-theoretic and algorithmic perspectives.


Image Mosaicing and Super-resolution

Image Mosaicing and Super-resolution

Author: David Capel

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 233

ISBN-13: 0857293842

DOWNLOAD EBOOK

This book investigates sets of images consisting of many overlapping viewsofa scene, and how the information contained within them may be combined to produce single images of superior quality. The generic name for such techniques is frame fusion. Using frame fusion, it is possible to extend the fieldof view beyond that ofany single image, to reduce noise, to restore high-frequency content, and even to increase spatial resolution and dynamic range. The aim in this book is to develop efficient, robust and automated frame fusion algorithms which may be applied to real image sequences. An essential step required to enable frame fusion is image registration: computing the point-to-point mapping between images in their overlapping region. This sub problem is considered in detail, and a robust and efficient solution is proposed and its accuracy evaluated. Two forms of frame fusion are then considered: image mosaic ing and super-resolution. Image mosaicing is the alignment of multiple images into a large composition which represents part of a 3D scene. Super-resolution is a more sophisticated technique which aims to restore poor-quality video sequences by mod elling and removing the degradations inherent in the imaging process, such as noise, blur and spatial-sampling. A key element in this book is the assumption of a completely uncalibrated cam era. No prior knowledge of the camera parameters, its motion, optics or photometric characteristics is assumed. The power of the methods is illustrated with many real image sequence examples.


A Mathematical Introduction to Compressive Sensing

A Mathematical Introduction to Compressive Sensing

Author: Simon Foucart

Publisher: Springer Science & Business Media

Published: 2013-08-13

Total Pages: 634

ISBN-13: 0817649484

DOWNLOAD EBOOK

At the intersection of mathematics, engineering, and computer science sits the thriving field of compressive sensing. Based on the premise that data acquisition and compression can be performed simultaneously, compressive sensing finds applications in imaging, signal processing, and many other domains. In the areas of applied mathematics, electrical engineering, and theoretical computer science, an explosion of research activity has already followed the theoretical results that highlighted the efficiency of the basic principles. The elegant ideas behind these principles are also of independent interest to pure mathematicians. A Mathematical Introduction to Compressive Sensing gives a detailed account of the core theory upon which the field is build. With only moderate prerequisites, it is an excellent textbook for graduate courses in mathematics, engineering, and computer science. It also serves as a reliable resource for practitioners and researchers in these disciplines who want to acquire a careful understanding of the subject. A Mathematical Introduction to Compressive Sensing uses a mathematical perspective to present the core of the theory underlying compressive sensing.


Sampling Theory

Sampling Theory

Author: Yonina C. Eldar

Publisher: Cambridge University Press

Published: 2015-04-09

Total Pages: 837

ISBN-13: 1107003393

DOWNLOAD EBOOK

A comprehensive guide to sampling for engineers, covering the fundamental mathematical underpinnings together with practical engineering principles and applications.


Exponential Data Fitting and Its Applications

Exponential Data Fitting and Its Applications

Author: Victor Pereyra

Publisher: Bentham Science Publishers

Published: 2010

Total Pages: 206

ISBN-13: 1608050483

DOWNLOAD EBOOK

"Real and complex exponential data fitting is an important activity in many different areas of science and engineering, ranging from Nuclear Magnetic Resonance Spectroscopy and Lattice Quantum Chromodynamics to Electrical and Chemical Engineering, Vision a"


Statistical Parametric Mapping: The Analysis of Functional Brain Images

Statistical Parametric Mapping: The Analysis of Functional Brain Images

Author: William D. Penny

Publisher: Elsevier

Published: 2011-04-28

Total Pages: 689

ISBN-13: 0080466508

DOWNLOAD EBOOK

In an age where the amount of data collected from brain imaging is increasing constantly, it is of critical importance to analyse those data within an accepted framework to ensure proper integration and comparison of the information collected. This book describes the ideas and procedures that underlie the analysis of signals produced by the brain. The aim is to understand how the brain works, in terms of its functional architecture and dynamics. This book provides the background and methodology for the analysis of all types of brain imaging data, from functional magnetic resonance imaging to magnetoencephalography. Critically, Statistical Parametric Mapping provides a widely accepted conceptual framework which allows treatment of all these different modalities. This rests on an understanding of the brain's functional anatomy and the way that measured signals are caused experimentally. The book takes the reader from the basic concepts underlying the analysis of neuroimaging data to cutting edge approaches that would be difficult to find in any other source. Critically, the material is presented in an incremental way so that the reader can understand the precedents for each new development. This book will be particularly useful to neuroscientists engaged in any form of brain mapping; who have to contend with the real-world problems of data analysis and understanding the techniques they are using. It is primarily a scientific treatment and a didactic introduction to the analysis of brain imaging data. It can be used as both a textbook for students and scientists starting to use the techniques, as well as a reference for practicing neuroscientists. The book also serves as a companion to the software packages that have been developed for brain imaging data analysis. An essential reference and companion for users of the SPM software Provides a complete description of the concepts and procedures entailed by the analysis of brain images Offers full didactic treatment of the basic mathematics behind the analysis of brain imaging data Stands as a compendium of all the advances in neuroimaging data analysis over the past decade Adopts an easy to understand and incremental approach that takes the reader from basic statistics to state of the art approaches such as Variational Bayes Structured treatment of data analysis issues that links different modalities and models Includes a series of appendices and tutorial-style chapters that makes even the most sophisticated approaches accessible


Sparse Representations for Radar with MATLAB Examples

Sparse Representations for Radar with MATLAB Examples

Author: Peter Knee

Publisher: Springer Nature

Published: 2022-05-31

Total Pages: 71

ISBN-13: 3031015193

DOWNLOAD EBOOK

Although the field of sparse representations is relatively new, research activities in academic and industrial research labs are already producing encouraging results. The sparse signal or parameter model motivated several researchers and practitioners to explore high complexity/wide bandwidth applications such as Digital TV, MRI processing, and certain defense applications. The potential signal processing advancements in this area may influence radar technologies. This book presents the basic mathematical concepts along with a number of useful MATLABĀ® examples to emphasize the practical implementations both inside and outside the radar field. Table of Contents: Radar Systems: A Signal Processing Perspective / Introduction to Sparse Representations / Dimensionality Reduction / Radar Signal Processing Fundamentals / Sparse Representations in Radar