Large Sample Covariance Matrices and High-Dimensional Data Analysis

Large Sample Covariance Matrices and High-Dimensional Data Analysis

Author: Jianfeng Yao

Publisher: Cambridge University Press

Published: 2015-03-26

Total Pages: 0

ISBN-13: 9781107065178

DOWNLOAD EBOOK

High-dimensional data appear in many fields, and their analysis has become increasingly important in modern statistics. However, it has long been observed that several well-known methods in multivariate analysis become inefficient, or even misleading, when the data dimension p is larger than, say, several tens. A seminal example is the well-known inefficiency of Hotelling's T2-test in such cases. This example shows that classical large sample limits may no longer hold for high-dimensional data; statisticians must seek new limiting theorems in these instances. Thus, the theory of random matrices (RMT) serves as a much-needed and welcome alternative framework. Based on the authors' own research, this book provides a first-hand introduction to new high-dimensional statistical methods derived from RMT. The book begins with a detailed introduction to useful tools from RMT, and then presents a series of high-dimensional problems with solutions provided by RMT methods.


High-Dimensional Covariance Matrix Estimation

High-Dimensional Covariance Matrix Estimation

Author: Aygul Zagidullina

Publisher: Springer Nature

Published: 2021-10-29

Total Pages: 123

ISBN-13: 3030800652

DOWNLOAD EBOOK

This book presents covariance matrix estimation and related aspects of random matrix theory. It focuses on the sample covariance matrix estimator and provides a holistic description of its properties under two asymptotic regimes: the traditional one, and the high-dimensional regime that better fits the big data context. It draws attention to the deficiencies of standard statistical tools when used in the high-dimensional setting, and introduces the basic concepts and major results related to spectral statistics and random matrix theory under high-dimensional asymptotics in an understandable and reader-friendly way. The aim of this book is to inspire applied statisticians, econometricians, and machine learning practitioners who analyze high-dimensional data to apply the recent developments in their work.


Discriminant Analysis and Applications

Discriminant Analysis and Applications

Author: T. Cacoullos

Publisher: Academic Press

Published: 2014-05-10

Total Pages: 455

ISBN-13: 1483268713

DOWNLOAD EBOOK

Discriminant Analysis and Applications comprises the proceedings of the NATO Advanced Study Institute on Discriminant Analysis and Applications held in Kifissia, Athens, Greece in June 1972. The book presents the theory and applications of Discriminant analysis, one of the most important areas of multivariate statistical analysis. This volume contains chapters that cover the historical development of discriminant analysis methods; logistic and quasi-linear discrimination; and distance functions. Medical and biological applications, and computer graphical analysis and graphical techniques for multidimensional data are likewise discussed. Statisticians, mathematicians, and biomathematicians will find the book very interesting.


High-Dimensional Covariance Estimation

High-Dimensional Covariance Estimation

Author: Mohsen Pourahmadi

Publisher: John Wiley & Sons

Published: 2013-05-28

Total Pages: 204

ISBN-13: 1118573668

DOWNLOAD EBOOK

Methods for estimating sparse and large covariance matrices Covariance and correlation matrices play fundamental roles in every aspect of the analysis of multivariate data collected from a variety of fields including business and economics, health care, engineering, and environmental and physical sciences. High-Dimensional Covariance Estimation provides accessible and comprehensive coverage of the classical and modern approaches for estimating covariance matrices as well as their applications to the rapidly developing areas lying at the intersection of statistics and machine learning. Recently, the classical sample covariance methodologies have been modified and improved upon to meet the needs of statisticians and researchers dealing with large correlated datasets. High-Dimensional Covariance Estimation focuses on the methodologies based on shrinkage, thresholding, and penalized likelihood with applications to Gaussian graphical models, prediction, and mean-variance portfolio management. The book relies heavily on regression-based ideas and interpretations to connect and unify many existing methods and algorithms for the task. High-Dimensional Covariance Estimation features chapters on: Data, Sparsity, and Regularization Regularizing the Eigenstructure Banding, Tapering, and Thresholding Covariance Matrices Sparse Gaussian Graphical Models Multivariate Regression The book is an ideal resource for researchers in statistics, mathematics, business and economics, computer sciences, and engineering, as well as a useful text or supplement for graduate-level courses in multivariate analysis, covariance estimation, statistical learning, and high-dimensional data analysis.


Robust Correlation

Robust Correlation

Author: Georgy L. Shevlyakov

Publisher: John Wiley & Sons

Published: 2016-09-19

Total Pages: 353

ISBN-13: 1118493451

DOWNLOAD EBOOK

This bookpresents material on both the analysis of the classical concepts of correlation and on the development of their robust versions, as well as discussing the related concepts of correlation matrices, partial correlation, canonical correlation, rank correlations, with the corresponding robust and non-robust estimation procedures. Every chapter contains a set of examples with simulated and real-life data. Key features: Makes modern and robust correlation methods readily available and understandable to practitioners, specialists, and consultants working in various fields. Focuses on implementation of methodology and application of robust correlation with R. Introduces the main approaches in robust statistics, such as Huber’s minimax approach and Hampel’s approach based on influence functions. Explores various robust estimates of the correlation coefficient including the minimax variance and bias estimates as well as the most B- and V-robust estimates. Contains applications of robust correlation methods to exploratory data analysis, multivariate statistics, statistics of time series, and to real-life data. Includes an accompanying website featuring computer code and datasets Features exercises and examples throughout the text using both small and large data sets. Theoretical and applied statisticians, specialists in multivariate statistics, robust statistics, robust time series analysis, data analysis and signal processing will benefit from this book. Practitioners who use correlation based methods in their work as well as postgraduate students in statistics will also find this book useful.


Statistical Foundations of Data Science

Statistical Foundations of Data Science

Author: Jianqing Fan

Publisher: CRC Press

Published: 2020-09-21

Total Pages: 942

ISBN-13: 0429527616

DOWNLOAD EBOOK

Statistical Foundations of Data Science gives a thorough introduction to commonly used statistical models, contemporary statistical machine learning techniques and algorithms, along with their mathematical insights and statistical theories. It aims to serve as a graduate-level textbook and a research monograph on high-dimensional statistics, sparsity and covariance learning, machine learning, and statistical inference. It includes ample exercises that involve both theoretical studies as well as empirical applications. The book begins with an introduction to the stylized features of big data and their impacts on statistical analysis. It then introduces multiple linear regression and expands the techniques of model building via nonparametric regression and kernel tricks. It provides a comprehensive account on sparsity explorations and model selections for multiple regression, generalized linear models, quantile regression, robust regression, hazards regression, among others. High-dimensional inference is also thoroughly addressed and so is feature screening. The book also provides a comprehensive account on high-dimensional covariance estimation, learning latent factors and hidden structures, as well as their applications to statistical estimation, inference, prediction and machine learning problems. It also introduces thoroughly statistical machine learning theory and methods for classification, clustering, and prediction. These include CART, random forests, boosting, support vector machines, clustering algorithms, sparse PCA, and deep learning.


Signal Theory Methods in Multispectral Remote Sensing

Signal Theory Methods in Multispectral Remote Sensing

Author: David A Landgrebe

Publisher: John Wiley & Sons

Published: 2005-02-04

Total Pages: 528

ISBN-13: 0471721255

DOWNLOAD EBOOK

An outgrowth of the author's extensive experience teaching senior and graduate level students, this is both a thorough introduction and a solid professional reference. * Material covered has been developed based on a 35-year research program associated with such systems as the Landsat satellite program and later satellite and aircraft programs. * Covers existing aircraft and satellite programs and several future programs *An Instructor's Manual presenting detailed solutions to all the problems in the book is available from the Wiley editorial department.


Discriminant Analysis and Statistical Pattern Recognition

Discriminant Analysis and Statistical Pattern Recognition

Author: Geoffrey J. McLachlan

Publisher: John Wiley & Sons

Published: 2005-02-25

Total Pages: 553

ISBN-13: 0471725285

DOWNLOAD EBOOK

The Wiley-Interscience Paperback Series consists of selected books that have been made more accessible to consumers in an effort to increase global appeal and general circulation. With these new unabridged softcover volumes, Wiley hopes to extend the lives of these works by making them available to future generations of statisticians, mathematicians, and scientists. "For both applied and theoretical statisticians as well as investigators working in the many areas in which relevant use can be made of discriminant techniques, this monograph provides a modern, comprehensive, and systematic account of discriminant analysis, with the focus on the more recent advances in the field." –SciTech Book News ". . . a very useful source of information for any researcher working in discriminant analysis and pattern recognition." –Computational Statistics Discriminant Analysis and Statistical Pattern Recognition provides a systematic account of the subject. While the focus is on practical considerations, both theoretical and practical issues are explored. Among the advances covered are regularized discriminant analysis and bootstrap-based assessment of the performance of a sample-based discriminant rule, and extensions of discriminant analysis motivated by problems in statistical image analysis. The accompanying bibliography contains over 1,200 references.


Time Series Analysis: Methods and Applications

Time Series Analysis: Methods and Applications

Author: Tata Subba Rao

Publisher: Elsevier

Published: 2012-06-26

Total Pages: 778

ISBN-13: 0444538585

DOWNLOAD EBOOK

'Handbook of Statistics' is a series of self-contained reference books. Each volume is devoted to a particular topic in statistics, with volume 30 dealing with time series.


Time Series Analysis: Methods and Applications

Time Series Analysis: Methods and Applications

Author:

Publisher: Elsevier

Published: 2012-05-18

Total Pages: 777

ISBN-13: 0444538631

DOWNLOAD EBOOK

The field of statistics not only affects all areas of scientific activity, but also many other matters such as public policy. It is branching rapidly into so many different subjects that a series of handbooks is the only way of comprehensively presenting the various aspects of statistical methodology, applications, and recent developments.The Handbook of Statistics is a series of self-contained reference books. Each volume is devoted to a particular topic in statistics, with Volume 30 dealing with time series. The series is addressed to the entire community of statisticians and scientists in various disciplines who use statistical methodology in their work. At the same time, special emphasis is placed on applications-oriented techniques, with the applied statistician in mind as the primary audience. - Comprehensively presents the various aspects of statistical methodology - Discusses a wide variety of diverse applications and recent developments - Contributors are internationally renowened experts in their respective areas