Shrinkage Estimation for Mean and Covariance Matrices
Shrinkage Estimation for Mean and Covariance Matrices

Author: Hisayuki Tsukuma

Publisher: Springer Nature

Published: 2020-04-16

Total Pages: 119

ISBN-13: 9811515964

DOWNLOAD EBOOK

This book provides a self-contained introduction to shrinkage estimation for matrix-variate normal distribution models. More specifically, it presents recent techniques and results in estimation of mean and covariance matrices with a high-dimensional setting that implies singularity of the sample covariance matrix. Such high-dimensional models can be analyzed by using the same arguments as for low-dimensional models, thus yielding a unified approach to both high- and low-dimensional shrinkage estimations. The unified shrinkage approach not only integrates modern and classical shrinkage estimation, but is also required for further development of the field. Beginning with the notion of decision-theoretic estimation, this book explains matrix theory, group invariance, and other mathematical tools for finding better estimators. It also includes examples of shrinkage estimators for improving standard estimators, such as least squares, maximum likelihood, and minimum risk invariant estimators, and discusses the historical background and related topics in decision-theoretic estimation of parameter matrices. This book is useful for researchers and graduate students in various fields requiring data analysis skills as well as in mathematical statistics.

High-Dimensional Covariance Estimation
High-Dimensional Covariance Estimation

Author: Mohsen Pourahmadi

Publisher: John Wiley & Sons

Published: 2013-06-24

Total Pages: 204

ISBN-13: 1118034295

DOWNLOAD EBOOK

Methods for estimating sparse and large covariance matrices Covariance and correlation matrices play fundamental roles in every aspect of the analysis of multivariate data collected from a variety of fields including business and economics, health care, engineering, and environmental and physical sciences. High-Dimensional Covariance Estimation provides accessible and comprehensive coverage of the classical and modern approaches for estimating covariance matrices as well as their applications to the rapidly developing areas lying at the intersection of statistics and machine learning. Recently, the classical sample covariance methodologies have been modified and improved upon to meet the needs of statisticians and researchers dealing with large correlated datasets. High-Dimensional Covariance Estimation focuses on the methodologies based on shrinkage, thresholding, and penalized likelihood with applications to Gaussian graphical models, prediction, and mean-variance portfolio management. The book relies heavily on regression-based ideas and interpretations to connect and unify many existing methods and algorithms for the task. High-Dimensional Covariance Estimation features chapters on: Data, Sparsity, and Regularization Regularizing the Eigenstructure Banding, Tapering, and Thresholding Covariance Matrices Sparse Gaussian Graphical Models Multivariate Regression The book is an ideal resource for researchers in statistics, mathematics, business and economics, computer sciences, and engineering, as well as a useful text or supplement for graduate-level courses in multivariate analysis, covariance estimation, statistical learning, and high-dimensional data analysis.

Explorations in Harmonic Analysis
Explorations in Harmonic Analysis

Author: Steven G. Krantz

Publisher: Springer Science & Business Media

Published: 2009-05-24

Total Pages: 367

ISBN-13: 0817646698

DOWNLOAD EBOOK

This self-contained text provides an introduction to modern harmonic analysis in the context in which it is actually applied, in particular, through complex function theory and partial differential equations. It takes the novice mathematical reader from the rudiments of harmonic analysis (Fourier series) to the Fourier transform, pseudodifferential operators, and finally to Heisenberg analysis.

Spectral Analysis of Large Dimensional Random Matrices
Spectral Analysis of Large Dimensional Random Matrices

Author: Zhidong Bai

Publisher: Springer Science & Business Media

Published: 2009-12-10

Total Pages: 560

ISBN-13: 1441906614

DOWNLOAD EBOOK

The aim of the book is to introduce basic concepts, main results, and widely applied mathematical tools in the spectral analysis of large dimensional random matrices. The core of the book focuses on results established under moment conditions on random variables using probabilistic methods, and is thus easily applicable to statistics and other areas of science. The book introduces fundamental results, most of them investigated by the authors, such as the semicircular law of Wigner matrices, the Marcenko-Pastur law, the limiting spectral distribution of the multivariate F matrix, limits of extreme eigenvalues, spectrum separation theorems, convergence rates of empirical distributions, central limit theorems of linear spectral statistics, and the partial solution of the famous circular law. While deriving the main results, the book simultaneously emphasizes the ideas and methodologies of the fundamental mathematical tools, among them being: truncation techniques, matrix identities, moment convergence theorems, and the Stieltjes transform. Its treatment is especially fitting to the needs of mathematics and statistics graduate students and beginning researchers, having a basic knowledge of matrix theory and an understanding of probability theory at the graduate level, who desire to learn the concepts and tools in solving problems in this area. It can also serve as a detailed handbook on results of large dimensional random matrices for practical users. This second edition includes two additional chapters, one on the authors' results on the limiting behavior of eigenvectors of sample covariance matrices, another on applications to wireless communications and finance. While attempting to bring this edition up-to-date on recent work, it also provides summaries of other areas which are typically considered part of the general field of random matrix theory.

Shrinkage Estimation
Shrinkage Estimation

Author: Dominique Fourdrinier

Publisher: Springer

Published: 2018-11-27

Total Pages: 339

ISBN-13: 3030021858

DOWNLOAD EBOOK

This book provides a coherent framework for understanding shrinkage estimation in statistics. The term refers to modifying a classical estimator by moving it closer to a target which could be known a priori or arise from a model. The goal is to construct estimators with improved statistical properties. The book focuses primarily on point and loss estimation of the mean vector of multivariate normal and spherically symmetric distributions. Chapter 1 reviews the statistical and decision theoretic terminology and results that will be used throughout the book. Chapter 2 is concerned with estimating the mean vector of a multivariate normal distribution under quadratic loss from a frequentist perspective. In Chapter 3 the authors take a Bayesian view of shrinkage estimation in the normal setting. Chapter 4 introduces the general classes of spherically and elliptically symmetric distributions. Point and loss estimation for these broad classes are studied in subsequent chapters. In particular, Chapter 5 extends many of the results from Chapters 2 and 3 to spherically and elliptically symmetric distributions. Chapter 6 considers the general linear model with spherically symmetric error distributions when a residual vector is available. Chapter 7 then considers the problem of estimating a location vector which is constrained to lie in a convex set. Much of the chapter is devoted to one of two types of constraint sets, balls and polyhedral cones. In Chapter 8 the authors focus on loss estimation and data-dependent evidence reports. Appendices cover a number of technical topics including weakly differentiable functions; examples where Stein’s identity doesn’t hold; Stein’s lemma and Stokes’ theorem for smooth boundaries; harmonic, superharmonic and subharmonic functions; and modified Bessel functions.

A Matrix Handbook for Statisticians
A Matrix Handbook for Statisticians

Author: George A. F. Seber

Publisher: John Wiley & Sons

Published: 2008-01-28

Total Pages: 592

ISBN-13: 0470226781

DOWNLOAD EBOOK

A comprehensive, must-have handbook of matrix methods with a unique emphasis on statistical applications This timely book, A Matrix Handbook for Statisticians, provides a comprehensive, encyclopedic treatment of matrices as they relate to both statistical concepts and methodologies. Written by an experienced authority on matrices and statistical theory, this handbook is organized by topic rather than mathematical developments and includes numerous references to both the theory behind the methods and the applications of the methods. A uniform approach is applied to each chapter, which contains four parts: a definition followed by a list of results; a short list of references to related topics in the book; one or more references to proofs; and references to applications. The use of extensive cross-referencing to topics within the book and external referencing to proofs allows for definitions to be located easily as well as interrelationships among subject areas to be recognized. A Matrix Handbook for Statisticians addresses the need for matrix theory topics to be presented together in one book and features a collection of topics not found elsewhere under one cover. These topics include: Complex matrices A wide range of special matrices and their properties Special products and operators, such as the Kronecker product Partitioned and patterned matrices Matrix analysis and approximation Matrix optimization Majorization Random vectors and matrices Inequalities, such as probabilistic inequalities Additional topics, such as rank, eigenvalues, determinants, norms, generalized inverses, linear and quadratic equations, differentiation, and Jacobians, are also included. The book assumes a fundamental knowledge of vectors and matrices, maintains a reasonable level of abstraction when appropriate, and provides a comprehensive compendium of linear algebra results with use or potential use in statistics. A Matrix Handbook for Statisticians is an essential, one-of-a-kind book for graduate-level courses in advanced statistical studies including linear and nonlinear models, multivariate analysis, and statistical computing. It also serves as an excellent self-study guide for statistical researchers.

Functional and Operatorial Statistics
Functional and Operatorial Statistics

Author: Sophie Dabo-Niang

Publisher: Springer Science & Business Media

Published: 2008-05-21

Total Pages: 296

ISBN-13: 3790820628

DOWNLOAD EBOOK

An increasing number of statistical problems and methods involve infinite-dimensional aspects. This is due to the progress of technologies which allow us to store more and more information while modern instruments are able to collect data much more effectively due to their increasingly sophisticated design. This evolution directly concerns statisticians, who have to propose new methodologies while taking into account such high-dimensional data (e.g. continuous processes, functional data, etc.). The numerous applications (micro-arrays, paleo- ecological data, radar waveforms, spectrometric curves, speech recognition, continuous time series, 3-D images, etc.) in various fields (biology, econometrics, environmetrics, the food industry, medical sciences, paper industry, etc.) make researching this statistical topic very worthwhile. This book gathers important contributions on the functional and operatorial statistics fields.

High-Dimensional Covariance Matrix Estimation: Shrinkage Toward a Diagonal Target
High-Dimensional Covariance Matrix Estimation: Shrinkage Toward a Diagonal Target

Author: Mr. Sakai Ando

Publisher: International Monetary Fund

Published: 2023-12-08

Total Pages: 32

ISBN-13:

DOWNLOAD EBOOK

This paper proposes a novel shrinkage estimator for high-dimensional covariance matrices by extending the Oracle Approximating Shrinkage (OAS) of Chen et al. (2009) to target the diagonal elements of the sample covariance matrix. We derive the closed-form solution of the shrinkage parameter and show by simulation that, when the diagonal elements of the true covariance matrix exhibit substantial variation, our method reduces the Mean Squared Error, compared with the OAS that targets an average variance. The improvement is larger when the true covariance matrix is sparser. Our method also reduces the Mean Squared Error for the inverse of the covariance matrix.

Large Sample Covariance Matrices and High-Dimensional Data Analysis
Large Sample Covariance Matrices and High-Dimensional Data Analysis

Author: Jianfeng Yao

Publisher: Cambridge University Press

Published: 2015-03-26

Total Pages: 0

ISBN-13: 9781107065178

DOWNLOAD EBOOK

High-dimensional data appear in many fields, and their analysis has become increasingly important in modern statistics. However, it has long been observed that several well-known methods in multivariate analysis become inefficient, or even misleading, when the data dimension p is larger than, say, several tens. A seminal example is the well-known inefficiency of Hotelling's T2-test in such cases. This example shows that classical large sample limits may no longer hold for high-dimensional data; statisticians must seek new limiting theorems in these instances. Thus, the theory of random matrices (RMT) serves as a much-needed and welcome alternative framework. Based on the authors' own research, this book provides a first-hand introduction to new high-dimensional statistical methods derived from RMT. The book begins with a detailed introduction to useful tools from RMT, and then presents a series of high-dimensional problems with solutions provided by RMT methods.

Your Essential Guide to Quantitative Hedge Fund Investing
Your Essential Guide to Quantitative Hedge Fund Investing

Author: Marat Molyboga

Publisher: CRC Press

Published: 2023-07-18

Total Pages: 317

ISBN-13: 100090461X

DOWNLOAD EBOOK

Your Essential Guide to Quantitative Hedge Fund Investing provides a conceptual framework for understanding effective hedge fund investment strategies. The book offers a mathematically rigorous exploration of different topics, framed in an easy to digest set of examples and analogies, including stories from some legendary hedge fund investors. Readers will be guided from the historical to the cutting edge, while building a framework of understanding that encompasses it all. Features Filled with novel examples and analogies from within and beyond the world of finance Suitable for practitioners and graduate-level students with a passion for understanding the complexities that lie behind the raw mechanics of quantitative hedge fund investment A unique insight from an author with experience of both the practical and academic spheres.