Shrinkage Estimation
Shrinkage Estimation

Author: Dominique Fourdrinier

Publisher: Springer

Published: 2018-11-27

Total Pages: 339

ISBN-13: 3030021858

DOWNLOAD EBOOK

This book provides a coherent framework for understanding shrinkage estimation in statistics. The term refers to modifying a classical estimator by moving it closer to a target which could be known a priori or arise from a model. The goal is to construct estimators with improved statistical properties. The book focuses primarily on point and loss estimation of the mean vector of multivariate normal and spherically symmetric distributions. Chapter 1 reviews the statistical and decision theoretic terminology and results that will be used throughout the book. Chapter 2 is concerned with estimating the mean vector of a multivariate normal distribution under quadratic loss from a frequentist perspective. In Chapter 3 the authors take a Bayesian view of shrinkage estimation in the normal setting. Chapter 4 introduces the general classes of spherically and elliptically symmetric distributions. Point and loss estimation for these broad classes are studied in subsequent chapters. In particular, Chapter 5 extends many of the results from Chapters 2 and 3 to spherically and elliptically symmetric distributions. Chapter 6 considers the general linear model with spherically symmetric error distributions when a residual vector is available. Chapter 7 then considers the problem of estimating a location vector which is constrained to lie in a convex set. Much of the chapter is devoted to one of two types of constraint sets, balls and polyhedral cones. In Chapter 8 the authors focus on loss estimation and data-dependent evidence reports. Appendices cover a number of technical topics including weakly differentiable functions; examples where Stein’s identity doesn’t hold; Stein’s lemma and Stokes’ theorem for smooth boundaries; harmonic, superharmonic and subharmonic functions; and modified Bessel functions.

Shrinkage Estimation for Mean and Covariance Matrices
Shrinkage Estimation for Mean and Covariance Matrices

Author: Hisayuki Tsukuma

Publisher: Springer Nature

Published: 2020-04-16

Total Pages: 119

ISBN-13: 9811515964

DOWNLOAD EBOOK

This book provides a self-contained introduction to shrinkage estimation for matrix-variate normal distribution models. More specifically, it presents recent techniques and results in estimation of mean and covariance matrices with a high-dimensional setting that implies singularity of the sample covariance matrix. Such high-dimensional models can be analyzed by using the same arguments as for low-dimensional models, thus yielding a unified approach to both high- and low-dimensional shrinkage estimations. The unified shrinkage approach not only integrates modern and classical shrinkage estimation, but is also required for further development of the field. Beginning with the notion of decision-theoretic estimation, this book explains matrix theory, group invariance, and other mathematical tools for finding better estimators. It also includes examples of shrinkage estimators for improving standard estimators, such as least squares, maximum likelihood, and minimum risk invariant estimators, and discusses the historical background and related topics in decision-theoretic estimation of parameter matrices. This book is useful for researchers and graduate students in various fields requiring data analysis skills as well as in mathematical statistics.

Penalty, Shrinkage and Pretest Strategies
Penalty, Shrinkage and Pretest Strategies

Author: S. Ejaz Ahmed

Publisher: Springer Science & Business Media

Published: 2013-12-11

Total Pages: 122

ISBN-13: 331903149X

DOWNLOAD EBOOK

The objective of this book is to compare the statistical properties of penalty and non-penalty estimation strategies for some popular models. Specifically, it considers the full model, submodel, penalty, pretest and shrinkage estimation techniques for three regression models before presenting the asymptotic properties of the non-penalty estimators and their asymptotic distributional efficiency comparisons. Further, the risk properties of the non-penalty estimators and penalty estimators are explored through a Monte Carlo simulation study. Showcasing examples based on real datasets, the book will be useful for students and applied researchers in a host of applied fields. The book’s level of presentation and style make it accessible to a broad audience. It offers clear, succinct expositions of each estimation strategy. More importantly, it clearly describes how to use each estimation strategy for the problem at hand. The book is largely self-contained, as are the individual chapters, so that anyone interested in a particular topic or area of application may read only that specific chapter. The book is specially designed for graduate students who want to understand the foundations and concepts underlying penalty and non-penalty estimation and its applications. It is well-suited as a textbook for senior undergraduate and graduate courses surveying penalty and non-penalty estimation strategies, and can also be used as a reference book for a host of related subjects, including courses on meta-analysis. Professional statisticians will find this book to be a valuable reference work, since nearly all chapters are self-contained.

Shrinkage Estimation of a Linear Regression
Shrinkage Estimation of a Linear Regression

Author: Kazuhiro Ohtani

Publisher:

Published: 2000

Total Pages: 182

ISBN-13:

DOWNLOAD EBOOK

This book deals with shrinkage regression estimators obtained by shrinking the ordinary least squares (OLS) estimator towards the origin. The author's main concern is to compare the sampling properties of a family of Stein-rule estimators with those of a family of minimum mean squared error estimators. In this book, the author deals with shrinkage regression estimators obtained by shrinking the ordinary least squares (OLS) estimator towards the origin. In particular, he deals with a family of Stein-rule (SR) estimators and a family of minimum mean squared error (MMSE) estimators.

Post-Shrinkage Strategies in Statistical and Machine Learning for High Dimensional Data
Post-Shrinkage Strategies in Statistical and Machine Learning for High Dimensional Data

Author: Syed Ejaz Ahmed

Publisher: CRC Press

Published: 2023-05-25

Total Pages: 409

ISBN-13: 1000876659

DOWNLOAD EBOOK

This book presents some post-estimation and predictions strategies for the host of useful statistical models with applications in data science. It combines statistical learning and machine learning techniques in a unique and optimal way. It is well-known that machine learning methods are subject to many issues relating to bias, and consequently the mean squared error and prediction error may explode. For this reason, we suggest shrinkage strategies to control the bias by combining a submodel selected by a penalized method with a model with many features. Further, the suggested shrinkage methodology can be successfully implemented for high dimensional data analysis. Many researchers in statistics and medical sciences work with big data. They need to analyse this data through statistical modelling. Estimating the model parameters accurately is an important part of the data analysis. This book may be a repository for developing improve estimation strategies for statisticians. This book will help researchers and practitioners for their teaching and advanced research, and is an excellent textbook for advanced undergraduate and graduate courses involving shrinkage, statistical, and machine learning. The book succinctly reveals the bias inherited in machine learning method and successfully provides tools, tricks and tips to deal with the bias issue. Expertly sheds light on the fundamental reasoning for model selection and post estimation using shrinkage and related strategies. This presentation is fundamental, because shrinkage and other methods appropriate for model selection and estimation problems and there is a growing interest in this area to fill the gap between competitive strategies. Application of these strategies to real life data set from many walks of life. Analytical results are fully corroborated by numerical work and numerous worked examples are included in each chapter with numerous graphs for data visualization. The presentation and style of the book clearly makes it accessible to a broad audience. It offers rich, concise expositions of each strategy and clearly describes how to use each estimation strategy for the problem at hand. This book emphasizes that statistics/statisticians can play a dominant role in solving Big Data problems, and will put them on the precipice of scientific discovery. The book contributes novel methodologies for HDDA and will open a door for continued research in this hot area. The practical impact of the proposed work stems from wide applications. The developed computational packages will aid in analyzing a broad range of applications in many walks of life.

Statistical Portfolio Estimation
Statistical Portfolio Estimation

Author: Masanobu Taniguchi

Publisher: CRC Press

Published: 2017-09-01

Total Pages: 455

ISBN-13: 1351643622

DOWNLOAD EBOOK

The composition of portfolios is one of the most fundamental and important methods in financial engineering, used to control the risk of investments. This book provides a comprehensive overview of statistical inference for portfolios and their various applications. A variety of asset processes are introduced, including non-Gaussian stationary processes, nonlinear processes, non-stationary processes, and the book provides a framework for statistical inference using local asymptotic normality (LAN). The approach is generalized for portfolio estimation, so that many important problems can be covered. This book can primarily be used as a reference by researchers from statistics, mathematics, finance, econometrics, and genomics. It can also be used as a textbook by senior undergraduate and graduate students in these fields.

Improving Efficiency by Shrinkage
Improving Efficiency by Shrinkage

Author: Marvin Gruber

Publisher: Routledge

Published: 2017-11-01

Total Pages: 648

ISBN-13: 1351439162

DOWNLOAD EBOOK

Offers a treatment of different kinds of James-Stein and ridge regression estimators from a frequentist and Bayesian point of view. The book explains and compares estimators analytically as well as numerically and includes Mathematica and Maple programs used in numerical comparison.;College or university bookshops may order five or more copies at a special student rate, available on request.

Missing Data and Small-Area Estimation
Missing Data and Small-Area Estimation

Author: Nicholas T. Longford

Publisher: Springer Science & Business Media

Published: 2005-08-05

Total Pages: 384

ISBN-13: 9781852337605

DOWNLOAD EBOOK

This book evolved from lectures, courses and workshops on missing data and small-area estimation that I presented during my tenure as the ?rst C- pion Fellow (2000–2002). For the Fellowship I proposed these two topics as areas in which the academic statistics could contribute to the development of government statistics, in exchange for access to the operational details and background that would inform the direction and sharpen the focus of a- demic research. After a few years of involvement, I have come to realise that the separation of ‘academic’ and ‘industrial’ statistics is not well suited to either party, and their integration is the key to progress in both branches. Most of the work on this monograph was done while I was a visiting l- turer at Massey University, Palmerston North, New Zealand. The hospitality and stimulating academic environment of their Institute of Information S- ence and Technology is gratefully acknowledged. I could not name all those who commented on my lecture notes and on the presentations themselves; apart from them, I want to thank the organisers and silent attendees of all the events, and, with a modicum of reluctance, the ‘grey ?gures’ who kept inquiring whether I was any nearer the completion of whatever stage I had been foolish enough to attach a date.

Improving Efficiency by Shrinkage
Improving Efficiency by Shrinkage

Author: Marvin Gruber

Publisher: Routledge

Published: 2017-11-01

Total Pages: 664

ISBN-13: 1351439154

DOWNLOAD EBOOK

Offers a treatment of different kinds of James-Stein and ridge regression estimators from a frequentist and Bayesian point of view. The book explains and compares estimators analytically as well as numerically and includes Mathematica and Maple programs used in numerical comparison.;College or university bookshops may order five or more copies at a special student rate, available on request.