This is an introductory text on a broad class of statistical estimators that are minimizers of convex functions. It covers the basics of U-statistics and Mm-estimators and develops their asymptotic properties. It also provides an elementary introduction to resampling, particularly in the context of these estimators. The last chapter is on practical implementation of the methods presented in other chapters, using the free software R.
This is an introductory book on Non-Commutative Probability or Free Probability and Large Dimensional Random Matrices. Basic concepts of free probability are introduced by analogy with classical probability in a lucid and quick manner. It then develops the results on the convergence of large dimensional random matrices, with a special focus on the interesting connections to free probability. The book assumes almost no prerequisite for the most part. However, familiarity with the basic convergence concepts in probability and a bit of mathematical maturity will be helpful. Combinatorial properties of non-crossing partitions, including the Möbius function play a central role in introducing free probability. Free independence is defined via free cumulants in analogy with the way classical independence can be defined via classical cumulants. Free cumulants are introduced through the Möbius function. Free product probability spaces are constructed using free cumulants. Marginal and joint tracial convergence of large dimensional random matrices such as the Wigner, elliptic, sample covariance, cross-covariance, Toeplitz, Circulant and Hankel are discussed. Convergence of the empirical spectral distribution is discussed for symmetric matrices. Asymptotic freeness results for random matrices, including some recent ones, are discussed in detail. These clarify the structure of the limits for joint convergence of random matrices. Asymptotic freeness of independent sample covariance matrices is also demonstrated via embedding into Wigner matrices. Exercises, at advanced undergraduate and graduate level, are provided in each chapter.
Circulant matrices have been around for a long time and have been extensively used in many scientific areas. This book studies the properties of the eigenvalues for various types of circulant matrices, such as the usual circulant, the reverse circulant, and the k-circulant when the dimension of the matrices grow and the entries are random. In particular, the behavior of the spectral distribution, of the spectral radius and of the appropriate point processes are developed systematically using the method of moments and the various powerful normal approximation results. This behavior varies according as the entries are independent, are from a linear process, and are light- or heavy-tailed. Arup Bose obtained his B.Stat., M.Stat. and Ph.D. degrees from the Indian Statistical Institute. He has been on its faculty at the Theoretical Statistics and Mathematics Unit, Kolkata, India since 1991. He is a Fellow of the Institute of Mathematical Statistics, and of all three national science academies of India. He is a recipient of the S.S. Bhatnagar Prize and the C.R. Rao Award. He is the author of three books: Patterned Random Matrices, Large Covariance and Autocovariance Matrices (with Monika Bhattacharjee) and U-Statistics, M_m-Estimators and Resampling (with Snigdhansu Chatterjee). Koushik Saha obtained a B.Sc. in Mathematics from Ramakrishna Mission Vidyamandiara, Belur and an M.Sc. in Mathematics from Indian Institute of Technology Bombay. He obtained his Ph.D. degree from the Indian Statistical Institute under the supervision of Arup Bose. His thesis on circulant matrices received high praise from the reviewers. He has been on the faculty of the Department of Mathematics, Indian Institute of Technology Bombay since 2014.
This book deals with topics on the theory of measure and integration. It starts with discussion on the Riemann integral and points out certain shortcomings, which motivate the theory of measure and the Lebesgue integral. Most of the material in this book can be covered in a one-semester introductory course. An awareness of basic real analysis and elementary topological notions, with special emphasis on the topology of the n-dimensional Euclidean space, is the pre-requisite for this book. Each chapter is provided with a variety of exercises for the students. The book is targeted to students of graduate- and advanced-graduate-level courses on the theory of measure and integration.
This book is for students and researchers who have had a first year graduate level mathematical statistics course. It covers classical likelihood, Bayesian, and permutation inference; an introduction to basic asymptotic distribution theory; and modern topics like M-estimation, the jackknife, and the bootstrap. R code is woven throughout the text, and there are a large number of examples and problems. An important goal has been to make the topics accessible to a wide audience, with little overt reliance on measure theory. A typical semester course consists of Chapters 1-6 (likelihood-based estimation and testing, Bayesian inference, basic asymptotic results) plus selections from M-estimation and related testing and resampling methodology. Dennis Boos and Len Stefanski are professors in the Department of Statistics at North Carolina State. Their research has been eclectic, often with a robustness angle, although Stefanski is also known for research concentrated on measurement error, including a co-authored book on non-linear measurement error models. In recent years the authors have jointly worked on variable selection methods.
This highly popular introduction to confidence intervals has been thoroughly updated and expanded. It includes methods for using confidence intervals, with illustrative worked examples and extensive guidelines and checklists to help the novice.
The three parts of this book on survey methodology combine an introduction to basic sampling theory, engaging presentation of topics that reflect current research trends, and informed discussion of the problems commonly encountered in survey practice. These related aspects of survey methodology rarely appear together under a single connected roof, making this book a unique combination of materials for teaching, research and practice in survey sampling. Basic knowledge of probability theory and statistical inference is assumed, but no prior exposure to survey sampling is required. The first part focuses on the design-based approach to finite population sampling. It contains a rigorous coverage of basic sampling designs, related estimation theory, model-based prediction approach, and model-assisted estimation methods. The second part stems from original research conducted by the authors as well as important methodological advances in the field during the past three decades. Topics include calibration weighting methods, regression analysis and survey weighted estimating equation (EE) theory, longitudinal surveys and generalized estimating equations (GEE) analysis, variance estimation and resampling techniques, empirical likelihood methods for complex surveys, handling missing data and non-response, and Bayesian inference for survey data. The third part provides guidance and tools on practical aspects of large-scale surveys, such as training and quality control, frame construction, choices of survey designs, strategies for reducing non-response, and weight calculation. These procedures are illustrated through real-world surveys. Several specialized topics are also discussed in detail, including household surveys, telephone and web surveys, natural resource inventory surveys, adaptive and network surveys, dual-frame and multiple frame surveys, and analysis of non-probability survey samples. This book is a self-contained introduction to survey sampling that provides a strong theoretical base with coverage of current research trends and pragmatic guidance and tools for conducting surveys.
Large dimensional random matrices (LDRM) with specific patterns arise in econometrics, computer science, mathematics, physics, and statistics. This book provides an easy initiation to LDRM. Through a unified approach, we investigate the existence and properties of the limiting spectral distribution (LSD) of different patterned random matrices as the dimension grows. The main ingredients are the method of moments and normal approximation with rudimentary combinatorics for support. Some elementary results from matrix theory are also used. By stretching the moment arguments, we also have a brush with the intriguing but difficult concepts of joint convergence of sequences of random matrices and its ramifications. This book covers the Wigner matrix, the sample covariance matrix, the Toeplitz matrix, the Hankel matrix, the sample autocovariance matrix and the k-Circulant matrices. Quick and simple proofs of their LSDs are provided and it is shown how the semi-circle law and the March enko-Pastur law arise as the LSDs of the first two matrices. Extending the basic approach, we also establish interesting limits for some triangular matrices, band matrices, balanced matrices, and the sample autocovariance matrix. We also study the joint convergence of several patterned matrices, and show that independent Wigner matrices converge jointly and are asymptotically free of other patterned matrices. Arup Bose is a Professor at the Indian Statistical Institute, Kolkata, India. He is a distinguished researcher in Mathematical Statistics and has been working in high-dimensional random matrices for the last fifteen years. He has been the Editor of Sankyhā for several years and has been on the editorial board of several other journals. He is a Fellow of the Institute of Mathematical Statistics, USA and all three national science academies of India, as well as the recipient of the S.S. Bhatnagar Award and the C.R. Rao Award. His forthcoming books are the monograph, Large Covariance and Autocovariance Matrices (with Monika Bhattacharjee), to be published by Chapman & Hall/CRC Press, and a graduate text, U-statistics, M-estimates and Resampling (with Snigdhansu Chatterjee), to be published by Hindustan Book Agency.
