Statistical Physics, Optimization, Inference, and Message-Passing Algorithms

Statistical Physics, Optimization, Inference, and Message-Passing Algorithms

Author: Florent Krzakala

Publisher: Oxford University Press

Published: 2016

Total Pages: 319

ISBN-13: 0198743734

DOWNLOAD EBOOK

In the last decade, there have been an increasing convergence of interest and methods between theoretical physics and fields as diverse as probability, machine learning, optimization and compressed sensing. In particular, many theoretical and applied works in statistical physics and computer science have relied on the use of message passing algorithms and their connection to statistical physics of spin glasses. The aim of this book, especially adapted to PhD students, post-docs, and young researchers, is to present the background necessary for entering this fast developing field.


Statistical Inference Via Convex Optimization

Statistical Inference Via Convex Optimization

Author: Anatoli Juditsky

Publisher: Princeton University Press

Published: 2020-04-07

Total Pages: 655

ISBN-13: 0691197296

DOWNLOAD EBOOK

This authoritative book draws on the latest research to explore the interplay of high-dimensional statistics with optimization. Through an accessible analysis of fundamental problems of hypothesis testing and signal recovery, Anatoli Juditsky and Arkadi Nemirovski show how convex optimization theory can be used to devise and analyze near-optimal statistical inferences. Statistical Inference via Convex Optimization is an essential resource for optimization specialists who are new to statistics and its applications, and for data scientists who want to improve their optimization methods. Juditsky and Nemirovski provide the first systematic treatment of the statistical techniques that have arisen from advances in the theory of optimization. They focus on four well-known statistical problems—sparse recovery, hypothesis testing, and recovery from indirect observations of both signals and functions of signals—demonstrating how they can be solved more efficiently as convex optimization problems. The emphasis throughout is on achieving the best possible statistical performance. The construction of inference routines and the quantification of their statistical performance are given by efficient computation rather than by analytical derivation typical of more conventional statistical approaches. In addition to being computation-friendly, the methods described in this book enable practitioners to handle numerous situations too difficult for closed analytical form analysis, such as composite hypothesis testing and signal recovery in inverse problems. Statistical Inference via Convex Optimization features exercises with solutions along with extensive appendixes, making it ideal for use as a graduate text.


Statistical Inference as Severe Testing

Statistical Inference as Severe Testing

Author: Deborah G. Mayo

Publisher: Cambridge University Press

Published: 2018-09-20

Total Pages: 503

ISBN-13: 1108563309

DOWNLOAD EBOOK

Mounting failures of replication in social and biological sciences give a new urgency to critically appraising proposed reforms. This book pulls back the cover on disagreements between experts charged with restoring integrity to science. It denies two pervasive views of the role of probability in inference: to assign degrees of belief, and to control error rates in a long run. If statistical consumers are unaware of assumptions behind rival evidence reforms, they can't scrutinize the consequences that affect them (in personalized medicine, psychology, etc.). The book sets sail with a simple tool: if little has been done to rule out flaws in inferring a claim, then it has not passed a severe test. Many methods advocated by data experts do not stand up to severe scrutiny and are in tension with successful strategies for blocking or accounting for cherry picking and selective reporting. Through a series of excursions and exhibits, the philosophy and history of inductive inference come alive. Philosophical tools are put to work to solve problems about science and pseudoscience, induction and falsification.


Statistical Mechanics of Learning

Statistical Mechanics of Learning

Author: A. Engel

Publisher: Cambridge University Press

Published: 2001-03-29

Total Pages: 346

ISBN-13: 9780521774796

DOWNLOAD EBOOK

Learning is one of the things that humans do naturally, and it has always been a challenge for us to understand the process. Nowadays this challenge has another dimension as we try to build machines that are able to learn and to undertake tasks such as datamining, image processing and pattern recognition. We can formulate a simple framework, artificial neural networks, in which learning from examples may be described and understood. The contribution to this subject made over the last decade by researchers applying the techniques of statistical mechanics is the subject of this book. The authors provide a coherent account of various important concepts and techniques that are currently only found scattered in papers, supplement this with background material in mathematics and physics and include many examples and exercises to make a book that can be used with courses, or for self-teaching, or as a handy reference.


Statistical Inference for Spatial Processes

Statistical Inference for Spatial Processes

Author: B. D. Ripley

Publisher: Cambridge University Press

Published: 1988

Total Pages: 162

ISBN-13: 9780521424202

DOWNLOAD EBOOK

The study of spatial processes and their applications is an important topic in statistics and finds wide application particularly in computer vision and image processing. This book is devoted to statistical inference in spatial statistics and is intended for specialists needing an introduction to the subject and to its applications. One of the themes of the book is the demonstration of how these techniques give new insights into classical procedures (including new examples in likelihood theory) and newer statistical paradigms such as Monte-Carlo inference and pseudo-likelihood. Professor Ripley also stresses the importance of edge effects and of lack of a unique asymptotic setting in spatial problems. Throughout, the author discusses the foundational issues posed and the difficulties, both computational and philosophical, which arise. The final chapters consider image restoration and segmentation methods and the averaging and summarising of images. Thus, the book will find wide appeal to researchers in computer vision, image processing, and those applying microscopy in biology, geology and materials science, as well as to statisticians interested in the foundations of their discipline.


High-Dimensional Statistics

High-Dimensional Statistics

Author: Martin J. Wainwright

Publisher: Cambridge University Press

Published: 2019-02-21

Total Pages: 571

ISBN-13: 1108498027

DOWNLOAD EBOOK

A coherent introductory text from a groundbreaking researcher, focusing on clarity and motivation to build intuition and understanding.


Information, Physics, and Computation

Information, Physics, and Computation

Author: Marc Mézard

Publisher: Oxford University Press

Published: 2009-01-22

Total Pages: 584

ISBN-13: 019857083X

DOWNLOAD EBOOK

A very active field of research is emerging at the frontier of statistical physics, theoretical computer science/discrete mathematics, and coding/information theory. This book sets up a common language and pool of concepts, accessible to students and researchers from each of these fields.


Statistical Mechanics: Algorithms and Computations

Statistical Mechanics: Algorithms and Computations

Author: Werner Krauth

Publisher: Oxford University Press, USA

Published: 2006-09-14

Total Pages: 355

ISBN-13: 0198515367

DOWNLOAD EBOOK

This book discusses the computational approach in modern statistical physics in a clear and accessible way and demonstrates its close relation to other approaches in theoretical physics. Individual chapters focus on subjects as diverse as the hard sphere liquid, classical spin models, single quantum particles and Bose-Einstein condensation. Contained within the chapters are in-depth discussions of algorithms, ranging from basic enumeration methods to modern Monte Carlo techniques. The emphasis is on orientation, with discussion of implementation details kept to a minimum. Illustrations, tables and concise printed algorithms convey key information, making the material very accessible. The book is completely self-contained and graphs and tables can readily be reproduced, requiring minimal computer code. Most sections begin at an elementary level and lead on to the rich and difficult problems of contemporary computational and statistical physics. The book will be of interest to a wide range of students, teachers and researchers in physics and the neighbouring sciences. An accompanying CD allows incorporation of the book's content (illustrations, tables, schematic programs) into the reader's own presentations.


Statistical Rethinking

Statistical Rethinking

Author: Richard McElreath

Publisher: CRC Press

Published: 2018-01-03

Total Pages: 488

ISBN-13: 1315362619

DOWNLOAD EBOOK

Statistical Rethinking: A Bayesian Course with Examples in R and Stan builds readers’ knowledge of and confidence in statistical modeling. Reflecting the need for even minor programming in today’s model-based statistics, the book pushes readers to perform step-by-step calculations that are usually automated. This unique computational approach ensures that readers understand enough of the details to make reasonable choices and interpretations in their own modeling work. The text presents generalized linear multilevel models from a Bayesian perspective, relying on a simple logical interpretation of Bayesian probability and maximum entropy. It covers from the basics of regression to multilevel models. The author also discusses measurement error, missing data, and Gaussian process models for spatial and network autocorrelation. By using complete R code examples throughout, this book provides a practical foundation for performing statistical inference. Designed for both PhD students and seasoned professionals in the natural and social sciences, it prepares them for more advanced or specialized statistical modeling. Web Resource The book is accompanied by an R package (rethinking) that is available on the author’s website and GitHub. The two core functions (map and map2stan) of this package allow a variety of statistical models to be constructed from standard model formulas.


Principles of Statistical Inference

Principles of Statistical Inference

Author: D. R. Cox

Publisher: Cambridge University Press

Published: 2006-08-10

Total Pages: 227

ISBN-13: 1139459139

DOWNLOAD EBOOK

In this definitive book, D. R. Cox gives a comprehensive and balanced appraisal of statistical inference. He develops the key concepts, describing and comparing the main ideas and controversies over foundational issues that have been keenly argued for more than two-hundred years. Continuing a sixty-year career of major contributions to statistical thought, no one is better placed to give this much-needed account of the field. An appendix gives a more personal assessment of the merits of different ideas. The content ranges from the traditional to the contemporary. While specific applications are not treated, the book is strongly motivated by applications across the sciences and associated technologies. The mathematics is kept as elementary as feasible, though previous knowledge of statistics is assumed. The book will be valued by every user or student of statistics who is serious about understanding the uncertainty inherent in conclusions from statistical analyses.