Heavy tails –extreme events or values more common than expected –emerge everywhere: the economy, natural events, and social and information networks are just a few examples. Yet after decades of progress, they are still treated as mysterious, surprising, and even controversial, primarily because the necessary mathematical models and statistical methods are not widely known. This book, for the first time, provides a rigorous introduction to heavy-tailed distributions accessible to anyone who knows elementary probability. It tackles and tames the zoo of terminology for models and properties, demystifying topics such as the generalized central limit theorem and regular variation. It tracks the natural emergence of heavy-tailed distributions from a wide variety of general processes, building intuition. And it reveals the controversy surrounding heavy tails to be the result of flawed statistics, then equips readers to identify and estimate with confidence. Over 100 exercises complete this engaging package.
Taken literally, the title "All of Statistics" is an exaggeration. But in spirit, the title is apt, as the book does cover a much broader range of topics than a typical introductory book on mathematical statistics. This book is for people who want to learn probability and statistics quickly. It is suitable for graduate or advanced undergraduate students in computer science, mathematics, statistics, and related disciplines. The book includes modern topics like non-parametric curve estimation, bootstrapping, and classification, topics that are usually relegated to follow-up courses. The reader is presumed to know calculus and a little linear algebra. No previous knowledge of probability and statistics is required. Statistics, data mining, and machine learning are all concerned with collecting and analysing data.
The Chesapeake Bay is North America's largest and most biologically diverse estuary, as well as an important commercial and recreational resource. However, excessive amounts of nitrogen, phosphorus, and sediment from human activities and land development have disrupted the ecosystem, causing harmful algae blooms, degraded habitats, and diminished populations of many species of fish and shellfish. In 1983, the Chesapeake Bay Program (CBP) was established, based on a cooperative partnership among the U.S. Environmental Protection Agency (EPA), the state of Maryland, and the commonwealths of Pennsylvania and Virginia, and the District of Columbia, to address the extent, complexity, and sources of pollutants entering the Bay. In 2008, the CBP launched a series of initiatives to increase the transparency of the program and heighten its accountability and in 2009 an executive order injected new energy into the restoration. In addition, as part of the effect to improve the pace of progress and increase accountability in the Bay restoration, a two-year milestone strategy was introduced aimed at reducing overall pollution in the Bay by focusing on incremental, short-term commitments from each of the Bay jurisdictions. The National Research Council (NRC) established the Committee on the Evaluation of Chesapeake Bay Program Implementation for Nutrient Reduction in Improve Water Quality in 2009 in response to a request from the EPA. The committee was charged to assess the framework used by the states and the CBP for tracking nutrient and sediment control practices that are implemented in the Chesapeake Bay watershed and to evaluate the two-year milestone strategy. The committee was also to assess existing adaptive management strategies and to recommend improvements that could help CBP to meet its nutrient and sediment reduction goals. The committee did not attempt to identify every possible strategy that could be implemented but instead focused on approaches that are not being implemented to their full potential or that may have substantial, unrealized potential in the Bay watershed. Because many of these strategies have policy or societal implications that could not be fully evaluated by the committee, the strategies are not prioritized but are offered to encourage further consideration and exploration among the CBP partners and stakeholders.
The new edition of this influential textbook, geared towards graduate or advanced undergraduate students, teaches the statistics necessary for financial engineering. In doing so, it illustrates concepts using financial markets and economic data, R Labs with real-data exercises, and graphical and analytic methods for modeling and diagnosing modeling errors. These methods are critical because financial engineers now have access to enormous quantities of data. To make use of this data, the powerful methods in this book for working with quantitative information, particularly about volatility and risks, are essential. Strengths of this fully-revised edition include major additions to the R code and the advanced topics covered. Individual chapters cover, among other topics, multivariate distributions, copulas, Bayesian computations, risk management, and cointegration. Suggested prerequisites are basic knowledge of statistics and probability, matrices and linear algebra, and calculus. There is an appendix on probability, statistics and linear algebra. Practicing financial engineers will also find this book of interest.
Now in widespread use, generalized additive models (GAMs) have evolved into a standard statistical methodology of considerable flexibility. While Hastie and Tibshirani's outstanding 1990 research monograph on GAMs is largely responsible for this, there has been a long-standing need for an accessible introductory treatment of the subject that also emphasizes recent penalized regression spline approaches to GAMs and the mixed model extensions of these models. Generalized Additive Models: An Introduction with R imparts a thorough understanding of the theory and practical applications of GAMs and related advanced models, enabling informed use of these very flexible tools. The author bases his approach on a framework of penalized regression splines, and builds a well-grounded foundation through motivating chapters on linear and generalized linear models. While firmly focused on the practical aspects of GAMs, discussions include fairly full explanations of the theory underlying the methods. Use of the freely available R software helps explain the theory and illustrates the practicalities of linear, generalized linear, and generalized additive models, as well as their mixed effect extensions. The treatment is rich with practical examples, and it includes an entire chapter on the analysis of real data sets using R and the author's add-on package mgcv. Each chapter includes exercises, for which complete solutions are provided in an appendix. Concise, comprehensive, and essentially self-contained, Generalized Additive Models: An Introduction with R prepares readers with the practical skills and the theoretical background needed to use and understand GAMs and to move on to other GAM-related methods and models, such as SS-ANOVA, P-splines, backfitting and Bayesian approaches to smoothing and additive modelling.
The fundamental mathematical tools needed to understand machine learning include linear algebra, analytic geometry, matrix decompositions, vector calculus, optimization, probability and statistics. These topics are traditionally taught in disparate courses, making it hard for data science or computer science students, or professionals, to efficiently learn the mathematics. This self-contained textbook bridges the gap between mathematical and machine learning texts, introducing the mathematical concepts with a minimum of prerequisites. It uses these concepts to derive four central machine learning methods: linear regression, principal component analysis, Gaussian mixture models and support vector machines. For students and others with a mathematical background, these derivations provide a starting point to machine learning texts. For those learning the mathematics for the first time, the methods help build intuition and practical experience with applying mathematical concepts. Every chapter includes worked examples and exercises to test understanding. Programming tutorials are offered on the book's web site.
This is a textbook for an undergraduate course in probability and statistics. The approximate prerequisites are two or three semesters of calculus and some linear algebra. Students attending the class include mathematics, engineering, and computer science majors.
Data on water quality and other environmental issues are being collected at an ever-increasing rate. In the past, however, the techniques used by scientists to interpret this data have not progressed as quickly. This is a book of modern statistical methods for analysis of practical problems in water quality and water resources.The last fifteen years have seen major advances in the fields of exploratory data analysis (EDA) and robust statistical methods. The 'real-life' characteristics of environmental data tend to drive analysis towards the use of these methods. These advances are presented in a practical and relevant format. Alternate methods are compared, highlighting the strengths and weaknesses of each as applied to environmental data. Techniques for trend analysis and dealing with water below the detection limit are topics covered, which are of great interest to consultants in water-quality and hydrology, scientists in state, provincial and federal water resources, and geological survey agencies.The practising water resources scientist will find the worked examples using actual field data from case studies of environmental problems, of real value. Exercises at the end of each chapter enable the mechanics of the methodological process to be fully understood, with data sets included on diskette for easy use. The result is a book that is both up-to-date and immediately relevant to ongoing work in the environmental and water sciences.
