"Algorithmic information theory (AIT) is the result of putting Shannon's information theory and Turing's computability theory into a cocktail shaker and shaking vigorously", says G.J. Chaitin, one of the fathers of this theory of complexity and randomness, which is also known as Kolmogorov complexity. It is relevant for logic (new light is shed on Gödel's incompleteness results), physics (chaotic motion), biology (how likely is life to appear and evolve?), and metaphysics (how ordered is the universe?). This book, benefiting from the author's research and teaching experience in Algorithmic Information Theory (AIT), should help to make the detailed mathematical techniques of AIT accessible to a much wider audience.
Computability and complexity theory are two central areas of research in theoretical computer science. This book provides a systematic, technical development of "algorithmic randomness" and complexity for scientists from diverse fields.
This essential companion to Chaitin's successful books The Unknowable and The Limits of Mathematics, presents the technical core of his theory of program-size complexity. The two previous volumes are more concerned with applications to meta-mathematics. LISP is used to present the key algorithms and to enable computer users to interact with the authors proofs and discover for themselves how they work. The LISP code for this book is available at the author's Web site together with a Java applet LISP interpreter. "No one has looked deeper and farther into the abyss of randomness and its role in mathematics than Greg Chaitin. This book tells you everything hes seen. Don miss it." John Casti, Santa Fe Institute, Author of Goedel: A Life of Logic.'
Fooled by Randomness is a standalone book in Nassim Nicholas Taleb’s landmark Incerto series, an investigation of opacity, luck, uncertainty, probability, human error, risk, and decision-making in a world we don’t understand. The other books in the series are The Black Swan, Antifragile, Skin in the Game, and The Bed of Procrustes. Fooled by Randomness is the word-of-mouth sensation that will change the way you think about business and the world. Nassim Nicholas Taleb–veteran trader, renowned risk expert, polymathic scholar, erudite raconteur, and New York Times bestselling author of The Black Swan–has written a modern classic that turns on its head what we believe about luck and skill. This book is about luck–or more precisely, about how we perceive and deal with luck in life and business. Set against the backdrop of the most conspicuous forum in which luck is mistaken for skill–the world of trading–Fooled by Randomness provides captivating insight into one of the least understood factors in all our lives. Writing in an entertaining narrative style, the author tackles major intellectual issues related to the underestimation of the influence of happenstance on our lives. The book is populated with an array of characters, some of whom have grasped, in their own way, the significance of chance: the baseball legend Yogi Berra; the philosopher of knowledge Karl Popper; the ancient world’s wisest man, Solon; the modern financier George Soros; and the Greek voyager Odysseus. We also meet the fictional Nero, who seems to understand the role of randomness in his professional life but falls victim to his own superstitious foolishness. However, the most recognizable character of all remains unnamed–the lucky fool who happens to be in the right place at the right time–he embodies the “survival of the least fit.” Such individuals attract devoted followers who believe in their guru’s insights and methods. But no one can replicate what is obtained by chance. Are we capable of distinguishing the fortunate charlatan from the genuine visionary? Must we always try to uncover nonexistent messages in random events? It may be impossible to guard ourselves against the vagaries of the goddess Fortuna, but after reading Fooled by Randomness we can be a little better prepared. Named by Fortune One of the Smartest Books of All Time A Financial Times Best Business Book of the Year
The last two decades have seen a wave of exciting new developments in the theory of algorithmic randomness and its applications to other areas of mathematics. This volume surveys much of the recent work that has not been included in published volumes until now. It contains a range of articles on algorithmic randomness and its interactions with closely related topics such as computability theory and computational complexity, as well as wider applications in areas of mathematics including analysis, probability, and ergodic theory. In addition to being an indispensable reference for researchers in algorithmic randomness, the unified view of the theory presented here makes this an excellent entry point for graduate students and other newcomers to the field.
Algorithmic Learning in a Random World describes recent theoretical and experimental developments in building computable approximations to Kolmogorov's algorithmic notion of randomness. Based on these approximations, a new set of machine learning algorithms have been developed that can be used to make predictions and to estimate their confidence and credibility in high-dimensional spaces under the usual assumption that the data are independent and identically distributed (assumption of randomness). Another aim of this unique monograph is to outline some limits of predictions: The approach based on algorithmic theory of randomness allows for the proof of impossibility of prediction in certain situations. The book describes how several important machine learning problems, such as density estimation in high-dimensional spaces, cannot be solved if the only assumption is randomness.
Recent findings in the computer sciences, discrete mathematics, formal logics and metamathematics have opened up a royal road for the investigation of undecidability and randomness in physics. A translation of these formal concepts yields a fresh look into diverse features of physical modelling such as quantum complementarity and the measurement problem, but also stipulates questions related to the necessity of the assumption of continua.Conversely, any computer may be perceived as a physical system: not only in the immediate sense of the physical properties of its hardware. Computers are a medium to virtual realities. The foreseeable importance of such virtual realities stimulates the investigation of an ?inner description?, a ?virtual physics? of these universes of computation. Indeed, one may consider our own universe as just one particular realisation of an enormous number of virtual realities, most of them awaiting discovery.One motive of this book is the recognition that what is often referred to as ?randomness? in physics might actually be a signature of undecidability for systems whose evolution is computable on a step-by-step basis. To give a flavour of the type of questions envisaged: Consider an arbitrary algorithmic system which is computable on a step-by-step basis. Then it is in general impossible to specify a second algorithmic procedure, including itself, which, by experimental input-output analysis, is capable of finding the deterministic law of the first system. But even if such a law is specified beforehand, it is in general impossible to predict the system behaviour in the ?distant future?. In other words: no ?speedup? or ?computational shortcut? is available. In this approach, classical paradoxes can be formally translated into no-go theorems concerning intrinsic physical perception.It is suggested that complementarity can be modelled by experiments on finite automata, where measurements of one observable of the automaton destroys the possibility to measure another observable of the same automaton and it vice versa.Besides undecidability, a great part of the book is dedicated to a formal definition of randomness and entropy measures based on algorithmic information theory.
In this fascinating book, mathematician Ed Beltrami takes a close enough look at randomness to make it mysteriously disappear. The results of coin tosses, it turns out, are determined from the start, and only our incomplete knowledge makes them look random. "Random" sequences of numbers are more elusive, but Godels undecidability theorem informs us that we will never know. Those familiar with quantum indeterminacy assert that order is an illusion, and that the world is fundamentally random. Yet randomness is also an illusion. Perhaps order and randomness, like waves and particles, are only two sides of the same (tossed) coin.
From the ancients' first readings of the innards of birds to your neighbor's last bout with the state lottery, humankind has put itself into the hands of chance. Today life itself may be at stake when probability comes into play--in the chance of a false negative in a medical test, in the reliability of DNA findings as legal evidence, or in the likelihood of passing on a deadly congenital disease--yet as few people as ever understand the odds. This book is aimed at the trouble with trying to learn about probability. A story of the misconceptions and difficulties civilization overcame in progressing toward probabilistic thinking, Randomness is also a skillful account of what makes the science of probability so daunting in our own day. To acquire a (correct) intuition of chance is not easy to begin with, and moving from an intuitive sense to a formal notion of probability presents further problems. Author Deborah Bennett traces the path this process takes in an individual trying to come to grips with concepts of uncertainty and fairness, and also charts the parallel path by which societies have developed ideas about chance. Why, from ancient to modern times, have people resorted to chance in making decisions? Is a decision made by random choice fair? What role has gambling played in our understanding of chance? Why do some individuals and societies refuse to accept randomness at all? If understanding randomness is so important to probabilistic thinking, why do the experts disagree about what it really is? And why are our intuitions about chance almost always dead wrong? Anyone who has puzzled over a probability conundrum is struck by the paradoxes and counterintuitive results that occur at a relatively simple level. Why this should be, and how it has been the case through the ages, for bumblers and brilliant mathematicians alike, is the entertaining and enlightening lesson of Randomness.
The book is a collection of papers written by a selection of eminent authors from around the world in honour of Gregory Chaitin's 60th birthday. This is a unique volume including technical contributions, philosophical papers and essays.
