Scientific knowledge grows at a phenomenal pace--but few books have had as lasting an impact or played as important a role in our modern world as The Mathematical Theory of Communication, published originally as a paper on communication theory more than fifty years ago. Republished in book form shortly thereafter, it has since gone through four hardcover and sixteen paperback printings. It is a revolutionary work, astounding in its foresight and contemporaneity. The University of Illinois Press is pleased and honored to issue this commemorative reprinting of a classic.
The general concept of information is here, for the first time, defined mathematically by adding one single axiom to the probability theory. This Mathematical Theory of Information is explored in fourteen chapters: 1. Information can be measured in different units, in anything from bits to dollars. We will here argue that any measure is acceptable if it does not violate the Law of Diminishing Information. This law is supported by two independent arguments: one derived from the Bar-Hillel ideal receiver, the other is based on Shannon's noisy channel. The entropy in the 'classical information theory' is one of the measures conforming to the Law of Diminishing Information, but it has, however, properties such as being symmetric, which makes it unsuitable for some applications. The measure reliability is found to be a universal information measure. 2. For discrete and finite signals, the Law of Diminishing Information is defined mathematically, using probability theory and matrix algebra. 3. The Law of Diminishing Information is used as an axiom to derive essential properties of information. Byron's law: there is more information in a lie than in gibberish. Preservation: no information is lost in a reversible channel. Etc. The Mathematical Theory of Information supports colligation, i. e. the property to bind facts together making 'two plus two greater than four'. Colligation is a must when the information carries knowledge, or is a base for decisions. In such cases, reliability is always a useful information measure. Entropy does not allow colligation.
Introduction; 1 The information revolution; 2 The language of information; 3 Mathematical information; 4 Semantic information; 5 Physical information; 6 Biological information; 7 Economic information; 8 The ethics of information; Conclusion; References.
Originally developed by Claude Shannon in the 1940s, information theory laid the foundations for the digital revolution, and is now an essential tool in telecommunications, genetics, linguistics, brain sciences, and deep space communication. In this richly illustrated book, accessible examples are used to introduce information theory in terms of everyday games like ‘20 questions’ before more advanced topics are explored. Online MatLab and Python computer programs provide hands-on experience of information theory in action, and PowerPoint slides give support for teaching. Written in an informal style, with a comprehensive glossary and tutorial appendices, this text is an ideal primer for novices who wish to learn the essential principles and applications of information theory.
This volume contains survey and research articles by some of the leading researchers in mathematical systems theory - a vibrant research area in its own right. Many authors have taken special care that their articles are self-contained and accessible also to non-specialists.
Networks of communication evolve in terms of reflexive exchanges. The codification of these reflections in language, that is, at the social level, can be considered as the operating system of society. Under sociologically specifiable conditions, the discursive reconstructions can be expected to make the systems under reflection increasingly knowledge-intensive. This sociological theory of communication is founded in a tradition that includes Giddens' (1979) structuration theory, Habermas' (1981) theory of communicative action, and Luhmann's (1984) proposal to consider social systems as self-organizing. The study also elaborates on Shannon's (1948) mathematical theory of communication for the formalization and operationalization of the non-linear dynamics. The development of scientific communications can be studied using citation analysis. The exchange media at the interfaces of knowledge production provide us with the evolutionary model of a Triple Helix of university-industry-government relations. The construction of the European Information Society can then be analyzed in terms of interacting networks of communication. The issues of sustainable development and the expectation of social change are discussed in relation to the possibility of a general theory of communication. REVIEW In this book, LoetLeydesdorff sets out to answer the question, "Can society be considered as a self-organizing (autopoietic) system. In the process, Leydesdorff, develops a general sociological theory of communication, as well as a special theory of scientific communication designed to analyze complex systems such as the Euroean Information Society. (from review in JASIST 53[1], 2002, 62-63)
Mathematical Foundations for Signal Processing, Communications, and Networking describes mathematical concepts and results important in the design, analysis, and optimization of signal processing algorithms, modern communication systems, and networks. Helping readers master key techniques and comprehend the current research literature, the book offers a comprehensive overview of methods and applications from linear algebra, numerical analysis, statistics, probability, stochastic processes, and optimization. From basic transforms to Monte Carlo simulation to linear programming, the text covers a broad range of mathematical techniques essential to understanding the concepts and results in signal processing, telecommunications, and networking. Along with discussing mathematical theory, each self-contained chapter presents examples that illustrate the use of various mathematical concepts to solve different applications. Each chapter also includes a set of homework exercises and readings for additional study. This text helps readers understand fundamental and advanced results as well as recent research trends in the interrelated fields of signal processing, telecommunications, and networking. It provides all the necessary mathematical background to prepare students for more advanced courses and train specialists working in these areas.
Winner of the Neumann Prize for the History of Mathematics "We owe Claude Shannon a lot, and Soni & Goodman’s book takes a big first step in paying that debt." —San Francisco Review of Books "Soni and Goodman are at their best when they invoke the wonder an idea can instill. They summon the right level of awe while stopping short of hyperbole." —Financial Times "Jimmy Soni and Rob Goodman make a convincing case for their subtitle while reminding us that Shannon never made this claim himself." —The Wall Street Journal “A charming account of one of the twentieth century’s most distinguished scientists…Readers will enjoy this portrait of a modern-day Da Vinci.” —Fortune In their second collaboration, biographers Jimmy Soni and Rob Goodman present the story of Claude Shannon—one of the foremost intellects of the twentieth century and the architect of the Information Age, whose insights stand behind every computer built, email sent, video streamed, and webpage loaded. Claude Shannon was a groundbreaking polymath, a brilliant tinkerer, and a digital pioneer. He constructed the first wearable computer, outfoxed Vegas casinos, and built juggling robots. He also wrote the seminal text of the digital revolution, which has been called “the Magna Carta of the Information Age.” In this elegantly written, exhaustively researched biography, Soni and Goodman reveal Claude Shannon’s full story for the first time. With unique access to Shannon’s family and friends, A Mind at Play brings this singular innovator and always playful genius to life.
This book brings together a huge range of material including academic articles, film scripts and interplanetary messages adrift on space probes with supporting commentary to clarify their imporatance to the field. Communication Studies: The Essential Resource is a collection of essays and texts for all those studying communication at university and pre-university level. Individual sections address: * texts and meanings in communication * themes in personal communication * communication practice * culture, communication and context * debates and controversies in communication. Edited by the same teachers and examiners who brought us AS Communication Studies: The Essential Introduction, this volume will help communications students to engage with the subject successfully. Its key features include: * suggested further activities at the end of each chapter * a glossary of key terms * a comprehensive bibliography with web resources.
