Rate Distortion Approach to Broadcasting with Side Information

Rate Distortion Approach to Broadcasting with Side Information

Author: Sinem Unal

Publisher:

Published: 2016

Total Pages: 366

ISBN-13:

DOWNLOAD EBOOK

We consider data dissemination from a single transmitter to multiple receivers with side information, which is possibly due to prior transmissions. Side information at receivers can be utilized to reduce the broadcasting rate at the transmitter. How to accomplish this is the main focus of this dissertation. We address this problem in three parts from an information theoretic point of view. First we model the source as uniform vector of bits and each side information is an arbitrary subset of the source. Known as index coding problem [1], we approach this problem as a special case of rate-distortion with multiple receivers, each with side information. Specifically, using techniques developed for the rate-distortion problem, we provide two upper bounds and one lower bound on the optimal index coding rate. The upper bounds are based on specific choices of the auxiliary random variables in the best existing scheme for the ratedistortion problem [2], which is shown invalid for the general rate-distortion problem and improved in our work [3] later. The lower bound is based on a new lower bound for the general rate-distortion problem. The bounds are shown to coincide for a number of (groupcast) index coding instances, including all instances for which the number of decoders does not exceed three. Then we consider rate-distortion with two decoders, each with distinct side information. This problem is well understood when the side information at the various decoders satisfies a certain degradedness condition. We consider cases in which this degradedness condition is violated but the source and the side information consist of jointly Gaussian vectors. We provide a hierarchy of four lower bounds on the optimal rate. These bounds are then used to determine the optimal rate for several classes of instances. Lastly, we consider a rate distortion problem with side information at multiple decoders. We provide an upper bound for general instances of this problem by utilizing random binning and simultaneous decoding techniques [4] and compare it with the existing bounds. Also, we provide a lower bound for the general problem, which was inspired by a linear-programming lower bound for index coding, and show that it subsumes most of the lower bounds in literature including the ones we used for the index coding and rate distortion with two decoders problems. Using these upper and lower bounds, we explicitly characterize the rate distortion function of a problem which can be seen as a Gaussian analogue of the \odd-cycle\" index coding problem."


Lattice Coding for Signals and Networks

Lattice Coding for Signals and Networks

Author: Ram Zamir

Publisher: Cambridge University Press

Published: 2014-08-07

Total Pages: 459

ISBN-13: 1139991590

DOWNLOAD EBOOK

Unifying information theory and digital communication through the language of lattice codes, this book provides a detailed overview for students, researchers and industry practitioners. It covers classical work by leading researchers in the field of lattice codes and complementary work on dithered quantization and infinite constellations, and then introduces the more recent results on 'algebraic binning' for side-information problems, and linear/lattice codes for networks. It shows how high dimensional lattice codes can close the gap to the optimal information theoretic solution, including the characterisation of error exponents. The solutions presented are based on lattice codes, and are therefore close to practical implementations, with many advanced setups and techniques, such as shaping, entropy-coding, side-information and multi-terminal systems. Moreover, some of the network setups shown demonstrate how lattice codes are potentially more efficient than traditional random-coding solutions, for instance when generalising the framework to Gaussian networks.


Channel Coding in the Presence of Side Information

Channel Coding in the Presence of Side Information

Author: Guy Keshet

Publisher: Now Publishers Inc

Published: 2008

Total Pages: 154

ISBN-13: 1601980485

DOWNLOAD EBOOK

Channel Coding in the Presence of Side Information reviews the concepts and methods of communication systems equipped with side information both from the theoretical and practical points of view. It is a comprehensive review that gives the reader an insightful introduction to one of the most important topics in modern communications systems.


Network Information Theory

Network Information Theory

Author: Abbas El Gamal

Publisher: Cambridge University Press

Published: 2011-12-08

Total Pages: 666

ISBN-13: 1139503146

DOWNLOAD EBOOK

This comprehensive treatment of network information theory and its applications provides the first unified coverage of both classical and recent results. With an approach that balances the introduction of new models and new coding techniques, readers are guided through Shannon's point-to-point information theory, single-hop networks, multihop networks, and extensions to distributed computing, secrecy, wireless communication, and networking. Elementary mathematical tools and techniques are used throughout, requiring only basic knowledge of probability, whilst unified proofs of coding theorems are based on a few simple lemmas, making the text accessible to newcomers. Key topics covered include successive cancellation and superposition coding, MIMO wireless communication, network coding, and cooperative relaying. Also covered are feedback and interactive communication, capacity approximations and scaling laws, and asynchronous and random access channels. This book is ideal for use in the classroom, for self-study, and as a reference for researchers and engineers in industry and academia.


Advances in Network Information Theory

Advances in Network Information Theory

Author: Piyush Gupta, Gerhard Kramer, and Adriaan J. van Wijngaarden

Publisher: American Mathematical Soc.

Published:

Total Pages: 356

ISBN-13: 9780821871089

DOWNLOAD EBOOK

Information theory has recently attracted renewed attention because of key developments spawning challenging research problems." "The book is suitable for graduate students and research mathematicians interested in communications and network information theory."--Jacket.


Advanced Wireless Communications

Advanced Wireless Communications

Author: Savo G. Glisic

Publisher: John Wiley & Sons

Published: 2007-06-13

Total Pages: 890

ISBN-13: 9780470512876

DOWNLOAD EBOOK

Fully revised and updated version of the successful "AdvancedWireless Communications" Wireless communications continue to attract the attention ofboth research community and industry. Since the first edition waspublished significant research and industry activities have broughtthe fourth generation (4G) of wireless communications systemscloser to implementation and standardization. "Advanced Wireless Communications" continues to provide acomparative study of enabling technologies for 4G. This secondedition has been revised and updated and now includes additionalinformation on the components of common air interface, includingthe area of space time coding , multicarrier modulation especiallyOFDM, MIMO, cognitive radio and cooperative transmission. Ideal for students and engineers in research and development inthe field of wireless communications, the second edition ofAdvanced Wireless Communications also gives an understanding tocurrent approaches for engineers in telecomm operators, governmentand regulatory institutions. New features include: Brand new chapter covering linear precoding in MIMO channelsbased on convex optimization theory. Material based on game theory modelling encompassing problemsof adjacent cell interference, flexible spectra sharing andcooperation between the nodes in ad hoc networks. Presents and discusses the latest schemes for interferencesuppression in ultra wide band (UWB) cognitive systems. Discusses the cooperative transmission and more details onpositioning.


Information Theory for Data Communications and Processing

Information Theory for Data Communications and Processing

Author: Shlomo Shamai (Shitz)

Publisher: MDPI

Published: 2021-01-13

Total Pages: 294

ISBN-13: 3039438174

DOWNLOAD EBOOK

Modern, current, and future communications/processing aspects motivate basic information-theoretic research for a wide variety of systems for which we do not have the ultimate theoretical solutions (for example, a variety of problems in network information theory as the broadcast/interference and relay channels, which mostly remain unsolved in terms of determining capacity regions and the like). Technologies such as 5/6G cellular communications, Internet of Things (IoT), and mobile edge networks, among others, not only require reliable rates of information measured by the relevant capacity and capacity regions, but are also subject to issues such as latency vs. reliability, availability of system state information, priority of information, secrecy demands, energy consumption per mobile equipment, sharing of communications resources (time/frequency/space), etc. This book, composed of a collection of papers that have appeared in the Special Issue of the Entropy journal dedicated to “Information Theory for Data Communications and Processing”, reflects, in its eleven chapters, novel contributions based on the firm basic grounds of information theory. The book chapters address timely theoretical and practical aspects that constitute both interesting and relevant theoretical contributions, as well as direct implications for modern current and future communications systems.


Distributed Source Coding

Distributed Source Coding

Author: Pier Luigi Dragotti

Publisher: Academic Press

Published: 2009-02-24

Total Pages: 359

ISBN-13: 0080922740

DOWNLOAD EBOOK

The advent of wireless sensor technology and ad-hoc networks has made DSC a major field of interest. Edited and written by the leading players in the field, this book presents the latest theory, algorithms and applications, making it the definitive reference on DSC for systems designers and implementers, researchers, and graduate students. This book gives a clear understanding of the performance limits of distributed source coders for specific classes of sources and presents the design and application of practical algorithms for realistic scenarios. Material covered includes the use of standard channel codes, such as LDPC and Turbo codes, to DSC, and discussion of the suitability of compressed sensing for distributed compression of sparse signals. Extensive applications are presented and include distributed video coding, microphone arrays and securing biometric data. - Clear explanation of the principles of distributed source coding (DSC), a technology that has applications in sensor networks, ad-hoc networks, and distributed wireless video systems for surveillance - Edited and written by the leading players in the field, providing a complete and authoritative reference - Contains all the latest theory, practical algorithms for DSC design and the most recently developed applications


General Theory of Information Transfer and Combinatorics

General Theory of Information Transfer and Combinatorics

Author: Rudolf Ahlswede

Publisher: Springer Science & Business Media

Published: 2006-12-14

Total Pages: 1138

ISBN-13: 3540462449

DOWNLOAD EBOOK

This book collects 63 revised, full-papers contributed to a research project on the "General Theory of Information Transfer and Combinatorics" that was hosted from 2001-2004 at the Center for Interdisciplinary Research (ZIF) of Bielefeld University and several incorporated meetings. Topics covered include probabilistic models, cryptology, pseudo random sequences, quantum models, pattern discovery, language evolution, and network coding.


Elements of Information Theory

Elements of Information Theory

Author: Thomas M. Cover

Publisher: John Wiley & Sons

Published: 2006-07-18

Total Pages: 788

ISBN-13: 0471241954

DOWNLOAD EBOOK

The latest edition of this classic is updated with new problem sets and material The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory. All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points. The Second Edition features: * Chapters reorganized to improve teaching * 200 new problems * New material on source coding, portfolio theory, and feedback capacity * Updated references Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications.