Joint Source Channel Coding for Non-ergodic Channels
Joint Source Channel Coding for Non-ergodic Channels

Author: Kapil Bhattad

Publisher:

Published: 2008

Total Pages:

ISBN-13:

DOWNLOAD EBOOK

We study the problem of communicating a discrete time analog source over a channel such that the resulting distortion is minimized. For ergodic channels, Shannon showed that separate source and channel coding is optimal. In this work we study this problem for non-ergodic channels. Although not much can be said about the general problem of transmitting any analog sources over any non-ergodic channels with any distortion metric, for many practical problems like video broadcast and voice transmission, we can gain insights by studying the transmission of a Gaussian source over a wireless channel with mean square error as the distortion measure. Motivated by different applications, we consider three different non-ergodic channel models - (1) Additive white Gaussian noise (AWGN) channel whose signal-to-noise ratio (SNR) is unknown at the transmitter; (2) Rayleigh fading multiple-input multiple-output MIMO channel whose SNR is known at the transmitter; and (3) Rayleigh fading MIMO channel whose SNR is unknown at the transmitter. The traditional approach to study these problems has been to fix certain SNRs of interest and study the corresponding achievable distortion regions. However, the problems formulated this way have not been solved even for simple setups like 2 SNRs for the AWGN channel. We are interested in performance over a wide range of SNR and hence we use the distortion SNR exponent metric to study this problem. Distortion SNR exponent is defined as the rate of decay of distortion with SNR in the high SNR limit. We study several layered transmissions schemes where the source is first compressed in layers and then the layers are transmitted using channel codes that provide variable error protection. Results show that in several cases such layered transmission schemes are optimal in terms of the distortion SNR exponent. Specifically, if the band- width expansion (number of channel uses per source sample) is b, we show that the optimal distortion SNR exponent for the AWGN channel is b and it is achievable using a superposition based layered scheme. For the L-block Rayleigh fading M x N MIMO channel the optimal exponent is characterized for b (N - M +1)= min(M;N) and b MNL2. This corresponds to the entire range of b when min(M;N) = 1 and L = 1. The results also show that the exponents obtained using layered schemes which are a small subclass of joint source channel coding (JSCC) schemes are, surprisingly, as good as and better in some cases than achievable exponent of all other JSCC schemes reported so far.

Joint Source Channel Coding in Broadcast and Relay Channels
Joint Source Channel Coding in Broadcast and Relay Channels

Author: James Ho

Publisher:

Published: 2013

Total Pages: 103

ISBN-13:

DOWNLOAD EBOOK

The paradigm of separate source-channel coding is inspired by Shannon's separation result, which implies the asymptotic optimality of designing source and channel coding independently from each other. The result exploits the fact that channel error probabilities can be made arbitrarily small, as long as the block length of the channel code can be made arbitrarily large. However, this is not possible in practice, where the block length is either fixed or restricted to a range of finite values. As a result, the optimality of source and channel coding separation becomes unknown, leading researchers to consider joint source-channel coding (JSCC) to further improve the performance of practical systems that must operate in the finite block length regime. With this motivation, this thesis investigates the application of JSCC principles for multimedia communications over point-to-point, broadcast, and relay channels. All analyses are conducted from the perspective of end-to-end distortion (EED) for results that are applicable to channel codes with finite block lengths in pursuing insights into practical design. The thesis first revisits the fundamental open problem of the separation of source and channel coding in the finite block length regime. Derived formulations and numerical analyses for a source-channel coding system reveal many scenarios where the EED reduction is positive when pairing the channel-optimized source quantizer (COSQ) with an optimal channel code, hence establishing the invalidity of the separation theorem in the finite block length regime. With this, further improvements to JSCC systems are considered by augmenting error detection codes with the COSQ. Closed-form EED expressions for such system are derived, from which necessary optimality conditions are identified and used in proposed algorithms for system design. Results for both the point-to-point and broadcast channels demonstrate significant reductions to the EED without sacrificing bandwidth when considering a tradeoff between quantization and error detection coding rates. Lastly, the JSCC system is considered under relay channels, for which a computable measure of the EED is derived for any relay channel conditions with nonzero channel error probabilities. To emphasize the importance of analyzing JSCC systems under finite block lengths, the large sub-optimality in performance is demonstrated when solving the power allocation configuration problem according to capacity-based formulations that disregard channel errors, as opposed to those based on the EED. Although this thesis only considers one JSCC setup of many, it is concluded that consideration of JSCC systems from a non-asymptotic perspective not only is more meaningful, but also reveals more relevant insight into practical system design. This thesis accomplishes such by maintaining the EED as a measure of system performance in each of the considered point-to-point, broadcast, and relay cases.

Joint Source-Channel Decoding
Joint Source-Channel Decoding

Author: Pierre Duhamel

Publisher: Academic Press

Published: 2009-11-26

Total Pages: 337

ISBN-13: 0080922449

DOWNLOAD EBOOK

Treats joint source and channel decoding in an integrated way Gives a clear description of the problems in the field together with the mathematical tools for their solution Contains many detailed examples useful for practical applications of the theory to video broadcasting over mobile and wireless networks Traditionally, cross-layer and joint source-channel coding were seen as incompatible with classically structured networks but recent advances in theory changed this situation. Joint source-channel decoding is now seen as a viable alternative to separate decoding of source and channel codes, if the protocol layers are taken into account. A joint source/protocol/channel approach is thus addressed in this book: all levels of the protocol stack are considered, showing how the information in each layer influences the others. This book provides the tools to show how cross-layer and joint source-channel coding and decoding are now compatible with present-day mobile and wireless networks, with a particular application to the key area of video transmission to mobiles. Typical applications are broadcasting, or point-to-point delivery of multimedia contents, which are very timely in the context of the current development of mobile services such as audio (MPEG4 AAC) or video (H263, H264) transmission using recent wireless transmission standards (DVH-H, DVB-SH, WiMAX, LTE). This cross-disciplinary book is ideal for graduate students, researchers, and more generally professionals working either in signal processing for communications or in networking applications, interested in reliable multimedia transmission. This book is also of interest to people involved in cross-layer optimization of mobile networks. Its content may provide them with other points of view on their optimization problem, enlarging the set of tools which they could use. Pierre Duhamel is director of research at CNRS/ LSS and has previously held research positions at Thomson-CSF, CNET, and ENST, where he was head of the Signal and Image Processing Department. He has served as chairman of the DSP committee and associate Editor of the IEEE Transactions on Signal Processing and Signal Processing Letters, as well as acting as a co-chair at MMSP and ICASSP conferences. He was awarded the Grand Prix France Telecom by the French Science Academy in 2000. He is co-author of more than 80 papers in international journals, 250 conference proceedings, and 28 patents. Michel Kieffer is an assistant professor in signal processing for communications at the Université Paris-Sud and a researcher at the Laboratoire des Signaux et Systèmes, Gif-sur-Yvette, France. His research interests are in joint source-channel coding and decoding techniques for the reliable transmission of multimedia contents. He serves as associate editor of Signal Processing (Elsevier). He is co-author of more than 90 contributions to journals, conference proceedings, and book chapters. Treats joint source and channel decoding in an integrated way Gives a clear description of the problems in the field together with the mathematical tools for their solution Contains many detailed examples useful for practical applications of the theory to video broadcasting over mobile and wireless networks

Joint Source-Channel Coding
Joint Source-Channel Coding

Author: Andres Kwasinski

Publisher: John Wiley & Sons

Published: 2023-01-04

Total Pages: 404

ISBN-13: 1119978521

DOWNLOAD EBOOK

Consolidating knowledge on Joint Source-Channel Coding (JSCC), this book provides an indispensable resource on a key area of performance enhancement for communications networks Presenting in one volume the key theories, concepts and important developments in the area of Joint Source-Channel Coding (JSCC), this book provides the fundamental material needed to enhance the performance of digital and wireless communication systems and networks. It comprehensively introduces JSCC technologies for communications systems, including coding and decoding algorithms, and emerging applications of JSCC in current wireless communications. The book covers the full range of theoretical and technical areas before concluding with a section considering recent applications and emerging designs for JSCC. A methodical reference for academic and industrial researchers, development engineers, system engineers, system architects and software engineers, this book: Explains how JSCC leads to high performance in communication systems and networks Consolidates key material from multiple disparate sources Is an ideal reference for graduate-level courses on digital or wireless communications, as well as courses on information theory Targets professionals involved with digital and wireless communications and networking systems

Channel Coding in the Presence of Side Information
Channel Coding in the Presence of Side Information

Author: Guy Keshet

Publisher: Now Publishers Inc

Published: 2008

Total Pages: 154

ISBN-13: 1601980485

DOWNLOAD EBOOK

Channel Coding in the Presence of Side Information reviews the concepts and methods of communication systems equipped with side information both from the theoretical and practical points of view. It is a comprehensive review that gives the reader an insightful introduction to one of the most important topics in modern communications systems.

An Introduction to Single-User Information Theory
An Introduction to Single-User Information Theory

Author: Fady Alajaji

Publisher: Springer

Published: 2018-04-24

Total Pages: 333

ISBN-13: 9811080011

DOWNLOAD EBOOK

This book presents a succinct and mathematically rigorous treatment of the main pillars of Shannon’s information theory, discussing the fundamental concepts and indispensable results of Shannon’s mathematical theory of communications. It includes five meticulously written core chapters (with accompanying problems), emphasizing the key topics of information measures; lossless and lossy data compression; channel coding; and joint source-channel coding for single-user (point-to-point) communications systems. It also features two appendices covering necessary background material in real analysis and in probability theory and stochastic processes. The book is ideal for a one-semester foundational course on information theory for senior undergraduate and entry-level graduate students in mathematics, statistics, engineering, and computing and information sciences. A comprehensive instructor’s solutions manual is available.

Entropy and Information Theory
Entropy and Information Theory

Author: Robert M. Gray

Publisher: Springer Science & Business Media

Published: 2013-03-14

Total Pages: 346

ISBN-13: 1475739826

DOWNLOAD EBOOK

This book is devoted to the theory of probabilistic information measures and their application to coding theorems for information sources and noisy channels. The eventual goal is a general development of Shannon's mathematical theory of communication, but much of the space is devoted to the tools and methods required to prove the Shannon coding theorems. These tools form an area common to ergodic theory and information theory and comprise several quantitative notions of the information in random variables, random processes, and dynamical systems. Examples are entropy, mutual information, conditional entropy, conditional information, and discrimination or relative entropy, along with the limiting normalized versions of these quantities such as entropy rate and information rate. Much of the book is concerned with their properties, especially the long term asymptotic behavior of sample information and expected information. This is the only up-to-date treatment of traditional information theory emphasizing ergodic theory.

Joint Source-channel Coding Of Discrete-time Signals With Continuous Amplitudes
Joint Source-channel Coding Of Discrete-time Signals With Continuous Amplitudes

Author: Norbert Goertz

Publisher: World Scientific

Published: 2007-09-21

Total Pages: 207

ISBN-13: 1908979143

DOWNLOAD EBOOK

This book provides the first comprehensive and easy-to-read discussion of joint source-channel encoding and decoding for source signals with continuous amplitudes. It is a state-of-the-art presentation of this exciting, thriving field of research, making pioneering contributions to the new concept of source-adaptive modulation.The book starts with the basic theory and the motivation for a joint realization of source and channel coding. Specialized chapters deal with practically relevant scenarios such as iterative source-channel decoding and its optimization for a given encoder, and also improved encoder designs by channel-adaptive quantization or source-adaptive modulation.Although Information Theory is not the main topic of the book — in fact, the concept of joint source-channel coding is contradictory to the classical system design motivated by a questionable practical interpretation of the separation theorem — this theory still provides the ultimate performance limits for any practical system, whether it uses joint source-channel coding or not. Therefore, the theoretical limits are presented in a self-contained appendix, which is a useful reference also for those not directly interested in the main topic of this book./a