Joint Source-channel Coding Reliability Function for Single and Multi-terminal Communication Systems

Joint Source-channel Coding Reliability Function for Single and Multi-terminal Communication Systems

Author: Yangfan Zhong

Publisher:

Published: 2008

Total Pages: 682

ISBN-13:

DOWNLOAD EBOOK

Traditionally, source coding (data compression) and channel coding (error protection) are performed separately and sequentially, resulting in what we call a tandem (separate) coding system. In practical implementations, however, tandem coding might involve a large delay and a high coding/decoding complexity, since one needs to remove the redundancy in the source coding part and then insert certain redundancy in the channel coding part. On the other hand, joint source-channel coding (JSCC), which coordinates source and channel coding or combines them into a single step, may offer substantial improvements over the tandem coding approach. This thesis deals with the fundamental Shannon-theoretic limits for a variety of communication systems via JSCC. More specifically, we investigate the reliability function (which is the largest rate at which the coding probability of error vanishes exponentially with increasing blocklength) for JSCC for the following discrete-time communication systems: (i) discrete memoryless systems; (ii) discrete memoryless systems with perfect channel feedback; (iii) discrete memoryless systems with source side information; (iv) discrete systems with Markovian memory; (v) continuous-valued (particularly Gaussian) memoryless systems; (vi) discrete asymmetric 2-user source-channel systems. For the above systems, we establish upper and lower bounds for the JSCC reliability function and we analytically compute these bounds. The conditions for which the upper and lower bounds coincide are also provided. We show that the conditions are satisfied for a large class of source-channel systems, and hence exactly determine the reliability function. We next provide a systematic comparison between the JSCC reliability function and the tandem coding reliability function (the reliability function resulting from separate source and channel coding). We show that the JSCC reliability function is substantially larger than the tandem coding reliability function for most cases. In particular, the JSCC reliability function is close to twice as large as the tandem coding reliability function for many source-channel pairs. This exponent gain provides a theoretical underpinning and justification for JSCC design as opposed to the widely used tandem coding method, since JSCC will yield a faster exponential rate of decay for the system error probability and thus provides substantial reductions in complexity and coding/decoding delay for real-world communication systems.


Analog Joint Source Channel Coding for Multi Terminal and Non-linear Channels

Analog Joint Source Channel Coding for Multi Terminal and Non-linear Channels

Author: Mohamed K. Hassanin

Publisher:

Published: 2018

Total Pages: 119

ISBN-13: 9780438595552

DOWNLOAD EBOOK

This dissertation discusses various problems in analog Joint Source Channel Coding (JSCC). Analog JSCC is an attractive communication scheme due to its encoding/decoding simplicity, and its ability to achieve near-optimal performance using very short code lengths. JSCC systems have received a renewed interest in recent years due to, among other factors, the sub-optimality of separation based schemes in many situations in multi-terminal communications. Different from traditional digital communication systems which utilize a quantizer followed by a source code and a channel code, analog JSCC systems combine source and channel coding into a single block and deal with real numbers. ☐ We present original work on the application of space filling curves, a common scheme in analog coding, to different communication scenarios. We begin by examining how to extend the use of space filling curves to non-linear channels with Inter-Symbol Interference (ISI). This type of channel arises when considering acoustic communications in the underwater environment, where the power amplifier used for communication is highly non-linear, and multi-path propagation causes ISI. We first study a simplified version of the acoustic channel assuming a frequency flat (no ISI) response, developing a scheme to adapt space filling curves to the simplified channel and studying its theoretical limits. Then, we extend our work to the complete end-to-end acoustic channel (including ISI), presenting a communication system for the end-to-end channel. ☐ We then investigate the problem of transmitting independent sources over the Gaussian Multiple Access Channel (MAC). The Gaussian MAC consists of two or more users communicating information to a central receiver over a shared noisy physical channel. We introduce an analog CDMA-like access scheme that allows users to transmit at different rates over the MAC. The developed access scheme is suitable for the transmission of analog JSCC encoded sources. The CDMA-like access scheme will be proven to be optimal for a particular case when the channel degrees of freedom are assigned amongst the users in a particular way. We will then present a hybrid analog-digital scheme which is an extension of the analog CDMA-like access scheme. The hybrid scheme uses analog and digital codes, designed for the point-to-point channel, and will be proven to be optimal for the entire region of the MAC. ☐ Finally, the dissertation introduces a new communication scheme for the two-user Gaussian Broadcast channel. The channel consists of a common transmitter wishing to communicate information to two receivers over a noisy Gaussian channel. The broadcast channel is an interesting case, since in general separation based schemes cannot achieve the theoretical limits. The new developed scheme is a variant of Scalar Quantizer Linear Coder (SQLC) systems, and is suitable for transmitting correlated Bivariate Gaussian sources. The scheme will be analyzed and shown to outperform the best known separation based schemes.


Joint Source-Channel Coding

Joint Source-Channel Coding

Author: Andres Kwasinski

Publisher: John Wiley & Sons

Published: 2023-01-04

Total Pages: 404

ISBN-13: 1119978521

DOWNLOAD EBOOK

Consolidating knowledge on Joint Source-Channel Coding (JSCC), this book provides an indispensable resource on a key area of performance enhancement for communications networks Presenting in one volume the key theories, concepts and important developments in the area of Joint Source-Channel Coding (JSCC), this book provides the fundamental material needed to enhance the performance of digital and wireless communication systems and networks. It comprehensively introduces JSCC technologies for communications systems, including coding and decoding algorithms, and emerging applications of JSCC in current wireless communications. The book covers the full range of theoretical and technical areas before concluding with a section considering recent applications and emerging designs for JSCC. A methodical reference for academic and industrial researchers, development engineers, system engineers, system architects and software engineers, this book: Explains how JSCC leads to high performance in communication systems and networks Consolidates key material from multiple disparate sources Is an ideal reference for graduate-level courses on digital or wireless communications, as well as courses on information theory Targets professionals involved with digital and wireless communications and networking systems


An Introduction to Single-User Information Theory

An Introduction to Single-User Information Theory

Author: Fady Alajaji

Publisher: Springer

Published: 2018-04-24

Total Pages: 333

ISBN-13: 9811080011

DOWNLOAD EBOOK

This book presents a succinct and mathematically rigorous treatment of the main pillars of Shannon’s information theory, discussing the fundamental concepts and indispensable results of Shannon’s mathematical theory of communications. It includes five meticulously written core chapters (with accompanying problems), emphasizing the key topics of information measures; lossless and lossy data compression; channel coding; and joint source-channel coding for single-user (point-to-point) communications systems. It also features two appendices covering necessary background material in real analysis and in probability theory and stochastic processes. The book is ideal for a one-semester foundational course on information theory for senior undergraduate and entry-level graduate students in mathematics, statistics, engineering, and computing and information sciences. A comprehensive instructor’s solutions manual is available.


Lossy Joint Source-channel Coding for Energy Harvesting Communication Systems

Lossy Joint Source-channel Coding for Energy Harvesting Communication Systems

Author: Meysam Shahrbaf Motlagh

Publisher:

Published: 2014

Total Pages: 60

ISBN-13:

DOWNLOAD EBOOK

In this work, we study the problem of lossy joint source-channel coding in an energy harvesting single-user communication system with causal energy arrivals, where the energy storage unit may have leakage. In particular, we investigate the achievable distortion in the transmission of a single source with arbitrary alphabets via an energy harvesting transmitter over a point-to-point channel. We first establish a lower bound on the achievable distortion. Then, to minimize the distortion we consider an adaptive joint source-channel coding scheme, where the length of channel codewords varies adaptively based on the available battery charge in each communication block. For this scheme, we obtain two coupled equations that determine the mismatch ratio between channel symbols and input symbols as well as the transmission power, both as functions of battery charge. As examples of continuous and discrete sources, we consider Gaussian and binary sources. In particular, for the Gaussian case, we obtain a closed form expression for the mismatch factor in terms of the $Lambert W$ function, and show that an increasing transmission power results in a decreasing mismatch factor and vice versa. We also numerically show that when the mismatch factor adaptively changes based on the available charge in the battery, the communication system achieves a smaller distortion compared to that of a constant mismatch factor.


Information Theory

Information Theory

Author: Imre Csiszár

Publisher: Cambridge University Press

Published: 2011-06-30

Total Pages: 522

ISBN-13: 113949998X

DOWNLOAD EBOOK

Csiszár and Körner's book is widely regarded as a classic in the field of information theory, providing deep insights and expert treatment of the key theoretical issues. It includes in-depth coverage of the mathematics of reliable information transmission, both in two-terminal and multi-terminal network scenarios. Updated and considerably expanded, this new edition presents unique discussions of information theoretic secrecy and of zero-error information theory, including the deep connections of the latter with extremal combinatorics. The presentations of all core subjects are self contained, even the advanced topics, which helps readers to understand the important connections between seemingly different problems. Finally, 320 end-of-chapter problems, together with helpful hints for solving them, allow readers to develop a full command of the mathematical techniques. It is an ideal resource for graduate students and researchers in electrical and electronic engineering, computer science and applied mathematics.


Source Channel Separation in Energy Constrained Multiterminal Source-channel Communications Schemes

Source Channel Separation in Energy Constrained Multiterminal Source-channel Communications Schemes

Author: Anil Kumar Daga

Publisher:

Published: 2006

Total Pages: 60

ISBN-13:

DOWNLOAD EBOOK

[Author's abstract] Source coding and channel coding are two important parts of a communications system. Source coding deals with the compression of source data, while channel coding adds some redundancy to circumvent the channel errors. Source coding and channel coding can be done either jointly or separately depending on the design issues like complexity of the system, rate, power, distortion tradeoffs. For optimal performance, all the parameters should be carefully chosen and optimized. This thesis looks at the scenarios of multi-terminal communications model where source and channel separation will not degrade the performance of the system in terms of rate power and distortion tradeoffs. Specifically, we investigate the transmission of data from correlated sources over an orthogonal multiple access channel under a total power constraint. It is observed that source-channel separation in this particular scenario is possible without any loss in the performance of the system. For the correlated sources case of the multiterminal communications, we provide an alternate approach for achieving source-channel separation.


Scientific and Technical Aerospace Reports

Scientific and Technical Aerospace Reports

Author:

Publisher:

Published: 1994

Total Pages: 880

ISBN-13:

DOWNLOAD EBOOK

Lists citations with abstracts for aerospace related reports obtained from world wide sources and announces documents that have recently been entered into the NASA Scientific and Technical Information Database.