In this thesis, the error resilient transmission of H.264 compressed video using Context-based Adaptive Binary Arithmetic Code (CABAC) as the entropy code is examined. The H.264 compressed video is convolutionally encoded and transmitted over an Additive White Gaussian Noise (AWGN) channel. Two iterative joint source-channel decoding schemes are proposed, in which slice candidates that failed semantic verification are exploited. The first proposed scheme uses soft values of bits produced by a soft-input soft-output channel decoder to generate a list of slice candidates for each slice in the compressed video sequence. These slice candidates are semantically verified to choose the best one. A new semantic checking method is proposed, which uses information from slice candidates that failed semantic verification to virtually check the current slice candidate. The second proposed scheme is built on the first one. This scheme also uses slice candidates that failed semantic verification but it uses them to modify soft values of bits at the source decoder before they are fed back into the channel decoder for the next iteration. Simulation results show that both schemes offer improvements in terms of subjective quality and in terms of objective quality using PSNR and BER as measures. Keywords: Video transmission, H.264, semantics, slice candidate, joint source-channel decoding, error resiliency.
Treats joint source and channel decoding in an integrated way Gives a clear description of the problems in the field together with the mathematical tools for their solution Contains many detailed examples useful for practical applications of the theory to video broadcasting over mobile and wireless networks Traditionally, cross-layer and joint source-channel coding were seen as incompatible with classically structured networks but recent advances in theory changed this situation. Joint source-channel decoding is now seen as a viable alternative to separate decoding of source and channel codes, if the protocol layers are taken into account. A joint source/protocol/channel approach is thus addressed in this book: all levels of the protocol stack are considered, showing how the information in each layer influences the others. This book provides the tools to show how cross-layer and joint source-channel coding and decoding are now compatible with present-day mobile and wireless networks, with a particular application to the key area of video transmission to mobiles. Typical applications are broadcasting, or point-to-point delivery of multimedia contents, which are very timely in the context of the current development of mobile services such as audio (MPEG4 AAC) or video (H263, H264) transmission using recent wireless transmission standards (DVH-H, DVB-SH, WiMAX, LTE). This cross-disciplinary book is ideal for graduate students, researchers, and more generally professionals working either in signal processing for communications or in networking applications, interested in reliable multimedia transmission. This book is also of interest to people involved in cross-layer optimization of mobile networks. Its content may provide them with other points of view on their optimization problem, enlarging the set of tools which they could use. Pierre Duhamel is director of research at CNRS/ LSS and has previously held research positions at Thomson-CSF, CNET, and ENST, where he was head of the Signal and Image Processing Department. He has served as chairman of the DSP committee and associate Editor of the IEEE Transactions on Signal Processing and Signal Processing Letters, as well as acting as a co-chair at MMSP and ICASSP conferences. He was awarded the Grand Prix France Telecom by the French Science Academy in 2000. He is co-author of more than 80 papers in international journals, 250 conference proceedings, and 28 patents. Michel Kieffer is an assistant professor in signal processing for communications at the Université Paris-Sud and a researcher at the Laboratoire des Signaux et Systèmes, Gif-sur-Yvette, France. His research interests are in joint source-channel coding and decoding techniques for the reliable transmission of multimedia contents. He serves as associate editor of Signal Processing (Elsevier). He is co-author of more than 90 contributions to journals, conference proceedings, and book chapters. Treats joint source and channel decoding in an integrated way Gives a clear description of the problems in the field together with the mathematical tools for their solution Contains many detailed examples useful for practical applications of the theory to video broadcasting over mobile and wireless networks
This thesis presents a novel iterative joint source and channel decoding scheme using turbo codes for MPEG-4 video transmission over noisy channels. The proposed scheme, on one hand, utilizes the channel soft outputs generated by a turbo decoder to assist syntax based error concealment in a source decoder. On the other hand, the residual redundancy extracted by the source decoder is fed back to the channel decoder through modifying the extrinsic information exchanged between the two constituent MAP decoders of the turbo decoder so as to improve the error performance of the turbo decoder. With video packet mixer, the proposed scheme can correct most of the turbo coding blocks with a large number of bit errors. Simulation results show significant improvement in terms of BER, PSNR and the reconstructed video quality.
Since the publication of Wireless Video Communications five years ago, the area of video compression and wireless transceivers has evolved even further. This new edition addresses a range of recent developments in these areas, giving cognizance to the associated transmission aspects and issues of error resilience. Video Compression and Communications has been updated and condensed yet remains all-encompassing, giving a comprehensive overview of the subject. Covering compression issues, coding delay, implementational complexity and bitrate, the book also looks at the historical perspective to video communication. New edition of successful and informative text, Wireless Video Communications Substantial new material has been added on areas such as H.264, MPEG4 coding and transceivers Clear presentation and broad scope make it essential for anyone interested in wireless communications Systematically converts the lessons of Shannon's information theory into design principles applicable to practical wireless systems. This book is ideal for postgraduates and researchers in communication systems but will also be a valuable reference to undergraduates, development and systems engineers of video compression applications as well as industrialists, managers and visual communications practitioners.
This book provides the first comprehensive and easy-to-read discussion of joint source-channel encoding and decoding for source signals with continuous amplitudes. It is a state-of-the-art presentation of this exciting, thriving field of research, making pioneering contributions to the new concept of source-adaptive modulation.The book starts with the basic theory and the motivation for a joint realization of source and channel coding. Specialized chapters deal with practically relevant scenarios such as iterative source-channel decoding and its optimization for a given encoder, and also improved encoder designs by channel-adaptive quantization or source-adaptive modulation.Although Information Theory is not the main topic of the book — in fact, the concept of joint source-channel coding is contradictory to the classical system design motivated by a questionable practical interpretation of the separation theorem — this theory still provides the ultimate performance limits for any practical system, whether it uses joint source-channel coding or not. Therefore, the theoretical limits are presented in a self-contained appendix, which is a useful reference also for those not directly interested in the main topic of this book./a
Examines the problem of joint source-channel video transmission - the joint optimal allocation of resources at the application layer and the other network layers, such as data rate adaptation, channel coding, power adaptation in wireless networks, quality of service (QoS) support from the network, and packet scheduling, for efficient video transmission.
Recent developments such as the invention of powerful turbo-decoding and irregular designs, together with the increase in the number of potential applications to multimedia signal compression, have increased the importance of variable length coding (VLC). Providing insights into the very latest research, the authors examine the design of diverse near-capacity VLC codes in the context of wireless telecommunications. The book commences with an introduction to Information Theory, followed by a discussion of Regular as well as Irregular Variable Length Coding and their applications in joint source and channel coding. Near-capacity designs are created using Extrinsic Information Transfer (EXIT) chart analysis. The latest techniques are discussed, outlining radical concepts such as Genetic Algorithm (GA) aided construction of diverse VLC codes. The book concludes with two chapters on VLC-based space-time transceivers as well as on frequency-hopping assisted schemes, followed by suggestions for future work on the topic. Surveys the historic evolution and development of VLCs Discusses the very latest research into VLC codes Introduces the novel concept of Irregular VLCs and their application in joint-source and channel coding
H.264 Advanced Video Coding or MPEG-4 Part 10 is fundamental to a growing range of markets such as high definition broadcasting, internet video sharing, mobile video and digital surveillance. This book reflects the growing importance and implementation of H.264 video technology. Offering a detailed overview of the system, it explains the syntax, tools and features of H.264 and equips readers with practical advice on how to get the most out of the standard. Packed with clear examples and illustrations to explain H.264 technology in an accessible and practical way. Covers basic video coding concepts, video formats and visual quality. Explains how to measure and optimise the performance of H.264 and how to balance bitrate, computation and video quality. Analyses recent work on scalable and multi-view versions of H.264, case studies of H.264 codecs and new technological developments such as the popular High Profile extensions. An invaluable companion for developers, broadcasters, system integrators, academics and students who want to master this burgeoning state-of-the-art technology. "[This book] unravels the mysteries behind the latest H.264 standard and delves deeper into each of the operations in the codec. The reader can implement (simulate, design, evaluate, optimize) the codec with all profiles and levels. The book ends with extensions and directions (such as SVC and MVC) for further research." Professor K. R. Rao, The University of Texas at Arlington, co-inventor of the Discrete Cosine Transform
This book is intended to attract the attention of practitioners and researchers in academia and industry interested in challenging paradigms of image and video coding algorithms with an emphasis on recent technological developments. All the chapters are well demonstrated by various researchers around the world covering the field of image and video processing. This book highlights the current research in the image and video processing area such as image fusion, image segmentation and classification, image compression, machine vision algorithms and video compression. The entire work available in the book is mainly focusing on researchers who can do quality research in the area of image and video processing and related fields. Each chapter is an independent research which will definitely motivate the young researchers to ponder into. These eleven chapters available in five sections will be an eye-opener for all who are doing systematic research in these fields.
