Asymmetric Modulation of H.264/AVC Compressed Video Using Unequal Error Protection

Asymmetric Modulation of H.264/AVC Compressed Video Using Unequal Error Protection

Author: Arpun Nangia

Publisher:

Published: 2012

Total Pages: 42

ISBN-13:

DOWNLOAD EBOOK

Wireless channels are prone to errors due to the presence of noise, fading effects and interference. The quality of communication is degraded by these channel errors. To counter the effect of these channel errors we use the Forward Error Correction (FEC) codes. The perceptual video quality is influenced by not only the channel errors caused during transmission, but also by the compression artifacts. We have aimed to reduce the amount of channel errors in this thesis. In this thesis, we have used a H.264/AVC bit stream. The video bit stream consists of high and low priority bits. The high priority bits are given more protection and the low priority bits are given less protection. This is called as Unequal Error Protection (UEP). H.264/AVC bit stream is then modulated and sent over the channel. The high priority data gets protection from the asymmetric modulation and the low priority data gets convolutionally encoded. In this way we have provided protection to both high and low priority. The bit stream is then recovered at the receiver side. The Peak Signal to Noise Ratio (PSNR) of the recovered video is calculated. PSNR is used to estimate the quality of the recovered video. This scheme gives a 3 dB improvement when compared with the previous techniques.


Unequal Error Protection for Compressed Video Over Noisy Channels

Unequal Error Protection for Compressed Video Over Noisy Channels

Author: Arash Vosoughi

Publisher:

Published: 2015

Total Pages: 111

ISBN-13:

DOWNLOAD EBOOK

The huge amount of data embodied in a video signal is by far the biggest burden on existing wireless communication systems. Adopting an efficient video transmission strategy is thus crucial in order to deliver video data at the lowest bit rate and the highest quality possible. Unequal error protection (UEP) is a powerful tool in this regard, whose ultimate goal is to wisely provide a stronger protection for the more important data, and a weaker protection for the less important data carried by a video signal. The use of efficient video delivery techniques becomes more important when 3D video content is transmitted over a wireless channel, since it contains twice as much data as 2D video. In this dissertation, we consider the UEP problem for transmission of 3D video over wireless channels. The proposed UEP techniques entail relatively high computational complexity which lend themselves to be more suitable for video-on-demand delivery, where the time-consuming computations are done offline at the transmitter/encoder side. To adopt UEP for 3D video, we consider a general problem of joint source-channel coding (JSCC). Solving the JSCC problem yields the optimum amount of 3D video compression as well as the optimum FEC (forward error correction) code rates exploited for UEP. We first need to estimate the perceived quality of the reconstructed video at the receiver. The lack of a good objective metric for 3D video makes adopting UEP a more challenging and problematic task compared to 2D video. Fortunately, for 3D video, some quality thresholds are derived in the literature based on the PSNR (peak-signal-to-noise-ratio) metric through experimental tests. These thresholds allow us to formulate the JSCC optimization problem using the PSNR in a straightforward but different way from the typical counterpart optimization problems in the literature. More precisely, we put the constraints of the optimization problem on the quality of the reconstructed 3D video and set our goal to minimize the total bit rate. We adopt the multiview coding (MVC) extension of the H.264/AVC. We also propose a scalable variant of MVC and formulate and solve the JSCC optimization problem for it. We show that significant gains are obtained if the proposed UEP scheme is combined with asymmetric coding. We also tackle the UEP problem for the video plus depth (V+D) format. We employ the SSIM (Structural SIMilarity) metric for designing UEP for V+D, since it has been shown that PSNR does not properly characterize the perceived quality of a 3D video represented in V+D format. Moreover, the synthesized right view always shows a huge PSNR loss (even in the absence of compression), which does not even allow us to use the asymmetric coding PSNR thresholds. This motivated us to adopt the classical JSCC problem formulation, where our goal is to maximize the quality of the reconstructed left and right views, given that there is a constraint on the sum of the number of source bits and the number of FEC bits. We show that UEP provides significant gains compared to equal error protection. We also derive several interesting results; some of them are in accordance with what have already been published in the literature and some of them are not. We show that the reason for this inconsistency is that we are solving the UEP problem in a more general situation, which yields novel solutions. Lastly, we focus on UEP for video broadcasting over wireless channels. Our goal here is to design a UEP-based video broadcasting system that well serves all the users within the service area of a base station. In a service area, there exist heterogeneous users with different display resolutions operating at different bit rates. Spatially scalable video is an excellent video compression format for this scenario, since it allows a user to decode that portion of the scalable bit stream that fits its operating bit rate as well as its display resolution. We tackle this problem for a MIMO (multi-input-multi-output) channel which enables us to exploit either spatial diversity or spatial multiplexing in a multipath fading channel to increase channel reliability or throughput, respectively. We employ spatial diversity techniques, in particular the Alamouti code, to encode the base layer. We also adopt spatial multiplexing techniques, in particular the V-BLAST, to encode the enhancement layer. By controlling the power allocation between the base layer and the enhancement layer, we can control the level of protection we provide to each of them. We also show that the adoption of scalable video in our system yields much higher gains compared to non-scalable video.


Study of the Impact of Encoder Parameters and Unequal Error Protection Scheme on HEVC Performance on Fading Channels

Study of the Impact of Encoder Parameters and Unequal Error Protection Scheme on HEVC Performance on Fading Channels

Author:

Publisher:

Published: 2018

Total Pages:

ISBN-13:

DOWNLOAD EBOOK

With the advent of technology, video resolution has increased up to 8K. But the wireless channel bandwidth available to transmit such high resolution videos is limited. Therefore, a better video coding standard, known as the high efficiency video coding (HEVC), has been developed that can compress the video data more efficiently than the currently deployed H.264 AVC standard, in order to fit high resolution videos on available wireless channels. For compressing videos using HEVC, first we need to set the encoding parameters appropriately so that the application requirements can be met, while increasing the compression ratio and video quality at the end user. In this thesis, we have studied the impact of various encoding parameters (such as group of pictures (GOP) size, GOP structure, and bitrate) on HEVC bitstream. Not every packet in the compressed video bitstream has the same contribution to video quality. If the most important video packets are lost, the error propagation will be more and the decoded video will be highly distorted. Since measuring video distortion contributed by the loss of a slice is computationally intensive and introduces delay, a prediction model is used to predict the distortion value and assign priority to each slice. The video packets (i.e., slices) of a GOP are divided into four equally populated classes based on their predicted distortion value, and priorities are assigned to each class. While transmitting through the channel, the packet is susceptible to channel noise and transmission errors. In this thesis, we have used an unequal error protection (UEP) scheme developed in our group, which protects the most important data against the channel induced losses based on their priority. For this, the low density parity check (LDPC) codes are applied to each packet based on its priority, for error correction. The LDPC code rates are computed for all the slices in a GOP by using a genetic algorithm (GA) based optimization scheme, which considers the video data rate, channel capacity and slice priorities. The performance of UEP scheme is evaluated for fading channels.


Unequal Error Protection for H.264/SVC Bitstream

Unequal Error Protection for H.264/SVC Bitstream

Author: Shireen Shankar

Publisher:

Published: 2010

Total Pages: 91

ISBN-13:

DOWNLOAD EBOOK

Today, the wide variety of devices in the digital world ranges from desktops to mobile phones. Within the currently available interactive multimedia applications, there are demands in terms of video quality and coding efficiency, the cost as well as scalability. That is why there is a need for scalable video coding schemes which provide fully progressive bit streams and supports scalability. Scalable Video Coding targets on seamless delivery of digital content and access to the same, enabling optimal user centered multi-channel and cross-platform media services, providing a straightforward solution for universal video delivery to a broad range of applications. Scalable video coding gives a nice way to perform rate shaping for video streams adapting to the available transmission resource. The work in this thesis deals with the overview and practical implementation of the H.264 Scalable Video Codec .All the major building blocks of H.264/SVC codec are discussed and implemented. Various kinds of Scalabilities and Error Concealment methods are achieved and comparative studies are performed. This thesis proposes and discusses Unequal Error Protection scheme in Scalable Video Coding. Unequal Error Protection method is an error resiliency scheme in which we protect the bit stream of the base and the enhancement layers based on priority levels. This priority information is based on the dependency, temporal, and quality scalabilities values. We have also provided an external protection to the bit stream in the form of Reed Solomon code. A detailed implementation of this scheme is done and results obtained through these simulations and video quality evaluation, are provided, showing the system performance under various network conditions.


Standard Codecs

Standard Codecs

Author: Mohammed Ghanbari

Publisher: IET

Published: 2003

Total Pages: 430

ISBN-13: 0852967101

DOWNLOAD EBOOK

This book discusses the growth of digital television technology and the revolution in image and video compression (such as JPEG2000, broadcast TV, video phone), highlighting the need for standardisation in processing static and moving images and their exchange between computer systems.


Digital Video Processing

Digital Video Processing

Author: A. Murat Tekalp

Publisher: Prentice Hall

Published: 2015-06-06

Total Pages: 808

ISBN-13: 0133991105

DOWNLOAD EBOOK

Over the years, thousands of engineering students and professionals relied on Digital Video Processing as the definitive, in-depth guide to digital image and video processing technology. Now, Dr. A. Murat Tekalp has completely revamped the first edition to reflect today’s technologies, techniques, algorithms, and trends. Digital Video Processing, Second Edition, reflects important advances in image processing, computer vision, and video compression, including new applications such as digital cinema, ultra-high-resolution video, and 3D video. This edition offers rigorous, comprehensive, balanced, and quantitative coverage of image filtering, motion estimation, tracking, segmentation, video filtering, and compression. Now organized and presented as a true tutorial, it contains updated problem sets and new MATLAB projects in every chapter. Coverage includes Multi-dimensional signals/systems: transforms, sampling, and lattice conversion Digital images and video: human vision, analog/digital video, and video quality Image filtering: gradient estimation, edge detection, scaling, multi-resolution representations, enhancement, de-noising, and restoration Motion estimation: image formation; motion models; differential, matching, optimization, and transform-domain methods; and 3D motion and shape estimation Video segmentation: color and motion segmentation, change detection, shot boundary detection, video matting, video tracking, and performance evaluation Multi-frame filtering: motion-compensated filtering, multi-frame standards conversion, multi-frame noise filtering, restoration, and super-resolution Image compression: lossless compression, JPEG, wavelets, and JPEG2000 Video compression: early standards, ITU-T H.264/MPEG-4 AVC, HEVC, Scalable Video Compression, and stereo/multi-view approaches


Art of Digital Audio

Art of Digital Audio

Author: John Watkinson

Publisher: Taylor & Francis

Published: 2013-04-26

Total Pages: 770

ISBN-13: 1136117091

DOWNLOAD EBOOK

Described as "the most comprehensive book on digital audio to date", it is widely acclaimed as an industry "bible". Covering the very latest developments in digital audio technology, it provides an thorough introduction to the theory as well as acting as an authoritative and comprehensive professional reference source. Everything you need is here from the fundamental principles to the latest applications, written in an award-winning style with clear explanations from first principles. New material covered includes internet audio, PC audio technology, DVD, MPEG audio compression, digital audio broadcasting and audio networks. Whether you are in the field of audio engineering, sound recording, music technology, broadcasting and communications media or audio design and installation, this book has it all. Written by a leading international audio specialist, who conducts professional seminars and workshops around the world, the book has been road tested for many years by professional seminar attendees and students to ensure their needs are taken into account, and all the right information is covered. This new edition now includes: Internet audio PC Audio technology DVD MPEG Audio compression Digital Audio Broadcasting Audio networks Digital audio professionals will find everything they need here, from the fundamental principles to the latest applications, written in an award-winning style with clear explanations from first principles. John Watkinson is an international consultant in audio, video and data recording. He is a Fellow of the AES, a member of the British Computer Society and a chartered information systems practitioner. He presents lectures, seminars, conference papers and training courses worldwide. He is the author of many other Focal Press books, including: the Kraszna-Krausz award winning MPEG-2; The Art of Digital Audio; An Introduction to Digital Video; The Art of Sound Reproduction; An Introduction to Digital Audio; TV Fundamentals and Audio for Television. He is also co-author, with Francis Rumsey, of The Digital Interface Handbook, and contributor to the Loudspeaker and Headphone Handbook, 3rd edition.


High Efficiency Video Coding

High Efficiency Video Coding

Author: Mathias Wien

Publisher: Springer

Published: 2014-09-29

Total Pages: 331

ISBN-13: 3662442760

DOWNLOAD EBOOK

The video coding standard High Efficiency Video Coding (HEVC) targets at improved compression performance for video resolutions of HD and beyond, providing Ultra HD video at similar compressed bit rates as for HD video encoded with the well-established video coding standard H.264/AVC. Based on known concepts, new coding structures and improved coding tools have been developed and specified in HEVC. The standard is expected to be taken up easily by established industry as well as new endeavors, answering the needs of todays connected and ever-evolving online world. This book presents the High Efficiency Video Coding standard and explains it in a clear and coherent language. It provides a comprehensive and consistently written description, all of a piece. The book targets at both, newbies to video coding as well as experts in the field. While providing sections with introductory text for the beginner, it suits as a well-arranged reference book for the expert. The book provides a comprehensive reference for the technical details of the employed coding tools; it further outlines the algorithmic advances compared to H.264/AVC. In addition to the technical aspects, the book provides insight to the general concepts of standardization, how specification text is written, and how these concepts apply to the HEVC specification.