Numerous voice, still image, audio, and video compression standards have been developed over the last 25 years, and significant advances in the state of the art have been achieved. However, in the more than 50 years since Shannon's seminal 1959 paper, no rate distortion bounds for voice and video have been forthcoming. In this volume, we present the first rate distortion bounds for voice and video that actually lower bound the operational rate distortion performance of the best-performing voice and video codecs. The bounds indicate that improvements in rate distortion performance of approximately 50% over the best-performing voice and video codecs are possible. Research directions to improve the new bounds are discussed.
This book is very specifically targeted to problems in communications and compression by providing the fundamental principles and results in information theory and rate distortion theory for these applications and presenting methods that have proved and will prove useful in analyzing and designing real systems. The chapters contain treatments of entropy, mutual information, lossless source coding, channel capacity, and rate distortion theory; however, it is the selection, ordering, and presentation of the topics within these broad categories that is unique to this concise book. While the coverage of some standard topics is shortened or eliminated, the standard, but important, topics of the chain rules for entropy and mutual information, relative entropy, the data processing inequality, and the Markov chain condition receive a full treatment. Similarly, lossless source coding techniques presented include the Lempel-Ziv-Welch coding method. The material on rate Distortion theory and exploring fundamental limits on lossy source coding covers the often-neglected Shannon lower bound and the Shannon backward channel condition, rate distortion theory for sources with memory, and the extremely practical topic of rate distortion functions for composite sources.
This book develops the concepts for the transmission of digital information sequences through analog, band limited channels, including the topics of pulse shaping, channels with amplitude and delay distortion, eye patterns, zero forcing and mean squared error equalization, and data scrambling. The text considers the effects of noise in digital communications, developing the fundamental ideas of signal space, optimum symbol-by-symbol detection, and modulation system design, with particular emphasis on maximum likelihood and maximum a posteriori detection and system performance comparisons based on energy per bit to noise ratio and average error probability. The key technique of maximum likelihood sequence estimation is also developed. Tutorial coverage provides an introduction to block and convolutional codes for error control coding, including coding and decoding methods for error detection and correction, tree and trellis representations, and Viterbi decoding. Some performance comparisons for selected codes in terms of energy per bit to noise ratio versus bit error probability are presented. This book examines joint coding and modulation methods such as constant envelope modulation and trellis coded modulation, including examples such as minimum shift keying and offset quadrature phase shift keying.
This book provides the background and the mathematical methods necessary to understand the basic transforms in signal processing and linear systems and probability and random processes to prepare for in depth study of analog and digital communications systems. This tutorial presentation provides developments of Fourier series and other orthogonal series, including trigonometric and complex exponential Fourier series, least squares approximations and generalized Fourier series, and the spectral content of periodic signals. This text thoroughly covers Fourier transform pairs for continuous time signals, Fourier transform properties, and the magnitude and phase of Fourier transforms. The author includes discussions of techniques for the analysis of continuous time linear systems in the time and frequency domains with particular emphasis on the system transfer function, impulse response, system/filter bandwidth, power and energy calculations, and the time domain sampling theorem. The basics of probability and random processes, including the key concepts of expected value, variance, characteristic functions, common probability distributions, autocorrelation, power spectral densities, wide sense stationarity, and ergodicity, are all developed in some detail. Many examples and problems are included to illustrate and examine these topics. • Provides developments of Fourier series and other orthogonal series • Presents fundamental Fourier transform properties and example applications • Discusses techniques for the analysis of continuous time linear systems in the time and frequency domains • Presents a fundamental development of probability and random variables • Develops the basic ideas of random processes including autocorrelation, power spectral densities, stationarity, and ergodicity
This book develops the basic concepts in understanding Analog Communications. Beginning with coverage of amplitude modulation, including the time and frequency domain representations of double sideband, single sideband, and vestigial sideband modulation, and introduces the student to the fundamental ideas of quadrature amplitude modulation, frequency division multiplexing, and digital communications using on-off keying. The author continues with additional discussion and coverage of the time and frequency domain representations of frequency and phase modulation, including bandwidth calculations, and the use of frequency shift keying, phase shift keying, and differential phase shift keying for the transmission of digital information. Contents include applications and further analyses of the effects of channel noise on amplitude, phase, and frequency modulation performance based on input versus output signal to noise ratios and some system comparisons are discussed.
Frontiers in Entropy Across the Disciplines presents a panorama of entropy emphasizing mathematical theory, physical and scientific significance, computational methods, and applications in mathematics, physics, statistics, engineering, biomedical signals, and signal processing.In the last century classical concepts of entropy were introduced in the areas of thermodynamics, information theory, probability theory, statistics, dynamical systems, and ergodic theory. During the past 50 years, dozens of new concepts of entropy have been introduced and studied in many disciplines. This volume captures significant developments in this arena. It features expository, review, and research papers by distinguished mathematicians and scientists from many disciplines. The level of mathematics ranges from intermediate level to research level. Each chapter contains a comprehensive list of references. Topics include entropy and society, entropy and time, Souriau entropy on symplectic model of statistical physics, new definitions of entropy, geometric theory of heat and information, maximum entropy in Bayesian networks, maximum entropy methods, entropy analysis of biomedical signals (review and comparison of methods), spectral entropy and its application to video coding and speech coding, a comprehensive review of 50 years of entropy in dynamics, a comprehensive review on entropy, entropy-like quantities and applications, topological entropy of multimodal maps, entropy production in complex systems, entropy production and convergence to equilibrium, reversibility and irreversibility in entropy, nonequilibrium entropy, index of various entropy, entropy and the greatest blunder ever.
This book describes the basic principles underlying the generation, coding, transmission and enhancement of speech and audio signals, including advanced statistical and machine learning techniques for speech and speaker recognition with an overview of the key innovations in these areas. Key research undertaken in speech coding, speech enhancement, speech recognition, emotion recognition and speaker diarization are also presented, along with recent advances and new paradigms in these areas.
Multimedia stands as one of the most challenging and exciting aspects of the information era. Although there are books available that deal with various facets of multimedia, the field has urgently needed a comprehensive look at recent developments in the systems, processing, and applications of image and video data in a multimedia environment.
