Low-Complexity Decoding of Low-Density Parity Check Codes Through Optimal Quantization and Machine Learning and Optimal Modulation and Coding for Short Block-Length Transmissions

Low-Complexity Decoding of Low-Density Parity Check Codes Through Optimal Quantization and Machine Learning and Optimal Modulation and Coding for Short Block-Length Transmissions

Author: Linfang Wang

Publisher:

Published: 2023

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

This dissertation investigates two topics in channel coding theory: low-complexity decoder design for low-density parity-check (LDPC) codes and reliable communication in the short blocklength regime. For the first topic, we propose a finite-precision decoding method that features the three steps of Reconstruction, Computation, and Quantization (RCQ). The parameters of the RCQ decoder, for both the flooding-scheduled and the layered-scheduled, can be designed efficiently using discrete density evolution featuring hierarchical dynamic quantization (HDQ). To further reduce the hardware usage of the RCQ decoder, we propose a second RCQ framework called weighted RCQ (W-RCQ). Unlike the RCQ decoder, whose quantization and reconstruction parameters change in each layer and iteration, the W-RCQ decoder limits the number of quantization and reconstruction functions to a very small number during the decoding process, for example, three or four. However, the W-RCQ decoder weights check-to-variable node messages using dynamic parameters optimized by a quantized neural network. The proposed W-RCQ decoder uses fewer parameters than the RCQ decoder, thus requiring much fewer resources such as lookup tables. For the second topic, we apply probabilistic amplitude shaping (PAS) to cyclic redundancy check (CRC)-aided tail-biting trellis-coded modulation (TCM). CRC-TCM-PAS produces practical codes for short block lengths on the additive white Gaussian noise (AWGN) channel. In the transmitter, equally likely message bits are encoded by a distribution matcher (DM), generating amplitude symbols with a desired distribution.A CRC is appended to the sequence of amplitude symbols, and this sequence is then encoded and modulated by TCM to produce real-valued channel input signals. We prove that the sign values produced by the TCM are asymptotically equally likely to be positive or negative. The CRC-TCM-PAS scheme can thus generate channel input symbols with a symmetric capacity-approaching probability mass function. We also provide an analytical upper bound on the frame error rate of the CRC-TCM-PAS system over the AWGN channel. This FER upper bound is the objective function for jointly optimizing the CRC and convolutional code. This paper also proposes a multi-composition DM, a collection of multiple constant-composition DMs. The optimized CRC-TCM-PAS systems achieve frame error rates below the random coding union (RCU) bound in AWGN and outperform the short-blocklength PAS systems with various other forward error correction codes.


Good Families of Quantum Low-density Parity-check Codes and a Geometric Framework for the Amplitude-damping Channel

Good Families of Quantum Low-density Parity-check Codes and a Geometric Framework for the Amplitude-damping Channel

Author: Reina Riemann

Publisher:

Published: 2011

Total Pages: 70

ISBN-13:

DOWNLOAD EBOOK

Classical low-density parity-check (LDPC) codes were first introduced by Robert Gallager in the 1960's and have reemerged as one of the most influential coding schemes. We present new families of quantum low-density parity-check error-correcting codes derived from regular tessellations of Platonic 2-manifolds and from embeddings of the Lubotzky-Phillips-Sarnak Ramanujan graphs. These families of quantum error-correcting codes answer a conjecture proposed by MacKay about the existence of good families of quantum low-density parity-check codes with nonzero rate, increasing minimum distance and a practical decoder. For both families of codes, we present a logarithmic lower bound on the shortest noncontractible cycle of the tessellations and therefore on their distance. Note that a logarithmic lower bound is the best known in the theory of regular tessellations of 2-manifolds. We show their asymptotic sparsity and non-zero rate. In addition, we show their decoding performance with simulations using belief propagation. Furthermore, we present a general geometrical model to design non-additive quantum error-correcting codes for the amplitude-damping channel. Non-additive quantum error-correcting codes are more general than stabilizer or additive quantum errorcorrecting codes, and in some cases non-additive quantum codes are more optimal. As an example, we provide an 8-qubit amplitude-damping code, which can encode 1 qubit and correct for 2 errors. This violates the quantum Hamming bound which requires that its length start at 9.


Weight Distributions and Constructions of Low-density Parity-check Codes

Weight Distributions and Constructions of Low-density Parity-check Codes

Author: Chung-Li Wang

Publisher:

Published: 2010

Total Pages:

ISBN-13: 9781124223643

DOWNLOAD EBOOK

Low-density parity-check (LDPC) codes are currently the most promising coding technique to achieve the Shannon capacities for a wide range of channels. These codes were first discovered by Gallager in 1962 and then rediscovered in late 1990's. Ever since their rediscovery, a great deal of research effort has been expended in design, construction, encoding, decoding, performance analysis, generalizations, and applications of LDPC codes. This research is set up to investigate two major aspects of LDPC codes: weight distributions and code constructions. The research focus of the first part is to analyze the asymptotic weight distributions of various ensembles. Analysis shows that for generalized LDPC (G-LDPC) and doubly generalized LDPC (DG-LDPC) code ensembles with some conditions, the average minimum distance grows linearly with the code length. This implies that both ensembles contain good codes. The effect of changing the component codes of the ensemble on the minimum distance is clarified. The computation of asymptotic weight and stopping set enumerators is improved. Furthermore, the average weight distribution of a multi-edge type code ensemble is investigated to obtain its upper and lower bounds. Based on them, the growth rate of the number of codewords is defined. For the growth rate of codewords with small linear, logarithmic, and constant weights, the approximations are given with two critical coefficients. It is shown that for infinite code length, the properties of the weight distribution are determined by its asymptotic growth rate. The second part of the research emphasizes specific designs and constructions of LDPC codes that not only perform well but can also be efficiently encoded. One such construction is the serial concatenation of an LDPC outer code and an accumulator with an interleaver. Such construction gives a code called an LDPCA code. The study shows that well designed LDPCA codes perform just as well as the regular LDPC codes. It also shows that the asymptotic minimum distance of regular LDPCA codes grows linearly with the code length.


Low-complexity Near-maximum-likelihood Multiuser Detection and LDPC Channel Coding

Low-complexity Near-maximum-likelihood Multiuser Detection and LDPC Channel Coding

Author:

Publisher:

Published: 2005

Total Pages: 105

ISBN-13:

DOWNLOAD EBOOK

In digital communication systems, maximum likelihood (ML) multiuser detection and decoding of linear block codes translate to similar basic combinatorial optimization problems with complexity exponential in the number of users or code size, respectively. Development of low-complexity high-performance sub-optimum solutions is of great practical interest. In this dissertation, we establish that the performance of the ML optimum multi-user detector can be approached efficiently and effectively as follows. First, we use a multiuser zero-forcing or minimum-mean-square-error (MMSE) linear filter as a pre-processor. The output magnitudes of the pre-processor, when properly scaled, provide a reliability measure for each user bit decision. Then, we produce and execute an ordered reliability-based error search sequence of length linear in the number of users which returns the most likely user bit vector among all visited options. Extensive simulation studies support these theoretical developments and indicate that the error performance of the optimum and the proposed detector are nearly indistinguishable over the whole pre-detection signal-to-noise ratio (SNR) range of practical interest. A low-complexity algorithm for the decoding of low-density parity-check (LDPC) codes is also developed. The algorithm is oriented specifically toward the low cost & mdash;yet effective & mdash;decoding of (high rate) finite geometry LDPC codes. The decoding procedure updates the hard-decision received vector iteratively in search of a valid codeword in the vector space. Only one bit is changed in each iteration and the bit selection criterion combines the number of failed checks and the reliability of the received bits. Prior knowledge of the signal amplitude and noise power is not required. An optional mechanism to avoid infinite loops in the search is also proposed. The algorithm achieves an appealing trade-off between performance and complexity for finite geometry LDPC codes. In addition, some new properties of generalized polygon LDPC codes are reported. We show formally that when the diameter is four or six or eight all codewords have even Hamming weight. When the generalized polygon has in addition equal number of points and lines, we see that the non-regular polygon based code construction has minimum distance that is higher at least by two in comparison with the dual regular polygon code of the same rate and length. A new minimum distance bound is presented for these codes. Finally, we prove that all codes derived from finite classical generalized quadrangles are quasi-cyclic and give the explicit size of circulant blocks in the parity check matrix.


Algebraic Low-density Parity-check Codes

Algebraic Low-density Parity-check Codes

Author: Qiuju Diao

Publisher:

Published: 2013

Total Pages:

ISBN-13: 9781303442414

DOWNLOAD EBOOK

The ever-growing needs for cheaper, faster, and more reliable communication systems have forced many researchers to seek means to attain the ultimate limits on reliable communications. Low densityparity-check (LDPC) codes are currently the most promising coding technique to achieve the Shannon capacities for a wide range of channels. Many LDPC codes have been chosen as the standard codes for various next generations of communication systems and they are appearing in recent data storage products. More applications are expected to come.Major methods for constructing LDPC codes can be divided into two general categories, graphtheoretic-based methods (using computer search) and algebraic methods. Each type of constructions has its advantages and disadvantages in terms overall error performance, encoding and decoding implementations. In general, algebraically constructed LDPC codes have lower error-floor and their decoding using iterative message-passing algorithms converges at a much faster rate than the LDPC codes constructed using a graph theoretic-based method. Furthermore, it is much easier to constructalgebraic LDPC codes with large minimum distances.This research project is set up to investigate several important aspects of algebraic LDPC codes for the purpose of achieving overall good error performance required for future high-speed communication systems and high-density data storage systems. The subjects to be investigated include: (1) new constructions of algebraic LDPC codes based on finite geometries; (2) analysis of structural properties of algebraic LDPC codes, especially the trapping set structure that determines how lowthe error probability of a given LDPC code can achieve; (3) construction of algebraic LDPC codes and design coding techniques for correcting combinations of random errors and erasures that occursimultaneously in many physical communication and storage channels; and (4) analysis and construction of algebraic LDPC codes in transform domain.Research effort has resulted in important findings in all four proposed research subjects which may have a significant impact on future generations of communication and storage systems andadvance the state-of-the-art of channel coding theory.


Multimedia Content Analysis and Mining

Multimedia Content Analysis and Mining

Author: Nicu Sebe

Publisher: Springer

Published: 2007-07-10

Total Pages: 526

ISBN-13: 3540734171

DOWNLOAD EBOOK

Prominent international experts came together to present and debate the latest findings in the field at the 2007 International Workshop on Multimedia Content Analysis and Mining. This volume includes forty-six papers from the workshop as well as thirteen invited papers. The papers cover a wide range of cutting-edge issues, including all aspects of multimedia in the fields of entertainment, commerce, science, medicine, and public safety.