Channel Coding Techniques for Scaling Modern Data-Driven Applications

Channel Coding Techniques for Scaling Modern Data-Driven Applications

Author: Debarnab Mitra

Publisher:

Published: 2023

Total Pages: 0

ISBN-13:

DOWNLOAD EBOOK

Channel coding theory offers advanced mathematical techniques that have proven to be highly effective at improving the reliability of traditional communication systems such as wireless communication, storage in memories, and many more. However, modern data driven applications such as blockchains and quantum communications encounter a new set of challenges resulting in new metrics of concerns, e.g., storage requirements, communication costs, security, data rates, etc., compared to traditional systems. These new metrics necessitate new and specialized channel code designs to improve the performance of these systems. In this dissertation, we aim to mitigate the challenges encountered in certain widely used data-driven applications viz. blockchains and quantum communications by designing specialized channel codes that are tailor-made for each specific application. The first line of the dissertation is focused on specialized Low-Density Parity-Check (LDPC) code design to mitigate challenges present in blockchain systems. These systems are known to suffer from a security vulnerability known as Data Availability (DA) Attacks where system users accept an invalid block with unavailable portions. Existing work focused on utilizing random LDPC codes and 2D Reed-Solomon (2D-RS) codes to mitigate DA attacks. Although effective, these codes are not necessarily optimal for this application, especially for blockchains with small block sizes. For these types of blockchains, we propose a co-design of specialized LDPC codes and code word sampling strategies to result in good system performance in terms of DA detection probability and communication cost. We devise our co-design techniques to tackle adversaries of varying strengths and demonstrate that they result in a higher probability of detection of DA attacks and lower communication cost compared to approaches in earlier literature. The second line of the dissertation is focused on specialized polar code design to mitigate DA attacks in blockchains with large block sizes. Previously used 2D-RS codes and LDPC codes are difficult to apply to blockchains with large block sizes due to their large decoding complexity and coding fraud proof size (2D-RS codes), and intractable code guarantees for large code lengths (LDPC codes). To mitigate DA attacks in blockchains with large block sizes, we propose a novel data structure called Graph Coded Merkle Tree (GCMT): a Merkle tree encoded using the encoding graph of polar codes. Additionally, we propose a specialized polar code design algorithm for the GCMT. We demonstrate that the GCMTbuild using the above specialized polar codes simultaneously performs well in the various performance metrics relevant to DA attacks at large block sizes including DA detection probability, communication cost, tractable code guarantees, and decoding complexity. The third line of the dissertation is focused on an important application in quantum communication known as Quantum Key Distribution (QKD). QKD aims to provide private keys to multiple users at a large key generation rate. LDPC codes have been previously utilized to extract private keys in QKD. However, the existing LDPC codes do not fully utilize the properties of the QKD channel to optimize the key rates. In this dissertation, we propose novel and specialized channel coding techniques to result in high key generation rates in QKD systems. Firstly, we propose a joint code rate and LDPC code design algorithm that is tailored to use the properties of the QKD channel for high key rates. Secondly, we propose an interleaved decoding algorithm to extract the private key from raw quantum data. We demonstrate that the above techniques significantly improve the private key generation rate in QKD systems compared to approaches in earlier literature.


Application-Driven Coding Techniques

Application-Driven Coding Techniques

Author: Siyi Yang

Publisher:

Published: 2021

Total Pages: 195

ISBN-13:

DOWNLOAD EBOOK

Data-driven applications are becoming ubiquitous. This dissertation is focused on developing advanced channel coding techniques for improved reliability and latency in a variety of data-hungry applications, from cloud storage, to memory devices, and quantum communications. The first line of our work focused on cloud storage. In order to accommodate the ever-growing data from various, possibly independent, sources and the dynamic nature of data usage rates in practical applications, modern cloud data storage systems are required to be scalable, flexible, and heterogeneous. The recent rise of the blockchain technology is also moving various information systems towards decentralization to achieve high privacy at low costs. We proposed channel codes with hierarchical locality that were the first to simultaneously achieve scalability and flexibility for both centralized cloud storage and decentralized storage networks (DSN). In particular, we proposed a joint coding scheme where each node receives extra protection through the cooperation with nodes in its neighborhood in a heterogeneous DSN with any given topology. Our proposed construction not only preserves desirable properties such as scalability and flexibility, which are critical in dynamic networks, but also adapts to arbitrary topologies, a property that is essential in DSNs but has been overlooked in existing works. The second line of our work focused on spatially-coupled (SC) codes design for advanced memory devices and quantum communications. SC codes have demonstrated potential in a variety of applications thanks to their excellent error-correcting performance and desirable structures that enable low latency decoding. While high memory SC codes are known to have superior performance, no prior work was able to produce practical codes due to computational complexity of the high-memory regime. We overcome this computational bottleneck in the finite-length construction of high-performance SC codes with high memory, with a novel coding framework that unifies seemingly disparate probabilistic and combinatorial approaches, and benefits from both. Simulation results show that codes obtained through our proposed method notably outperform state-of-the-art codes in a variety of practical settings, including flash memories and hard disk drives. Building on this new framework, we then developed a new class of channel codes for quantum communications. Combined with irregular-repeat-accumulate (IRA) codes that are known for excellent performance on low rate region, we constructed state-of-the-art SC-IRA codes for multidimensional quantum key distribution to efficiently generate private keys for one-time pad encrypted communications.


Contemporary Coding Techniques and Applications for Mobile Communications

Contemporary Coding Techniques and Applications for Mobile Communications

Author: Onur Osman

Publisher: CRC Press

Published: 2009-05-07

Total Pages: 362

ISBN-13: 1420054627

DOWNLOAD EBOOK

Modern error control coding methods based on turbo coding have essentially solved the problem of reliable data communications over noisy channels. Contemporary Coding Techniques and Applications for Mobile Communications provides a clear, comprehensive, and practical grounding on the subject matter, examining the fundamentals, theory, and ap


Channel Coding Techniques for Wireless Communications

Channel Coding Techniques for Wireless Communications

Author: K. Deergha Rao

Publisher: Springer Nature

Published: 2019-11-22

Total Pages: 484

ISBN-13: 9811505616

DOWNLOAD EBOOK

This book discusses the latest channel coding techniques, MIMO systems, and 5G channel coding evolution. It provides a comprehensive overview of channel coding, covering modern techniques such as turbo codes, low-density parity-check (LDPC) codes, space–time coding, polar codes, LT codes, and Raptor codes as well as the traditional codes such as cyclic codes, BCH, RS codes, and convolutional codes. It also explores MIMO communications, which is an effective method for high-speed or high-reliability wireless communications. It also examines the evolution of 5G channel coding techniques. Each of the 13 chapters features numerous illustrative examples for easy understanding of the coding techniques, and MATLAB-based programs are integrated in the text to enhance readers’ grasp of the underlying theories. Further, PC-based MATLAB m-files for illustrative examples are included for students and researchers involved in advanced and current concepts of coding theory.


Designing Data-Intensive Applications

Designing Data-Intensive Applications

Author: Martin Kleppmann

Publisher: "O'Reilly Media, Inc."

Published: 2017-03-16

Total Pages: 658

ISBN-13: 1491903104

DOWNLOAD EBOOK

Data is at the center of many challenges in system design today. Difficult issues need to be figured out, such as scalability, consistency, reliability, efficiency, and maintainability. In addition, we have an overwhelming variety of tools, including relational databases, NoSQL datastores, stream or batch processors, and message brokers. What are the right choices for your application? How do you make sense of all these buzzwords? In this practical and comprehensive guide, author Martin Kleppmann helps you navigate this diverse landscape by examining the pros and cons of various technologies for processing and storing data. Software keeps changing, but the fundamental principles remain the same. With this book, software engineers and architects will learn how to apply those ideas in practice, and how to make full use of data in modern applications. Peer under the hood of the systems you already use, and learn how to use and operate them more effectively Make informed decisions by identifying the strengths and weaknesses of different tools Navigate the trade-offs around consistency, scalability, fault tolerance, and complexity Understand the distributed systems research upon which modern databases are built Peek behind the scenes of major online services, and learn from their architectures


Channel Coding Strategies for Emerging Data Storage Systems

Channel Coding Strategies for Emerging Data Storage Systems

Author: Ryan Christopher Gabrys

Publisher:

Published: 2014

Total Pages: 179

ISBN-13:

DOWNLOAD EBOOK

The on-going data revolution demands storage systems that can store very large quantities of data while being fast, reliable and cheap. Emerging storage technologies such as flash and granular media offer improved densities, faster access times, and are more power-efficient than conventional hard disk drives. The primary drawback associated with these new devices is their high error rate, caused by difficulties in programming, voltage drift, and wear-out. Coding methods used in existing storage applications are based on symmetric, Hamming-type metrics. However, when used in new memory devices, these traditional approaches result in costly overprovisioning. In this work, we present advanced coding-theoretic techniques applicable to modern storage devices that exploit the asymmetries in the underlying physical operations for improved performance. In many cases of interest, the results in this thesis represent the state of the art. Taken collectively, our results can help enable all modern, data-intensive technologies that require reliably storing large quantities of data.


Channel Coding: Theory, Algorithms, and Applications

Channel Coding: Theory, Algorithms, and Applications

Author:

Publisher: Academic Press

Published: 2014-07-29

Total Pages: 687

ISBN-13: 012397223X

DOWNLOAD EBOOK

This book gives a review of the principles, methods and techniques of important and emerging research topics and technologies in Channel Coding, including theory, algorithms, and applications. Edited by leading people in the field who, through their reputation, have been able to commission experts to write on a particular topic. With this reference source you will: Quickly grasp a new area of research Understand the underlying principles of a topic and its applications Ascertain how a topic relates to other areas and learn of the research issues yet to be resolved Quick tutorial reviews of important and emerging topics of research in Channel Coding Presents core principles in Channel Coding theory and shows their applications Reference content on core principles, technologies, algorithms and applications Comprehensive references to journal articles and other literature on which to build further, more specific and detailed knowledge


Channel Codes

Channel Codes

Author: William E. Ryan

Publisher: Cambridge University Press

Published: 2024-08-31

Total Pages: 0

ISBN-13: 9781009335904

DOWNLOAD EBOOK