Sechelea, A. (2017). Binary Source Coding with Side Information. [PhD Thesis, Vrije Universiteit Brussel].

@phdthesis{6f28e2246a62428399ec4dae497a1c9b,
title = "Binary Source Coding with Side Information",
abstract = "The goal of an information transmission system is to get a message passed from source to destination. The realization that information can be consistently represented in binary form, i.e. using only 0{\textquoteright}s and 1{\textquoteright}s, led to mathematical formulations describing the characteristics of such a transmission system. Their design implies finding an appropriate trade-off between costs of transmission and quality of the received message. Point-to-point communications assume a setup formed from one sender which encodes the message to be sent, and one receiver that will decode the message. In practical applications however, it is often the case that multiple sources must send information to a unique destination. Slepian-Wolf (SW) coding, which is concerned with separate lossless compression of correlated sources with joint decoding, forms the basis of distributed source coding (DSC) and can be used to exploit the correlation among quantized sources in lossy DSC problems such as Wyner-Ziv (WZ) coding and multiterminal (MT) source coding. The SW theory states that the coding performances of a system performing independent encoding and joint decoding of two correlated sources are the same with the case when the two sources are jointly encoded and decoded. A practical development of the above information theoretical facts is the distributed video coding (DVC) framework which allows to move the computation complexity from the encoder – which is usually facing computational constraints – to the decoder. This recent field of research has shown increased interesting for a wide range of applications, such as video surveillance, real-time streaming from multiple cameras, and immersive communications in general. The ultimate goal of this dissertation is to provide a complete analysis of the binary Wyner-Ziv coding problem. As a preamble, the introductory chapters of the manuscript situate the topic of research within the generic information theory spectrum and introduce the fundaments and concepts required for the understanding of the main contributions. We begin by making a clear distinction between point-to-point and multi-terminal coding scenarios; as such the already existing theoretical analysis regarding the generic SW and WZ setups are detailed in Chapter 2. Following the path of our research all the way back to its initial justifying argument, i.e., asymmetric correlation models in DVC, Chapter 3 explores the basics of predictive video coding in comparison to the classical DVC architectures. We capture the essential difference between the two paradigms, namely, the presence/absence of side-information at the encoder, and justify the importance of our subsequent derivations. The following three chapters are dedicated to a detailed exposition of the contributions of the thesis. Chapter 4 presents the analytical derivation of the rate-distortion function for binary source coding with encoder-decoder side-information. This corresponds to predictive coding, and its derivation is of high importance, as this represents the absolute lower bound for WZ coding. Chapter 5 presents the actual derivation of the proposed rate-distortion bound for the binary WZ coding setup. The input of the problem assumes a binary source generic source, which may be non-uniform, the side information is known to be obtained considering a generic binary correlation channel which is binary asymmetric (BAC) and the Hamming distance is the distortion metric. This problem is proven not to admit an analytical solution, and as a consequence, the proposed solution is numerical. We describe strategies to achieve all",
keywords = "decoding",
author = "Andrei Sechelea",
year = "2017",
language = "English",
school = "Vrije Universiteit Brussel",
}