Almost Optimal Scaling of Reed-Muller Codes on BEC and BSC Channels
نویسندگان
چکیده
Consider a binary linear code of length N , minimum distance dmin, transmission over the binary erasure channel with parameter 0 < ǫ < 1 or the binary symmetric channel with parameter 0 < ǫ < 1 2 , and block-MAP decoding. It was shown by Tillich and Zemor that in this case the error probability of the block-MAP decoder transitions “quickly” from δ to 1− δ for any δ > 0 if the minimum distance is large. In particular the width of the transition is of order O(1/ √ dmin). We strengthen this result by showing that under suitable conditions on the weight distribution of the code, the transition width can be as small as Θ(1/N 1 2 −κ), for any κ > 0, even if the minimum distance of the code is not linear. This condition applies e.g., to Reed-Mueller codes. Since Θ(1/N 1 2 ) is the smallest transition possible for any code, we speak of “almost” optimal scaling. We emphasize that the width of the transition says nothing about the location of the transition. Therefore this result has no bearing on whether a code is capacity-achieving or not. As a second contribution, we present a new estimate on the derivative of the EXIT function, the proof of which is based on the Blowing-Up Lemma.
منابع مشابه
From Polar to Reed-Muller Codes: Unified Scaling, Non-standard Channels, and a Proven Conjecture
The year 2016, in which I am writing these words, marks the centenary of Claude Shannon, the father of information theory. In his landmark 1948 paper “A Mathematical Theory of Communication”, Shannon established the largest rate at which reliable communication is possible, and he referred to it as the channel capacity. Since then, researchers have focused on the design of practical coding schem...
متن کاملReed-Muller Codes Achieve Capacity on the Binary Erasure Channel under MAP Decoding
We show that Reed-Muller codes achieve capacity under maximum a posteriori bit decoding for transmission over the binary erasure channel for all rates 0 < R < 1. The proof is generic and applies to other codes with sufficient amount of symmetry as well. The main idea is to combine the following observations: (i) monotone functions experience a sharp threshold behavior, (ii) the extrinsic inform...
متن کاملEfficient list decoding of punctured Reed-Muller codes
The Reed-Muller (RM) code encoding n-variate degree-d polynomials over Fq for d < q, with its evaluation on Fq , has relative distance 1− d/q and can be list decoded from a 1−O( √ d/q) fraction of errors. In this work, for d ≪ q, we give a length-efficient puncturing of such codes which (almost) retains the distance and list decodability properties of the Reed-Muller code, but has much better r...
متن کاملCapacity Achieving Codes From Randomness Condensers
We give a general framework for construction of small ensembles of capacity achieving linear codes for a wide range of (not necessarily memoryless) discrete symmetric channels, and in particular, the binary erasure and symmetric channels. The main tool used in our constructions is the notion of randomness extractors and lossless condensers that are regarded as central tools in theoretical compu...
متن کاملBinary Linear Codes with Optimal Scaling and Quasi-Linear Complexity
We present the first family of binary codes that attains optimal scaling and quasi-linear complexity, at least for the binary erasure channel (BEC). In other words, for any fixed δ > 0, we provide codes that ensure reliable communication at rates within ε > 0 of the Shannon capacity with block length n = O(1/ε2+δ), construction complexity Θ(n), and encoding/decoding complexity Θ(n log n). Furth...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1801.09481 شماره
صفحات -
تاریخ انتشار 2018