27 Open Problems in Kolmogorov Complexity

نویسندگان

چکیده

This formula can be informally read as follows: the ith messagemi brings us log(1=pi) "bits of information" (whatever this means), and appears with frequency pi, so H is expected amount information provided by one random message (one sample variable). Moreover, we construct an optimal uniquely decodable code that requires about (at most + 1, to exact) bits per on average, it encodes approximately bits, following natural idea use short codewords for frequent messages. fits well informal reading given above, tempting say "contains information." Shannon himself succumbed temptation [46, p. 399] when he wrote entropy estimates considers Basic English James Joyces's book "Finnegan's Wake" two extreme examples high low redundancy in texts. But, strictly speaking, speak only entropies variables, not their individual values, a variable, just specific string. Can define objects?

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Kolmogorov complexity in perspective

We survey the diverse approaches to the notion of information content: from Shannon entropy to Kolmogorov complexity. The main applications of Kolmogorov complexity are presented: namely, the mathematical notion of randomness (which goes back to the 60’s with the work of MartinLöf, Schnorr, Chaitin, Levin), and classification, which is a recent idea with provocative implementation by Vitanyi an...

متن کامل

Time - Bounded Kolmogorov Complexity in Complexity Theory

This paper presents one method of using time-bounded Kol-mogorov complexity as a measure of the complexity of sets, and outlines a number of applications of this approach to diierent questions in complexity theory. Connections will be drawn among the following topics: NE predicates, ranking functions, pseudorandom generators, and hierarchy theorems in circuit complexity.

متن کامل

Kolmogorov Complexity Arguments in Combinatorics

The utility of a Kolmogorov complexity method in combinatorial theory is demonstrated by several examples.

متن کامل

Chapter 19 Kolmogorov Complexity

Kolmogorov complexity has intellectual roots in the areas of information theory, computability theory and probability theory. Despites its remarkably simple basis, it has some striking applications in Complexity Theory. The subject was developed by the Russian mathematician Andrei N. Kolmogorov (1903–1987) as an approach to the notion of random sequences and to provide an algorithmic approach t...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: SIGACT news

سال: 2021

ISSN: ['1943-5827', '0163-5700']

DOI: https://doi.org/10.1145/3510382.3510389