Algorithmic Information Theory Using Kolmogorov Complexity
نویسندگان
چکیده
منابع مشابه
Algorithmic Information Theory and Kolmogorov Complexity
This document contains lecture notes of an introductory course on Kolmogorov complexity. They cover basic notions of algorithmic information theory: Kolmogorov complexity (plain, conditional, prefix), notion of randomness (Martin-Löf randomness, Mises–Church randomness), Solomonoff universal a priori probability and their properties (symmetry of information, connection between a priori probabil...
متن کاملAlgorithmic “Kolmogorov” Complexity
The information content or complexity of an object can be measured by the length of its shortest description. For instance the string ‘01010101010101010101010101010101’ has the short description “16 repetitions of 01”, while ‘11001000011000011101111011101100’ presumably has no simpler description other than writing down the string itself. More formally, the Algorithmic “Kolmogorov” Complexity (...
متن کاملKolmogorov Complexity and Algorithmic Randomness
This paper aims to provide a minimal introduction to algorithmic randomness. In particular, we cover the equivalent 1-randomness and MartinLöf randomness. After a brief review of relevant concepts in computability, we develop the basic theory of Kolmogorov complexity, including the KC theorem and more general notion of information content measures. We then build two natural definitions of rando...
متن کاملAlgorithmic Information Theory and Computational Complexity
We present examples where theorems on complexity of computation are proved using methods in algorithmic information theory. The first example is a non-effective construction of a language for which the size of any deterministic finite automaton exceeds the size of a probabilistic finite automaton with a bounded error exponentially. The second example refers to frequency computation. Frequency c...
متن کاملKolmogorov Complexity in perspective. Part I: Information Theory and Randomnes
We survey diverse approaches to the notion of information: from Shannon entropy to Kolmogorov complexity. Two of the main applications of Kolmogorov complexity are presented: randomness and classification. The survey is divided in two parts in the same volume. Part I is dedicated to information theory and the mathematical formalization of randomness based on Kolmogorov complexity. This last app...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Applied & Computational Mathematics
سال: 2012
ISSN: 2168-9679
DOI: 10.4172/2168-9679.1000e106