Information Entropy and Mutual Information-based Uncertainty Measures in Rough Set Theory
نویسندگان
چکیده
منابع مشابه
Information Entropy and Mutual Information-based Uncertainty Measures in Rough Set Theory
As an extension of the classical set theory, rough set theory plays a crucial role in uncertainty measurement. In this paper, concepts of information entropy and mutual information-based uncertainty measures are presented in both complete and incomplete information/decision systems. Then, some important properties of these measures are investigated, relationships among them are established, and...
متن کاملInformation Theory 4.1 Entropy and Mutual Information
Neural encoding and decoding focus on the question: " What does the response of a neuron tell us about a stimulus ". In this chapter we consider a related but different question: " How much does the neural response tell us about a stimulus ". The techniques of information theory allow us to answer this question in a quantitative manner. Furthermore, we can use them to ask what forms of neural r...
متن کاملClustering of a Number of Genes Affecting in Milk Production using Information Theory and Mutual Information
Information theory is a branch of mathematics. Information theory is used in genetic and bioinformatics analyses and can be used for many analyses related to the biological structures and sequences. Bio-computational grouping of genes facilitates genetic analysis, sequencing and structural-based analyses. In this study, after retrieving gene and exon DNA sequences affecting milk yield in dairy ...
متن کاملInformation Entropy and Information Granulation-based Uncertainty Measures in Incomplete Information Systems
In this paper, concepts of information entropy and information granulation-based uncertainty measures are introduced in incomplete information/decision systems, and based on maximal consistent block technique, some variants of information entropy and information granulation are presented to measure the discernibility ability of an incomplete information system. Then, some important properties o...
متن کاملInformation Theory: Data Compression, Channel Coding, Entropy, and Mutual Information
This report gives an insight about two major aspects of information theory, including data compression and channel coding. It discusses the simulations results obtained using MATLAB from the information theory view point. It also defines these aspects by using the definitions of entropy and mutual information which reflects the optimum data compression could be obtained and the ultimate transmi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Mathematics & Information Sciences
سال: 2014
ISSN: 1935-0090,2325-0399
DOI: 10.12785/amis/080456