The use of information and information gain in the analysis of attribute dependencies

This paper demonstrates the possible conclusions which can be drawn from an analysis of entropy and information. Because of its universality, entropy can be widely used in different subjects, especially in biomedicine. Based on simulated data the similarities and differences between the grouping of...

Full description

Saved in:
Bibliographic Details
Published inBiometrical Letters Vol. 49; no. 2; pp. 149 - 158
Main Authors Moliński, Krzysztof, Dobek, Anita, Tomaszyk, Kamila
Format Journal Article
LanguageEnglish
Published Poznan Versita 01.12.2012
De Gruyter Brill Sp. z o.o., Paradigm Publishing Services
Subjects
dendrogram
entropy
information gain
Online AccessGet full text
ISSN1896-3811
2199-577X
2199-577X
DOI10.2478/bile-2013-0011

Cover

More Information
Summary:This paper demonstrates the possible conclusions which can be drawn from an analysis of entropy and information. Because of its universality, entropy can be widely used in different subjects, especially in biomedicine. Based on simulated data the similarities and differences between the grouping of attributes and testing of their independencies are shown. It follows that a complete exploration of data sets requires both of these elements. A new concept introduced in this paper is that of normed information gain, allowing the use of any logarithm in the definition of entropy.
Bibliography:istex:303D32A09773700FFCA68F1C695D1A45AC747781
ark:/67375/QT4-19M6CJLN-L
ArticleID:bile-2013-0011
bile-2013-0011.pdf
ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1896-3811
2199-577X
2199-577X
DOI:10.2478/bile-2013-0011