Maximization of statistical heterogeneity: From Shannon’s entropy to Gini’s index

• Published in: Physica A Vol. 389; no. 16; pp. 3023 - 3038
• Main Authors: Eliazar, Iddo, Sokolov, Igor M.
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 15.08.2010
• Subjects: Dispersion; Dispersions; Economics; Egalitarianism; Entropy; Gages; Gini’s index; Heterogeneity; Laws; Maximization; Shannon’s entropy; Statistical heterogeneity; Statistical mechanics; Subbotin’s distribution; The logistic distribution; Statistical heterogeneity; Shannon’s entropy; Gini’s index; Subbotin’s distribution; Entropy; The logistic distribution; Egalitarianism; Dispersion
• ISSN: 0378-4371; 1873-2119
• DOI: 10.1016/j.physa.2010.03.045

Different fields of Science apply different quantitative gauges to measure statistical heterogeneity. Statistical Physics and Information Theory commonly use Shannon’s entropy which measures the randomness of probability laws, whereas Economics and the Social Sciences commonly use Gini’s index which measures the evenness of probability laws. Motivated by the principle of maximal entropy, we explore the maximization of statistical heterogeneity–for probability laws with a given mean–in the four following scenarios: (i) Shannon entropy maximization subject to a given dispersion level; (ii) Gini index maximization subject to a given dispersion level; (iii) Shannon entropy maximization subject to a given Gini index; (iv) Gini index maximization subject to a given Shannon entropy. Analysis of these four scenarios results in four different classes of heterogeneity-maximizing probability laws–yielding an in-depth description of both the marked differences and the interplay between the Physical “randomness-based” and the Economic “evenness-based” approaches to the maximization of statistical heterogeneity.