Rényi entropy yields artificial biases not in the data and incorrect updating due to the finite-size data

Thomas Oikonomou, G. Baris Bagci

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

We show that the Rényi entropy implies artificial biases not warranted by the data and incorrect updating information due to the finite size of the data despite being additive. It is demonstrated that this is so because it does not conform to the system and subset independence axioms of Shore and Johnson [J. IEEE Trans. Inf. Theory 26, 26 (1980)IETTAW0018-944810.1109/TIT.1980.1056144]. We finally show that the escort averaged constraints do not remedy the situation.

Original languageEnglish
Article number032134
JournalPhysical Review E
Volume99
Issue number3
DOIs
Publication statusPublished - Mar 27 2019

Fingerprint

axioms
set theory
Updating
Entropy
entropy
Axioms
Imply
Subset
Independence

ASJC Scopus subject areas

  • Statistical and Nonlinear Physics
  • Statistics and Probability
  • Condensed Matter Physics

Cite this

Rényi entropy yields artificial biases not in the data and incorrect updating due to the finite-size data. / Oikonomou, Thomas; Bagci, G. Baris.

In: Physical Review E, Vol. 99, No. 3, 032134, 27.03.2019.

Research output: Contribution to journalArticle

@article{f6ee65cc5e4a42799664e0860dc49870,
title = "R{\'e}nyi entropy yields artificial biases not in the data and incorrect updating due to the finite-size data",
abstract = "We show that the R{\'e}nyi entropy implies artificial biases not warranted by the data and incorrect updating information due to the finite size of the data despite being additive. It is demonstrated that this is so because it does not conform to the system and subset independence axioms of Shore and Johnson [J. IEEE Trans. Inf. Theory 26, 26 (1980)IETTAW0018-944810.1109/TIT.1980.1056144]. We finally show that the escort averaged constraints do not remedy the situation.",
author = "Thomas Oikonomou and Bagci, {G. Baris}",
year = "2019",
month = "3",
day = "27",
doi = "10.1103/PhysRevE.99.032134",
language = "English",
volume = "99",
journal = "Physical review. E",
issn = "2470-0045",
publisher = "American Physical Society",
number = "3",

}

TY - JOUR

T1 - Rényi entropy yields artificial biases not in the data and incorrect updating due to the finite-size data

AU - Oikonomou, Thomas

AU - Bagci, G. Baris

PY - 2019/3/27

Y1 - 2019/3/27

N2 - We show that the Rényi entropy implies artificial biases not warranted by the data and incorrect updating information due to the finite size of the data despite being additive. It is demonstrated that this is so because it does not conform to the system and subset independence axioms of Shore and Johnson [J. IEEE Trans. Inf. Theory 26, 26 (1980)IETTAW0018-944810.1109/TIT.1980.1056144]. We finally show that the escort averaged constraints do not remedy the situation.

AB - We show that the Rényi entropy implies artificial biases not warranted by the data and incorrect updating information due to the finite size of the data despite being additive. It is demonstrated that this is so because it does not conform to the system and subset independence axioms of Shore and Johnson [J. IEEE Trans. Inf. Theory 26, 26 (1980)IETTAW0018-944810.1109/TIT.1980.1056144]. We finally show that the escort averaged constraints do not remedy the situation.

UR - http://www.scopus.com/inward/record.url?scp=85064077784&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85064077784&partnerID=8YFLogxK

U2 - 10.1103/PhysRevE.99.032134

DO - 10.1103/PhysRevE.99.032134

M3 - Article

AN - SCOPUS:85064077784

VL - 99

JO - Physical review. E

JF - Physical review. E

SN - 2470-0045

IS - 3

M1 - 032134

ER -