Computer Science > Information Theory
[Submitted on 26 Jan 2017 (v1), last revised 10 Nov 2017 (this version, v3)]
Title:Coarse-graining and the Blackwell order
View PDFAbstract:Suppose we have a pair of information channels, $\kappa_{1},\kappa_{2}$, with a common input. The Blackwell order is a partial order over channels that compares $\kappa_{1}$ and $\kappa_{2}$ by the maximal expected utility an agent can obtain when decisions are based on the channel outputs. Equivalently, $\kappa_{1}$ is said to be Blackwell-inferior to $\kappa_{2}$ if and only if $\kappa_{1}$ can be constructed by garbling the output of $\kappa_{2}$. A related partial order stipulates that $\kappa_{2}$ is more capable than $\kappa_{1}$ if the mutual information between the input and output is larger for $\kappa_{2}$ than for $\kappa_{1}$ for any distribution over inputs. A Blackwell-inferior channel is necessarily less capable. However, examples are known where $\kappa_{1}$ is less capable than $\kappa_{2}$ but not Blackwell-inferior. We show that this may even happen when $\kappa_{1}$ is constructed by coarse-graining the inputs of $\kappa_{2}$. Such a coarse-graining is a special kind of "pre-garbling" of the channel inputs. This example directly establishes that the expected value of the shared utility function for the coarse-grained channel is larger than it is for the non-coarse-grained channel. This contradicts the intuition that coarse-graining can only destroy information and lead to inferior channels. We also discuss our results in the context of information decompositions.
Submission history
From: Pradeep Kr. Banerjee [view email][v1] Thu, 26 Jan 2017 07:50:20 UTC (129 KB)
[v2] Thu, 9 Nov 2017 14:20:39 UTC (150 KB)
[v3] Fri, 10 Nov 2017 13:04:29 UTC (150 KB)
Bibliographic and Citation Tools
Bibliographic Explorer (What is the Explorer?)
Connected Papers (What is Connected Papers?)
Litmaps (What is Litmaps?)
scite Smart Citations (What are Smart Citations?)
Code, Data and Media Associated with this Article
alphaXiv (What is alphaXiv?)
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub (What is DagsHub?)
Gotit.pub (What is GotitPub?)
Hugging Face (What is Huggingface?)
Papers with Code (What is Papers with Code?)
ScienceCast (What is ScienceCast?)
Demos
Recommenders and Search Tools
Influence Flower (What are Influence Flowers?)
CORE Recommender (What is CORE?)
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.