arXiv preprint ·
Gaussian BROJA Partial Information Decomposition in Closed Form
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
Abstract
The BROJA partial information decomposition provides an operationally motivated way to separate the information that two sources carry about a target into unique, redundant, and synergistic components. For continuous and high-dimensional variables, however, computing the BROJA decomposition requires solving a difficult optimization problem. Previous work showed that, when each source-target pair is jointly Gaussian, the problem can be reduced to finite-dimensional numerical optimization. Here, we derive a closed-form solution to this optimization problem, enabling direct computation of the BROJA decomposition in the general multivariate Gaussian setting. The resulting closed-form expression enables speedups exceeding two orders of magnitude for high-dimensional Gaussian BROJA PID. Code is available at https://github.com/brainsandmachines/Eigen_PID.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Information Theory
DataCupid: Stable Matching Repair for Training Data Acquisition with Delayed Feedback
Limitations on Autoregressive Token Generation via Sequential Sampling
JEPA-kMMVAE: CSI Prediction for Time-Varying Wireless Channels
Directional and Quasi-Omnidirectional Indoor Channel Measurements at Upper 6 GHz
Rydberg Atomic Quantum Receivers for OFDM Systems: An Atomic-Comb Design
Get the few papers worth your time in Information Theory every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.