Diagnosing GNN Failure Modes with Layer-Wise Probe Entropy

Abstract

Graph neural networks (GNNs) are typically evaluated only at their final layer, obscuring how task-relevant information evolves during message passing. We introduce a post-hoc diagnostic that freezes a trained GNN, fits an independent linear probe to each layer, and tracks probe accuracy alongside normalized predictive entropy. Across real and synthetic graph settings, layer-wise probe entropy distinguishes beneficial, neutral, and harmful smoothing, a capability not demonstrated by existing geometric measures. Moreover, by comparing shallow and deep models, we show that the onset of entropy degradation separates the two main GNN failure modes: structural mismatch under heterophily, which appears from the earliest layers even in shallow models, and excessive-depth oversmoothing, which emerges only as propagation depth increases. These results establish probe-entropy trajectories as a tool for analyzing information flow in GNNs and motivate future work on adaptive depth selection and early-exit mechanisms.

The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.

More in Machine Learning

• arXiv preprint · 15 October 2026

  Efficient Agnostic Learning of Univariate Densities Under Local Differential Privacy

  Mohammad Afzali, Hassan Ashtiani and Sivan Sabato
• arXiv preprint · 16 October 2026

  Shape-Aware Neural Time Fields for Rigid-Body Motion and Manipulation Planning

  Yanming Zhou, Yuchen Liu and Ahmed H. Qureshi
• arXiv preprint · 15 October 2026

  INCONVENIENT: A Benchmark to Assess LLM Generalization Capabilities from Convenience Samples

  Sara Rezaeimanesh, Chad Klochko, Kundan Thind and 1 other
• arXiv preprint · 16 October 2026

  Acquisition Function-Guided Generation for Bayesian Optimization over Discrete Spaces

  Tommaso Ancilli, Thomas Wedenig, Henry Moss and 1 other
• arXiv preprint · 15 October 2026

  PremiseCheck: Efficient Fact-Checking of Human and AI Peer Reviews

  Dingjie Song, Zhiling Yan, Ziqian Zhang and 2 others

All new papers in Machine Learning