arXiv preprint ·
A Living Leaderboard for Graph Machine Learning
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
In brief
A Better Scorecard for Graph ML
The authors introduce a graph-learning leaderboard that organizes reported results by dataset, so new results can be checked against compatible prior work. By 15 October 2026, its LLM-based extraction pipeline had collected 27,723 eligible results from 885 peer-reviewed papers across 111 datasets, and the analysis found substantial gaps in some papers’ baseline tables.
What they found: The leaderboard brings together 27,723 eligible results from 885 peer-reviewed papers across 111 datasets, using results available as of 15 October 2026. Its analysis finds that legacy datasets remain in active use and that some papers report baseline scores far below results already published. The gap appeared in 45% of Amazon-ratings tables and 37% of Peptides-struct tables.
AI-written summary. Check anything you rely on against the original paper.
Abstract
Graph machine learning benchmarking results are scattered across papers that use quite different sets of datasets and baseline methods, making it difficult to tell whether a reported gain reflects architectural progress or merely an outdated comparison or weakly tuned baseline. We introduce a living, graph-learning-specific leaderboard that organizes reported results by dataset, putting new results into context. As of 15 October 2026 our LLM-based extraction pipeline extracted 27,723 eligible results across 111 datasets from 885 peer-reviewed papers. Our analysis of these results quantifies concerns about graph-learning benchmarking: legacy datasets are still actively used and many result tables contain baseline results that are drastically lower than those already available in the literature, e.g. 45% Amazon-ratings tables and 37% for Peptides-struct. The leaderboard allows to quickly compare new results against compatible prior results, aiming to improve the overall quality of graph learning benchmarking.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
CytoWave: Perturbation-Centric Pretraining for Single-Cell Response Prediction
ScaleTraj: Scale-Decomposed Human Trajectory Generation
Improving Financial Cybersecurity Through Fraud Transaction Detection with Deep Learning
When Strong Reasoners Join the Pool: Small Union Premiums and Costly Runaway Generations in LLM Routing
A Capitulation Direction Emerges With Scale and Is Causally Load-Bearing Where Validation Is Strong: Eight Models, Two Families, and Five Measurement Hazards
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.