arXiv preprint ·
Characterizing Cross-Relay Generalization Failure in Machine Learning-Based Power System Protection
- Published
- Source
- arXiv preprint, posted before peer review
- Original
- Read it at arXiv
- Topics
In brief
When Similar F1 Scores Hide More False Alarms
The authors test a multilayer perceptron across relay locations in a simulated 110 kV network, using held-out simulations and no target-specific calibration. Although mean F1 barely changes across locations, false-positive rates rise substantially on cross-relay transfers, with especially high rates for transfers from Bus 2 to other bus groups.
What they found: Across the simulated 110 kV network, mean F1 was 0.730 within-relay and 0.734 cross-relay, which could suggest little change at first glance. But mean FPR increased from 0.088 to 0.341, while mean FNR fell from 0.399 to 0.318. The shift depended on transfer direction: Bus 2-trained models had a mean FPR of 0.670 at Bus 1 and Bus 3 relays, compared with 0.096 for transfers within the same bus group.
AI-written summary. Check anything you rely on against the original paper.
Abstract
Machine learning-based fault detectors are often evaluated at the relay locations used for training, although local voltage and current measurements vary across power networks. This work investigates cross-relay generalization for binary detection of faults anywhere in the network using local measurements, rather than line-selective tripping. Using 50 ms windows from a simulated 110 kV transmission network, we evaluate a multilayer perceptron across all 64 source target combinations of eight relays and five random seeds. A shared simulation-level split and source-only threshold selection provide a controlled held-out evaluation without target-specific calibration. Despite nearly unchanged mean F1-scores (0.730 within-relay versus 0.734 cross-relay), the mean false-positive rate (FPR) increases from 0.088 to 0.341, while the mean false-negative rate decreases from 0.399 to 0.318. The change is strongly directional: models trained at Bus 2 relays yield a mean FPR of 0.670 at Bus 1 and Bus 3 relays, compared with 0.096 for cross-relay transfers within the same bus group. Linear probing indicates that learned representations retain coarse bus-group information, while exploratory class-conditional latent distribution analysis shows no consistent monotonic association with transfer errors. These findings demonstrate that aggregate metrics can conceal location-structured changes in false-alarm behavior, highlighting the importance of evaluating error types separately when assessing cross-relay generalization.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Machine Learning
Learning the Geometry of Materials Space with Trained Neural Tangent Kernels
A Jump-Modified Wasserstein Gradient Flow for Maximum Mean Discrepancy with Energy Kernels
The Router Already Knows
Local and Sparse Kernel Operator Learning for Incompressible Flows: An Operator Lagrange Formulation
Baseline and Incremental: User, Item, and Request Debiasing in Instagram Feed Ranking
Get the few papers worth your time in Machine Learning every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.