OpenAlex ·
Beat-Synchronous Tokenization for ECG Transformers
- Published
- Source
- OpenAlex
- DOI
- 10.48550/arxiv.2608.30367
- Original
- Read it at the publisher
- Topics
Abstract
Transformer-based electrocardiogram (ECG) models commonly tokenize waveforms into fixed temporal patches. Though convenient, fixed patching can split heartbeat structures across token boundaries. We study beat-synchronous tokenization as a physiologically grounded alternative, comparing fixed patches with three beat-aligned strategies: resampled beats, adaptive pooled beats, and resampled beats augmented with R--R interval information. Experiments span two settings: 10-second 12-lead diagnostic classification on PTB-XL after MIMIC-IV-ECG masked pretraining, and 60-second single-lead rhythm classification on Icentia11k after patient-level contrastive pretraining. On PTB-XL, resampled beat tokens achieve the highest mean macro Area Under the ROC Curve (AUROC; 0.8945) and nearly match the best fixed-patch macro Area Under the Precision-Recall Curve (AUPRC; 0.7414), reducing average sequence length from 100 to 11.2 tokens. On Icentia11k, beat-synchronous tokenizers obtain comparable AUPRC to fixed patching with better stability across runs. These results suggest morphology-preserving beat tokenization is a compact, competitive alternative to fixed temporal patching.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Artificial Intelligence
ECGQuest: Benchmarking and Fine-Tuning Language Models for Electrocardiography
Major adverse cardiac events and mortality associated with ADHD and its treatment in adults with type 2 diabetes: a multi-national cohort study.
Heart failure may promote breast cancer progression through a Col10a1-associated Tgf-β/Smad-EMT pathway.
MR-JEPA: A General Purpose Video Foundation Model for Cardiac MRI
Multiscale four-dimensional imaging of cardiac remodelling after myocardial infarction.
Get the few papers worth your time in Artificial Intelligence every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.