OpenAlex ·
Flux: Optimal Scheduling of Optical Circuit Switches for LLM Training
- Published
- Source
- OpenAlex
- Published in
- arXiv (Cornell University)
- DOI
- 10.48550/arxiv.2609.25949
- Original
- Read it at the publisher
- Topics
Abstract
Optical Circuit Switching (OCS) offers high bandwidth density and energy efficiency for LLM training, but incurs a non-negligible reconfiguration delay. Prior work typically schedules optical circuit switches independently of compute, using aggregate traffic demand to determine which circuits to provision and when. We argue that this separation creates a fundamental inefficiency: reconfigurations that ignore the compute timeline can stall communication, resulting in low circuit utilization and large buffer requirements. In this paper, we present Flux, a scheduler that optimally schedules optical circuit switches based on the structure of the entire workload. Flux remains effective across a wide range of switching speeds by reusing circuits and amortizing reconfiguration delay behind compute and communication. We show that Flux reduces training iteration time by up to $10\times$ and peak NIC buffer requirements by more than three orders of magnitude compared to traditional periodic schedulers.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Hardware Architecture
Accelerating the Mitigation of LLM Inference Nondeterminism Across GPU Architectures
Precision and resource scaling of real-time flux distortion compensation for superconducting quantum control
AgenticSizing: A Large Language Model-based Multi-Agent Framework for Analog Circuit Sizing
MicroQonv: Reshaping Convolution Tensors for Efficient Microscaling in Training and Inference
Bringing Chip Tapeout Into University Education
Get the few papers worth your time in Hardware Architecture every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.