arXiv preprint ·
Efficiently Distributed Federated Learning
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.1007/978-3-031-48803-0_40
- Original
- Read it at arXiv
- Topics
Abstract
Federated Learning (FL) is experiencing a substantial research interest, with many frameworks being developed to allow practitioners to build federations easily and quickly. Most of these efforts do not consider two main aspects that are key to Machine Learning (ML) software: customizability and performance. This research addresses these issues by implementing an open-source FL framework named FastFederatedLearning (FFL). FFL is implemented in C/C++, focusing on code performance, and allows the user to specify any communication graph between clients and servers involved in the federation, ensuring customizability. FFL is tested against Intel OpenFL, achieving consistent speedups over different computational platforms (x86-64, ARM-v8, RISC-V), ranging from 2.5x and 3.69x. We aim to wrap FFL with a Python interface to ease its use and implement a middleware for different communication backends to be used. We aim to build dynamic federations in which relations between clients and servers are not static, giving life to an environment where federations can be seen as long-time evolving structures and exploited as services.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Performance
PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving
Hybrid GPU-CPU Retrieval for Personalized Search at Ultra-Large Scale
Understanding and Exploiting Diagonal Attention Sparsity in Autoregressive Image Generation
Cross-Platform vs Native Mobile Development: An Empirical Study of Software Quality Trade-offs
The Life of a Token: from Words to Bits on the Wire
Get the few papers worth your time in Performance every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.