arXiv preprint ·
RyBench: Runtime Verification Benchmarking Framework over Publish/Subscribe Networks
- Published
- Source
- arXiv preprint, posted before peer review
- DOI
- 10.4204/EPTCS.457.6
- Original
- Read it at arXiv
- Topics
Abstract
Autonomous systems built as distributed, node-based systems communicate via publish/subscribe middleware. Runtime Verification (RV) tools are used to monitor those systems against formal specifications, receiving monitored events through the pub/sub channel. An RV tool's practical value depends on its monitoring throughput capacity and verdict latency, besides its correctness, so a systematic benchmarking setup is needed to evaluate how efficiently these tools run. This paper presents RyBench, a pub/sub-based benchmarking framework that acts as a synthetic event publisher in place of a monitored system, providing a common benchmarking setup. RyBench separates benchmark generation, serialization, and transport into distinct components, enabling the combination of different event-generation strategies, data formats, and transport layers. We also evaluate the framework's throughput capacity across these configurations using Open Simulation Interface (OSI) schemas and Timescales properties, and illustrate the end-to-end benchmarking flow through an application to Reelay and an integration with MonPoly.
The authors’ abstract, as arXiv lists it. arXiv’s listings, abstracts included, are free for anyone to reuse.
Read it on ReadSearch
Each opens after you create an account, and brings you back to this paper.
More in Logic in Computer Science
From Constraints to Causality: Petri net Encodings for Explaining Binary Neural Network Inference
SkiNet-Sim: Simulating Petri Nets with Data for the Verification and Validation of Controllers for Autonomous Systems
Plenty to FRET About: From Hazard Analysis to Formal Requirements for Robot-Assisted Dressing
BehaVerify: A Formal Verification Tool for Behavior Trees
ROSMonitoring in Action: Runtime Monitoring and Enforcement for ROS 2 Actions
Get the few papers worth your time in Logic in Computer Science every morning.
ReadSearch reads the new papers in your field each day and brings you the few worth reading, each with its key finding in a sentence.