Computer Science > Logic in Computer Science
Title:RyBench: Runtime Verification Benchmarking Framework over Publish/Subscribe Networks
Abstract:Autonomous systems built as distributed, node-based systems communicate via publish/subscribe middleware. Runtime Verification (RV) tools are used to monitor those systems against formal specifications, receiving monitored events through the pub/sub channel. An RV tool's practical value depends on its monitoring throughput capacity and verdict latency, besides its correctness, so a systematic benchmarking setup is needed to evaluate how efficiently these tools run. This paper presents RyBench, a pub/sub-based benchmarking framework that acts as a synthetic event publisher in place of a monitored system, providing a common benchmarking setup. RyBench separates benchmark generation, serialization, and transport into distinct components, enabling the combination of different event-generation strategies, data formats, and transport layers. We also evaluate the framework's throughput capacity across these configurations using Open Simulation Interface (OSI) schemas and Timescales properties, and illustrate the end-to-end benchmarking flow through an application to Reelay and an integration with MonPoly.
| Comments: | In Proceedings FMAS 2026, arXiv:2611.21375 |
|---|---|
| Subjects: | Logic in Computer Science (cs.LO) ; Performance (cs.PF); Software Engineering (cs.SE) |
| Cite as: | arXiv:2611.22401 [cs.LO] |
| (or arXiv:2611.22401v1 [cs.LO] for this version) | |
| https://doi.org/10.48550/arXiv.2611.22401 arXiv-issued DOI via DataCite (pending registration) | |
| Journal reference: | EPTCS 457, 2026, pp. 72-90 |
| Related DOI : | https://doi.org/10.4204/EPTCS.457.6 DOI(s) linking to related resources |
Submission history
Access Paper:
Additional Features
- Audio Summary
Current browse context:
References & Citations
- Google Scholar
- Semantic Scholar
BibTeX formatted citation
Bookmark
Bibliographic and Citation Tools
Code, Data and Media Associated with this Article
Demos
Recommenders and Search Tools
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.