Retaining the Renaissance: Lessons Learned For Maintainable Benchmark Suites
Introduced in 2019, the Renaissance suite provides a set of modern workloads for the JVM, utilizing different programming paradigms to enable evaluation of JIT compilers, garbage collectors, and other tools. The continued maintenance of the suite across releases of the JVM has highlighted practical challenges in both software maintenance and performance evaluation. This talk summarizes the evolution of the suite, discussing the engineering effort required to manage large framework dependencies in face of rapid JVM release cycles. It touches on methodological lessons learned from observing the execution behavior and performance stability of complex workloads over time. Finally, it offers an outlook on the future of the suite and the broader benchmarking ecosystem, emphasizing the need for the systems community to collaboratively develop new workloads that reflect ongoing architectural advancements in the Java platform.
Lubomír is an associate professor at the Department of Distributed and Dependable Systems, Charles University, Prague, Czech Republic. His primary research interests include performance-related topics focusing on performance evaluation, testing, and monitoring. In addition to performance, his research interests include also dynamic program analysis, with specific focus on making the programs running on the Java Virtual Machine more observable. He holds an MSc. from the Czech Technical University in Prague, and a PhD from the Charles University in Prague.
Tue 17 MarDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
15:30 - 17:00 | |||
15:30 60mTalk | Retaining the Renaissance: Lessons Learned For Maintainable Benchmark Suites MoreVMs Lubomír Bulej Charles University | ||
