Stefan Marr, Benoit Daloze, Hanspeter Mössenböck,
"Cross-Language Compiler Benchmarking: Are we Fast Yet?"
: Proceeding DLS 2016 Proceedings of the 12th Symposium on Dynamic Languages, ACM, New York, Seite(n) 120-131, 11-2016, ISBN: 978-1-4503-4445-6
Original Titel:
Cross-Language Compiler Benchmarking: Are we Fast Yet?
Sprache des Titels:
Englisch
Original Buchtitel:
Proceeding DLS 2016 Proceedings of the 12th Symposium on Dynamic Languages
Original Kurzfassung:
Comparing the performance of programming languages is difficult because they differ in many aspects including preferred programming abstractions, available frameworks, and their runtime systems. Nonetheless, the question about relative performance comes up repeatedly in the research community, industry, and wider audience of enthusiasts.
This paper presents 14 benchmarks and a novel methodology to assess the compiler effectiveness across language implementations. Using a set of common language abstractions, the benchmarks are implemented in Java, JavaScript, Ruby, Crystal, Newspeak, and Smalltalk. We show that the benchmarks exhibit a wide range of characteristics using language-agnostic metrics. Using four different languages on top of the same compiler, we show that the benchmarks perform similarly and therefore allow for a comparison of compiler effectiveness across languages. Based on anecdotes, we argue that these benchmarks help language implementers to identify performance bugs and optimization potential by comparing to other language implementations.