DataMill: Rigorous Empirical Performance Evaluation Made Easy, Prof. Sebastian Fischmeister
Sprache des Titels:
Empirical systems research is facing a dilemma. Minor aspects of an experimental setup can have a significant impact on its associated performance measurements and potentially invalidate conclusions drawn from them. The growth in complexity and size of modern systems will further aggravate this dilemma, especially with the given time pressure of producing results. So how can one trust any reported empirical analysis of a new idea or concept in computer science?
This talk introduces DataMill, a community-based easy-to-use services-oriented open benchmarking infrastructure for performance evaluation of single computer experiments. DataMill facilitates producing robust, reliable, and reproducible results.