On Improvements of the Varro19 o Benchmark for Graph ...

Universitat Karlsruhe (TH)
Forschungsuniversitat gegrundet 1825
Fakultat fur Informatik
Institut fur Programmstrukturen
und Datenorganisation
Lehrstuhl Prof. Goos
On Improvements of the Varr o Benchmark
for Graph Transformation Tools
Rubino Gei Moritz Kroll
December 5, 2007
Technical Report 2007-7
ISSN 1432-7864iiABSTRACT
In 2004 G. Varr o, A. Schurr, and D. Varro proposed the rst graph transformation benchmark
ever. Varr o et al. also published results for tools like AGG,PROGRES, andFujaba. While
repeating some of his measurements, we were not able to reproduce his gures and ndings.
This paper reports our suggestions for improving the so-called Varr o benchmark.
iiiivCONTENTS
1 Introduction and Problem 1
1.1 The Published Test Charts . . . . . . . . . . . . . . . . . . . . . 3
1.1.1 What has been Measured? . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.1.2 The STS Benchmark . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
1.1.3 The Log Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.1.4 Incomplete Log Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
1.1.5 The Publications of Benchmark Results . . . . . . . . . . . . . . . . . 4
1.2 The Implementation of the Chronometry . . . . . . . . . . . . . . . 7
1.2.1 Time Measurement for Fujaba and AGG . . . . . . . . . . . . . . . . 7
1.2.2 Timet for PROGRES . . . . . . . . . . . . . . . . . . . 7
1.3 Design of the Chronometry . . . . . . . . . . . . . . . . . . . . . ...