Benchmarking the Performance of Storage Systems that expose ...

Benchmarking the Performance of Storage Systems
that expose SPARQL Endpoints
1 1 Christian Bizer and Andreas Schultz

1 Freie Universität Berlin, Web-based Systems Group,
Garystr. 21, 14195 Berlin, Germany
christian.bizer@fu-berlin.de, aschultz@mi.fu-berlin.de
Abstract. The SPARQL Query Language for RDF and the SPARQL Protocol
for RDF are implemented by a growing number of storage systems and are used
within enterprise and open web settings. As SPARQL is taken up by the
community there is a growing need for benchmarks to compare the performance
of storage systems that expose SPARQL endpoints via the SPARQL protocol.
Such systems include native RDF stores, systems that map relational databases
into RDF, and SPARQL wrappers around other kinds of data sources. This
paper introduces the Berlin SPARQL Benchmark (BSBM) for comparing the
performance of these systems across architectures. The benchmark is built
around an e-commerce use case in which a set of products is offered by
different vendors and consumers have posted reviews about products. The
benchmark query mix illustrates the search and navigation pattern of a
consumer looking for a product. After giving an overview about the design of
the benchmark, the paper presents the results of an experiment comparing the
performance of D2R Server, a relational database to RDF wrapper, with the
performance of Sesame, Virtuoso, and Jena SDB, three popular RDF stores.
Keywords: Benchmark, Scalability, ...