LUBM: A Benchmark for OWL Knowledge Base Systems
34 Pages Posted: 5 Jul 2018 Publication Status: Accepted
We describe our method for benchmarking Semantic Web knowledge base systems with respect to use in large OWL applications. We present the Lehigh University Benchmark (LUBM) as an example of how to design such benchmarks. The LUBM features an ontology for the university domain, synthetic OWL data scalable to an arbitrary size, fourteen extensional queries representing a variety of properties, and several performance metrics. The LUBM can be used to evaluate systems with different reasoning capabilities and storage mechanisms. We demonstrate this with an evaluation of two memory-based systems and two systems with persistent storage.
Keywords: Semantic Web, Knowledge Base System, Lehigh University Benchmark, Evaluation
Suggested Citation: Suggested Citation