HOBBIT : Holistic Benchmarking of Big Linked Data

HOBBIT aims at abolishing the barriers in the adoption and deployment of Big Linked Data by European companies, by means of open benchmarking reports that allow them to assess the fitness of existing solutions for their purposes. These benchmarks are based on data that reflects reality and measures industry-relevant Key Performance Indicators (KPIs) with comparable results using standardized hardware.


The HOBBIT evaluation platform is build upon the open-source platform GERBIL benchmarking platform, which resulted from collaboration between 8 institutions (including the Big Data vendor Unister) across Europe. This platform will ensure that:

  1. The benchmarks are easy to use.
  2. New benchmarks can be easily created and added to the platform by third parties.
  3. The evaluation can be scaled out to large datasets and on distributed architectures.
  4. The publishing and analysis of the results of different systems can be carried out in a uniform manner across the different benchmarks.

The online instance of HOBBIT evaluation platform is accessible here: master.project-hobbit.eu. The code of HOBBIT platform and HOBBIT  benchmarks is accessible here: https://github.com/hobbit-project.

Hobbit platform

Project Web Site.

Deliverables (LINK)

Publications (LINK)


HOBBIT organizes, joins and promotes challenges that aim to measure the performance of technologies for the different steps of the Big Linked Data (BLD) lifecycle. In contrast to existing benchmarks, we will provide modular and easily extensible benchmarks for all industry-relevant BLD processing steps that allow to assess whole suites of software that cover more than one step. The infrastructure necessary to run the evaluation campaigns will be made available. Our architecture will rely on web interfaces and cloud infrastructures to ensure scalability.

The challenges are:

HOBBIT is composed of 9 partners representing 5 countries.




iMinds is a research institute focusing on information & communication technology.
Contact: Tom De Nies, Ruben Taelman, Dr Ruben Verborgh


AGT logo

AGT Group R&D GmbH

AGT a multinational company specialised in the Internet of Things, cloud solutions and professional services.
Contact: Dr Martin Strohbach, Dr Panayotis Kikiras


Fraunhofer IAIS

Fraunhofer has more than 20,000 employees and 2 Billion annual research budgets.
Contact: Prof. Dr. Jens Lehmann


Institute for applied informatics (InfAI)

InfAI with 40+ researchers in the AKSW group will lead WP2, WP3 and WP9. InAI is also the project coordinator.
Contact: Dr Axel-C. Ngonga Ngomo, Michael Röder, Nadine Jänicke


USU Software AG

USU and its subsidiaries develop and sell complete software solutions for knowledge-based IT service management.
Contact: Henrik Oppermann, Alexa Schumacher, Roman Korf



Foundation for Research & Technology – Hellas (FORTH)

FORTH is a top rated research center in Greece and represents Greece in the ERCIM network.
Contact: Dr Irini Fundulaki, Dr Giorgos Flouris, Dr Kostas Stefanidis


National Center for Scientific Research Demokritos (NCSR)

NCSR is the largest self-governing research organisation under the supervision of the General Secretariat for Research and Technology of the Greek Government.
Contact: Dr Anastasia Krithara, Dr George Paliouras

United Kingdom (UK)


OpenLink Software

OpenLink established in 1992 is a SME specialised on the RDF database technology.
Contact: Hugh Williams, Milos Jovanovik, Mirko Spasic




TomTom founded in 1991 is a world leader of products for in-car location and navigation products.
Contact: Marcin Graczyk, Oliver Kannenberg


Project coordinator
Dr. Axel-Cyrille Ngonga Ngomo (InfAI)
Agile Knowledge Engineering and Semantic Web (AKSW) group leader.
Augustusplatz 10, room P905, 04109 Leipzig, Germany
Tel.: +49 341 97 32362
E-mail: ngonga at informatik dot uni-leipzig dot de
Technical Manager
Michael Röder (InfAI)
Agile Knowledge Engineering and Semantic Web (AKSW) group.
Augustusplatz 10, 04109 Leipzig, Germany
Tel.: +49 341 355381 25209
E-mail: roeder at informatik dot uni-leipzig dot de
Financial Manager
Nadine Jänicke (InfAI)
Augustusplatz 10, 04109 Leipzig, Germany
Tel.: +49 341 97-32310
E-mail: jaenicke at uni-leipzig dot de
Dissemination Manager
Dr. Irini Fundulaki (FORTH)
Associate Researcher and Head of W3C Greece office.
N. Plastira 100, Vassilika Vouton, Heraklion, Crete, Greece
Tel.: +30 2810 39 1725
E-mail: fundul at ics dot forth dot gr
Outreach Leader
Frank Salliau (iMinds)
Researcher at the semantic hypermedia Lab at Ghent University – iMinds.
Ghent University, Multimedia Lab, Gaston Crommenlaan 8, 9050 Ledeberg-Ghent, Belgium
Tel.: +32 9 331 49 43
E-mail: frank dot salliau at ugent dot be
Challenge Coordinator
Dr. Anastasia Krithara (NCSR)
Institute of Informatics & Telecommunications (IIT),
National Centre for Scientific Research “Demokritos” (NCSR)
Patriarchou Grigoriou and Neapoleos, Agia Paraskeui

You may also like...