HOBBIT : Holistic Benchmarking of Big Linked Data
HOBBIT aims at abolishing the barriers in the adoption and deployment of Big Linked Data by European companies, by means of open benchmarking reports that allow them to assess the fitness of existing solutions for their purposes. These benchmarks are based on data that reflects reality and measures industry-relevant Key Performance Indicators (KPIs) with comparable results using standardized hardware.
HOBBIT PLATFORM
The HOBBIT evaluation platform is build upon the open-source platform GERBIL benchmarking platform, which resulted from collaboration between 8 institutions (including the Big Data vendor Unister) across Europe. This platform will ensure that:
- The benchmarks are easy to use.
- New benchmarks can be easily created and added to the platform by third parties.
- The evaluation can be scaled out to large datasets and on distributed architectures.
- The publishing and analysis of the results of different systems can be carried out in a uniform manner across the different benchmarks.
The online instance of HOBBIT evaluation platform is accessible here: master.project-hobbit.eu. The code of HOBBIT platform and HOBBIT benchmarks is accessible here: https://github.com/hobbit-project.
CHALLENGES
HOBBIT organizes, joins and promotes challenges that aim to measure the performance of technologies for the different steps of the Big Linked Data (BLD) lifecycle. In contrast to existing benchmarks, we will provide modular and easily extensible benchmarks for all industry-relevant BLD processing steps that allow to assess whole suites of software that cover more than one step. The infrastructure necessary to run the evaluation campaigns will be made available. Our architecture will rely on web interfaces and cloud infrastructures to ensure scalability.
The challenges are:
- MOCHA2017 Challenge – ESWC 2017
- QALD2017 Challenge – ESWC 2017
- OKE2017 Challenge – ESWC 2017
- Grand Challenge – DEBS 2017
HOBBIT is composed of 9 partners representing 5 countries.
Belgium |
|
iMindsiMinds is a research institute focusing on information & communication technology. |
|
Germany |
|
AGT Group R&D GmbHAGT a multinational company specialised in the Internet of Things, cloud solutions and professional services. |
|
Fraunhofer IAISFraunhofer has more than 20,000 employees and 2 Billion annual research budgets. |
|
Institute for applied informatics (InfAI)InfAI with 40+ researchers in the AKSW group will lead WP2, WP3 and WP9. InAI is also the project coordinator. |
|
USU Software AGUSU and its subsidiaries develop and sell complete software solutions for knowledge-based IT service management. |
|
Greece |
|
Foundation for Research & Technology – Hellas (FORTH)FORTH is a top rated research center in Greece and represents Greece in the ERCIM network. |
|
National Center for Scientific Research Demokritos (NCSR)NCSR is the largest self-governing research organisation under the supervision of the General Secretariat for Research and Technology of the Greek Government. |
|
United Kingdom (UK) |
|
OpenLink SoftwareOpenLink established in 1992 is a SME specialised on the RDF database technology. |
|
Poland |
|
TomTomTomTom founded in 1991 is a world leader of products for in-car location and navigation products. |
Contacts
Project coordinator Dr. Axel-Cyrille Ngonga Ngomo (InfAI) Agile Knowledge Engineering and Semantic Web (AKSW) group leader. Augustusplatz 10, room P905, 04109 Leipzig, Germany Tel.: +49 341 97 32362 E-mail: ngonga at informatik dot uni-leipzig dot de |
|
Technical Manager Michael Röder (InfAI) Agile Knowledge Engineering and Semantic Web (AKSW) group. Augustusplatz 10, 04109 Leipzig, Germany Tel.: +49 341 355381 25209 E-mail: roeder at informatik dot uni-leipzig dot de |
|
Financial Manager Nadine Jänicke (InfAI) Augustusplatz 10, 04109 Leipzig, Germany Tel.: +49 341 97-32310 E-mail: jaenicke at uni-leipzig dot de |
|
Dissemination Manager Dr. Irini Fundulaki (FORTH) Associate Researcher and Head of W3C Greece office. N. Plastira 100, Vassilika Vouton, Heraklion, Crete, Greece Tel.: +30 2810 39 1725 E-mail: fundul at ics dot forth dot gr |
|
Outreach Leader Frank Salliau (iMinds) Researcher at the semantic hypermedia Lab at Ghent University – iMinds. Ghent University, Multimedia Lab, Gaston Crommenlaan 8, 9050 Ledeberg-Ghent, Belgium Tel.: +32 9 331 49 43 E-mail: frank dot salliau at ugent dot be |
|
Challenge Coordinator Dr. Anastasia Krithara (NCSR) Institute of Informatics & Telecommunications (IIT), National Centre for Scientific Research “Demokritos” (NCSR) Patriarchou Grigoriou and Neapoleos, Agia Paraskeui |