Chasing the Optimum in Replicated In-memory Transactional Platforms via Protocol Adaptation

Chasing the Optimum in Replicated In-memory Transactional Platforms via Protocol Adaptation

Maria Couceiro
INESC-ID Lisboa/Instituto Superior T ́ecnico, Universidade de Lisboa jgpaiva@gsd.inesc-id.pt

Pedro Ruivo
Red Hat Inc. pruivo@gsd.inesc-id.pt

Paolo Romano
INESC-ID Lisboa/Instituto Superior T ́ecnico, Universidade de Lisboa romano@inesc-id.pt

Luis Rodrigues
INESC-ID Lisboa/Instituto Superior T ́ecnico, Universidade de Lisboa ler@gsd.inesc-id.pt

May 2014-Technical Report RT/20/2014

Abstract

Replication plays an essential role for in-memory distributed transactional platforms, such as NoSQL data grids, given that it represents the primary mean to ensure data durability. Unfortunately, no single replication technique can ensure optimal performance across a wide range of workloads and system configurations. This paper tackles this problem by presenting MorphR, a framework that allows to automatically adapt the replication protocol of in-memory transactional platforms according to the current operational conditions. MorphR presents two key innovative aspects. On one hand, it allows to plug in, in a modular fashion, specialized algorithms to regulate the switching between arbitrary replication protocols. On the other hand, MorphR relies on state of the art machine learning techniques to autonomously determine the optimal replication in face of varying workloads. We integrated MorphR in a popular open-source in-memory NoSQL data grid, and evaluated it by means of an extensive experimental study. The results highlight that MorphR is accurate in identifying the optimal replication strategy in presence of complex, realistic workloads, and does so with minimal overhead.

DOWNLOAD REPORT (.pdf): TR_Morphr

You may also like...