logo

Using a Distributed Key-Value Store

Authors:   Nick Cameron, Andy Lok


Summary

The presentation discusses the features and benefits of TaiKV, a distributed and transactional key-value store, and its Python clients.
  • TaiKV is a distributed and transactional key-value store that supports explicit transactions and offers a rich key-value API.
  • It is horizontally scalable, fault-tolerant, and can store and access large amounts of data quickly.
  • TaiKV's co-processor allows for computation on data storage nodes, resulting in significant performance benefits.
  • The Python clients for TaiKV can communicate with the TaiKV nodes using either the raw or transactional interfaces.
  • TaiKV and its clients are open-source projects, and the best place to learn more is on GitHub or the TaiKV website.
Jihu, a user of TaiKV, had around 200 TaiKV nodes and was getting up to 100 million reads per second from their database on two trillion rows, which is about 320ish terabytes of data. This demonstrates the scalability and performance capabilities of TaiKV.

Abstract

Key-value stores are well-known and the concept is simple, but there are myriad differences in the details of different stores. How you choose and use a key-value store in your projects is dictated by these details. TiKV is a distributed and transactional key-value store, which makes it massively scalable and a great choice if you have huge volumes of data and need low-latency access with low tolerance for inconsistency. In this talk, Nick Cameron and Di’an Luo will walk through building an application around TiKV using a language-native client. They will delve into the features, architecture, and limitations of TiKV, and the design principles and APIs of the clients. The talk focuses on the practical aspects of building an application using TiKV, so that you can easily leverage this technology in your own projects. TiKV and its clients are open source and have an open and active community; TiKV is a graduated CNCF project.

Materials:

Tags: