LineairDB: Transactional Key-Value Storage with Epoch-based Synchronization

作     者：Nakazono, Sho Bessho, Yutaro Nakamori, Tatsuhiro 中園 翔;別所 祐太朗;中森 辰洋

作者机构：LY Corporation Japan NTT Computer and Data Science Laboratories Japan Keio University Faculty of Environment and Information Studies Japan 

出 版 物：《Computer Software》 (Comput. Softw.)

年 卷 期：2024年第41卷第1期

页      面：15-35页

核心收录：

主　　题：Synchronization 

摘      要：Demands on the performance of database systems continue to increase. In state-of-the-art database systems, the storage engine is a major source of performance bottlenecks, and it is important to harness parallelism by avoiding mutual exlusion mechanisms such as locks. In this paper, we outline the design of LineairDB, a transactional storage engine open-sourced by the authors. LineairDB employs epoch-based synchronization to all components, which harnesses a high degree of multicore parallelism in handling data structures. We describe how each component of LineairDB is optimized by epoch-based synchronization. Our experimental results show that the optimizations in LineairDB lead to about a 75x increase in throughput in YCSB benchmark. In addition, we implement LineairDB-storage-engine, which is a plugin for MySQL. It achieved up to 5x better throughput compared to InnoDB, which is MySQL’s default storage engine. On the other hand, the approach of epoch-based synchronization affects both the performance characteristics and the consistency that the database provides to users. This paper also discusses these aspects. © 2024 Japan Society for Software Science and Technology. All rights reserved.