Design and Implementation of a Scalable Distributed Database System with LSM-tree Storage and Consistent Hashing
编号:4
访问权限:仅限参会人
更新:2025-12-03 21:52:48 浏览:3次
口头报告
摘要
This paper explains the full scope, the intricate details, and the result of the evaluation of a novel distributed database system that combines a Log-Structured Merge-tree (LSM-tree) storage structure with consistent hashing for the best data distribution and retrieval in a way that they complement each other. To begin with, the system that we have designed addresses the problems that have become the major challenges of the data-intensive applications that consume large amounts of data. It supports a great throughput of write operations while also preserving a strong read performance and fault tolerance. The architecture utilizes a fundamentally new ring-based topology with the automatic replication of data, the efficient mechanisms of secondary indexing, and the advanced memory management with the help of the intelligent memtable flushing. The result of a broad range of experiments confirms the high performance of our system in that it can achieve 45,231 operations/second write throughput, and this is a 17.6% betterment of Apache Cassandra and a 266% betterment of MongoDB. Under the test environment, the system shows linear scalability up to 12 nodes, and it is consistent that sub-millisecond latency is achieved for 95% of the read operations.
关键词
database,lsm tree,secondary indexing,hashing,replication
稿件作者
CHANDRU M S
SRM Institute of Science and Technology *
JAGAN KARTHICK A
SRM Institute of Science and Technology *
MADHAN KUMAR S
SRM Institute of Science and Technology *
发表评论