The Secrets of Kernel File System Technology
2024-12-4
An article introducing a kernel-mode client, briefly describing part of the software architecture and the usage method of the client.
Kubernetes CSI history and current situation
2024-04-18
A popular science article about kubernetes storage, mainly introducing the evolution of kubernetes storage plugin protocol.
Application practice of Raft in CubeFS erasure code system
2023-12-22
The given text describes the CubeFS erasure coding service’s metadata management module (Blobstore/ClusterMgr), Raft algorithm practice, and daily operation recommendations.
Secret of CubeFS｜ Multi-AZ Erasure Coding Disaster Tolerance
2023-11-30
This article introduces the AZ-level disaster tolerance scheme of the Blobstore erasure coding subsystem in CubeFS. Due to the disadvantages of high storage cost and low efficiency in the multi-replica storage mode, high network bandwidth consumption in the multi-AZ case, and the need to ensure data consistency in a timely manner, we will only discuss the erasure coding (EC) storage mode. Blobstore uses erasure coding to encode and calculate user data and persistently store it in multiple AZs, achieving high availability and disaster tolerance. The main content of the article includes the EC calculation principle in multiple AZs, as well as how to maintain high availability for writing, efficient reading, and reducing cross-AZ data recovery. The reliability for EC data is not elaborated here, and can be found in our related articles.
Introduction to CubeFS Quota Feature
2023-11-10
In storage systems, quotas are a technique for managing and controlling the use of storage resources. They can help system administrators effectively manage storage resources, ensuring their rational allocation and utilization.
Understanding cubefs source code | The RAFT of master
2023-08-29
This article explains the implementation details of the RAFT protocol in the Master node of the CubefS distributed file system. By analyzing the state machine of the Master node and the interaction process of the RAFT protocol, readers can better understand how the CubefS system works.
Understanding cubefs source code | The HTTP server of master
2023-08-29
This article introduces the implementation of the HTTP server in the Master node of the CubefS distributed file system. By analyzing the architecture and code implementation of the HTTP server, readers can better understand the working principle and file management function of the Master node in the CubefS system.
Secret of CubeFS Technology ｜ Implementation of Api Atomicty
2023-08-24
This article introduces the implementation of API atomicity in the CubefS distributed file system. By explaining the definition and implementation of API atomicity, the author illustrates how file operations in the CubefS system ensure atomicity, thereby improving the reliability and stability of the system.
Secret of CubeFS Technology | Metadata Subsystem Design
2023-08-02
The previous article CubeFS Storage Technology Revealed - Metadata Management [1] introduced the design concept of the CubeFS metadata system. The article mentioned that the traditional file system has a single-point bottleneck problem of metadata nodes, and the scalable metadata of CubeFS The design effectively solves the single-point bottleneck problem. This article will introduce some implementations and considerations of metadata systems in terms of reliability, scalability, and access performance from a more detailed perspective. Before reading this article, you need to understand the system architecture of CubeFS, as well as the responsibilities of each key component and the noun concept of the system.