Go to file
dengxiaochao d794dc4647 fix(sdk): incorrect offset when aheadread copy cacheBlock to req data buffer
@formatter:off

Signed-off-by: dengxiaochao <dengxiaochao@bilibili.com>
(cherry picked from commit a5f9ecd148)
2025-12-24 17:01:13 +08:00
.github refactor(sdk): remove dp cache code from sdk, client, cli. #1000063488 2025-08-08 14:59:27 +08:00
authnode feat(projectstructure): reorganize the module directory in the root to a suitable subdirectory 2024-12-26 09:24:22 +08:00
blobstore fix(blobstore): avoid unnecessary work for disabled codemodes 2025-11-19 09:56:58 +08:00
build feat(remotecache): add config tool 2025-12-24 17:00:58 +08:00
cli feat(master): add status update records to dp decommission process for querying. 2025-12-24 17:01:10 +08:00
client fix(client): cleanup eh when flush is completed 2025-12-24 17:01:09 +08:00
cmd feat(cmd): add healthy and ready check url. #1000296298 2025-12-24 17:01:07 +08:00
console fix(sdk): fix Uncontrolled data used in network request 2024-08-12 11:30:10 +08:00
datanode fix(master): reported bad disk not complete decommission timely metric. 2025-08-11 17:21:20 +08:00
depends refactor(fuse): refactor fuse read performance. #1000261380 2025-12-24 17:01:03 +08:00
deploy enhance(log): Modify the threshold triggering log to logLeftSpaceLimitRatio of the total disk space 2024-07-18 16:57:38 +08:00
docker feat(flashgroupmaster): support raft 2025-12-24 16:59:49 +08:00
docs feat(client): Add async flush, reduce the close handler time cost @formatter:off 2025-12-24 17:01:03 +08:00
docs-zh chore(docs): update document of access and rpc 2025-10-15 10:58:51 +08:00
java fix(client): support 3.5.0 java sdk #23068759 2025-08-07 16:00:27 +08:00
lcnode fix(meta): msg sent back to the master process async to prevent blocking the connection 2025-08-11 17:21:15 +08:00
master fix(master): Optimize the reporting metrics for bad disks that fail to decommission promptly. 2025-12-24 17:01:12 +08:00
metanode fix(meta): fix meta panic when log extent info. #1000286609 2025-12-24 17:01:07 +08:00
objectnode refactor(all): remove cache rule and cache threshold. #1000142823 2025-08-08 14:59:31 +08:00
proto fix(cache): improve read concurrency 2025-12-24 17:01:10 +08:00
raftstore fix(meta): check and rename old raft dir if exist. #1000187608 2025-08-11 17:21:15 +08:00
remotecache fix(flash): to load blockv2 need to init key limieter 2025-12-24 17:01:13 +08:00
sdk fix(sdk): incorrect offset when aheadread copy cacheBlock to req data buffer 2025-12-24 17:01:13 +08:00
security feat(docs): Update Governance related documentation 2024-08-28 17:14:02 +08:00
shell feat(cmd): enable pprof configuration for signle-node deployment #22779997 2024-12-26 09:24:22 +08:00
test feat(projectstructure): reorganize the module directory in the root to a suitable subdirectory 2024-12-26 09:24:22 +08:00
tool fix(client): add flow limit for object operation 2025-12-24 17:01:13 +08:00
util fix(client): read from leader when excuting ahead read 2025-12-24 17:01:11 +08:00
vendor refactor(vendor): user smux in depends to replace pkg in vendor. #1000193713 2025-08-11 17:21:16 +08:00
.gitattributes docs(kernel): Add kernel client design document 2024-12-03 09:27:26 +08:00
.gitignore refactor(client): refactor random write retry strategy. 2024-12-26 09:24:22 +08:00
.gitlab-ci.yml Enhancement: update dockerimage for s3test 2023-11-24 14:41:14 +08:00
.goreleaser.yaml refactor(sdk): remove dp cache code from sdk, client, cli. #1000063488 2025-08-08 14:59:27 +08:00
.semgrep.yml chore(style): fix up semgrep for ip v4 and v6 2025-02-19 10:05:11 +08:00
.semgrepignore chore(test): add semgrep ignore paths 2025-02-18 17:53:24 +08:00
.travis.yml docs. update to cubefs 2023-05-26 11:17:10 +08:00
ADOPTERS.md feat(doc): Update the document of adopters 2024-05-15 16:41:04 +08:00
build.sh chore(docs): fix some typo 2023-11-30 14:00:58 +08:00
CHANGELOG.md docs(docs): update changelog for v3.5.2 2025-08-11 17:21:20 +08:00
CODE_OF_CONDUCT.md Update md doc since cubefs moved from sandbox to incubate in cncf! 2022-06-10 11:26:08 +08:00
codecov.yaml chore(codecov): make informational codecov when pull master 2023-06-07 15:43:42 +08:00
CONTRIBUTING.md feat(doc): Add TestCase Guidelines for contributors 2024-08-09 10:59:09 +08:00
cubefs.go style(all): format all codes with golangci tools 2024-05-14 09:54:13 +08:00
go.mod feat(cli): erase proxy cache by filter 2025-10-13 15:29:34 +08:00
go.sum fix(rpc): timeout with response in rpc client 2025-09-05 12:15:07 +08:00
GOVERNANCE_CN.md chore(docs): remove unusefull files 2025-06-03 14:08:15 +08:00
GOVERNANCE.md feat(doc): Add rule for Peripheral Projects and describe the rule of joining and achriving 2024-10-29 17:23:35 +08:00
HELM.md Update README.md 2022-07-14 19:00:47 +08:00
INSTALL.md chore: replace the document address 2023-04-17 09:47:44 +08:00
LICENSE docs. update to cubefs 2023-05-26 11:17:10 +08:00
MAINTAINERS.md update haifeng's email 2025-02-15 01:12:20 +08:00
Makefile feat(remotecache): add config tool 2025-12-24 17:00:58 +08:00
NOTICE update: update to CubeFS 2022-08-22 18:16:09 +08:00
OWNERS.md feat(docs): update Governance related documentation 2024-12-26 09:24:22 +08:00
README.md docs(doc): Update the maturity level of cubefs to graduated 2025-03-03 10:39:47 +08:00
RELEASE.md chore(docs): remove unusefull files 2025-06-03 14:08:15 +08:00
ROADMAP.md feat(doc): Update the ROADMAP of 2025 2025-03-18 10:16:56 +08:00
SECURITY.md feat(docs): Update Governance related documentation 2024-08-28 17:14:02 +08:00
UPDATE.md docs(scheduler): add update docs, from v1.2.2 to v1.2.3, solve handle blob delete msg too slow 2023-11-08 12:37:10 +08:00

CubeFS

CNCF Status Build Status LICENSE Language Go Report Card Docs OpenSSF Best Practices OpenSSF Scorecard Codecov Artifact HUB CLOMonitor FOSSA Status Release Tag Gurubase

 Community Meeting
The CubeFS Project holds bi-weekly community online meeting. To join or watch previous meeting notes and recordings, please see meeting schedule and meeting minutes.
CubeFS

Overview

CubeFS ("储宝" in Chinese) is an open-source cloud-native distributed file & object storage system, hosted by the Cloud Native Computing Foundation (CNCF) as a graduated project.

What can you build with CubeFS

  • As an open-source distributed storage, CubeFS can serve as your datacenter filesystem, data lake storage infra, and private or hybrid cloud storage.

  • Moreover, it can be run in public cloud services, providing cache acceleration and file system semantics on top of public cloud storage such as S3.

  • In particular, CubeFS enables the separation of storage/compute architecture for databases, search systems, and AI/ML applications.

Some key features of CubeFS include:

  • Multiple access protocols such as POSIX, HDFS, S3, and its own REST API
  • Highly scalable metadata service with strong consistency
  • Performance optimization of large/small files and sequential/random writes
  • Multi-tenancy support with better resource utilization and tenant isolation
  • Hybrid cloud I/O acceleration through multi-level caching
  • Flexible storage policies, high-performance replication or low-cost erasure coding
CubeFS Architecture

Documents

Community

Governance

Governance documentation plays a crucial role in establishing clear guidelines, procedures, and structures within an organization or project

Contribute

Contributing to CubeFS

There is a clear definition of roles and their promotion paths.

Partners and Users

There is the list of users and success stories ADOPTERS.md.

Reference

Haifeng Liu, et al., CFS: A Distributed File System for Large Scale Container Platforms. SIGMOD19, June 30-July 5, 2019, Amsterdam, Netherlands.

For more information, please refer to https://dl.acm.org/citation.cfm?doid=3299869.3314046 and https://arxiv.org/abs/1911.03001

License

CubeFS is licensed under the Apache License, Version 2.0. For detail see LICENSE and NOTICE.

Note

The master branch may be in an unstable or even broken state during development. Please use releases instead of the master branch in order to get a stable set of binaries.

Star History

Star History Chart