Go to file
clinx 086034cb92 fix(flash): avoid returning network EOF
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
2025-09-29 14:27:27 +08:00
.github refactor(sdk): remove dp cache code from sdk, client, cli. #1000063488 2025-05-16 10:16:58 +08:00
authnode feat(projectstructure): reorganize the module directory in the root to a suitable subdirectory 2024-12-26 09:24:22 +08:00
blobstore refactor(fmt): use gofumpt to format code. #1000063488 2025-05-16 10:17:00 +08:00
build feat(remotecache): add config tool 2025-08-19 14:59:28 +08:00
cli fix(flash): the master distributes the flashkeylimit value 2025-09-24 11:09:27 +08:00
client fix(client):cleanup eh when flush is completed 2025-09-10 09:59:50 +08:00
cmd feat(cmd): add healthy and ready check url. #1000296298 2025-08-28 15:44:33 +08:00
console fix(sdk): fix Uncontrolled data used in network request 2024-08-12 11:30:10 +08:00
datanode fix(master): if the bad disk is not completed decommission within the time limit, the disk is reported in metrics. 2025-09-04 10:01:19 +08:00
depends fix(master): fix panic caused by lack of locking during concurrent access to the rafts map. 2025-09-26 11:01:25 +08:00
deploy enhance(log): Modify the threshold triggering log to logLeftSpaceLimitRatio of the total disk space 2024-07-18 16:57:38 +08:00
docker feat(flashgroupmaster): support raft 2025-08-19 14:35:36 +08:00
docs feat(client): Add async flush, reduce the close handler time cost @formatter:off 2025-08-19 15:43:20 +08:00
docs-zh fix(master): Optimize disk decommission command and add boundary conditions. #1000217026 2025-07-09 18:47:02 +08:00
java support 3.5.0 java sdk #23068759 2025-04-01 11:05:01 +08:00
lcnode fix(meta): once the msg is sent back to the master, it is processed async to prevent blocking the connection.#1000187177 2025-06-20 10:47:38 +08:00
master fix(master): when querying the decommissioning progress of a disk that has not yet been decommissioned, it returns the initial decommissioning status. 2025-09-26 15:57:45 +08:00
metanode fix(master): Optimize fileStats related interfaces. #1000240718 2025-09-04 10:01:19 +08:00
objectnode refactor(all): remove cache rule and cache threshold. #1000142823 2025-06-06 14:19:25 +08:00
proto fix(flash): change the write packet size to 64K to avoid timeout 2025-09-29 14:27:27 +08:00
raftstore fix(meta): check and rename old raft dir if exist. #1000187608 2025-06-20 10:47:38 +08:00
remotecache fix(flash): do not put cache miss error to warn 2025-09-26 17:31:21 +08:00
sdk fix(flash): avoid returning network EOF 2025-09-29 14:27:27 +08:00
security feat(docs): Update Governance related documentation 2024-08-28 17:14:02 +08:00
shell feat(cmd): enable pprof configuration for signle-node deployment #22779997 2024-12-26 09:24:22 +08:00
test feat(projectstructure): reorganize the module directory in the root to a suitable subdirectory 2024-12-26 09:24:22 +08:00
tool fix(flash): change the write packet size to 64K to avoid timeout 2025-09-29 14:27:27 +08:00
util fix(client):fixing the prefetching sliding window logic 2025-09-22 19:59:43 +08:00
vendor refactor(vendor): user smux in depends to replace pkg in vendor. #1000193713 2025-06-26 12:35:54 +08:00
.gitattributes docs(kernel): Add kernel client design document 2024-12-03 09:27:26 +08:00
.gitignore refactor(client): refactor random write retry strategy. 2024-12-26 09:24:22 +08:00
.gitlab-ci.yml Enhancement: update dockerimage for s3test 2023-11-24 14:41:14 +08:00
.goreleaser.yaml refactor(sdk): remove dp cache code from sdk, client, cli. #1000063488 2025-05-16 10:16:58 +08:00
.semgrep.yml chore(style): fix up semgrep for ip v4 and v6 2025-02-19 10:05:11 +08:00
.semgrepignore chore(test): add semgrep ignore paths 2025-02-18 17:53:24 +08:00
.travis.yml docs. update to cubefs 2023-05-26 11:17:10 +08:00
ADOPTERS.md feat(doc): Update the document of adopters 2024-05-15 16:41:04 +08:00
build.sh chore(docs): fix some typo 2023-11-30 14:00:58 +08:00
CHANGELOG.md fix(client,meta): remove client enableSummary and meta not support UpdateXAttr.#23129966 2025-06-27 10:59:35 +08:00
CODE_OF_CONDUCT.md Update md doc since cubefs moved from sandbox to incubate in cncf! 2022-06-10 11:26:08 +08:00
codecov.yaml chore(codecov): make informational codecov when pull master 2023-06-07 15:43:42 +08:00
CONTRIBUTING.md feat(doc): Add TestCase Guidelines for contributors 2024-08-09 10:59:09 +08:00
cubefs.go style(all): format all codes with golangci tools 2024-05-14 09:54:13 +08:00
go.mod feat(util): add go ping for flash sdk 2025-04-01 10:50:27 +08:00
go.sum feat(util): add go ping for flash sdk 2025-04-01 10:50:27 +08:00
GOVERNANCE_CN.md feat(doc): Add rule for Peripheral Projects and describe the rule of joining and achriving 2024-10-29 17:23:35 +08:00
GOVERNANCE.md feat(doc): Add rule for Peripheral Projects and describe the rule of joining and achriving 2024-10-29 17:23:35 +08:00
HELM.md Update README.md 2022-07-14 19:00:47 +08:00
INSTALL.md chore: replace the document address 2023-04-17 09:47:44 +08:00
LICENSE docs. update to cubefs 2023-05-26 11:17:10 +08:00
MAINTAINERS.md update haifeng's email 2025-02-15 01:12:20 +08:00
Makefile feat(remotecache): add config tool 2025-08-19 14:59:28 +08:00
NOTICE update: update to CubeFS 2022-08-22 18:16:09 +08:00
OWNERS.md feat(docs): update Governance related documentation 2024-12-26 09:24:22 +08:00
README.md docs(doc): Update the maturity level of cubefs to graduated 2025-03-03 10:39:47 +08:00
RELEASE.md feat(doc): Update the release documentation and add docker image info 2024-07-29 10:16:08 +08:00
ROADMAP.md feat(doc): Update the ROADMAP of 2025 2025-03-18 10:16:56 +08:00
SECURITY.md feat(docs): Update Governance related documentation 2024-08-28 17:14:02 +08:00
UPDATE.md docs(scheduler): add update docs, from v1.2.2 to v1.2.3, solve handle blob delete msg too slow 2023-11-08 12:37:10 +08:00

CubeFS

CNCF Status Build Status LICENSE Language Go Report Card Docs OpenSSF Best Practices OpenSSF Scorecard Codecov Artifact HUB CLOMonitor FOSSA Status Release Tag Gurubase

 Community Meeting
The CubeFS Project holds bi-weekly community online meeting. To join or watch previous meeting notes and recordings, please see meeting schedule and meeting minutes.
CubeFS

Overview

CubeFS ("储宝" in Chinese) is an open-source cloud-native distributed file & object storage system, hosted by the Cloud Native Computing Foundation (CNCF) as a graduated project.

What can you build with CubeFS

  • As an open-source distributed storage, CubeFS can serve as your datacenter filesystem, data lake storage infra, and private or hybrid cloud storage.

  • Moreover, it can be run in public cloud services, providing cache acceleration and file system semantics on top of public cloud storage such as S3.

  • In particular, CubeFS enables the separation of storage/compute architecture for databases, search systems, and AI/ML applications.

Some key features of CubeFS include:

  • Multiple access protocols such as POSIX, HDFS, S3, and its own REST API
  • Highly scalable metadata service with strong consistency
  • Performance optimization of large/small files and sequential/random writes
  • Multi-tenancy support with better resource utilization and tenant isolation
  • Hybrid cloud I/O acceleration through multi-level caching
  • Flexible storage policies, high-performance replication or low-cost erasure coding
CubeFS Architecture

Documents

Community

Governance

Governance documentation plays a crucial role in establishing clear guidelines, procedures, and structures within an organization or project

Contribute

Contributing to CubeFS

There is a clear definition of roles and their promotion paths.

Partners and Users

There is the list of users and success stories ADOPTERS.md.

Reference

Haifeng Liu, et al., CFS: A Distributed File System for Large Scale Container Platforms. SIGMOD19, June 30-July 5, 2019, Amsterdam, Netherlands.

For more information, please refer to https://dl.acm.org/citation.cfm?doid=3299869.3314046 and https://arxiv.org/abs/1911.03001

License

CubeFS is licensed under the Apache License, Version 2.0. For detail see LICENSE and NOTICE.

Note

The master branch may be in an unstable or even broken state during development. Please use releases instead of the master branch in order to get a stable set of binaries.

Star History

Star History Chart