|
|
||
|---|---|---|
| .github | ||
| authnode | ||
| authtool | ||
| blobstore | ||
| blockcache | ||
| build | ||
| cli | ||
| client | ||
| cmd | ||
| console | ||
| datanode | ||
| depends | ||
| docker | ||
| docs | ||
| docs-zh | ||
| fdstore | ||
| fsck | ||
| java | ||
| libsdk | ||
| master | ||
| metanode | ||
| objectnode | ||
| preload | ||
| proto | ||
| raftstore | ||
| regression | ||
| repl | ||
| sdk | ||
| security | ||
| storage | ||
| test | ||
| util | ||
| vendor | ||
| .gitignore | ||
| .gitlab-ci.yml | ||
| .travis.yml | ||
| ADOPTERS.md | ||
| build.sh | ||
| CHANGELOG.md | ||
| CODE_OF_CONDUCT.md | ||
| CONTRIBUTING.md | ||
| go.mod | ||
| go.sum | ||
| GOVERNANCE.md | ||
| HELM.md | ||
| INSTALL.md | ||
| LICENSE | ||
| MAINTAINERS.md | ||
| Makefile | ||
| NOTICE | ||
| README.md | ||
| ROADMAP.md | ||
CubeFS
 Community Meeting |
|---|
| The CubeFS Project holds bi-weekly community online meeting. To join or watch previous meeting notes and recordings, please see meeting schedule and meeting minutes. |
Overview
CubeFS ("储宝" in Chinese) is an open-source cloud-native file storage system, hosted by the Cloud Native Computing Foundation (CNCF) as an incubating project.
First, CubeFS has been commonly used as the datacenter filesystem for online applications, database or data processing services and machine learning jobs orchestrated by Kubernetes to separate storage from compute. Second, CubeFS also works as a high-performance object store compatible with the S3 API. Moreover, CubeFS offers personal cloud storage on all your devices.
Some key features of CubeFS include:
- Multiple access protocols such as POSIX, HDFS, S3, and its own REST API
- Highly scalable metadata service with strong consistency
- Performance optimization of large/small files and sequential/random writes
- Multi-tenancy support with better resource utilization and tenant isolation
- Hybrid cloud I/O acceleration through multi-level caching
- Flexible storage policies, high-performance replication or low-cost erasure coding
Documents
- English version: https://cubefs.readthedocs.io/en/latest/
- Chinese version: https://cubefs.readthedocs.io/zh_CN/latest/
Benchmark
Small file operation performance and scalability benchmark tested by mdtest.
| File Size (KB) | 1 | 2 | 4 | 8 | 16 | 32 | 64 | 128 |
|---|---|---|---|---|---|---|---|---|
| Creation (TPS) | 70383 | 70383 | 73738 | 74617 | 69479 | 67435 | 47540 | 27147 |
| Read (TPS) | 108600 | 118193 | 118346 | 122975 | 116374 | 110795 | 90462 | 62082 |
| Removal (TPS) | 87648 | 84651 | 83532 | 79279 | 85498 | 86523 | 80946 | 84441 |
| Stat (TPS) | 231961 | 263270 | 264207 | 252309 | 240244 | 244906 | 273576 | 242930 |
Refer to cubefs.readthedocs.io for performance and scalability of IO and Metadata.
Setup CubeFS
Community
- Homepage: cubefs.io
- Mailing list: cubefs-users@groups.io
- Slack: cubefs.slack.com
- WeChat: detail see here.
Partners and Users
There is the list of users and success stories ADOPTERS.md.
Reference
Haifeng Liu, et al., CFS: A Distributed File System for Large Scale Container Platforms. SIGMOD‘19, June 30-July 5, 2019, Amsterdam, Netherlands.
For more information, please refer to https://dl.acm.org/citation.cfm?doid=3299869.3314046 and https://arxiv.org/abs/1911.03001
License
CubeFS is licensed under the Apache License, Version 2.0. For detail see LICENSE and NOTICE.
Note
The master branch may be in an unstable or even broken state during development. Please use releases instead of the master branch in order to get a stable set of binaries.
