Commit Graph

70 Commits

Author SHA1 Message Date
chihe
d95c94d0e8 feat(flashgroupmanager): support api for flashnode management
close:#1000154569

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit 7d37d86f47)
2025-12-24 16:59:49 +08:00
Wu Huocheng
ddbff60e9c feat(master): forbidden to create data partition when the writable number reach config value
. #1000100007

Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-08 14:59:28 +08:00
Victor1319
c3ccdfc7e2 refactor(sdk): remove dp cache code from sdk, client, cli. #1000063488
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:27 +08:00
slasher
d30f8cae5b feat(flashnode): run flashnode in docker
. #22115361

Signed-off-by: slasher <mcq.sejust@gmail.com>
2025-08-07 15:19:00 +08:00
slasher
131b332136 chore(ci): split run test for cubefs and blobstore
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-09 10:05:10 +08:00
slasher
d4288318de feat(ci): add docker for go 1.18
@formatter:off

close: #3782

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:16 +08:00
leonrayang
3396accd80 feat(projectstructure): reorganize the module directory in the root to a suitable subdirectory
close:#22458839

Signed-off-by: leonrayang <chl696@sina.com>
2024-12-26 09:24:22 +08:00
Victor1319
7b8801af4e test(docker): support run in hybrid way for docker mod. #22816675
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
6cafecdb7d feat(masterclientcli): add property volStorageClass and allowedStorageClass to volume
now volType is not uesed while creating volume, but is maintained for compability

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
NaturalSelect
374018d88d fix(client): fix appendExtentKey extent conflict
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
slasher
5c7898354f style(all): format all codes with golangci tools
closes #3371

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2024-05-14 09:54:13 +08:00
slasher
4ae8eb48e7 chore(proto): golangci lint apply into proto
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-12 14:21:16 +08:00
slasher
1d84f74acd chore(format): format all code with gofumpt
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-12 14:21:16 +08:00
slasher
27c0b44a17 chore(blockcache): golangci lint apply into blockcache
Signed-off-by: slasher <shenjie1@oppo.com>
2023-12-28 17:13:05 +08:00
slasher
8234a93836 chore(lcnode): golangci lint apply into lcnode
Signed-off-by: slasher <shenjie1@oppo.com>
2023-12-28 17:13:05 +08:00
slasher
8f3e31faa8 feat(ci): show diffs of gofmt in ci format
Signed-off-by: slasher <shenjie1@oppo.com>
2023-12-27 10:23:10 +08:00
zhuzhengyi001
9f968b373d Enhancement: update dockerimage for s3test
Signed-off-by: zhuzhengyi001 <zhuzhengyi001@ke.com>
Signed-off-by: slasher <shenjie1@oppo.com>
2023-11-24 14:41:14 +08:00
slasher
7f406e5d0e chore(cli): golangci lint apply into cli
Signed-off-by: slasher <shenjie1@oppo.com>
2023-10-23 15:31:07 +08:00
slasher
a679018192 build(storage): format code with go generate
Signed-off-by: slasher <shenjie1@oppo.com>
2023-09-18 15:22:58 +08:00
NaturalSelect
7b945319cd test(ci): show node information to help debug
Signed-off-by: NaturalSelect <2145973003@qq.com>
2023-09-15 14:33:24 +08:00
leonrayang
4d81c6693c update: snapshot deletion and build test env
. inode 0 snapshot deletion and top layer deletion
. extentlist get inode don't need verion
. snapshot tools clean support 0 deletion
. update: build metanode basic test env

Signed-off-by: leonrayang <chl696@sina.com>
2023-08-30 20:05:32 +08:00
Patrick Wu
29e3110a93 S3 lifecycle
Signed-off-by: Patrick Wu <wuchunhuan@gmail.com>
2023-08-30 20:05:32 +08:00
slasher
fbbd480bb5 test(ci): rename all ci checks
close: #2210

Signed-off-by: slasher <shenjie1@oppo.com>
2023-06-29 11:56:08 +08:00
slasher
8c0deada4f test(build): concurrency unit and scenario tests
Signed-off-by: slasher <shenjie1@oppo.com>
2023-06-28 17:31:23 +08:00
yuxiaobo
53b933f1b8 build: put rocksdb libs into the docker image
Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
2023-05-29 17:08:46 +08:00
leonrayang
d5bb45ea49 docs. update to cubefs
Signed-off-by: leonrayang <chl696@sina.com>
2023-05-26 11:17:10 +08:00
yuxiaobo
ac75137295 build: the build script of blobstore is merged into cubefs
1. rocksdb upgrade to 6.3.6
2. optimize the build scripts
3. fix build errors
4. add env variable for blobstore unit test
5. update git ignore file to ignore build and test result
6. modify open files limit for unit test

Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: Victor1319 <834863182@qq.com>
2023-05-23 15:24:53 +08:00
leonrayang
f41b8c40d5 update: docker start create hot volume on default
Signed-off-by: leonrayang <chl696@sina.com>
2023-03-04 16:13:35 +08:00
Patrick Wu
c8bf55ae69 S3 bugfix
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
2023-03-04 16:13:35 +08:00
Patrick Wu
5f9e775cbe Cold volume support for S3 in objectnode
Signed-off-by: Patrick Wu <wuchunhuan@gmail.com>
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
2023-03-04 16:13:35 +08:00
slasher
15bdd062fc test(docker): run ltp testing when released
run ltp test with tag v* and release-*

closes #1698

Signed-off-by: slasher <shenjie1@oppo.com>
2023-02-28 16:01:50 +08:00
ZhangRui
07012bf6fa add build cfs-bcache
Signed-off-by: zcola <zhangrui90@163.com>
2022-10-11 17:48:27 +08:00
leonrayang
051a6218f9 update: clean docker start cli output
Signed-off-by: leonrayang <chl696@sina.com>
2022-08-22 18:16:09 +08:00
leonrayang
9a30b9f884 update: update to CubeFS
Signed-off-by: leonrayang <chl696@sina.com>
2022-08-22 18:16:09 +08:00
leonrayang
f97aa5717c update: name related update to cubefs
Signed-off-by: leonrayang <chl696@sina.com>
2022-08-10 22:05:45 +08:00
wanglei469
6c9364ed8b test: change s3-tests from single bucket to double buckets
We found a bug when multi bucket were operated.
The s3-tests case now only support single bucket tests.
So I add a bucket named 's3test'.

Signed-off-by: wanglei469 <wanglei469@ke.com>
2022-03-14 11:07:45 +08:00
leonrayang
2970e2c3d1 update. go import path change from chubaofs to cubefs
Signed-off-by: leonrayang <chl696@sina.com>
2022-01-25 18:17:02 +08:00
Shuoran Liu
c01debc1cd ci: use go 1.16.12 instead of go 1.15
As of Go 1.16, os.ReadDir is a more efficient and correct choice than
ioutil.ReadDir, so we are making the updates.

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2022-01-21 12:04:56 +08:00
zhuzhengyi001
4e17bdbac4 Fix: fix ltptest ci bug
Signed-off-by: zhuzhengyi001 <zhuzhengyi001@ke.com>
2021-08-25 18:02:00 +08:00
Justice
d455fdaea6 Enhancement: add ci check for ltptest result
Signed-off-by: Justice <zhengyi.zhu.hust@gmail.com>
2021-07-30 14:19:41 +08:00
Shuoran Liu
47129c7eb7 enhance: add libsdk build process to ci
Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2021-02-09 15:31:58 +08:00
awzhgw
cf7fbde1f5
Revert "Sync from release-20200720" 2020-11-11 14:23:59 +08:00
awzhgw
b230b7107d Sync changes from release-20200720 branch.
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
Signed-off-by: xuxihao1 <xuxihao3@jd.com>
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-11-09 16:03:42 +08:00
xuxihao1
428b5d1018 Enhancement: set/get delete rate parameters, display zone information and bad partition ids in cli tools.
Signed-off-by: xuxihao1 <xuxihao3@jd.com>
2020-07-30 11:13:28 +08:00
xuxihao1
f3cfd46577 enhancement: introduce log to cli tool and format error message
Signed-off-by: xuxihao1 <xuxihao3@jd.com>
2020-07-16 20:10:51 +08:00
ansjsun
f0c164523e add console node
Signed-off-by: ansjsun <ansj-sun@163.com>
2020-07-03 12:21:11 +08:00
yuboLee
2775a5e1cc Enhancement: add support for modifying part system metadata, self defined metadata management and tagging management
Signed-off-by: yuboLee <pangbolee@gmail.com>
2020-06-11 08:48:53 +08:00
Mofei Zhang
5b2d3fdc8f
Optimize multipart session lookup and docker tool
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-05-28 12:23:55 +08:00
Mervin
c52f2aa306
Merge branch 'master' into master 2020-05-22 13:49:20 +08:00
Mofei Zhang
df4b7f9a42
Fix: parallel-safe issue in conn pool and metanode conn serve
1. Fix: parallel-safe issue in conn pool and metanode conn serve
2. Fix: nil pointer issue when list parts for non-exist uploadId
3. Enhancement: validate read size while read from connnect.
4. Enhancement: clean up useless data on failure while upload part.
5. Enhancement: generate ETag if do not exist when listing.
6. Enhancement: include error message when formatting packet to string.
7. Enhancement: improve compatile with old version SDK.
8. Enhancement:  success when retry add exist multipart part.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
Signed-off-by: 张墨飞 <zhangmofei@jd.com>
2020-05-21 12:28:18 +08:00