Commit Graph

63 Commits

Author SHA1 Message Date
chihe
9c561ac9e3 feat(flashgroupmaster): support raft
close:#1000167427

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit b7af94e2a4)
2025-12-24 16:59:49 +08:00
chihe
7db7d4ddfc feat(flashgroupmanager): support api for flashgroup management
close:#1000153351

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit 0f02785f81)
2025-12-24 16:59:49 +08:00
chihe
4497d7de7a feat(flashgroupmanager): support api service
close:#1000151163

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit e40e6c0597)
2025-12-24 16:59:49 +08:00
zhumingze1108
2f8f2f92a7 fix(sdk): gofmt v3.5.2 for mege to master
Signed-off-by: zhumingze1108 <zhumingze@oppo.com>
2025-08-11 20:21:42 +08:00
slasher
a53b757e6d fix(flashnode): run testing in docker with no tmpfs
. #22200600

Signed-off-by: slasher <mcq.sejust@gmail.com>
2025-08-07 15:19:07 +08:00
slasher
d30f8cae5b feat(flashnode): run flashnode in docker
. #22115361

Signed-off-by: slasher <mcq.sejust@gmail.com>
2025-08-07 15:19:00 +08:00
slasher
131b332136 chore(ci): split run test for cubefs and blobstore
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-09 10:05:10 +08:00
slasher
d4288318de feat(ci): add docker for go 1.18
@formatter:off

close: #3782

Signed-off-by: slasher <shenjie1@oppo.com>
2025-07-08 11:30:16 +08:00
StevenLeiZhang
7a1921817a fix(build): grafana container can not start
close #3746

Signed-off-by: StevenLeiZhang <zhangleiic@163.com>
2025-03-31 10:15:06 +08:00
leonrayang
2e2250256c fix(docker): The filed version is obsolete due to the updated version of Docker Composeweq
Signed-off-by: leonrayang <chl696@sina.com>
2025-02-18 15:19:32 +08:00
NaturalSelect
374018d88d fix(client): fix appendExtentKey extent conflict
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-07-22 17:10:59 +08:00
Victor1319
4df91ebc6e refactor(all): reslove merge conflicts between 3.3.x and 3.4.0.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-07-18 16:57:38 +08:00
slasher
fa71952e55 feat(build): build with goreleaser
Signed-off-by: slasher <shenjie1@oppo.com>
2024-07-18 16:57:38 +08:00
slasher
f97f692c27 chore(ci): replace blobstore checking with main format
Signed-off-by: slasher <shenjie1@oppo.com>
2024-07-16 11:39:45 +08:00
mingwei
da525628ab fix(docker): fix docker-compose yml
double '<<' isn't allowed to new version of docker-compose, change to
the new form.

Signed-off-by: mingwei <42128779+heymingwei@users.noreply.github.com>

fix(docker): fix docker-compose yml

double '<<' isn't allowed to new version of docker-compose, change to
the new form.

Signed-off-by: mingwei <42128779+heymingwei@users.noreply.github.com>
2024-02-29 15:54:40 +08:00
NaturalSelect
c65758cf9c feat(ci): ci test support podman
Signed-off-by: NaturalSelect <2145973003@qq.com>
2024-01-09 14:19:28 +08:00
slasher
cef3ec9fb9 chore(docker): use variables in docker yml
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-09 14:19:28 +08:00
slasher
481fd33b9e chore(master): turn off logging of testing in docker
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-04 17:37:31 +08:00
slasher
fc431f6360 chore(ci): remove ltp in docker if no ltptest
Signed-off-by: slasher <shenjie1@oppo.com>
2023-12-28 17:13:05 +08:00
slasher
3fd0354057 feat(build): build with goreleaser
Signed-off-by: slasher <shenjie1@oppo.com>
2023-12-06 18:43:46 +08:00
zhaochenyang
4566e8810e feat(ci): add sast tools gosec and semgrep
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2023-12-06 17:05:54 +08:00
zhuzhengyi001
9f968b373d Enhancement: update dockerimage for s3test
Signed-off-by: zhuzhengyi001 <zhuzhengyi001@ke.com>
Signed-off-by: slasher <shenjie1@oppo.com>
2023-11-24 14:41:14 +08:00
Patrick Wu
29e3110a93 S3 lifecycle
Signed-off-by: Patrick Wu <wuchunhuan@gmail.com>
2023-08-30 20:05:32 +08:00
slasher
a0a12d530f test(ci): declaring variables in docker compose
Signed-off-by: slasher <shenjie1@oppo.com>
2023-06-29 11:56:08 +08:00
slasher
4f7c17cc76 test(ci): format blobstore in docker
Signed-off-by: slasher <shenjie1@oppo.com>
2023-06-29 11:56:08 +08:00
slasher
8c0deada4f test(build): concurrency unit and scenario tests
Signed-off-by: slasher <shenjie1@oppo.com>
2023-06-28 17:31:23 +08:00
yuxiaobo
53b933f1b8 build: put rocksdb libs into the docker image
Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
2023-05-29 17:08:46 +08:00
yuxiaobo
ac75137295 build: the build script of blobstore is merged into cubefs
1. rocksdb upgrade to 6.3.6
2. optimize the build scripts
3. fix build errors
4. add env variable for blobstore unit test
5. update git ignore file to ignore build and test result
6. modify open files limit for unit test

Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: Victor1319 <834863182@qq.com>
2023-05-23 15:24:53 +08:00
Patrick Wu
de36b418cf audit log
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
2023-03-04 16:13:35 +08:00
slasher
8e449b620e test(checks): upload test coverage to codecov
Signed-off-by: slasher <shenjie1@oppo.com>
2023-02-28 17:29:06 +08:00
leonrayang
f0d35128bd update. docker image path change from chubaofs to cubefs
Signed-off-by: leonrayang <chl696@sina.com>
2022-01-25 18:17:02 +08:00
Shuoran Liu
c01debc1cd ci: use go 1.16.12 instead of go 1.15
As of Go 1.16, os.ReadDir is a more efficient and correct choice than
ioutil.ReadDir, so we are making the updates.

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2022-01-21 12:04:56 +08:00
Shuoran Liu
79509ad8ad change: use ghcr instead of dockerhub
Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2021-08-02 20:59:51 +08:00
Shuoran Liu
8b00c19a66 change: docker pull to docker build
This commit changes the ci process from docker pull to docker build
since docker hub limits the image pulling rate. Also change the base
image from golang:1.12 to golang:1.15

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2021-01-07 20:59:14 +08:00
ansjsun
f0c164523e add console node
Signed-off-by: ansjsun <ansj-sun@163.com>
2020-07-03 12:21:11 +08:00
Mofei Zhang
5b2d3fdc8f
Optimize multipart session lookup and docker tool
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-05-28 12:23:55 +08:00
xuxihao
10c957b810 Fix: the maxInodeID of a metapartition is not sync to others when recovered from snapshot; docker build failing when running build_docker.sh; spelling mistakes in cli
Refactor: upgrade base image from `cfs-base:1.0` to `cfs-base:1.1` in dockerfile

Signed-off-by: xuxihao <xuxihao3@jd.com>
2020-05-20 18:20:03 +08:00
zhuzhengyi1
483e5b635b
Update: add detailed vol info on grafana dashboard
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-04-24 14:17:13 +08:00
Mofei Zhang
4a456f6951
Enhancement: add python based test script for s3
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-04-21 17:17:13 +08:00
xuxihao
176475a671 Fix: using local time to replace UTC in S3 modify action
Signed-off-by: xuxihao <xuxihao3@jd.com>
2020-04-16 17:46:41 +08:00
zhuzhengyi1
631b0e0666 Enhancement: add log map for docker-compose
Signed-off-by: zhuzhengyi1 <zhuzhengyi@jd.com>
2020-04-10 09:24:17 +08:00
Mofei Zhang
4ff10e0326
Enhancement: adjust name of the monitoring point
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-04-09 15:52:19 +08:00
zhuzhengyi1
721b9f3858 Enhancement: add prometheus metrics for objectnode
Signed-off-by: zhuzhengyi1 <zhuzhengyi@jd.com>
2020-04-09 14:11:51 +08:00
Mofei Zhang
e37abd0731
Enhancement: reduce blocking under concurrency
The blacklist mechanism has been added to the user store and volume
manager in the object node to solve the adverse effect of a large number
of invalid requests on system performance in a short period of time.

Stream requests to the user store and volume manager in the object node
in a hash bucket manner, reducing the blocking caused by read and write
locks under concurrency.

Abstracted the user store and added an implementation that does not
cache user information. This is enabled through the "strict"
configuration to provide sufficient real-time performance with cluster
information during interface compatibility testing.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-03-31 19:36:21 +08:00
Mofei Zhang
ddfd8b7c3f
Enhancement: improve error parsing for master APIs
Enhancement: improve error parsing for master APIs.
Fix: status code of DelteBucket ans DeleteObjects API.
Fix: url signature parsing of signature algorithm V2.
Add: s3tests framework for compatibility test.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-03-22 08:31:51 +08:00
Mofei Zhang
76bc8667af
Refactor: using cli instead of curl in CI scripts
Refactor: using cli instead of curl in CI scripts
Add: CLI command for CLI for adding more data partition to volume
Enhancement: optimize CLI output format

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-03-21 16:32:32 +08:00
Mervin
c495a765d3
Fix: fix docker ip address and format configuration files
Signed-off-by: Mervin <mofei2816@gmail.com>
2020-03-09 12:14:01 +08:00
Mervin
a78ce3ad84
Fix: log output of getObjectXAttrHandler
Signed-off-by: Mervin <mofei2816@gmail.com>
2020-03-09 10:35:34 +08:00
Mofei Zhang
9ccccafe32
Enhancement: add nginx and upstream for objectnode in docker compose
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-03-04 17:16:35 +08:00
zhuhyc
3450baeebc fix: decommission replica one by one
Only one replica can be taken offline at the same time, and other replicas can be taken offline only after recovery is completed
Signed-off-by: zhuhyc <zzhniy.163.niy@163.com>
2020-01-10 10:42:24 +08:00