Commit Graph

6152 Commits

Author SHA1 Message Date
xiejian
c0a5c67060 feature(shardnode): metadata statistics implementation
with: #1000464391

Signed-off-by: xiejian <xiejian3@oppo.com>
2026-04-21 09:23:09 +08:00
xiejian
6dcf03ab41 refactor(shardnode): rename del_blob.go
with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
2026-04-21 09:23:09 +08:00
xiejian
4d5b05ec0d feat(shardnode): init execute repair message process
with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
2026-04-21 09:23:09 +08:00
xiejian
073b7aee84 refactor(shardnode): rename blobdeleter package to message
with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
2026-04-21 09:23:09 +08:00
xiejian
43248c2656 refactor(shardnode): 1.extract public blob message process components
2.update punish message process

with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
2026-04-21 09:23:09 +08:00
mawei029
2294b13288 fix(blobnode): read format json backward compatible, check crc with old version
with: #1000464074

Signed-off-by: mawei029 <mawei2@oppo.com>
2026-04-21 09:23:09 +08:00
tangdeyi
e122cb60f3 feat(clustermgr): add cluster readonly manager api
with #1000596325

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2026-04-21 09:23:09 +08:00
tangdeyi
412fa7a48d fix(clustermgr): total free chunk only stats normal disk
#1000518879

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
6518595f6e feat(access): no distance for crossing idc getting
. #1000573599

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
8e85d22aee feat(proxy): changeable expiration config for volume and disk
. #1000570314

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
c047eecb51 feat(access): disk info expire in access memory
. #1000558473

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
xiejian
e93202c7c9 refactor(proxy): replace VersionVolume with VolumeInfo
with: #1000419929

Signed-off-by: xiejian <xiejian3@oppo.com>
2026-04-21 09:23:09 +08:00
xiejian
00919b446f feat(proxy): update volume cache by apply route update from clustermgr
with: #1000419929

Signed-off-by: xiejian <xiejian3@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
ac43310e84 feat(cli): using disk host for command
. #1000557660

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
0be8a2d820 feat(access): using disk host for put and get
. #1000557660

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
tangdeyi
54a61cea8c feat(clustermgr): multi create volume optimization
1. volume creation is limited by idc/disk free chunk
2. volume creation count can be configured by codemode ratio
3. volume creation can be triggered by volume writable space

with #1000518879

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2026-04-21 09:23:09 +08:00
tangdeyi
48d2dfdf6c feat(clustermgr): update disk lastupdate when disk status changes
with #1000518879

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2026-04-21 09:23:09 +08:00
tangdeyi
6499ead6d5 feat(clustermgr): raft filewal cleans trash log by itself
with #1000543617

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2026-04-21 09:23:09 +08:00
tangdeyi
8b085fbac6 feat(clustermgr): clustermgr support blobnode ip change
with #1000453093

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2026-04-21 09:23:09 +08:00
JasonHu520
28c5590b25 feat(scheduler): support ip change for delete and shard repair process
with: #1000426729
Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2026-04-21 09:23:09 +08:00
JasonHu520
df1a79c29d feat(scheduler): support ip change for blobnode
with: #1000426729
Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2026-04-21 09:23:09 +08:00
tangdeyi
3ffb090df4 feat(clustermgr): volume route add volume base info
with #1000431984

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2026-04-21 09:23:09 +08:00
mawei029
db13083205 feat(blobnode): support blobnode ip change with nodeID
with: #1000464074

Signed-off-by: mawei029 <mawei2@oppo.com>
2026-04-21 09:23:09 +08:00
tangdeyi
be22aad2b7 feat(clustermgr): create and update volume route
with #1000431984

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2026-04-21 09:23:09 +08:00
mawei029
2b2efeb073 fix(blobnode): we need check old disk status
when hot register disk; and check cluster id when add disk

with: #1000528521

Signed-off-by: mawei029 <mawei2@oppo.com>
2026-04-21 09:23:09 +08:00
JasonHu520
0e08c6e443 feat(scheduler): balance task access new alloc interface of cm
with: #1000527051
Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2026-04-21 09:23:09 +08:00
mawei029
f66d9bd2ae chore(blobnode): optimize stop blobnode, add some print log
with: #1000486493

Signed-off-by: mawei029 <mawei2@oppo.com>
2026-04-21 09:23:09 +08:00
xiejian
e0c1414bba feat(proxy): supports independent config of volume cache for different codemode
with: #1000420053

Signed-off-by: xiejian <xiejian3@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
06f8fb00cf feat(log): apply async logger to app and api
. #1000453008

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
b5fc5b8a23 feat(log): drop logging if aync queque is full
. #1000453008

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
3771f8a0be feat(log): add async logger in util
. #1000453008

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
tangdeyi
e5e1848ef0 feat(clustermgr): alloc chunk at disk level in balance case
with #1000479337

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
142434da6e fix(access): return 499 if alloc canceled
. #1000508589

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
mawei029
b572bb6be4 feat(blobnode): we can hot query, qos current statistic
with: #1000415457

Signed-off-by: mawei029 <mawei2@oppo.com>
2026-04-21 09:23:09 +08:00
zhangjianwei2
00fa06c716 feat(bssdk): support specify code_mode and cluster_id for access sdk put api
fixes: https://github.com/cubefs/cubefs/issues/3954

@formatter:off

Signed-off-by: zhangjianwei2 <zhangjianwei2@cmss.chinamobile.com>
2026-04-21 09:23:09 +08:00
yuzhiqiang
ed09c33f3b feat(blobnode): supports mounting meta directories separately for each disk
@formatter:off

Signed-off-by: yuzhiqiang <yuzhiqiang_yewu@cmss.chinamobile.com>
2026-04-21 09:23:09 +08:00
JasonHu520
199a945da0 perf(scheduler): optimize volume lock and disk limiting conflicts
with: #1000414417
Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2026-04-21 09:23:09 +08:00
mawei029
67e82011b3 fix(blobnode): fix clean lost disk metric when startup
fix fatal when lost disk has already marked broken disk

with: #1000389434 , #1000389466

Signed-off-by: mawei029 <mawei2@oppo.com>
2026-04-21 09:23:09 +08:00
slasher
5a588bb032 feat(access): retry uniqe proxy service in access
. #1000403229

Signed-off-by: slasher <shenjie1@oppo.com>
2026-04-21 09:23:09 +08:00
xiejian
b6ee58a15f feat(shardnode): synchronize the latest volume alloc process of proxy
with: #1000389284

Signed-off-by: xiejian <xiejian3@oppo.com>
2026-04-21 09:23:09 +08:00
JasonHu520
c7188afc2a feat(scheduler): acquire task no more aware task switch status
with: #1000380867

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2026-04-21 09:23:09 +08:00
yanghonggang
e3bc840a4e refactor(blobstore): reuse stream mempool and lazy init in access
* blobstore/sdk/sdk_client.go: sdkHandler now reuses the memory pool from
  the underlying stream handler instead of relying on a separate init()
* blobstore/api/access/client.go: Delay memory pool allocation until
  New() is called, removing the forced init() allocation

close #3918

@formatter:off

Signed-off-by: yanghonggang <yanghonggang_yewu@cmss.chinamobile.com>
Signed-off-by: zhangjianwei2 <zhangjianwei2_yewu@cmss.chinamobile.com>
2026-04-21 09:23:09 +08:00
Cloudstriff
ec4630026b feat(blobstore): init cpp version package directory
with #1000382944

Signed-off-by: Cloudstriff <chenjiong@oppo.com>
2026-04-21 09:23:09 +08:00
leonrayang
4d6c55a9ab feat(doc): 2026 Roadmap Update
Signed-off-by: leonrayang <changliang@oppo.com>
2026-04-20 17:13:00 +08:00
chihe
80a062bf2c fix(doc): modify change log
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
2025-12-26 14:59:44 +08:00
clinx
0bcdcee745 fix(flash): fix codeQL issue
@formatter:off

Signed-off-by: clinx <chenlin1@oppo.com>
2025-12-26 11:30:38 +08:00
leonrayang
0b02c44208 fix(client): Disable xattr security.capability to avoid useless request to backend
close:#1000519910

@formatter:off

Signed-off-by: leonrayang <changliang@oppo.com>
2025-12-25 14:43:17 +08:00
leonrayang
2b6173f7e6 fix(doc): Delete and update the usage of some outdated project names
@formatter:off

Signed-off-by: leonrayang <changliang@oppo.com>
2025-12-25 14:42:34 +08:00
clinx
43c448a75b fix(flash): change the reserved space of flashnode
with: #1000568547

Signed-off-by: clinx <chenlin1@oppo.com>
2025-12-25 14:42:00 +08:00
Victor1319
0424ada0fc fix(fuse): revert maxWrite constant to 128kB.
close:#1000511705

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-12-25 14:41:44 +08:00