gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 10:06:14 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
6,190 Commits 48 Branches 52 Tags 378 MiB
master
Commit Graph

122 Commits

Author SHA1 Message Date
xiejian
e286733d88 fix(shardnode): clean up prometheus labels on shard/disk removal 
with: #1000420047

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-05-25 10:40:13 +08:00
xiejian
612b656595 refactor(shardnode): improve tracing and volume cache consistency 
with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-05-15 11:02:25 +08:00
xiejian
6272fa3d38 fix(shardnode): encode blob task stats in correct way 
with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
94da88c382 fix(shardnode): set default retry times for slice repair config 
with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
9c76be3c6a fix(shardnode): fix sliceRepiarMgr components not initialized 
with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
44ff52987e feat(shardnode): support ip change for blob delete and slice repair process 
with: #1000567432

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
c2c9db173b feature(shardnode): init shardnode metrics report 
with: #1000503826

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
c0a5c67060 feature(shardnode): metadata statistics implementation 
with: #1000464391

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
4d5b05ec0d feat(shardnode): init execute repair message process 
with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
073b7aee84 refactor(shardnode): rename blobdeleter package to message 
with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
43248c2656 refactor(shardnode): 1.extract public blob message process components 
2.update punish message process

with: #1000420040

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
b6ee58a15f feat(shardnode): synchronize the latest volume alloc process of proxy 
with: #1000389284

Signed-off-by: xiejian <xiejian3@oppo.com>
 2026-04-21 09:23:09 +08:00
xiejian
8960fc7232 feat(shardnode): no need to wait apply member change when delete shards of broken disk 
with #1000176986

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:49:59 +08:00
xiejian
5a0a424edb fix(shardnode): avoid concurrent map iteration and map write 
when deleteSlice() failed in blob delete process

with: #1000357684

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:49:52 +08:00
xiejian
b19837d3b5 fix(shardnode): update clear trash shard task process 
with: #1000362906

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:47:54 +08:00
xiejian
d936cd4284 fix(shardnode): when disk broken and volume not updated should not delete blob success 
with: #1000357684

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:47:54 +08:00
xiejian
6ac6e515a2 fix(shardnode): blobdeleter: when no more delete msg created and then punish a msg 
punish operation can't take effect

with: #1000346246

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:47:54 +08:00
xiejian
43780a871a fix(shardnode): blobdeleter: 1 fix deleteStage abnormal reset 
2 avoid repeated list delete messages from storage

with: #1000346246

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:47:54 +08:00
xiejian
f4b8b362ac fix(shardnode): fix not record delete stage when delete shard failed in blobdeleter 
with: #1000335110

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:47:19 +08:00
xiejian
a1b9bbb10c feat(shardnode): 1.add delete log for blobdeleter, add some trace log 
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:35 +08:00
xiejian
0cbe1e276b feat(shardnode): support http rpc service 
with: #1000324330

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:35 +08:00
xiejian
a587a62b53 feat(shardnode): support show delete blob stats 
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:35 +08:00
slasher
76310260ee feat(access): write delete message to shardnode 
. #1000306808

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-10-13 15:29:35 +08:00
xiejian
3dafd80165 feat(shardnode): support set config to kinds of time unit in json string 
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:35 +08:00
xiejian
0b116a1097 feat(shardnode): support function for building blob name or item id with shardkeys 
change shardkeys type from [][]byte to []string

with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:35 +08:00
xiejian
8704c5b061 fix(shardnode): change blob name and item id data type from bytes to string 
with: #1000181642

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:35 +08:00
xiejian
9caef0e93d refactor(shardnode): rename delete_stage.go to extent_msg.go 
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:35 +08:00
xiejian
59ec91cf3c refactor(shardnode): replace msg.go from base to blobdeleter 
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:35 +08:00
xiejian
a851e43681 fix(shardnode): fix bugs of delete blob process 
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:35 +08:00
xiejian
4b74e874b0 feat(shardnode): support DeleteBlobRaw api, generate delete blob msg when DeleteBlob 
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:34 +08:00
xiejian
84cbec67e9 feat(shardnode): init blob delete manager to support delete blob process 
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:34 +08:00
xiejian
7e826ee36c feat(shardnode): add basic functions required to support the delete blob process 
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:34 +08:00
xiejian
a548e93f81 feat(shardnode): set shardKeys in blob name or item id, use '{}' to mark 
with: #1000181642

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-10-13 15:29:34 +08:00
slasher
8c156972a8 chore(testing): move mock files to testing all 
. #1000145567

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-10-13 15:29:33 +08:00
slasher
ad3442a467 chore(testing): move mock files to testing shardnode 
. #1000145567

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-10-13 15:29:33 +08:00
slasher
6506cab835 feat(common): add extend codemode 
. #1000111154

close .3773 .3767

Signed-off-by: slasher <shenjie1@oppo.com>
 2025-10-13 15:29:33 +08:00
xiejian
8ede90565d fix(shardnode): skip readIndex in shard.Stats() when service start 
with: #1000176274

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:16 +08:00
xiejian
dcdb7fb681 fix(shardnode): do not compare idc and rack info with clustermgr when init 
with: #1000176986

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:16 +08:00
xiejian
03cb728729 fix(shardnode): prevent seal part slices of local 
with: #1000183861

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:16 +08:00
xiejian
0c6d15042d fix(shardnode): 1.remove raft group when apply remove member 
avoid removed member still leader and clear raft data after all raft log applied
2. skip load disk which status is not normal in clustermgr
3.import gomonkey package

with: #1000176986

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:16 +08:00
xiejian
413c1de3c2 fix(shardnode): check readIndexFunc loaded in shard when preRWCheck 
with: #1000167662

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:16 +08:00
xiejian
836738b7e1 feat(shardnode): distinguish item and blob key in storage 
with: #22989410

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:16 +08:00
xiejian
27327ab3ce fix(shardnode): replay raft log by ReadIndex() before start serve, remove load shard asynchronous 
with: #1000004366

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
8274a65907 fix(shardnode): record slice count when SealBlob 
with #23109197

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
fd185ed965 test(shardnode): optimize shardnode ut 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
74c69ccd41 fix(shardnode): remove failedSlice.Count check of AllocSlice api 
full check of SealBlob args, update location when SealBlob

with #23109197

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
f83500da17 feat(shardnode): clear shardnode list blob log, print blob when seal failed 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
a7ffe01736 feat(raft): clear raft log 
with #22357426

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
fe107d3304 feat(shardnode): sync route version from clustermgr before start serve 
with #23092404

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00
xiejian
a05df55013 fix(shardnode): prevent reopen broken disk as normal cause raft panic 
with #23075546

Signed-off-by: xiejian <xiejian3@oppo.com>
 2025-07-08 11:30:15 +08:00