Commit Graph

5889 Commits

Author SHA1 Message Date
slasher
42ebc216ca fix(rpc): atomic error with all type
. #1000341010

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:47:54 +08:00
xiejian
f4b8b362ac fix(shardnode): fix not record delete stage when delete shard failed in blobdeleter
with: #1000335110

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:47:19 +08:00
xiejian
a1b9bbb10c feat(shardnode): 1.add delete log for blobdeleter, add some trace log
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
0cbe1e276b feat(shardnode): support http rpc service
with: #1000324330

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
slasher
44d2151d55 fix(trace): thread safe in trace span logging
. #1000320592

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
c998151d88 chore(blobnode): optimize unstable io pool ut tests
with: #1000334360

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
c93391332d fix(blobnode): fix data inspect mistakenly flagged bid
with: #1000322051

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
a587a62b53 feat(shardnode): support show delete blob stats
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
slasher
76310260ee feat(access): write delete message to shardnode
. #1000306808

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:29:35 +08:00
slasher
5a0e61dbbd chore(util): parse size in json configuration
. #1000334184

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:29:35 +08:00
slasher
81136e138e chore(util): alignment adds full size and blocks
. #1000334184

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
3dafd80165 feat(shardnode): support set config to kinds of time unit in json string
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
c58a38222a refactor(api): rename parse.go to proto.go
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
0b116a1097 feat(shardnode): support function for building blob name or item id with shardkeys
change shardkeys type from [][]byte to []string

with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
0d5c51eca8 fix(blobnode): when task call io pool submit, but ctx is cancel, fix return error
with: #1000309518

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
cdfce1c0ab tools(blobnode): disk drop stat check tool, support get blobnode ip from net_card
with: #1000334360

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
JasonHu520
daa85f973b fix(scheduler): update blob delete process for updating volume strategy
with: #1000304421

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
186cca127a fix(bssdk): change blob name type from bytes to string
with: #1000181642

Signed-off-by: mawei029 <mawei2@oppo.com>
Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
8704c5b061 fix(shardnode): change blob name and item id data type from bytes to string
with: #1000181642

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
75fec3ce29 chroe(blobnode): qos dynamic print log with disk id, the same target does not change
with: #1000334360

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
ac218c0fbb fix(blobnode): qos config hot modify, qos dynamic update limiter
with: #1000291897

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
bb4b64cc13 chroe(blobnode): increase the speed of ut, blobnode/core saving 30 seconds time
with:#1000334360

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
slasher
5f9600d088 chore(cli): show oversold free chunks
. #1000334184

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:29:35 +08:00
slasher
ad13597835 fix(proxy): proxy erase success if cache file not exist
. #21966006

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:29:35 +08:00
slasher
72cb5e8a87 feat(util): add Any2String and String2Any
. #1000334184

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
ed90619ed6 fix(blobnode): fix data inspect concurrent write or read map
with: #1000287722

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
3ae408e632 feat(blobnode): optimize log print, query inspect progress, record local log
with: #1000276667, #1000276672

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
39622270c8 fix(scheduler): record DiskDrop and ManualMigrate task in cache
with: #1000088302

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
JasonHu520
05c3635ff4 perf(blobnode): batch read support config timeout independently
with: #1000285347

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
9caef0e93d refactor(shardnode): rename delete_stage.go to extent_msg.go
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
59ec91cf3c refactor(shardnode): replace msg.go from base to blobdeleter
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
xiejian
a851e43681 fix(shardnode): fix bugs of delete blob process
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:35 +08:00
mawei029
d9d494ef80 feat(blobnode): dynamic update qos limiter
with: #1000260946, #1000213241

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:35 +08:00
JasonHu520
dcc95a03af fix(scheduler): fix stats interface for not response delete
and repair process with follower

with: #1000262678

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-10-13 15:29:35 +08:00
Cloudstriff
861046913b feat(util): use multi queue and thread pool to read or write data in large file
with #1000262058

Signed-off-by: Cloudstriff <chenjiong@oppo.com>
2025-10-13 15:29:35 +08:00
Cloudstriff
fece963da4 feat(util): add lightly operation IsClosed for closer
with #1000262058

Signed-off-by: Cloudstriff <chenjiong@oppo.com>
2025-10-13 15:29:34 +08:00
mawei029
06b43cac9a fix(blobnode): both woker and blobnode, need load code mode
with: #1000271469

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:34 +08:00
JasonHu520
4cd5060660 fix(blobnode): crc failed while repairing via batch read, should set data not ok in memory
with: #1000262678

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-10-13 15:29:34 +08:00
xiejian
e9ef158574 fix(raft): limit entries size when call storage.Entries
with: #23065907

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:34 +08:00
xiejian
4b74e874b0 feat(shardnode): support DeleteBlobRaw api, generate delete blob msg when DeleteBlob
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:34 +08:00
xiejian
84cbec67e9 feat(shardnode): init blob delete manager to support delete blob process
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:34 +08:00
xiejian
7e826ee36c feat(shardnode): add basic functions required to support the delete blob process
with: #1000042472

Signed-off-by: xiejian <xiejian3@oppo.com>
2025-10-13 15:29:34 +08:00
mawei029
432e1bfb58 refactor(blobnode): io qos mgr refactor, bandwidth dynamic limit, refactor qos type
with: #1000150059, #1000213238, #1000213241, #1000213265, #1000150059, #1000223627

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:34 +08:00
mawei029
a4a171a966 chroe(blobnode): meta db, disk broken EIO error
with: #1000334364

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:34 +08:00
mawei029
bde4cfedda refactor(blobnode): move util iopool to blobnode base
with: #1000250443

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:34 +08:00
tangdeyi
ae044299b3 fix(clustermgr): set volume epoch when loadData
with #1000255629

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2025-10-13 15:29:34 +08:00
mawei029
315a833194 refactor(blobnode): refacotr blobnode api iostat io type
with: #1000150059

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:34 +08:00
JasonHu520
d2eabe608c fix(blobnode): support batch download for repair in local
with: #1000247932

Signed-off-by: JasonHu520 <huzongchao@oppo.com>
2025-10-13 15:29:34 +08:00
mawei029
2378992e7b chroe(blobnode): disk broken EIO error, cannot allocate memory
with: #1000249055

Signed-off-by: mawei029 <mawei2@oppo.com>
2025-10-13 15:29:34 +08:00
slasher
b346da9385 fix(access): new span for background task
. #1000247577

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:29:34 +08:00