Commit Graph

6045 Commits

Author SHA1 Message Date
clinx
cd086fcb46 fix(flash): warm up task set force remote cache true
with: #1000390069

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 272660d7cb)
2025-12-24 17:01:22 +08:00
chihe
9f3548653a refactor(client): new sliding algorithm for readAhead
close:#1000048465

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit c2d6947a71)
2025-12-24 17:01:22 +08:00
chihe
407b49211d feat(client): support defining the size of cacheBlockSize
close:#1000261380

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit d2031e685c)
2025-12-24 17:01:22 +08:00
clinx
8ab32b038a fix(flash): increase reserve space for flash node
with: #1000386811

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 2881c1ce33)
2025-12-24 17:01:22 +08:00
clinx
144674ee30 feat(falsh): check file size limits for warm up task
with: #1000383519

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 03ae1861c7)
2025-12-24 17:01:22 +08:00
clinx
15f85f11a7 fix(flash): Double-check to prevent deleting newly created data
with: #1000379203

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 97365b5b2e)
2025-12-24 17:01:22 +08:00
clinx
7d6f427942 fix(flash): Avoid printing garbled characters
with: #1000371716

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 31e326f36d)
2025-12-24 17:01:22 +08:00
shuqiang-zheng
5251e6a78f feat(master): Record the decommission term when the dataNode is decommissioned.
close: #1000362788

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
(cherry picked from commit 8a0b0e5b67)
2025-12-24 17:01:21 +08:00
clinx
2a9b335268 fix(client): put interface uses custom errors to avoid obtaining pointer errors
with: #1000371716

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 578c7abb49)
2025-12-24 17:01:21 +08:00
chihe
7b045f2004 fix(client): flush as sequnce
close:#1000363069

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit d7ee0324af)
2025-12-24 17:01:21 +08:00
chihe
127bdc8899 fix(client): calculate remainsize in doMultiAheadRead
close:#1000367076

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit bea4dd6439)
2025-12-24 17:01:21 +08:00
shuqiang-zheng
2b3734bdad fix(master): fix the issue about dp marked decommission state.
close: #1000365149

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
(cherry picked from commit e17f460bd2)
2025-12-24 17:01:21 +08:00
shuqiang-zheng
1c580ae8ab fix(master): display the weight and decommission type.
close: #1000362788

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
(cherry picked from commit ef8d06e97e)
2025-12-24 17:01:20 +08:00
clinx
5554fe1e05 fix(flash): free allocated size after write data completed
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 61e58f7098)
2025-12-24 17:01:20 +08:00
clinx
e226b5cd07 fix(client): Remove unused time statistics fields
with: #1000359075

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 6f96108973)
2025-12-24 17:01:20 +08:00
clinx
36480cc4eb fix(client): update client dp info by master
with: #1000359075

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 5ea3b0ced5)
2025-12-24 17:01:20 +08:00
chihe
1f27e9bd37 fix(client): fix errMsg for aheadRead
close:#1000367076

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit b2498aabf3)
2025-12-24 17:01:19 +08:00
clinx
6ee91cd64c fix(flash): avoid returning network EOF
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 086034cb92)
2025-12-24 17:01:19 +08:00
clinx
b586dcd2a9 fix(flash): change the write packet size to 64K to avoid timeout
with:#1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 6e73ed2cd0)
2025-12-24 17:01:19 +08:00
chihe
49bbf008be fix(client): do not wait for async flush if stream is error
close:#1000363069

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit b5b2d3644c)
2025-12-24 17:01:19 +08:00
clinx
02f98822d1 fix(flash): set connection deadline with ctx for put
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit b07e38d8b1)
2025-12-24 17:01:18 +08:00
clinx
207f7b859a fix(flash): do not put cache miss error to warn
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 6503c0d7cc)
2025-12-24 17:01:18 +08:00
shuqiang-zheng
a721af2489 fix(master): fix issue about querying the decommissioning progress of a disk.
close: #1000362788

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
(cherry picked from commit 45d91e1387)
2025-12-24 17:01:18 +08:00
clinx
ed1f826956 fix(flash): print cache miss error to debug log file
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit e306c6f6fb)
2025-12-24 17:01:18 +08:00
shuqiang-zheng
f4ff24068e fix(master): fix an issue about maximum rollback count.
close: #1000359057

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
(cherry picked from commit 53ef100852)
2025-12-24 17:01:18 +08:00
shuqiang-zheng
8042b39daa fix(master): fix panic caused by lack of locking during concurrent access to the rafts map.
close: #1000356742

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
(cherry picked from commit 5635b02677)
2025-12-24 17:01:17 +08:00
shuqiang-zheng
97855da728 fix(master): fix the issue of inaccurate disk and node decommission progress due to leader changes.
close: #1000349627

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
(cherry picked from commit 65ac8ca7b2)
2025-12-24 17:01:17 +08:00
clinx
29052a66e7 fix(flash): free pre-allocated space after file creation
with:#1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 77eb7c264c)
2025-12-24 17:01:17 +08:00
chihe
1ce947de7b fix(clinet): shuffle the order of hosts for aheadread
close:#1000340945

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit f49728b4be)
2025-12-24 17:01:16 +08:00
clinx
02f6ab6370 fix(flash): change keyToDiskMap type
with: #1000356686

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 750ea762d1)
2025-12-24 17:01:16 +08:00
clinx
e9e4a82869 fix(flash): the master distributes the flashkeylimit value
with: #1000356686

Signed-off-by: clinx <chenlin1@oppo.com>
2025-12-24 17:01:16 +08:00
clinx
c38343e211 fix(flash): the read and write rate limit sizes using master config
with: #1000356820

Signed-off-by: clinx <chenlin1@oppo.com>

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 76dd0886b5)
2025-12-24 17:01:16 +08:00
chihe
a83b7d2678 fix(client): fix the issue with the timing of triggering the addNextTask task
close:#1000354285

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit de243a2a87)
2025-12-24 17:01:15 +08:00
Victor1319
d1291ff9f0 fix(cluster): update infos to handle discard partitions.
close:#1000355377

- Modify function signature to include ignoreDiscard parameter
- Update logic to skip discarded data partitions when requested
- Ensure compatibility with existing data node retrieval logic

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
(cherry picked from commit d24e646004)
2025-12-24 17:01:15 +08:00
clinx
5561a1d3a6 fix(flash): check key limit with no wait
with: #1000355286

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit b6771c282a)
2025-12-24 17:01:15 +08:00
chihe
220d470ac2 fix(client): fixing the prefetching sliding window logic
close:#1000354285

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit 5657874b3f)
2025-12-24 17:01:15 +08:00
chihe
663d97f009 fix(client): add unit test for aheadread
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit 9d45588a13)
2025-12-24 17:01:14 +08:00
clinx
41aa1cf2c1 feat(flash): atomic update request result
with: #1000347719

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 52a3674321)
2025-12-24 17:01:14 +08:00
clinx
d10274f4a4 fix(flash): config client flow limit by master
with: #1000347719

Signed-off-by: clinx <chenlin1@oppo.com>
2025-12-24 17:01:14 +08:00
clinx
3aa98d5fae fix(flash): pull handleReadTimeout when flashnode start
with: #1000347719

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit dfa3e22413)
2025-12-24 17:01:14 +08:00
clinx
ea4f49f026 fix(flash): change log level to warn
with: #1000347719

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 53edbd9d19)
2025-12-24 17:01:14 +08:00
chihe
01dfa9f09e fix(client): fix bugs in partly hit scenarios of the prefetch function
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit 19ea486af1)
2025-12-24 17:01:13 +08:00
dengxiaochao
d794dc4647 fix(sdk): incorrect offset when aheadread copy cacheBlock to req data buffer
@formatter:off

Signed-off-by: dengxiaochao <dengxiaochao@bilibili.com>
(cherry picked from commit a5f9ecd148)
2025-12-24 17:01:13 +08:00
clinx
6125ac66b7 fix(flash): to load blockv2 need to init key limieter
with: #1000347719

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 6685b34b2e)
2025-12-24 17:01:13 +08:00
clinx
cd4078e069 fix(client): add flow limit for object operation
with: #1000343199

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit d4c2520e8f)
2025-12-24 17:01:13 +08:00
clinx
bebe48c0ca feat(flash): add key limiter for cache read
with: #1000274394

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 951e600424)
2025-12-24 17:01:12 +08:00
shuqiang-zheng
4b3a8708ce fix(master): Optimize the reporting metrics for bad disks that fail to decommission promptly.
close: #1000336199

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
(cherry picked from commit dfcc603a03)
2025-12-24 17:01:12 +08:00
shuqiang-zheng
08b78954ca fix(master): fix an issue where token might consume twice.
close: #1000336199

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
(cherry picked from commit 654d5bfcf2)
2025-12-24 17:01:12 +08:00
chihe
5c83c917a1 fix(client): read from leader when excuting ahead read
close:#1000340945

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit a59c4c71ed)
2025-12-24 17:01:11 +08:00
zhumingze
8960c9388e fix(master): Don't show disk decommissionSuccess alerts triggered by node decommission.
.#1000336575

Signed-off-by: zhumingze <zhumingze@oppo.com>
(cherry picked from commit 2f64db405b)
2025-12-24 17:01:11 +08:00