Commit Graph

5188 Commits

Author SHA1 Message Date
clinx
0eb05bd9f7 feat(data): compatible json serialization for old datanode. #22883846
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 15:57:56 +08:00
clinx
e3ae2ea3f1 feat(data): change extentinfo serialize for getting remote extend info#22883846
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 15:57:56 +08:00
chihe
b0807770c3 fix(objectnode): return error message when encountering internal err
close:#22997834

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 15:57:56 +08:00
chihe
c65d6c19df fix(lcnode): init ExtentConfig with metaWrapper
close:#23007284

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 15:57:56 +08:00
chihe
621017b3b3 fix(client): cache all files if remoteCachePath is empty.
close:#23002423

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 15:57:56 +08:00
chihe
639a696545 fix(bcache): reduce memory consumption for bcache-service
close:#22775703

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 15:57:56 +08:00
zhumingze
1a20920be2 feat(datameta): Modify gcRecyclePercent to be configurable. #22995150
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 15:57:56 +08:00
baihailong
8d81c6d2f0 fix(cli): Restrict cli only execute httpStat and httpEvict on the flashnode of the cluster.#22983845
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:57:56 +08:00
chihe
12917180d4 fix(master): fix dead lock for flashnode
close:#22985995

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 15:57:56 +08:00
zhumingze
5e57eb1ecd feat(master): Add maximally-read config in master for better management. #22931456
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 15:57:56 +08:00
zhumingze
cbdcb01411 feat(sdk): support read quorum when dp no leader. #22931456
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 15:57:56 +08:00
chihe
dcc1b828ab refactor(client): Increase the timeout period for blobstore client
close:#22897285

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 15:57:56 +08:00
shuqiang-zheng
745261d31a fix(flashnode): modify log level for cacheBlock load failures.
close:#22985948

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 15:57:56 +08:00
baihailong
3d7c4917c2 fix(flashnode): optimize flashnode list cost time.#22989953
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:57:56 +08:00
baihailong
836108a02c fix(flashnode): optimize log level when cachePrepareTaskCh has been full.#22985948
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:57:56 +08:00
baihailong
46c323c25e fix(sdk): if not enable followerread, flashnode only read from dp leader.#22972336
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:57:56 +08:00
baihailong
969df96cb7 fix(cli): fix flashgroup info too many blank line and limit max weight of flashgroup.#22981269
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:57:56 +08:00
baihailong
fbc5634f63 fix(master): when master not find flashnode zone leadto panic.#22983373
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:57:56 +08:00
baihailong
f6a8a544c2 feat(flashnode): supplement flashnode info for http interface flashnode/get.#22975706
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:57:56 +08:00
chihe
94253b719d feat(client): remote cache supports specify dir
close:#22897285

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 15:57:56 +08:00
shuqiang-zheng
ca2eb33605 fix(flashnode): modify the name of the cache size and ratio configuration item.
close:#22963423

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 15:57:56 +08:00
shuqiang-zheng
f883980012 fix(flashnode): fix slow source return in case of concurrent cache reads.
@formatter:off

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 15:57:56 +08:00
shuqiang-zheng
76007c2d8d fix(flashnode): same cacheBlock may be created multiple times.
close:#22922141

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 15:57:40 +08:00
shuqiang-zheng
110075c431 feat(flashnode): data cache supports persistence and caching limit the number of file handle.
close:#22886884 #22886873

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 15:45:54 +08:00
shuqiang-zheng
101f0e0099 fix(flashnode): fix the problem of high cpu due to frequent gc on flashnode.
close:#22872898

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 15:45:54 +08:00
shuqiang-zheng
1cfd66ec91 fix(flashnode): fix low performance due to traversing keys in fetch status.
close:#22838790

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 15:45:37 +08:00
shuqiang-zheng
cf338f6fa5 feat(flashnode): supports configurable lru capacity.
close:#22834016

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2025-08-07 15:45:37 +08:00
baihailong
e9d9a447fd feat(client): support configuring enableRemoteCacheOnlyForNotSSD.#22957483
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:37 +08:00
baihailong
19dd3a225a feat(client): support configuring the maximum file size of remotecache.#22897285
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:37 +08:00
zhumingze
a2a73616ca feat(fsck): Add force clean function for fsck. #22944717
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 15:45:37 +08:00
baihailong
090e94bab8 feat(flashcache): Support to specify the weight parameter when creating flashgroup.#22931494
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:37 +08:00
Wu Huocheng
2752860e9e chore(metanode): Add debug logs and meta partition empty checking.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 15:45:37 +08:00
Wu Huocheng
d8bdc8d44f feat(master): Add getting clean task for empty meta partition.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 15:45:37 +08:00
Wu Huocheng
799173432e feat(master): Wait for 10 minites before setting meta replica forbidden.#22834621
Run the clean command in the background. It may takes several hours.

Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 15:45:37 +08:00
Wu Huocheng
f00702a0d0 feat(metanode): add set meta partition freeze raft command.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 15:45:37 +08:00
Wu Huocheng
1565adf97d fix(metanode): backup the raft dir of meta partition.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 15:45:37 +08:00
Wu Huocheng
46bb136ee8 chore(master): update the codes according to review comments.#22834621
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 15:45:37 +08:00
Wu Huocheng
242eedf13d chore(client): restore the client codes.#22834621
Delete the codes that removing empty meta partitions.

Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-08-07 15:45:37 +08:00
Wu Huocheng
6d881229b4 feat(master): Add freeze and clean empty meta partitions apis.#22834621
Signed-off-by: wu huocheng <wuhuocheng@oppo.com>
2025-08-07 15:45:37 +08:00
baihailong
4a30d7164c fix(master): Optimizing some http registration function of remotecache.#22913153
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:37 +08:00
zhumingze
410e4545e1 feat(master): Support setting dp and mp cnt limit for different machines #22883514
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-07 15:45:37 +08:00
baihailong
6d18b6251e fix(flashnode): parent directory permission wrong cause block file creation failure.#22906620
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:37 +08:00
baihailong
057d9605da fix(cli): Restrict the valid and default values of the volume's remoteCache parameter.#22897624
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:26 +08:00
baihailong
a04d110270 fix(flashnode): when removing a flashnode it adds an idle one.#22890663
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:25 +08:00
baihailong
db3099e619 fix(flashnode): fix unit test error.#22876448
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:25 +08:00
baihailong
607b49d953 fix(flashnode): optimize metrics of flashnode.#22876448
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:25 +08:00
baihailong
00b082d8d3 fix(flashnode): format some code and fix some test case error.#22692038
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:25 +08:00
baihailong
5083a406f0 fix(flashnode): add some metric for flashnode.#22837445
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:25 +08:00
baihailong
b550c3f4d8 fix(sdk): client can only select one flashnode in the same fg.#22802475
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:25 +08:00
baihailong
4a373f4b23 fix(flashcache): format some code and remove unsued code.#22692038
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-07 15:45:25 +08:00