Commit Graph

4591 Commits

Author SHA1 Message Date
Victor1319
447fcc1d61 fix(master): support meta follower read. #22782680
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
44d1d95161 fix(meta): fix some issue about compatiable. #22780321
1. remove useless code.
2. fix compatiable bug abount dataMediatType.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
60401d3e87 refactor(meta): remove useless code. #22716915
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
8209e99634 feat(client): trash can be disabled by sdk
close:#22775703

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
5c43034c5f fix(master): when performing meta-restoring, it is essential to check this action need to be executed.
close:#22771554

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
4ab0642da0 fix(sdk): enable config bcache only for clod data.#22770439
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
531fe6abec fix(client): enableBcache is invalid even if it was specified.#22770449
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
zhumingze
830781858e refactor(autofs): update default log and client path logic #22227137
Signed-off-by: zhumingze <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
40f7d2fc5c fix(meta): return opErr when append migrate extent key. #22771173
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
c36d41d8a5 refactor(master): add log for master raft op. #22766129
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
0c09436c98 fix(metanode): remove invalid filed for repsonese of getInode
close:#22768285

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
2f5ba609e5 refactor(lcnode): hybrid cloud avoid heatbeat timeout during adding lcnode #22768923
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
a69ba6978f fix(meta): fix unmarshal append inode bug. #22764528
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Reliey
96f4b0101b feat(datanode): add endpoint for setting enablePid in exporter and handle response building #22257509
Signed-off-by: Reliey <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
Reliey
ddfc4c29b8 feat(master): add http interface getOpLog for data processing #22257509
Signed-off-by: Reliey <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
Reliey
5f3c6e2d4a feat(cli): support reporting and viewing of cluster and vol dimension disk data #22257509
Signed-off-by: Reliey <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
Reliey
3986329ed7 feat(mastercli): support datanode report dpOpLog and diskOpLog infomation. #22257509
Signed-off-by: Reliey <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
Reliey
9ef9459cb3 test(stat): add testcase for statistic log when disk is full. #22637219
Signed-off-by: Reliey <zhumingze@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
a32476c9c5 fix(meta): fix unmarshal append inode bug. #22764528
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
bcf36ab04f fix(metanode): modify log level for fsmInternalBatchFreeMigrationExtentKey
close:#22757889

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
0eecc1fd85 fix(cli): fix some tiny issues. #22727537
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
abc2ab5912 refactor(master): support double check master media cfg type. #22727537
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
6fee55eb98 fix(meta): process extent list req as cache for blobstore ino. #22726594
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
ad404e752f feat(meta): hybrid cloud metanode quit starting if master not support the API getUpgradeCompatibleSettings
close:#22727537
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
7d22d9d451 feat(master): no allowed to start if config legacyDataMediaType not set correctly
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
shuqiang-zheng
754d983c36 fix(meta): fix an unlocked error when getting the leader address and master address from the masterclient.
close:#22709182
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
2bfd708dcf refactor(metanode): submit inode to free forbidden migration by batch
close:#22701675

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
623a671184 fix(meta): empty file not check storage class. #22735527
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
7ba5908e16 fix(ci): set master config enableDirectDeleteVol as true
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
2bced8d337 refactor(datameta): hybrid cloud optimize some logs related to upgrade compatibility
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
67ef6faefc fix(raft): make the apply and apply snapshot processes mutually exclusive. #22720099
not truncate raft log before raft apply snapshot success.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
692fa3e567 fix(meta): only file check storage class when unmarshal inode. #22735527
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
9f5fbba63b refactor(master): refactor variable name from cap to quota. #22731703
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
1eca4bf9bc fix(meta): avoid modify inode info in btree.#22575226
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
ce3439d199 feat(master): support replica storage quota limit.#22731703
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
2fc987ad17 refactor(meta): refactor metanode inodeGetWithAtime code. #22726594
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
5ca27c4483 refactor(master): suppor stat blob storage used. #22623271
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
168fa0418c feat(mastermeta): add LegacyDataMediaType in master cluster values, and metaNode fetch it from master.
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
716aa7970a feat(masterdata): datanode quit starting if master returns mediaType not match when register
close:#22727852
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
87f06d51bb refactor(master): support show vol used space group by media type. #22718093
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
07a9e70386 refactor(meta): support concurrent delete extent. #22716917
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
f134d2699c fix(metanode): delete extent_del file when reach end of the file. #22706828
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
c6f2c51277 fix(metanode): recover panic when marshal inode failed. #22720099
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
97af707e01 refactor(meta): support compatible with v3.4.0. #22711062
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
1f704d8eea fix(master): hybrid cloud correctly set legacy zone's dataMediaType by config legacyDataMediaType
#22699128
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
99beb68c32 fix(master): when create replica volume and replica-num is less than 3, auto set follower-read as true
close:#22701504
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
46b540ac7c fix(master): avoid the Apply and Snapshot processes at the same time. #22660472
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
17b4921396 fix(fsck): fix nil pointer when get partition info
close:#22709584
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
d09a0d21e4 refactor(lcnode): hybrid cloud avoid panic if rule in doing is nil #22706069
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
c824423199 refactor(meta): pass atime when batch sync inodes atime. #22701675
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00