Commit Graph

4529 Commits

Author SHA1 Message Date
true1064
883b15189d feat(metamastercli): hybrid cloud migration data usage statistics.
close:#22658297
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
c8de84516c refactor(sdk): log print dataPartition count of mediaType when refresh and select dataPartition.
close:#22600758
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
f25aa0734d feat(master): not allow a volume supports both replica storageClass and blobstore
close:#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
1452d45a88 feat(meta): put them into extent delete channel when deleting migration extents of type replica
close:#22605815
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
3677494108 refactor(sdk): support sleep before retry when write datanode failed. #22602256
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
f7a7ed66ee refactor(lcnode): hybrid cloud lifecycle validity check #22653422
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
532d35a5f1 fix(sdk): set innerReq when init metawrapper. #22645132
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
53d939fad6 fix(datameta): use default value if master not support the API AdminGetVolListForbidWriteOpOfProtoVer0.
close:#22644059
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
fecf14f159 feat(lcnode): set inner req true when init lc scanner meta wrapper. #22639641
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
d4d65ab8a0 feat(meta): not modify atime when get extent list for inner req. #22639641
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
2694a71d5d feat(meta): return real accessTime for lcnode get req. #22639636
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
63d0b94f57 feat(master): add an API to get volumes those set forbidden write op codes of protocaol version-0
close#22531837
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
f56ef231a1 fix(sdk): classifiy statistic file size and count for refresher tool.#22490031
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
baihailong
e9fb2da0b1 fix(libsdk): libsdk support interface for cubefs tools.#22490031
Signed-off-by: baihailong <baihailong@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
9f7ffeb194 feat(masterdatameta): support volume to forbidden write operate codes of lower packet protocol version
close#22531837

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
9d23e1660f refactor(lcnode): hybrid cloud stop task if vol delete #22520059
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
a43f96d403 feat(dataclientmaster): support configuring datanode and metanode to forbidden
write operate codes of lower packet protocol version.
       	 close#22531837
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
7fa4bb8992 refactor(lcnode): hybrid cloud memory optimization #22401401
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
4939fa8f63 refactor(lcnode): hybrid cloud config use create time and log optimization #22616040
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
b65e2b7ca6 fix(meta): hybrid cloud not allow truncate if inode's actual storageClass is blob
close:#22571994
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
ca137d7c0d fix(meta): hybrid cloud fix panic when print log in function UpdateExtentKeyAfterMigration
close:#22568588
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
ade3d22670 refactor(meta): hybrid cloud add storageClass validation check when inode.storageClass changes
##22542807
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
282bb4bde2 feat(master): if crossZone true, support degrade to create partitions when only one zone available
close:#22548189
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
aa716d9fc0 refactor(lcnode): hybrid cloud stop scan retry and log optimization #22515436 #22538171 #22543543
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
8c7acf9714 refactor(sdk): updateExtentKeyAfterMigration print only warn log if inode's lease is occupied
close:#22543543
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
71a04cd570 fix(master): reset mp replica's usage stat of storageClass if the metanode is not alive.
close:#22490158
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
0d12d07d03 fix(client): to access the right storageClass when inode has migrated to blobstore
close:#22506168
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
7a1c28fc85 fix(SDK): in function ExtentClient.Read, return if get extents failed.
#22476752
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
chihe
e21dbd7a0a fix(metanode): if storage class is already the same with request, return directly
close:#22517222

Signed-off-by: chihe <chihe@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
037df5f5f9 fix(sdkclient): client compatible with older version server modules
#22400600
	@formatter:off
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
56b4c27f7a fix(lcnode): hybrid cloud support start one task and stop one task
#22423763
	#22502668
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
f385a3b49d fix(lcnode): hybrid cloud delete vol done result when start vol task #22496315
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
eca0d782fb fix(lcnode): hybrid cloud support start vol task and stop vol task #22326199
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
daf4dd9d51 fix(lcNode): hybrid cloud set followerRead as false when create ExtentClient
#22481972
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
4e3e4752e0 fix(lcnode): hybrid cloud fix panic in setLcMetrics #22466527
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
c496672d81 fix(lcnode): hybrid cloud task restart everyday and sync lc results #22449953 #22438986 #22454917
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
cc025affe3 refactor(client): hybrid cloud print warn log when OpMetaExtentsList returns proto.OpMismatchStorageClass
#22004328
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
57c8f26829 refactor(cli): hybrid cloud add storageClass tips in help messages
#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
42aaa6d19a refactor(meta): hybrid cloud optimize meta log in UpdateExtentKeyAfterMigration()
#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
7346d24e74 fix(lcnode): hybrid cloud task continue if lcnode or master restart #22326221 #22322540
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
f9d8d69a29 fix(meta): after deletion migrate extents of an inode
push it back info free list if it is marked delete.
	#22313098
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
e05a7c063e refactor(meta): hybrid cloud optimize some error logging
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
744b001d5c fix(lcnode): hybrid cloud new blobstore client only when migrating to blobstore #22404848
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
af298477f3 fix(master): check if volume's zoneName list has the resource when add allowed storageClass
#22395995
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
zhaochenyang
7ddd35e9ee fix(lcnode): hybrid cloud optimize lcnode scanning #22347010 #22401484
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
00b4ccdbce fix(meta): hybrid cloud if raft not leader when submit opFSMUpdateExtentKeyAfterMigration
response proto.OpAgain
	#22332725
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
6e06157948 feat(metalcnode): meta API OpMetaUpdateExtentKeyAfterMigration replies err details to lcNode
lcNode will print it to audit log
	#22327519
	#22385058
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
e2e9943f47 feat(cli): while creating volume, auto set crossZone as true if assigned more than one zone.
#22376966

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
d1cbcb3d5e fix(master): hybrid cloud while creating volume, check datapartiton count of specific meidaType.
#22377936
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
4d6ee74eb2 feat(meta): hybrid cloud metapartition can start when failed to create blobStore client
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00