gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 02:00:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
4,506 Commits 48 Branches 52 Tags 378 MiB
aa716d9fc0
Commit Graph

62 Commits

Author SHA1 Message Date
zhaochenyang
aa716d9fc0 refactor(lcnode): hybrid cloud stop scan retry and log optimization #22515436 #22538171 #22543543 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
7a1c28fc85 fix(SDK): in function ExtentClient.Read, return if get extents failed. 
#22476752
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
56b4c27f7a fix(lcnode): hybrid cloud support start one task and stop one task 
#22423763
	#22502668
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
eca0d782fb fix(lcnode): hybrid cloud support start vol task and stop vol task #22326199 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
daf4dd9d51 fix(lcNode): hybrid cloud set followerRead as false when create ExtentClient 
#22481972
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
c496672d81 fix(lcnode): hybrid cloud task restart everyday and sync lc results #22449953 #22438986 #22454917 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
7346d24e74 fix(lcnode): hybrid cloud task continue if lcnode or master restart #22326221 #22322540 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
744b001d5c fix(lcnode): hybrid cloud new blobstore client only when migrating to blobstore #22404848 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
7ddd35e9ee fix(lcnode): hybrid cloud optimize lcnode scanning #22347010 #22401484 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
bfc9130b8e fix(master): hybrid cloud when zoneName in datanode's conf file changed, make adjustments of topology. 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
0fe9b02796 fix(lcnode): hybrid cloud optimize lcnode auditlog #22295845 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
NaturalSelect
3b9ef65dbe chore(all): format code 
@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
9fd51b5119 fix(lcnode): hybrid cloud remove multiple registrations for /metrics 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
09259d999d fix(sdk): hybrid cloud set VolCacheDpStorageClass when invoking NewExtentClient 
#22196488
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
ed9545c7a7 feat(lcnode): hybrid cloud add lcnode auditlog (#22067931) 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
bb6e16be21 fix(lcnode): hybrid cloud NewEbsClient when ebsAddr is not nil (#22049286) 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
52f2317304 fix(metanode): support empty file migration 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
08665970fd fix(lcnode): multipart migration to blobstore 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
cf5db8b6b6 fix(lcnode): hybrid cloud set delayDelMinute after migration 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
5b867906d2 fix(lcnode): hybrid cloud DeleteMigrationExtentKey before migration 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
ae018c58cd refactor(lcnode): hybrid cloud add start time in heartbeat 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
d207dcc6fe refactor(lcnode): hybrid cloud fix lcnode log 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
94dcb991db feat(metanode): hybrid cloud add audit log for migration 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
d9c01f0af5 fix(client): hybrid cloud Fix some places where the original condition 
should be changed to "vol storageClass is blobstore".
	Adds field volStorageClass to ExtentClient for this purpose.
	Remove field volumeType from ExtentClient by the way.

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
75925990f1 refactor(lcnode): hybrid cloud lifecycle transition 
1. add debug service

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
4c73097a3d refactor(lcnode): hybrid cloud lifecycle transition 
1. close extent client
2. use StorageClass_Replica_HDD and StorageClass_BlobStore
3. scanner init AllowedStorageClass
4. enhance lifecycle parameter check
5. add extent client for write

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
505015cd17 refactor(metanode): hybrid cloud add api for get full inode infomation include eks 
Signed-off-by: chihe <chi.he@oppo.com>
 2024-12-26 09:24:22 +08:00
zhaochenyang
d89812aaf0 feat(lcnode): hybrid cloud lifecycle transition 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-12-26 09:24:22 +08:00
W9068822
d25840b71f feat(metrics): report version of client, metanode, datanode, authnode, lcnode, objectnode 
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
 2024-07-22 17:10:59 +08:00
slasher
5c7898354f style(all): format all codes with golangci tools 
closes #3371

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
 2024-05-14 09:54:13 +08:00
zhaochenyang
72d9291453 fix(lcnode): fix lcnode panic and reduce task allocation time 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-03-07 17:21:21 +08:00
zhaochenyang
a1c3183386 fix(lcnode): snapshot apply on lcnode 
1. add firstDentry may cause panic if channel close
2. reset snapshot verinfos before add verinfo
3. add TaskResults in GetOneTask to avoid adding tasks repeatedly
4. support notify multi snapshot tasks
5. delete snapshot failed retry

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2024-02-22 14:53:39 +08:00
slasher
5d5e45cb0a chore(util): store current time to atomic value 
BenchmarkGetCurrentTime-4    100000000    11.60 ns/op            0 B/op          0 allocs/op
-->
BenchmarkGetCurrentTime-4    895091701     1.31 ns/op            0 B/op          0 allocs/op

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2024-01-31 19:13:25 +08:00
slasher
8234a93836 chore(lcnode): golangci lint apply into lcnode 
Signed-off-by: slasher <shenjie1@oppo.com>
 2023-12-28 17:13:05 +08:00
zhaochenyang
bd6608b8d0 enhance(lcnode): support multi task 
1. add lcTaskCountLimit
2. delete Scanning and add WorkingCount
3. add lcnode addr in heartbeat resp and scan resp

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2023-12-14 11:14:14 +08:00
lily-lee
126cef4bc6 fix(code scan): remove default statements in select added before 
Signed-off-by: lily-lee <lilylee88756@gmail.com>
 2023-12-09 22:32:29 +08:00
lily-lee
a8620dc1e9 fix(code scan): fix code-scanning problems. 
Signed-off-by: lily-lee <lilylee88756@gmail.com>
 2023-11-28 12:32:15 +08:00
zhaochenyang
61b19a1202 fix(lcnode): stop lcnode straightway 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2023-10-27 14:07:57 +08:00
zhaochenyang
3507c8d9b4 fix(lcnode): close metawrapper in lcnode 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2023-10-27 14:07:57 +08:00
NaturalSelect
34ec9ff8c6 feat(lc): support full path audit log 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-10-18 14:51:09 +08:00
zhaochenyang
c655eafbea fix(lcnode): fix duplicate sending of the same task and update delete interface 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2023-10-09 10:18:07 +08:00
leonrayang
2ed714c33c refactor(sdk,metaNode): refactor function name and param mainly relate to snapshot 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-09-05 19:30:39 +08:00
zhaochenyang
95c3c127fb refactor(lcnode): refactor some code about lcnode task manager 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2023-08-31 16:36:14 +08:00
zhaochenyang
f8c657daad refactor(lcnode): refactor some code in lcnode 
1)refactor some code about snapshot
2)fix some bugs
3)add some ut

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2023-08-30 20:05:32 +08:00
zhaochenyang
dcf9551268 fix(master): fix panic that may be caused in lcnode task 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2023-08-30 20:05:32 +08:00
zhaochenyang
a6d125f5ce feat(lcnode/master): lcnode support bucket lifecycle and vol snapshot delete 
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
 2023-08-30 20:05:32 +08:00
leonrayang
3a6e0715d3 fix: go vet not pass 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-08-30 20:05:32 +08:00
Patrick Wu
1960b503c4 fix: same task may be dispatched to multiple lcnodes when master leader changed or restarted 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-08-30 20:05:32 +08:00
Patrick Wu
66d95cb3bb fix: skip reading child files of dir in second phase scanning 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-08-30 20:05:32 +08:00
leonrayang
9c54f81c46 enhance: update read dir params to recognize options from snapshot deletion 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-08-30 20:05:32 +08:00