Commit Graph

79 Commits

Author SHA1 Message Date
zhaochenyang
6cdbcd6df1 refactor(lcnode): lcnode response ack to master after save data #22941195
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2025-01-08 14:20:11 +08:00
Victor1319
a8fde3ceb4 fix(meta): Adjust the call order of the RegistConsul func to prevent concurrent modify to clustername. #22873788
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-30 16:00:12 +08:00
Victor1319
12c73399bb refactor(lcnode): rename variable name writeGen to leaseExpire. #22855673
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-30 16:00:12 +08:00
Victor1319
a686e2a394 refactor(meta): refactor client lease logic. #22855673
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-30 16:00:12 +08:00
Victor1319
e6dbbd7fae refactor(sdk): for inner req, only support request mp leader . #22818553
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-30 16:00:11 +08:00
zhaochenyang
8092937450 refactor(lcnode): [hybrid cloud] lc scanner skip trash dir #22797969
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:33 +08:00
zhaochenyang
4f98302544 refactor(lcnode): [hybrid cloud] add auditlog for lc start stop and heartbeat #22771832
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:33 +08:00
chihe
a43321fe23 feat(client): trash can be disabled by sdk
close:#22775703

Signed-off-by: chihe <chihe@oppo.com>
2024-12-30 15:59:33 +08:00
zhaochenyang
7eeacd18ba refactor(lcnode): [hybrid cloud] avoid heatbeat timeout during adding lcnode #22768923
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:33 +08:00
chihe
b887d20127 fix(client):Client data modification is prohibited if renewal failed
close:#22676203

Signed-off-by: chihe <chihe@oppo.com>
2024-12-30 15:59:32 +08:00
zhaochenyang
d530146c48 refactor(lcnode): [hybrid cloud] admin lcnode auditlog #22675357 #22680253
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:32 +08:00
Victor1319
6da6e2d30d fix(sdk): avoid write on tiny extent handler again. #22657199
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-30 15:59:31 +08:00
Victor1319
333c5ae937 refactor(sdk): support sleep before retry when write datanode failed. #22602256
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-30 15:59:31 +08:00
zhaochenyang
2686afa949 refactor(lcnode): [hybrid cloud] lifecycle validity check #22653422
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:31 +08:00
Victor1319
b975cd742e feat(lcnode): set inner req true when init lc scanner meta wrapper. #22639641
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-30 15:59:31 +08:00
Victor1319
3b59f0243e feat(meta): return real accessTime for lcnode get req. #22639636
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-30 15:59:31 +08:00
zhaochenyang
54106de10c refactor(lcnode): [hybrid cloud] memory optimization #22401401
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:31 +08:00
zhaochenyang
40f3e530b6 refactor(lcnode): [hybrid cloud] config use create time and log optimization #22616040
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:31 +08:00
zhaochenyang
97e9884a3c refactor(lcnode): [hybrid cloud] stop scan retry and log optimization #22515436 #22538171 #22543543
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:31 +08:00
true1064
8369975ca6 fix(SDK): in function ExtentClient.Read, return if get extents failed.
#22476752
Signed-off-by: tangjingyu <tangjingyu@oppo.com>
2024-12-30 15:59:31 +08:00
zhaochenyang
52925c8a1b fix(lcnode): [hybrid cloud] support start one task and stop one task
#22423763
#22502668
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:30 +08:00
zhaochenyang
fc227055b4 fix(lcnode): [hybrid cloud] support start vol task and stop vol task #22326199
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:30 +08:00
true1064
dcb0e0f3d6 fix(lcNode):[hybrid cloud] set followerRead as false when create ExtentClient
#22481972
Signed-off-by: tangjingyu <tangjingyu@oppo.com>
2024-12-30 15:59:30 +08:00
zhaochenyang
be002f2831 fix(lcnode): [hybrid cloud] task restart everyday and sync lc results #22449953 #22438986 #22454917
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:30 +08:00
zhaochenyang
d18d38065f fix(lcnode): [hybrid cloud] task continue if lcnode or master restart #22326221 #22322540
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:30 +08:00
zhaochenyang
9177f90b31 fix(lcnode): [hybrid cloud] new blobstore client only when migrating to blobstore #22404848
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:30 +08:00
zhaochenyang
fd42546042 fix(lcnode): [hybrid cloud] optimize lcnode scanning #22347010 #22401484
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:30 +08:00
true1064
6a7cc48b75 fix(master): [hybrid cloud] when zoneName in datanode's conf file changed, make adjustments of topology.
Signed-off-by: tangjingyu <tangjingyu@oppo.com>
2024-12-30 15:59:30 +08:00
zhaochenyang
0729e9774a fix(lcnode): [hybrid cloud] optimize lcnode auditlog #22295845
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:30 +08:00
NaturalSelect
8f2d18f4f3 chore(all): format code
@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-12-30 15:59:30 +08:00
true1064
f983783222 fix(lcNode): [hybrid cloud] remove multiple registrations for "/metrics"
#22196488
Signed-off-by: tangjingyu <tangjingyu@oppo.com>
2024-12-30 15:59:29 +08:00
true1064
6e5f2023d6 fix(sdk): [hybrid cloud] set VolCacheDpStorageClass when invoking NewExtentClient
#22196488
Signed-off-by: tangjingyu <tangjingyu@oppo.com>
2024-12-30 15:59:29 +08:00
zhaochenyang
72b76103d6 feat(lcnode): [hybrid cloud] add lcnode auditlog (#22067931)
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:29 +08:00
zhaochenyang
ed8783bd06 fix(lcnode): [hybrid cloud] NewEbsClient when ebsAddr is not nil (#22049286)
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:29 +08:00
chihe
a629477876 fix(metanode): [hybrid cloud] support empty file migration
Signed-off-by: chihe <chihe@oppo.com>
2024-12-30 15:59:28 +08:00
zhaochenyang
ecf98727d1 fix(lcnode): [hybrid cloud] multipart migration to blobstore
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:28 +08:00
zhaochenyang
e36eb02b3c fix(lcnode): [hybrid cloud] set delayDelMinute after migration
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:28 +08:00
zhaochenyang
82f2d95fc9 fix(lcnode): [hybrid cloud] DeleteMigrationExtentKey before migration
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:28 +08:00
zhaochenyang
f4c0e92cc8 enhance(lcnode): [hybrid cloud] add start time in heartbeat
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:28 +08:00
zhaochenyang
98580f4edf enhance(lcnode): [hybrid cloud] fix lcnode log
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:27 +08:00
chihe
c4b467074c feature(metanode): [hybrid cloud] add audit log for migration
Signed-off-by: chihe <chihe@oppo.com>
2024-12-30 15:59:27 +08:00
true1064
dd224a1cde fix(client): [hybrid cloud] Fix some places where the original condition "vol allowedStorage supports blobstore"
should be changed to "vol storageClass is blobstore".
Adds field volStorageClass to ExtentClient for this purpose.
Remove field volumeType from ExtentClient by the way.

Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-30 15:59:27 +08:00
zhaochenyang
f48cbe09d5 enhance(lcnode): [hybrid cloud] lifecycle transition
1. add debug service

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:27 +08:00
zhaochenyang
c3fbed5812 enhance(lcnode): [hybrid cloud] lifecycle transition
1. close extent client
2. use StorageClass_Replica_HDD and StorageClass_BlobStore
3. scanner init AllowedStorageClass
4. enhance lifecycle parameter check
5. add extent client for write

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:01 +08:00
chihe
e018991d9b enhance(metanode): [hybrid cloud] add api for get full inode infomation include eks
Signed-off-by: chihe <chi.he@oppo.com>
2024-12-30 15:59:00 +08:00
zhaochenyang
f7f709afa1 feat(lcnode): [hybrid cloud] lifecycle transition
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-12-30 15:59:00 +08:00
W9068822
005cf8e5db feat(metrics): report version of client, metanode, datanode, authnode, lcnode, objectnode
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-10-18 09:37:28 +08:00
zhaochenyang
ca861f4017 fix(lcnode): fix lcnode panic and reduce task allocation time
#21938894
Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-05-13 17:30:54 +08:00
zhaochenyang
a1c3183386 fix(lcnode): snapshot apply on lcnode
1. add firstDentry may cause panic if channel close
2. reset snapshot verinfos before add verinfo
3. add TaskResults in GetOneTask to avoid adding tasks repeatedly
4. support notify multi snapshot tasks
5. delete snapshot failed retry

Signed-off-by: zhaochenyang <zhaochenyang@oppo.com>
2024-02-22 14:53:39 +08:00
slasher
5d5e45cb0a chore(util): store current time to atomic value
BenchmarkGetCurrentTime-4    100000000    11.60 ns/op            0 B/op          0 allocs/op
-->
BenchmarkGetCurrentTime-4    895091701     1.31 ns/op            0 B/op          0 allocs/op

Signed-off-by: slasher <mcq.sejust@gmail.com>
2024-01-31 19:13:25 +08:00