Commit Graph

220 Commits

Author SHA1 Message Date
W9068822
ba2b8672ad fix(cli): fix DataNodeMigrate, @formatter:off
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-10-18 09:37:21 +08:00
W9068822
4c21557d33 feat(master): add getAllDataNodes and getAllMetaNodes apis
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-10-18 09:37:21 +08:00
NaturalSelect
164c090bb3 feat(master): support reset dp restore status
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-10-18 09:37:20 +08:00
NaturalSelect
ac1a19c35a feat(master): return can alloc partition when query node info
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-10-18 09:37:20 +08:00
Victor1319
d32017cf23 refactor(all): reslove merge conflicts between 3.3.x and 3.4.0.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-10-18 09:37:16 +08:00
leonrayang
6c17c03271 feat(master): Volume update enable crossZone
Signed-off-by: leonrayang <changliang@oppo.com>
2024-10-18 09:37:13 +08:00
NaturalSelect
83038f361d feat(cli): support set trash interval
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-10-18 09:37:13 +08:00
NaturalSelect
1f96fcd802 fix(master): update decommission limit when load nodeset
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-10-18 09:37:12 +08:00
Victor1319
1945d80bf2 fix(master): Avoid concurrent access exceptions when responding to HTTP requests with a map.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-10-18 09:37:11 +08:00
Victor1319
f93f43943c refactor(cli): Optimize the print output results of fileInCore.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-10-18 09:37:11 +08:00
Victor1319
c357ab9a2f refactor(cli): remove pasue flag in transaction flag hint.
Signed-off-by: Victor1319 <834863182@qq.com>
2024-05-20 16:25:07 +08:00
Victor1319
875b894e45 fix(master&client&cli): Add a new variable EnableTransactionV1 to avoid compatibility issues
Signed-off-by: Victor1319 <834863182@qq.com>
2024-05-20 16:25:07 +08:00
NaturalSelect
6922da8960 feat(master): add forbid vol feature
Signed-off-by: NaturalSelect <2145973003@qq.com>
2024-05-20 16:25:07 +08:00
NaturalSelect
41b2bf7093 feat(master): enable audit log by default
NOTE: Please be careful when cherry-picking this commit.

Signed-off-by: NaturalSelect <2145973003@qq.com>
2024-05-20 16:25:06 +08:00
NaturalSelect
ce23550eb8 fix(cli): fix ui error occured by cherry-pick
Signed-off-by: NaturalSelect <2145973003@qq.com>
2024-05-20 16:25:06 +08:00
NaturalSelect
cae9127f94 feat(master): support set decommission disk limit
close: #21938887
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-05-20 14:34:04 +08:00
shuqiang-zheng
0f0211b28c enhance(log):Modify the threshold for triggering log cleanup to logLeftSpaceLimitRatio of the total disk space.
@formatter:off

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-05-20 11:02:39 +08:00
NaturalSelect
5214ea0257
chore(all): gofmt code
close:#21938887
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-05-13 10:44:04 +08:00
chihe
cf0d8efdc8 feat(cli): add decommissioned disks info for datanode node info display
close:##21938887

Signed-off-by: chihe <chihe@oppo.com>
2024-05-13 10:32:20 +08:00
chihe
131a23986d fix(cli): cli can display dps encountering IO errors during loading
close:#22157324

Signed-off-by: chihe <chihe@oppo.com>
2024-05-13 10:32:19 +08:00
NaturalSelect
2aa1b08bab
feat(master): support abort disk decommission
close: #21938887
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-05-09 09:51:37 +08:00
NaturalSelect
7422d00b9f feat(master): support query decommission failed disks
close: #22140475

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-05-08 20:32:42 +08:00
NaturalSelect
8e8fdad39c
feat(master): support max mp cnt limit
close: #22074239

@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-05-08 09:54:41 +08:00
NaturalSelect
e3f6c27968 test(master): fix unit tests
close: #22151341

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-05-08 09:53:36 +08:00
W9068822
e885171996 feat(ci): fix format failed. #22022943
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
2024-04-30 16:51:33 +08:00
chihe
8c5e15438f feat(matser,datanode,cli): add report for disk error dp replica for cli
close:#21938887

Signed-off-by: chihe <chihe@oppo.com>
2024-04-26 08:52:26 +08:00
NaturalSelect
43b41b488d
fix(master): persist decommission error message
close: #22093468

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-04-18 15:55:14 +08:00
NaturalSelect
131afc8729 feat(master): check datapartition status when set dp discard
close: #22053502

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-04-09 17:40:32 +08:00
NaturalSelect
33c17368dd feat(master): if dp is discard, decommission will success directly
close: #22053070

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-04-09 17:40:32 +08:00
NaturalSelect
a3c54902a9
fix(cli): foramt decommission dp info
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-04-03 16:36:45 +08:00
NaturalSelect
cfd730a7c7
feat(master): support auto decommission disk and config
close: #21938887

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-04-03 10:57:23 +08:00
NaturalSelect
4ff31a49f0
fix(cli): datapartition query-progress
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-04-02 10:53:28 +08:00
S9054862
07d7ba805f feat(data): repair block size support master config
close: #21989384

Signed-off-by: S9054862 <huangzhibin1@oppo.com>
2024-03-29 16:58:22 +08:00
leonrayang
89c6b48673 feat(master): Optimize logic of uid calculate for better performance
close:#22024738

1.use channel to instead of lock and isolate with main heartbeat routine
2.calculate in an aysnchoronus way periodically instead of real time
3.move heartbeat outside the goroutine, the startup of goroutine may delay the response time

Signed-off-by: leonrayang <changliang@oppo.com>
2024-03-29 14:52:06 +08:00
shuqiang-zheng
624843c99f feat(reconstruct): gofmt by gofumpt.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-03-28 11:46:35 +08:00
shuqiang-zheng
513d71dbe0 fix(master):Fix the problem of updating a cold volume when cachecap is 0 and dp replicaNum is also 0.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-03-27 14:19:17 +08:00
shuqiang-zheng
3e7d119f54 enhance(cli):Modifying Volume Deletion Related Error Messages.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-03-27 14:19:17 +08:00
shuqiang-zheng
dcc43ad142 fix(master):Fixed the problem that volumes marked for deletion but still in the freeze period could not restore the dp and mp replicas after reboot and migration was not supported.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-03-27 14:19:17 +08:00
shuqiang-zheng
743c6dbbaf enhance(cli):.Dynamically configure volDeletionDelayTime through the interface.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-03-27 14:19:17 +08:00
shuqiang-zheng
111cba1798 enhance(cli):Updated the volume information query interface to show the current delayed deletion time of the volume.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-03-27 14:19:17 +08:00
shuqiang-zheng
f16360b533 feat(master): Open the volume deletion interface to freeze the volume when performing a volume deletion and then wait 48 hours before deleting the volume.
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
2024-03-27 14:19:17 +08:00
NaturalSelect
c9646470cc feat(master): show error message when decommission dp fails
close: #21952214

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-03-22 15:35:52 +08:00
morphes1995
09ebe39b80 feat(metanode): Support create multiple meta partitions at one time
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2024-02-29 16:43:50 +08:00
NaturalSelect
24cbd9c1ab fix(meta): GetAllExtsOfflineInode failed to delete extent keys
close: #3140

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-02-29 14:33:40 +08:00
NaturalSelect
8bd2aac465 feat(cli): support discard dp
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
2024-02-28 16:31:57 +08:00
lily-lee
84dea94603 feat(master): compress client/partitions response data
Signed-off-by: lily-lee <lilylee88756@gmail.com>
2024-02-27 10:30:21 +08:00
slasher
5d5e45cb0a chore(util): store current time to atomic value
BenchmarkGetCurrentTime-4    100000000    11.60 ns/op            0 B/op          0 allocs/op
-->
BenchmarkGetCurrentTime-4    895091701     1.31 ns/op            0 B/op          0 allocs/op

Signed-off-by: slasher <mcq.sejust@gmail.com>
2024-01-31 19:13:25 +08:00
morphes1995
38fa309da4 [fix]: use original NodeStatInfo field type to adapt old services
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2024-01-26 18:50:15 +08:00
leonrayang
8ee2c10102 Revert "[Enhancement]: Support reporting the total size of writable space in the cluster."
This reverts commit 37bdadfc77.

Signed-off-by: leonrayang <chl696@sina.com>
2024-01-24 16:07:56 +08:00
morphes1995
37bdadfc77 [Enhancement]: Support reporting the total size of writable space in the cluster.
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2024-01-23 11:22:45 +08:00