gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 02:00:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
6,190 Commits 48 Branches 52 Tags 378 MiB
master
Commit Graph

429 Commits

Author SHA1 Message Date
NaturalSelect
414229e0b5 fix(master): update dp cache after create vol 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
chihe
e287f3a9ce fix(master): redundant replica not participate when decommissioning mutiple replicas of dp 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
48506bbd18 fix(data): avaliable space calculate consider decommissioned disks 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
7a1c60eeea feat(master): support enable or disable auto dp meta repair 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
d68b68a2a2 fix(master): support config dp repiar timeout 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
NaturalSelect
cf772279a7 feat(master): nodeset info return can alloc metanode/datanode cnt 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-22 17:10:59 +08:00
W9068822
24618be53c fix(cli): fix DataNodeMigrate, @formatter:off 
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
 2024-07-18 16:57:38 +08:00
W9068822
bf336dc34d feat(master): add getAllDataNodes and getAllMetaNodes apis 
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
c19b690d1d feat(master): support reset dp restore status 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
4acdeca1fd feat(master): return can alloc partition when query node info 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
Victor1319
4df91ebc6e refactor(all): reslove merge conflicts between 3.3.x and 3.4.0. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-18 16:57:38 +08:00
leonrayang
a9b3d54028 feat(master): Volume update enable crossZone 
Signed-off-by: leonrayang <changliang@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
ec188331f0 feat(cli): support set trash interval 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
53b269d7e5 fix(master): update decommission limit when load nodeset 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
Victor1319
d95f005df9 fix(master): Avoid concurrent access exceptions when responding to HTTP requests with a map. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-18 16:57:38 +08:00
Victor1319
c7aba207cc refactor(cli): Optimize the print output results of fileInCore. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-18 16:57:38 +08:00
Victor1319
c976358bbe refactor(cli): remove pasue flag in transaction flag hint. 
Signed-off-by: Victor1319 <834863182@qq.com>
 2024-07-18 16:57:38 +08:00
Victor1319
ee9aba1f3a fix(master&client&cli): Add a new variable EnableTransactionV1 to avoid compatibility issues 
Signed-off-by: Victor1319 <834863182@qq.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
7c08fedcd8 feat(master): add forbid vol feature 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
625a7a3d62 feat(master): enable audit log by default 
NOTE: Please be careful when cherry-picking this commit.

Signed-off-by: NaturalSelect <2145973003@qq.com>
 2024-07-18 16:57:38 +08:00
shuqiang-zheng
68cf97ab68 fix(master):fix the problem of TestCreateColdVol 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
3b2a91bdf6 fix(cli): fix ui error occured by cherry-pick 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2024-07-18 16:57:38 +08:00
NaturalSelect
d201f99c04 feat(master): support set decommission disk limit 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-18 16:57:38 +08:00
shuqiang-zheng
eed62c913f enhance(log): Modify the threshold triggering log to logLeftSpaceLimitRatio of the total disk space 
@formatter:off

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-07-18 16:57:38 +08:00
chihe
7a6febec4b feat(cli): add decommissioned disks info for datanode node info display 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-05 17:05:43 +08:00
chihe
65ee50a40a fix(cli): cli can display dps encountering IO errors during loading 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
fdec047ee4 feat(master): support abort disk decommission 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
0a158c3e96 feat(master): support query decommission failed disks 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
3b03341425 feat(master): support max mp cnt limit 
@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
14ce5dc2cd test(master): fix unit tests 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-05 17:05:43 +08:00
W9068822
470967aae4 feat(ci): fix format failed. 
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
 2024-07-05 17:05:43 +08:00
chihe
f704f3fdac feat(cli): add report for disk error dp replica for cli 
Signed-off-by: chihe <chihe@oppo.com>
 2024-07-05 17:05:43 +08:00
NaturalSelect
96ed7fd818 fix(master): persist decommission error message 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
7329d1f1e8 feat(master): check datapartition status when set dp discard 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
9ca77ba7aa feat(master): if dp is discard, decommission will success directly 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
18e83cd45d fix(cli): foramt decommission dp info 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
610e6bd457 feat(master): support auto decommission disk and config 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
NaturalSelect
38bd1924e0 fix(cli): datapartition query-progress 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-07-02 16:35:56 +08:00
S9054862
8ad316ecfc feat(data): repair block size support master config 
Signed-off-by: S9054862 <huangzhibin1@oppo.com>
 2024-07-01 15:09:55 +08:00
leonrayang
4ee2208263 feat(master): Optimize logic of uid calculate for better performance 
1.use channel to instead of lock and isolate with main heartbeat routine
2.calculate in an aysnchoronus way periodically instead of real time
3.move heartbeat outside the goroutine, the startup of goroutine may delay the response time

Signed-off-by: leonrayang <changliang@oppo.com>
 2024-07-01 15:09:55 +08:00
slasher
5c7898354f style(all): format all codes with golangci tools 
closes #3371

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
 2024-05-14 09:54:13 +08:00
morphes1995
b8c26ba20f feat(cli): cfs-cli add functionality to show disk info 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-04-19 14:06:35 +08:00
slasher
bdffd66650 feat(cli): auto format struct and table 
with #21965811

Signed-off-by: slasher <shenjie1@oppo.com>
 2024-03-29 14:22:29 +08:00
shuqiang-zheng
e59f07a084 feat(reconstruct): gofmt by gofumpt. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
af739c6a3f fix(master): Fix the problem of updating a cold volume when cachecap and replicaNum is all 0. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
42fa6628f4 enhance(cli): Modifying Volume Deletion Related Error Messages. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
6d0de0df25 fix(master): Fixed the problem that delayed deleted volumes do not support migration. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
452d2a3239 enhance(cli): Dynamically configure volDeletionDelayTime through the interface. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
325694a4f7 enhance(cli): Add query interface to show the current delayed deletion time of the volume. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
shuqiang-zheng
9c5185e9be feat(master): Freeze the volume when performing volume deletion. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-03-28 11:43:55 +08:00
NaturalSelect
df58ccb9b4 feat(master): show error message when decommission dp fails 
close: #21952214

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-03-27 14:24:50 +08:00
morphes1995
09ebe39b80 feat(metanode): Support create multiple meta partitions at one time 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-02-29 16:43:50 +08:00
NaturalSelect
24cbd9c1ab fix(meta): GetAllExtsOfflineInode failed to delete extent keys 
close: #3140

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-02-29 14:33:40 +08:00
NaturalSelect
8bd2aac465 feat(cli): support discard dp 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-02-28 16:31:57 +08:00
lily-lee
84dea94603 feat(master): compress client/partitions response data 
Signed-off-by: lily-lee <lilylee88756@gmail.com>
 2024-02-27 10:30:21 +08:00
slasher
5d5e45cb0a chore(util): store current time to atomic value 
BenchmarkGetCurrentTime-4    100000000    11.60 ns/op            0 B/op          0 allocs/op
-->
BenchmarkGetCurrentTime-4    895091701     1.31 ns/op            0 B/op          0 allocs/op

Signed-off-by: slasher <mcq.sejust@gmail.com>
 2024-01-31 19:13:25 +08:00
morphes1995
38fa309da4 [fix]: use original NodeStatInfo field type to adapt old services 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-01-26 18:50:15 +08:00
leonrayang
8ee2c10102 Revert "[Enhancement]: Support reporting the total size of writable space in the cluster." 
This reverts commit 37bdadfc77.

Signed-off-by: leonrayang <chl696@sina.com>
 2024-01-24 16:07:56 +08:00
morphes1995
37bdadfc77 [Enhancement]: Support reporting the total size of writable space in the cluster. 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-01-23 11:22:45 +08:00
slasher
1d84f74acd chore(format): format all code with gofumpt 
Signed-off-by: slasher <shenjie1@oppo.com>
 2024-01-12 14:21:16 +08:00
lily-lee
f45b4cd606 feat(dp): set dpCount when create volume 
Signed-off-by: lily-lee <lilylee88756@gmail.com>
 2024-01-08 16:51:38 +08:00
NaturalSelect
25af0b0935 feat(cli): support query decommission disk progress in cli 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2024-01-05 14:00:29 +08:00
slasher
9b1f6270ae chore(cli): catch errors on root of cmd 
Signed-off-by: slasher <shenjie1@oppo.com>
 2024-01-04 17:37:31 +08:00
slasher
98a9f5b07f chore(proto): parse http response in proto.HTTPReplyRaw 
Signed-off-by: slasher <shenjie1@oppo.com>
 2024-01-04 17:37:31 +08:00
NaturalSelect
f6e774b7cc fix(cli): fix typo 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-12-28 18:34:45 +08:00
NaturalSelect
5aeb164b58 feat(cli): cli support to recommission disk 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-12-15 15:04:55 +08:00
NaturalSelect
0291ff91fc feat(cli): cli support to decommission disk 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-12-15 15:04:55 +08:00
NaturalSelect
1003212650 feat(metanode): audit log support master control 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-11-09 15:10:23 +08:00
true1064
5af7084e0e refactor(data): optimize the determination of datanode disk's unavailable status: 
(1) add 2 conf item: diskUnavailableErrorCount and diskUnavailablePartitionErrorCount.
(2) when encounter disk error, set disk as unavailable if disk error count reaches diskUnavailableErrorCount or partition count with disk error reaches diskUnavailablePartitionErrorCount.
(3) if a partition encounter 1 disk error, set the partition's status as unavailable.

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-11-01 11:47:58 +08:00
chihe
ff2d5f6bd5 bugfix(datanode,cli):1.remove logic of fetching replica from master after adding raft member 
2.cli show error msg when decommission failed 3.keep disk original decommission status when load
from rocksdb

Signed-off-by: chihe <chi.he@oppo.com>
(cherry picked from commit 846ac29e57e838cb728c1cd9495d4ecf0bd4c839)
 2023-11-01 11:33:44 +08:00
chihe
b5de4b97b2 fix(master): panic when concurrent read/write decommissiondatapartition list 
Signed-off-by: chihe <chi.he@oppo.com>
(cherry picked from commit 3f20228d8edd8be9809d69e3a0cae7a75bea8703)
 2023-10-31 14:22:38 +08:00
slasher
74be4e4970 chore(cli): cli output with format 
Signed-off-by: slasher <shenjie1@oppo.com>
 2023-10-23 15:31:07 +08:00
slasher
7f406e5d0e chore(cli): golangci lint apply into cli 
Signed-off-by: slasher <shenjie1@oppo.com>
 2023-10-23 15:31:07 +08:00
slasher
ff476f4d7d chore(cli): gofumpt apply into cli 
Signed-off-by: slasher <shenjie1@oppo.com>
 2023-10-23 15:31:07 +08:00
shuqiang-zheng
06d542cc98 fix(cli): fix the bug of empty unavailable replica may appear when using cli command with metapartition check. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2023-10-23 14:27:38 +08:00
NaturalSelect
fdfa176a97 fix(cli): fix fmt bug 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-10-16 15:57:54 +08:00
true1064
a5dd54d60f feat(master/datanode/cli): 
(1)datanode bad disk report to master adds: TotalPartititionCnt and DiskErrPartitionList
(2)cfs-cli display bad disk adds TotalPartititionCnt and DiskErrPartitionList accordingly
(3)datanode's data partition add disk err count record and log print

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-10-12 14:52:52 +08:00
xuruida
7a6279d3b8 enhance(cli/master): rename volume create option "size" to "dp-size" (cli) / "dpSize" (api) 
Signed-off-by: xuruida <xuruida@oppo.com>
 2023-10-07 15:56:35 +08:00
baijiaruo
3a42e65af4 feat(sdk): Solve warnings that do not comply with go language rules 
Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-09-06 10:09:43 +08:00
NaturalSelect
c3ed9bafb5 feat(master): add forbid vol feature 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-09-01 16:23:21 +08:00
true1064
08c4672e95 enhance(master/cli): Reduce too much dp info printing about replica file count and size differ: 
(1)master: not record replica file count and size differ if dp is in decommission
(2)cli: only print number of dp with replica file count and size differ in default; and add an argument to control whether print such dp info

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-08-30 20:05:32 +08:00
leonrayang
86d0e5b8a9 enhance(master): snapshot.update ver from seconde to microSecond for future develop multi snapshot create one second 
Closes: #2499

Signed-off-by: leonrayang <chl696@sina.com>
 2023-08-30 20:05:32 +08:00
NaturalSelect
a93dce93e4 feat(master,cli): support to query and update node selector of nodeset 
close: #1921

Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-08-30 20:05:32 +08:00
NaturalSelect
4913de7e2e feat(master,cli): support cluster level node selector query and update 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-08-30 20:05:32 +08:00
NaturalSelect
b398946a82 feat(master,cli): support zone level node selector query and update 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-08-30 20:05:32 +08:00
NaturalSelect
4f058bd163 feat(master,cli): support query and update nodeset selector of zone 
Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-08-30 20:05:32 +08:00
setcy
c43dcb4962 feat(cli): support listing nodeSets and displaying space capacity with cli 
Signed-off-by: setcy <2670061551@qq.com>
 2023-08-30 20:05:32 +08:00
chihe
3638432b81 [bugfix]1.rollback will release token 2.new replica created by decommission status is recovering 
3.fix pause then resume progress error

Signed-off-by: chihe <chi.he@oppo.com>
 2023-08-30 20:05:32 +08:00
Patrick Wu
7e72ede897 feature: 1. support setting dp decommission control info. 2. add dp decommission progress for dp check cmd 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-08-30 20:05:32 +08:00
chihe
952142617e [bugfix]1.fix some bugs about decommission enhance 
2.cli add recovery status
    3.add decommission disk type for decommission disk api
    4.load decommission disk to add to nodeset decommission disk list

Signed-off-by: chihe <chi.he@oppo.com>
 2023-08-30 20:05:32 +08:00
leonrayang
88c2c5d7ff update: snapshot.Reduce extent count triggerd by ver inconsistent 
optimize code on function naming and abstract public function

Signed-off-by: leonrayang <chl696@sina.com>
 2023-08-30 20:05:32 +08:00
leonrayang
f7e324a98f update. enable cli support version strategy 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-08-30 20:05:32 +08:00
leonrayang
5ae500768b feature: support multi version snapshot 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-08-30 20:05:32 +08:00
NaturalSelect
e1a69d5314 feat(cli): support query cpu util of datanode and metanode and disk util of datanode 
close: #1922

Signed-off-by: NaturalSelect <2145973003@qq.com>
 2023-08-30 20:05:32 +08:00
M1eyu2018
65ec21d1a6 [Enhancement] add authentication for master admin api 
Signed-off-by: M1eyu2018 <857037797@qq.com>
 2023-08-24 16:05:12 +08:00
shuqiang-zheng
a0651b75d9 feat(Inode Lock Time): Changed the default value of optDeleteLockTime when updating volume information, and solved the problem of deletion lock failure after the client's system time has been changed. 
close: #2341

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2023-08-10 20:50:06 +08:00
shuqiang-zheng
1349490959 feat(Inode Lock Time): Added support for delete-lock-time to Inode in transactional situations, and provided a zero setting to disable file locking. 
close: #2341

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2023-08-09 14:01:52 +08:00
shuqiang-zheng
346c604692 fix(log): fix bug that logs were not cleaned in time. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2023-08-09 14:01:52 +08:00
shuqiang-zheng
680dc0158c feat(Inode Lock Time): Added support for delete-lock-time to Inode. 
close: #2341

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2023-08-09 14:01:52 +08:00
baijiaruo
e1748ee989 fix(cli): update volume operation cause quota switch to be off 
close: #2310
Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-08-09 14:01:52 +08:00
Victor1319
b087888438 refactor(master & client): no tx operation should also check txConflict error. 
Signed-off-by: Victor1319 <834863182@qq.com>
 2023-08-09 14:01:52 +08:00
leonrayang
7c23a8fbc1 fix(cli):Fix code scanning alert - Incorrect conversion between integer types 
close: #2432

Signed-off-by: leonrayang <chl696@sina.com>
 2023-08-08 09:43:59 +08:00
Victor1319
2199fd061c fix(master): fix the bug found in security code-scanning. 
Signed-off-by: Victor1319 <834863182@qq.com>
 2023-08-07 14:56:20 +08:00
setcy
d423d2d640 feat(master): partitions support displaying in which nodeSet 
Signed-off-by: setcy <2670061551@qq.com>
 2023-08-07 11:03:59 +08:00
baijiaruo
10dfcfd791 fix(metanode): fix quota capacity statistics are inaccurate 
close: #2271

Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-07-20 10:58:50 +08:00
baijiaruo
80a6e4c4d0 fix(metanode): fix metanode takes up too much memory 
close: #2249

Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-07-20 10:58:50 +08:00
baijiaruo
db013e2a90 feat(master/metanode/cli): Add vol quota switch 
close: #2244

Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-07-20 10:58:50 +08:00
baijiaruo
7c274013c8 fix(cli,master): 1.Directory nesting issues with different quotas 
2.root directory not checked out for nesting

Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-07-20 10:58:50 +08:00
baijiaruo
a8b61ad172 fix(master/metanode/cli): Fix the following bugs 
1.Subdirectories under the quota directory cannot be moved
2.After creating the quota, delete the quota root directory and create it again, but the apply still succeeds
3.Multi-level directory setting quota report does not has only one /
4.2000w directory file after the quota is created apply error

close: #2189

Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-07-20 10:58:50 +08:00
leonrayang
959a00b1b6 feat(transaction): support transaction limitition in metaPartition dimension and realize in a simplify way temporily 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-07-20 10:58:50 +08:00
baijiaruo
78e997b4c0 fix(cli): 1.No error reported when creating quota using multiple directories with the same name 
2.Deleting quota without revoking it first will cause directories to be undeletable
close: #2171

Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-07-20 10:58:50 +08:00
true1064
f323548268 feat(master): add cluster frobid meta partition decommission switch 
close: #2139
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-07-20 10:58:50 +08:00
baijiaruo
53b12d9b4c feat(master/metanode/cli): Enhance cfs-cli apply and revoke operations can swim to the root directory 
close: #2144

Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-06-16 17:42:02 +08:00
Patrick Wu
e622d34f35 fix(cli,sdk): 1.fix tx display bug in cli. 2.fix tx request retry bug 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-06-16 17:42:02 +08:00
Patrick Wu
68df3ea00d fix(cli,master): set default transaction value for old volume from previous version when loading from rocksdb 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-06-16 17:42:02 +08:00
baijiaruo
d97d066f5c fix(master,cli): 1.create quota dir without / without error. 
2.Create quota with the same directory error message optimization
    3.A single quota increases the directory limit to 5
    4.Creating a quota, the scene of multiple directories shows that the number of used files is incorrect
    5.list quota Sort by quotaId from small to large
close: #2107

Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-06-16 17:42:02 +08:00
Patrick Wu
d88585dac8 fix(cli,client,master,sdk): 1.add ability to force reset transaction mask. 2. sdk will retry transaction operation when conflict occurs, retry times and interval are configurable 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-06-16 17:42:02 +08:00
chihe
82b9b1fd80 enhance(cli,client):1. add check inode max mp check 2.client return err 
if user is not correct immediately

Signed-off-by: chihe <chihe@oppo.com>
 2023-06-16 17:42:02 +08:00
Patrick Wu
d309886dc3 fix(metanode, client, cli): 1. set SyncSendTaskDeadlineTime to 30 seconds, 2. fix tx timeout unit display in cli 3.tidy up, remove todos and comments 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-06-16 17:42:02 +08:00
baijiaruo
a2f7ac1f53 enhance(master/cli): Added multi-directory federation quota 
close: #2087

Signed-off-by: baijiaruo <baijiaruo@126.com>
 2023-06-16 17:42:02 +08:00
baijiaruo
b87a3a41e7 feat(master/metanode/cli): The directory transfer of quotaId has been changed from metanode to cli operation and rename is only allowed within a quota or outside the quota 
Signed-off-by: baijiaruo <huyao2@oppo.com>
 2023-06-16 17:42:02 +08:00
true1064
d7e6dd2f2e feat(master,cli): enhance discard data partition report: 
1. add cmd "cfs-cli datapartition get-discard" to display all discard data partitions;
2. missing dp metrics not display discard data partitions;

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-06-16 17:42:02 +08:00
true1064
014629c40f feat(cli):add an argument "--ignoreDiscard" to cmd "cfs-cli datapartition check", the datapartitions which is marked discard will not be displayed if this arg is set 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-06-16 17:42:02 +08:00
setcy
d991494ab8 feat(cli): give suggestions when root command not found 
Signed-off-by: setcy <2670061551@qq.com>
 2023-06-09 09:08:32 +08:00
setcy
b75a644040 feat(cli): add newline in errouts 
Signed-off-by: setcy <2670061551@qq.com>
 2023-06-09 09:08:32 +08:00
setcy
8e60a92829 docs(cil): improve documentation of cli tool 
Signed-off-by: setcy <2670061551@qq.com>
 2023-06-05 17:08:02 +08:00
xiaodi22013
8dab8348b0 feat(cfs-cli): cfs-cli cluster info supports displaying all master information 
Signed-off-by: xiaodi22013 <xiaodi22013@gmail.com>
 2023-05-31 11:32:41 +08:00
baijiaruo
e0375721cb enhance: 1.the number of quotas is configurable 
2.delete the quota using the path
         3.added listAll interface to query which volumes are configured with quotas

Signed-off-by: baijiaruo <huyao2@oppo.com>
 2023-05-26 11:17:10 +08:00
chihe
dffdf2f94c enchance(cli): add bad disk check 
Signed-off-by: chihe <chi.he@oppo.com>
 2023-05-26 11:17:10 +08:00
chihe
f108ee55ea enchance(cli): add mp inode and dentry count check 
Signed-off-by: chihe <chi.he@oppo.com>
 2023-05-26 11:17:10 +08:00
leonrayang
d5bb45ea49 docs. update to cubefs 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-05-26 11:17:10 +08:00
yuxiaobo
ac75137295 build: the build script of blobstore is merged into cubefs 
1. rocksdb upgrade to 6.3.6
2. optimize the build scripts
3. fix build errors
4. add env variable for blobstore unit test
5. update git ignore file to ignore build and test result
6. modify open files limit for unit test

Signed-off-by: yuxiaobo <yuxiaobo@oppo.com>
Signed-off-by: slasher <shenjie1@oppo.com>
Signed-off-by: Victor1319 <834863182@qq.com>
 2023-05-23 15:24:53 +08:00
Patrick Wu
b0eacf6c10 fix: parent inode rollback item is not added when dealing with dentry create and deletion 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-05-18 10:48:57 +08:00
true1064
448a180ed7 feat(master,cli): cfs-cli metapartition check add: (1)display unavailable mp, (2)display excess replica num mp, (3) mp no leader consider heartbeat report time 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-05-18 10:48:57 +08:00
true1064
82a10e751c enhance: 'cfs-cli datapartition check' adds display of datapartitions with excessive replica num 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-05-18 10:48:57 +08:00
true1064
ec2aa61ab9 enhance: add isDiscard flag to datapartion; master provides setup isDiscard flag API accordingly; when client try to read an discard dp it will fast fail and avoid retry 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-05-18 10:48:57 +08:00
baijiaruo
7e34c2b4ec fix: update quota default maxBytes update is incorrect 
Signed-off-by: baijiaruo <huyao2@oppo.com>
 2023-05-18 10:48:57 +08:00
baijiaruo
3e14be1f6e enhance:1.set and update without inodeId 
2.When renaming the upper-level or higher-level directory of the quota directory, the full path information of the quota is also modified accordingly.
        3.quota update operation, if only one parameter value is changed, other parameter values remain unchanged
        4.Change the display time to no longer a timestamp
Signed-off-by: baijiaruo <huyao2@oppo.com>
 2023-05-18 10:48:57 +08:00
true1064
bf75c8e6d8 fix: cli newVolUpdateCmd() not set DpReadOnlyWhenVolFull flag by default 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-05-18 10:48:57 +08:00
leonrayang
5403f28479 update: enable cli tool reduce volume replicaNum count and set followerRead automiclly 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-05-18 10:48:57 +08:00
true1064
b8f5e362d2 enhance: 'cfs-cli datapartition check' added to show datapartitions whose replica's used size and file count differ significantly 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-05-18 10:48:57 +08:00
Patrick Wu
7632e3f050 fix: tx timeout may fail when time are not synchronized among metanodes 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-05-18 10:48:57 +08:00
leonrayang
67a1785a46 enhance(master): When the number of replicas is 1 or 2, followerRead is set to true by default in vol create 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-05-18 10:48:57 +08:00
Patrick Wu
79f7cb2ca0 enhance : 1. change transaction info container from map to btree, which can take snapshot and dump to file. 2. set transaction timeout upper limit to 60, and add transaction info to http response 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-05-18 10:48:57 +08:00
baijiaruo
6d434a9108 Fix: 1.delete file failed due to wrong rootinode 
2.maxfiles reaches limited, you can still touch files

Signed-off-by: baijiaruo <huyao2@oppo.com>
 2023-05-18 10:48:57 +08:00
baijiaruo
7bccbc4ea2 Fix: 1.quota list optimization 
2.The path of quota update is consistent, but the inode is inconsistent, so it needs to fail
     3.To delete the rootquota directory, you need to delete the quota first
     4.Solve the problem that the quota has been deleted, but after restarting the master, the quota reappears
Signed-off-by: baijiaruo <huyao2@oppo.com>
 2023-05-18 10:48:57 +08:00
Patrick Wu
342233ac00 enhance: tx mask info optimization 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-05-18 10:48:57 +08:00
baijiaruo
035cb168ad enhance: add directory quota feature 
Signed-off-by: baijiaruo <huyao2@oppo.com>
 2023-05-18 10:48:57 +08:00
Patrick Wu
dc7e5b9885 fix&enhance(meta):transaction bugfix and enhance 
Signed-off-by: Patrick Wu <wuchunhuan@oppo.com>
 2023-05-18 10:48:57 +08:00
chihe
13069ccf67 [enhance]1.cli support raftForce 2.metanode add log to check leader change 
Signed-off-by: chihe <chi.he@oppo.com>
 2023-05-18 10:48:57 +08:00
leonrayang
cdbdcf969c enhance(cli): cli support volume replicaNum update 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-05-18 10:48:57 +08:00
leonrayang
68262d4183 enhance(cli): enable cli tool create volume with param replica-num as 1 or 2 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-05-18 10:48:57 +08:00
leonrayang
7b7e6587b9 feature(master.meta.client) support uid space manager 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-05-18 10:48:57 +08:00
leonrayang
b525c104a5 Feature: support ip addr acl check 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-05-18 10:48:57 +08:00
M1eyu2018
147abc88d6 [Enhancement] enable to show info include domain addr or get info by domain addr 
Signed-off-by: M1eyu2018 <857037797@qq.com>
 2023-03-29 18:40:35 +08:00
true1064
594cc63b50 enhance: add a configurable switch to control whether the volume's datapartitions become read-only when the volume is full 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-03-20 17:53:43 +08:00
leonrayang
6175df4eb5 Fix: bug fix on bad cases of follower read dps from leader 
Signed-off-by: leonrayang <chl696@sina.com>
 2023-03-20 01:06:52 +08:00
chihe
b0ec09b30f [feature] dp decommission speed control 
Signed-off-by: chihe <chi.he@oppo.com>
 2023-03-04 16:13:35 +08:00
true1064
d35020b554 enhance: add display of unavailable replica for cfs-cli datapartition check 
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2023-03-04 16:13:35 +08:00
sunjiapeng
3b1048e2e9 fix: reduce btree copy 2022-12-02 11:36:05 +08:00
Tao Li
bfa953e4e3 [BugFix] Volume info is displayed incorrectly 
Signed-off-by: Tao Li <tomscut@apache.org>
 2022-11-27 13:25:51 +08:00
liubingxing
51f17da59d FIX: format the code of fmt.go 
Signed-off-by: liubingxing <liubbingxing@gmail.com>
 2022-11-25 10:59:55 +08:00
Tao Li
1682425bb0 Enhancement: Cluster info lost MaxDpCntLimit 
Signed-off-by: Tao Li <tomscut@apache.org>
 2022-11-25 10:58:30 +08:00
Tao Li
00bbf0b485 Feature: support setting MaxDpCntLimit by cfs-cli 
Signed-off-by: Tao Li <tomscut@apache.org>
 2022-11-03 10:06:39 +08:00
leonrayang
9a30b9f884 update: update to CubeFS 
Signed-off-by: leonrayang <chl696@sina.com>
 2022-08-22 18:16:09 +08:00
leonrayang
3fdd01cae9 feature: add qos flow limit control process for 2nd cache layer 
1) update master inteface of datanode enable qos
2) master clean client info if long time no report
3) enable qos online shutdown and startup
4) master set client alloc preriod and count of girds hit trigger condition
5) datanode qos limit value set by master and add disable conf and http interface
6) client qos init buffer calculate according on real buffer storage
7) create limiter for both hot and cold volume

Signed-off-by: leonrayang <chl696@sina.com>
 2022-08-10 22:05:45 +08:00
tianjiongzhang
af0ca1b4fd enhance:add list dir interface to reduce native mem copy. 
Signed-off-by: tianjiongzhang <236556116@qq.com>
 2022-04-22 10:38:41 +08:00
chihe
565afcd313 bugfix:1.cli tool dp replicanum for different vol type. 
2.cache pool init

Signed-off-by: chihe <chi.he@oppo.com>
 2022-04-22 10:38:41 +08:00
leonrayang
cc406ae931 update: gofmt 
Signed-off-by: leonrayang <chl696@sina.com>
 2022-04-13 15:57:55 +08:00
chihe
58b2dc43c1 bugfix:change normalZonesFirst name for vol create 
Signed-off-by: chihe <chi.he@oppo.com>
 2022-04-13 15:57:55 +08:00
chihe
b48a4e02ab bugfix:fix some cli bugs 
Signed-off-by: chihe <chi.he@oppo.com>
 2022-04-13 15:57:55 +08:00
chihe
a7457f0644 feature:add migrate to cli 
Signed-off-by: chihe <chi.he@oppo.com>
 2022-04-13 15:57:55 +08:00
chihe
324135e766 bugfix: add dataNode decommission 
Signed-off-by: chihe <chi.he@oppo.com>
 2022-04-13 15:57:55 +08:00
chihe
49e62e794d bugfix: fix some cli tools bugs 
Signed-off-by: chihe <chi.he@oppo.com>
 2022-04-13 15:57:55 +08:00
lixiang12407
c1b9c89f06 enhance: add cli-command for cold volume 
Signed-off-by: lixiang12407 <960754123@qq.com>
 2022-04-13 15:57:55 +08:00
leonrayang
7ec2b73e96 add feature: support one replica of data storage 
notice:single replica cann't support write during migration but can support read

master
1) enable singal replica migration with method add new replica first and del later
2) add interface to cacel zombile decommission task
3) enable datapartition with single replica startup with inconsistent dp info with master caused by disk error or inormal

raft
1) add log. raft output log info details if recive reject from follower
2) fix. raft snapshot still running while peer remove happened which lead to the snapshot gorutine cann't end.
3) snapshot concurrent count has define limit 10, that's means much more snapshot will be hang if 10 exception happens
4) raft status must be include to cal data partition status

Signed-off-by: leonrayang <chl696@sina.com>
 2022-04-13 15:57:55 +08:00
lixiang12407
8e0a083456 fix:set default follower-read to false 
Signed-off-by: lixiang12407 <960754123@qq.com>
 2022-04-13 15:57:55 +08:00
lixiang12407
00cf2a2469 enhance: add ak/sk validation check 
Signed-off-by: lixiang12407 <960754123@qq.com>
 2022-04-13 15:57:55 +08:00
lixiang12407
ff4dd03b03 enhance: add cfs-cli request parameters 
Signed-off-by: lixiang12407 <960754123@qq.com>
 2022-04-13 15:57:55 +08:00
lixiang12407
d9c576fa9d enhance: add volume type to newVolCreateCmd 
Signed-off-by: lixiang12407 <960754123@qq.com>
 2022-04-13 15:57:55 +08:00
tianjiongzhang
94b2744275 feature: client support blobstore 
1. support read/write blobstore
2. multiple cache tier to acceleration data in datalake architecture

Signed-off-by: tianjiongzhang <236556116@qq.com>
Signed-off-by: bboyCH4 <hechi1014@126.com>
Signed-off-by: lixiang12407 <960754123@qq.com>
 2022-04-13 15:57:55 +08:00
leonrayang
2970e2c3d1 update. go import path change from chubaofs to cubefs 
Signed-off-by: leonrayang <chl696@sina.com>
 2022-01-25 18:17:02 +08:00
Sheng Yong
19191e9023 cli: Fix handling option of config set --addr 
Cli allows setting multiple master addersses. But it does not split
them into slice correctly. This patch fixes it, so that we could
set master address like,

	cfs-cli config set --addr IP1:PORT1,IP2:PORT2...

Signed-off-by: Sheng Yong <shengyong2021@gmail.com>
 2021-11-04 14:12:54 +08:00
Sheng Yong
8a1ee1606a client: Cleanup token related dead code 
Commit 73fdb86046 ("refactor: remove
token feature") has already removed token, so let's cleanup token
related dead code.

Signed-off-by: Sheng Yong <shengyong2021@gmail.com>
 2021-11-03 14:27:25 +08:00
Sheng Yong
f3bc4b1ca7 cli: Remove redundant GetVolumeSimpleInfo when setting user's perm 
There is no need to call GetVolumeSimpleInfo separately when setting
user's permission, since removeUserPolicy() or updateUserPolicy()
still checks if specific volume exists.

Signed-off-by: Sheng Yong <shengyong2021@gmail.com>
 2021-11-03 14:15:16 +08:00
Shuoran Liu
8d620f863c refactor: execute gofmt to the whole repo 
This commit does nothing but execute gofmt to the whole repo using the
following command:

$ find . -type f -name "*.go" | grep -v 'vendor' | xargs gofmt -w

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
 2021-09-24 15:47:02 +08:00
Plomty.Li
427f9898be fix: cli tool typo 
Signed-off-by: Plomty.Li <vnline1202@gmail.com>
 2021-07-20 08:13:39 +08:00
leonrayang
9f8ac01416 Add feature domain for cross zone 
Signed-off-by: leonrayang <chl696@sina.com>
 2021-07-14 16:40:19 +08:00
Justice
7f120f1aa5 Add role and clusterName field for gencfg command config 
Signed-off-by: Justice <zhengyi.zhu.hust@gmail.com>
 2021-07-14 16:06:55 +08:00
Justice
72f035645e feature: add gencfg command for cli to generate cluster config by yaml 
Signed-off-by: Justice <zhengyi.zhu.hust@gmail.com>
 2021-07-12 11:13:39 +08:00
Shuoran Liu
d326bb9624 refactor: remove unused token structures and functions 
Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
 2021-03-05 14:58:25 +08:00
awzhgw
cf7fbde1f5
Revert "Sync from release-20200720" 2020-11-11 14:23:59 +08:00
awzhgw
b230b7107d Sync changes from release-20200720 branch. 
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
Signed-off-by: xuxihao1 <xuxihao3@jd.com>
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-11-09 16:03:42 +08:00
Shuoran Liu
1054c00fd8 feature: introduce subdir permissions 
Originally the permission control for users are on volume level. This
commit introduces subdir level permission control.

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
 2020-08-14 20:48:05 +08:00
Mofei Zhang
dd45cd8ac5
Enhancement: error handling of ObjectNode 
- Response Http400 after got unexpected EOF error when reading data from
  request connection.
- Fix ldflag issue from 'cli/build.sh'.
- Do not write failure status code if request connect closed by peer.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-08-06 12:12:50 +08:00
xuxihao1
428b5d1018 Enhancement: set/get delete rate parameters, display zone information and bad partition ids in cli tools. 
Signed-off-by: xuxihao1 <xuxihao3@jd.com>
 2020-07-30 11:13:28 +08:00
zhuzhengyi1
4277d441c7 Fix: fix cli build bug 
Signed-off-by: zhuzhengyi1 <zhuzhengyi@jd.com>
 2020-07-24 16:04:57 +08:00
wenjia322
a2e5701a1f enhancement: configurable request timeout for cli tool 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-07-21 15:09:07 +08:00
awzhgw
155816fcbe
Merge pull request #775 from zhuhyc/fix_compatibility_hint_msg 
fixed: modify verify message
 2020-07-20 16:12:18 +08:00
zhuhyc
eaeeb5f42a fixed: modify verify message 
Signed-off-by: zhuhyc <zzhniy.163.niy@163.com>
 2020-07-20 15:34:19 +08:00
Mofei Zhang
bcea9abe4a
Fix: build script issue 
Fix the issue of obtaining the latest tag of the current branch during
build.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-07-20 11:16:16 +08:00
xiuquan
52fde06c76 add zonename flag to cli tool 
Signed-off-by: xiuquan <xiuquan@meizu.com>
 2020-07-17 18:20:36 +08:00
awzhgw
e697d0ac68
Merge pull request #764 from ssscottt/capacity 
add expand/shrink capacity interfaces; introduce log to cli tool
 2020-07-17 10:48:42 +08:00
xuxihao1
f3cfd46577 enhancement: introduce log to cli tool and format error message 
Signed-off-by: xuxihao1 <xuxihao3@jd.com>
 2020-07-16 20:10:51 +08:00
Mofei Zhang
c458dd6409
Enhancement: unified version information 
When using the build script to compile the program, it automatically
uses the latest git tag as the program version number information.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-07-16 18:34:15 +08:00
xuxihao1
6937cc7338 enhancement: add extra interface to expand/shrink capacity of volume 
Signed-off-by: xuxihao1 <xuxihao3@jd.com>
 2020-07-16 18:05:27 +08:00
xuxihao
85e4f0802a Fix: Remove timeout limits on decommission operations in master client sdk. 
Signed-off-by: xuxihao <xuxihao3@jd.com>
 2020-06-30 10:13:34 +08:00
xuxihao
a56f5c5dce documentation: Add CLI documentation 
Signed-off-by: xuxihao <xuxihao3@jd.com>
 2020-06-28 19:50:19 +08:00
xuxihao
7343e33427 enhancement: Add several api such as decommission, freeze cluster and set threshold, add/delete partition replica to CLI tool 
Signed-off-by: xuxihao <xuxihao3@jd.com>
 2020-06-28 18:31:39 +08:00
zhuhyc
55e667b147 feature: provide data consistency verification tool for meta partition 
Signed-off-by: zhuhyc <zzhniy.163.niy@163.com>
 2020-06-22 15:25:23 +08:00
xuxihao
c97cf6443c Fix: Display inode count and dentry count in admin/getVol and metaPartition/get interfaces and CLI 
Signed-off-by: xuxihao <xuxihao3@jd.com>
 2020-06-18 10:36:41 +08:00
xuxihao
10c957b810 Fix: the maxInodeID of a metapartition is not sync to others when recovered from snapshot; docker build failing when running build_docker.sh; spelling mistakes in cli 
Refactor: upgrade base image from `cfs-base:1.0` to `cfs-base:1.1` in dockerfile

Signed-off-by: xuxihao <xuxihao3@jd.com>
 2020-05-20 18:20:03 +08:00
xuxihao
a8b4075791 enhancement of cli: implement several interfaces; support bash completion; set config file by interactive command line 
Signed-off-by: xuxihao <xuxihao3@jd.com>
 2020-05-12 22:58:08 +08:00
Mofei Zhang
aeafa437d1
Refactor: create volume and create data partition 
When creating a volume, it returns to success when both the meta
partition and data partition are successfully created.
When adding a data partition to the volume, the data partition is
successfully created and then returns to success.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-05-06 12:35:14 +08:00
Mofei Zhang
397edb4370
Enhancement: auto create user while create volume 
Auto create user while create volume if the owner user is not exists.
Add a option for force transfer volume to target user.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-03-26 16:06:29 +08:00
wenjia322
3d8d30c48f fix: add permission to existed user when create volume 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-24 14:35:34 +08:00
wenjia322
14cea7a688 Enhancement: add cli api 'deleteUser'; remove create user automatically; ignore userSrc exists or not when transfer volume 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-24 14:35:34 +08:00
wenjia322
4d2a20e5f9 feature: add master and cli api 'updateUser' 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-24 14:35:34 +08:00
Mofei Zhang
8b3d6aa3c5
Enhancement: multiple enhancements and fixes 
Enhancement: validate user policy when mount volume.
Enhancement: when an object node loads a volume, different volumes do not block each other.
Enhancement: when checking policies, check user permissions before checking volume policies to reduce the overhead of loading volumes.
Enhancement: release connection pool when releasing meta wrapper resources.
Enhancement: the object node automatically releases the deleted volume.
Fix: response when deleting non-existing files using Object Storage
Interface.
Fix: url parameter parsing issue of signature algorithm V2.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-03-22 21:02:28 +08:00
Mofei Zhang
ddfd8b7c3f
Enhancement: improve error parsing for master APIs 
Enhancement: improve error parsing for master APIs.
Fix: status code of DelteBucket ans DeleteObjects API.
Fix: url signature parsing of signature algorithm V2.
Add: s3tests framework for compatibility test.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-03-22 08:31:51 +08:00
Mofei Zhang
76bc8667af
Refactor: using cli instead of curl in CI scripts 
Refactor: using cli instead of curl in CI scripts
Add: CLI command for CLI for adding more data partition to volume
Enhancement: optimize CLI output format

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-03-21 16:32:32 +08:00
Mofei Zhang
d7a2fb708e
Add: owner transfer commond to CLI tool. 
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-03-20 17:52:00 +08:00
wenjia322
8540a38fd0 refactor: user sdk api 'addPolicy'/'deletePolicy'/'transferVol' 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-20 00:03:31 +08:00
wenjia322
745728a306 refactor: change index of 'UserInfo' from 'ak' to 'userID' 
Signed-off-by: wenjia322 <buaa1214wwj@126.com>
 2020-03-20 00:03:31 +08:00
Mofei Zhang
b49d89c490
Add: list user with filter command for CLI 
Add: list user with filter command for CLI
Enhancement: performance of ListBuckets API
Fix: action identify issue

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-03-17 10:26:41 +08:00
Mofei Zhang
5b6598fab7
Refactor: command line interface 
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-03-17 02:00:53 +08:00
Mofei Zhang
11d0a4ddf0
Refactor: reorganize permission and actions 
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-03-17 00:11:01 +08:00
Mofei Zhang
69f9018293
Add: CLI tool to improve cluster management 
Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
 2020-03-15 17:30:23 +08:00
Mervin
a75fe4d85e
Add: init package and build script for cli tool 
Signed-off-by: Mervin <mofei2816@gmail.com>
 2020-03-11 13:11:26 +08:00