gian/cubefs
1
0
Fork 0
mirror of https://github.com/cubefs/cubefs.git synced 2026-08-02 02:00:56 +00:00
Code Issues Actions Packages Projects Releases Wiki Activity
6,190 Commits 48 Branches 52 Tags 378 MiB
master
Commit Graph

158 Commits

Author SHA1 Message Date
Victor1319
809d023e9e refactor(vendor): user smux in depends to replace pkg in vendor. #1000193713 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2025-08-11 17:21:16 +08:00
zhumingze
9e9eb0e753 fix(data): bad disk judgment logic fix. #1000184384 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-11 17:21:15 +08:00
zhumingze
b73b063598 fix(data): Limit asynchronous read and write iocc to 100. #1000167799 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-11 17:21:14 +08:00
zhumingze
71dee686ef feat(data): limitIO strategy for separating repair io from business io. #1000095860 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:30 +08:00
Wu Huocheng
df6a12c5d6 chore(datanode): change checking interval from hour to minute.#1000005968 
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
 2025-08-08 14:59:27 +08:00
Victor1319
631baaf14d feat(master): add switch to control whether ignore tiny extent recover. #1000094081 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2025-08-08 14:59:27 +08:00
Wu Huocheng
57d0b95284 feat(datanode): rotate all data partition raft log.#1000005968 
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
 2025-08-08 14:59:26 +08:00
Wu Huocheng
30b29217a1 feat(datanode): evict the extent cache by ttl.#1000005968 
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
 2025-08-08 14:59:26 +08:00
zhumingze
24cb92350d feat(data): Mark the disks that encounter disk errors during startup as bad disks. #1000004886 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:26 +08:00
zhumingze
1964c60240 feat(datamaster): Optimize the check disk lost logic. #1000004886 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
zhumingze
e0a1ff8c0f feat(data): Regularly check dp availability. #1000004886 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
zhumingze
1c794069a1 feat(masterdatacli): lost disks detection and reporting. #1000004886 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-08 14:59:25 +08:00
shuqiang-zheng
501dc61922 feat(meta): Support for dynamic adjustment of gogc. 
close:#1000011090

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-08 14:42:25 +08:00
Wu Huocheng
ed61daa568 feat(raft): display raft peers.@formatter:off 
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
 2025-08-07 16:00:26 +08:00
shuqiang-zheng
75d6aca05e fix(datanode): fixes for 1.read/write requests still being processed 
2.log files not being found after service stopped.

close: #23013195

Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2025-08-07 16:00:25 +08:00
zhumingze
1a20920be2 feat(datameta): Modify gcRecyclePercent to be configurable. #22995150 
Signed-off-by: zhumingze <zhumingze@oppo.com>
 2025-08-07 15:57:56 +08:00
morphes1995
9a334cd7e8 feat(master): add param to control whether raft partition can use different port 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
morphes1995
b23df49eca feat(datanode): support multi datanode process using different port on single node 
Signed-off-by: morphes1995 <morphes1995@gmail.com>
 2024-12-31 17:36:32 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
leonrayang
3396accd80 feat(projectstructure): reorganize the module directory in the root to a suitable subdirectory 
close:#22458839

Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
Victor1319
ced8ca0978 feat(masterdata): add config to control whether vol read direct disk. #22818122 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
ab8217379e refactor(datanode): refactor data read and write performance. #22504692 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
Reliey
96f4b0101b feat(datanode): add endpoint for setting enablePid in exporter and handle response building #22257509 
Signed-off-by: Reliey <zhumingze@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
abc2ab5912 refactor(master): support double check master media cfg type. #22727537 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
2bced8d337 refactor(datameta): hybrid cloud optimize some logs related to upgrade compatibility 
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
168fa0418c feat(mastermeta): add LegacyDataMediaType in master cluster values, and metaNode fetch it from master. 
close:#22716686
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
716aa7970a feat(masterdata): datanode quit starting if master returns mediaType not match when register 
close:#22727852
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
53d939fad6 fix(datameta): use default value if master not support the API AdminGetVolListForbidWriteOpOfProtoVer0. 
close:#22644059
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
63d0b94f57 feat(master): add an API to get volumes those set forbidden write op codes of protocaol version-0 
close#22531837
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
9f7ffeb194 feat(masterdatameta): support volume to forbidden write operate codes of lower packet protocol version 
close#22531837

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
a43f96d403 feat(dataclientmaster): support configuring datanode and metanode to forbidden 
write operate codes of lower packet protocol version.
       	 close#22531837
Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
NaturalSelect
3b9ef65dbe chore(all): format code 
@formatter:off

Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
14d7e0e19c feat(masterclientcli): hybrid cloud add property mediaType to datapartition 
(1)master: when creating vol, master creates dps of each mediaType according to vol.allowedStorageClass
	(2)client: when select dp to do append write, choose dp with spcific mediaType according to inode's storageClass

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
3081a30168 feat(master): hybrid cloud add mediaType property to zone 
(1) zone mediaType is set as the first add-in datanode's mediaType
	(2) once zone mediaType is set, all datanodes in the zone must be the same mediaType.
	(3) the cmd 'cfs-cli zone info' shows zone mediaType.

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
true1064
f70b3cfe38 feat(masterdatacli): hybrid cloud add datanode's mediaType 
for module master and datanode; the cmd 'cfs-cli datanode info' can show datanode's mediaType

Signed-off-by: true1064 <tangjingyu@oppo.com>
 2024-12-26 09:24:22 +08:00
leonrayang
111f9e9903 feat(dataemeta): cluster switch on snapshot take effect on module handle protocal process 
Signed-off-by: leonrayang <chl696@sina.com>
 2024-12-26 09:24:22 +08:00
chihe
ac54435341 feat(datanode): increasing retry interval when DataNode connects to Master during startup. 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
W9068822
6e51516a8c feat(stat): datanode disk and dp operation log 
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
 2024-12-26 09:24:22 +08:00
Victor1319
be565f6609 refactor(server): refactor http connect pool when comminute with master. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
68d6b4d09d fix(master): get disk path for replica when getting info for datanode 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
45686739d8 fix(datanode): use localServerAddr instead of replica[0] 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
2fb56e7282 feat(master): auto delete backup directories 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
chihe
292f2abd45 feat(master): add api for recovering bad disk 
Signed-off-by: chihe <chihe@oppo.com>
 2024-12-26 09:24:22 +08:00
NaturalSelect
d9ee4e5130 feat(data): limit memory used 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-12-26 09:24:22 +08:00
NaturalSelect
6aa160552c feat(master): persist datanode bad disk 
Signed-off-by: NaturalSelect <huangzhibin1@oppo.com>
 2024-12-26 09:24:22 +08:00
shuqiang-zheng
f8c677a041 fix(security): slice memory allocation with excessive size value. 
Signed-off-by: shuqiang-zheng <zhengshuqiang@oppo.com>
 2024-08-09 19:04:31 +08:00
baihailong
6174cfb9bd fix(util): incorrect conversion between integer types 
close:  #259

Signed-off-by: baihailong <baihailong@oppo.com>
 2024-08-09 17:14:32 +08:00
W9068822
d25840b71f feat(metrics): report version of client, metanode, datanode, authnode, lcnode, objectnode 
Signed-off-by: W9068822 <v-lijianrong1@oppo.com>
 2024-07-22 17:10:59 +08:00
Victor1319
77fdb47ea0 refactor(data): datanode only process random write op before node start. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-22 17:10:59 +08:00
Victor1319
4df91ebc6e refactor(all): reslove merge conflicts between 3.3.x and 3.4.0. 
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
 2024-07-18 16:57:38 +08:00