Commit Graph

39 Commits

Author SHA1 Message Date
chihe
5c83c917a1 fix(client): read from leader when excuting ahead read
close:#1000340945

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit a59c4c71ed)
2025-12-24 17:01:11 +08:00
Victor1319
388b1cb7cf refactor(meta): add bench testcase for inode marshal. #1000114612
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:29 +08:00
Victor1319
c296a62206 feat(meta): add testcase for inode and dentry marshal. #1000114612
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:28 +08:00
Victor1319
3ad0f3d01f feat(meta): use buf pool to refactor inode marshal func. #1000094350
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:28 +08:00
Victor1319
6e05be7156 refactor(data): refactor the usage of the buffer pool during the prefetch process. #1000048465
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:26 +08:00
yanbin027
f25c5b9cc7 feat(client): "client support aheadread"
Signed-off-by: yanbin027 <yanbin027@ke.com>
2025-03-20 14:18:21 +08:00
Victor1319
8bb1131500 refactor(all): refactor go code with golint. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
dac1a12d0a refactor(master): resolve conflicts when picking to master branch. #22906448
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
3825cad310 refactor(sdk): support limit tiny extent buf size. #22811542
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
true1064
a43f96d403 feat(dataclientmaster): support configuring datanode and metanode to forbidden
write operate codes of lower packet protocol version.
       	 close#22531837
Signed-off-by: true1064 <tangjingyu@oppo.com>
2024-12-26 09:24:22 +08:00
tangdeyi
7ae6457821 fix(objectnode): separate read and write buffers
with

Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
3d2137e545 refactor(client): reduce buffer chan size to reduce memory when client idle.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
Victor1319
ac5cde2a05 fix(client): fix the issuse of continuous memory growth on client side.
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2024-12-26 09:24:22 +08:00
S9054862
8ad316ecfc feat(data): repair block size support master config
Signed-off-by: S9054862 <huangzhibin1@oppo.com>
2024-07-01 15:09:55 +08:00
slasher
5c7898354f style(all): format all codes with golangci tools
closes #3371

@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2024-05-14 09:54:13 +08:00
morphes1995
f0d42ff42f fix(datanode): fix some typo error
Signed-off-by: morphes1995 <morphes1995@gmail.com>
2024-04-15 11:10:56 +08:00
slasher
1d84f74acd chore(format): format all code with gofumpt
Signed-off-by: slasher <shenjie1@oppo.com>
2024-01-12 14:21:16 +08:00
chihe
ff2d5f6bd5 bugfix(datanode,cli):1.remove logic of fetching replica from master after adding raft member
2.cli show error msg when decommission failed 3.keep disk original decommission status when load
from rocksdb

Signed-off-by: chihe <chi.he@oppo.com>
(cherry picked from commit 846ac29e57e838cb728c1cd9495d4ecf0bd4c839)
2023-11-01 11:33:44 +08:00
NaturalSelect
2cfb03dcc1 test(storage): add extent and extent store unit test
Signed-off-by: NaturalSelect <2145973003@qq.com>
2023-09-08 15:34:35 +08:00
NaturalSelect
e4970c2016 test(util): add util unit tests
Signed-off-by: NaturalSelect <2145973003@qq.com>
2023-09-08 15:34:35 +08:00
leonrayang
5ae500768b feature: support multi version snapshot
Signed-off-by: leonrayang <chl696@sina.com>
2023-08-30 20:05:32 +08:00
tangdeyi
0bb8a4b6ea feat(objectnode): read/write cold volume buffer pool
Signed-off-by: tangdeyi <tangdeyi@oppo.com>
2023-08-04 18:08:38 +08:00
slasher
25c669644e chore(code): code static check package util
Signed-off-by: slasher <shenjie1@oppo.com>
2023-06-14 19:27:09 +08:00
pengtianyue
cd967c20c9 docs(deploy): correcting deployment dependency instructions
Signed-off-by: pengtianyue <pengtianyue@oppo.com>
2023-05-15 10:04:05 +08:00
tianjiongzhang
a4780b8cf2 enhance(client-blockcache): async read and cache.
Signed-off-by: tianjiongzhang <236556116@qq.com>
2023-03-04 16:13:35 +08:00
leonrayang
1dcdf3e837 update:fmt code
Signed-off-by: leonrayang <chl696@sina.com>
2022-11-21 15:25:24 +08:00
leonrayang
8443150077 enhance: split bufferPool into several channels to reduce cost of lock caused by channel select
Signed-off-by: leonrayang <changliang@oppo.com>
2022-11-21 10:50:12 +08:00
leonrayang
cc406ae931 update: gofmt
Signed-off-by: leonrayang <chl696@sina.com>
2022-04-13 15:57:55 +08:00
chihe
59473e4aa1 bugfix:1.modify preload report.
2.fix nullpoint error in hot volume hadoop

Signed-off-by: chihe <chi.he@oppo.com>
2022-04-13 15:57:55 +08:00
chihe
a4404a3056 bugfix:1.In cold volume, cache dp number seldom less than 10
2.blobstoreWriter OOM
3.change FS name

Signed-off-by: chihe <chi.he@oppo.com>
2022-04-13 15:57:55 +08:00
AmazingChi
884dfb4581 enhance: Limit buffer pool size
Signed-off-by: AmazingChi <hechi1014@126.com>
2022-04-13 15:57:55 +08:00
leonrayang
2970e2c3d1 update. go import path change from chubaofs to cubefs
Signed-off-by: leonrayang <chl696@sina.com>
2022-01-25 18:17:02 +08:00
Shuoran Liu
54d6adb7c7 enhance: use total count instead of rate to limit memory usage
Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2020-06-11 14:20:46 +08:00
Shuoran Liu
7b674d152a fix: failed to put tiny buffer pool
Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2020-06-11 12:05:14 +08:00
Shuoran Liu
b2e82f48f6 enhance: limit the tiny buffer pool memory consumption
Use sync Pool and rate limiter to limit the memory usage.

Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
2020-06-10 18:00:03 +08:00
awzhgw
04230ed518 Refactor: Memory optimization, if there are more than 256 concurrent small files written, bufferPool is no longer used
Signed-off-by: awzhgw <guowl18702995996@gmail.com>
2020-04-30 16:39:40 +08:00
Mofei Zhang
4edef106d5
Enhancement: add routing for unimplemented APIs
In view of the particularity of the AWS S3 protocol rules, additional
routes are implemented for unimplemented APIs to prevent users from
incorrectly routing to other APIs when requesting unimplemented APIs.

Signed-off-by: Mofei Zhang <mofei2816@gmail.com>
2020-04-08 11:21:25 +08:00
awzhgw
97f2a18f5c rename repo from cfs to chubaofs 2019-04-28 15:12:17 +08:00
awzhgw
3893283054 init LICENSE file and vendor,util packet 2019-03-14 14:04:21 +08:00