Commit Graph

382 Commits

Author SHA1 Message Date
chihe
b47bc52042 fix(client): fix putAheadReadBlock Blocking issue
close:#1000412030

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit ccb7de44bb)
2025-12-24 17:01:35 +08:00
chihe
39ee65f326 fix(client): fix some bugs for metaCacheAcceleration
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit ad947942d1)
2025-12-24 17:01:29 +08:00
Victor1319
80eb869ebe feat(stream): enhance connection pool management with cost tracking. #1000402826
- Add cost tracking to connection pool objects
- Implement SetUseCostPool method for connection pool
- Update connection handling to utilize cost in PutConnectV2
- Introduce PoolInterface for improved pool management
- Create PoolWithCost for managing connections based on cost

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
(cherry picked from commit 767f5e9ae2)
2025-12-24 17:01:29 +08:00
clinx
9cd6c92dd3 fix(flash): check mount point and add metrics
with: #1000414729

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit a9c84eca6b)
2025-12-24 17:01:25 +08:00
Victor1319
5f9412e03d feat(client): add TCP keep-alive time configuration for connection pools. #1000402826
- Implement TcpAliveTime option in mount options
- Set TCP keep-alive time for stream and ahead read connection pools
- Update connection pool to accept timeout and minimum capacity parameters

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
(cherry picked from commit d96c5db9a3)
2025-12-24 17:01:24 +08:00
clinx
2a9b335268 fix(client): put interface uses custom errors to avoid obtaining pointer errors
with: #1000371716

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 578c7abb49)
2025-12-24 17:01:21 +08:00
chihe
127bdc8899 fix(client): calculate remainsize in doMultiAheadRead
close:#1000367076

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit bea4dd6439)
2025-12-24 17:01:21 +08:00
chihe
220d470ac2 fix(client): fixing the prefetching sliding window logic
close:#1000354285

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit 5657874b3f)
2025-12-24 17:01:15 +08:00
chihe
5c83c917a1 fix(client): read from leader when excuting ahead read
close:#1000340945

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit a59c4c71ed)
2025-12-24 17:01:11 +08:00
clinx
358058c74a fix(cache): improve read concurrency
with: #1000326585

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit e2b5003956)
2025-12-24 17:01:10 +08:00
clinx
57bea86ae0 fix(flash): print hanging size
with: #1000307099

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 7a249e1d99)
2025-12-24 17:01:07 +08:00
clinx
7dcd384f53 fix(client): set DefaultRemoteCacheSameRegionTimeout to 20 ms
with: #1000303671

Signed-off-by: clinx <chenlin1@oppo.com>
(cherry picked from commit 862c7f1171)
2025-12-24 17:01:06 +08:00
chihe
45dcc10e6a fix(flashnode): fixed the infinite loop issue in GetObject.
close:#1000151055

Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit c5e2315c7d)
2025-12-24 17:00:59 +08:00
clinx
54da526123 feat(flashnode): print client reqid in server log #1000150848
Signed-off-by: clinx <chenlin1@oppo.com>

(cherry picked from commit 52142b16c2)
2025-12-24 17:00:58 +08:00
chihe
3c7fb3cbec fix(sdk): enable remoteCacheClient init log.#1000151055
Signed-off-by: chihe <chihe@oppo.com>
(cherry picked from commit bf87156ac3)
2025-12-24 17:00:14 +08:00
clinx
d760b25ce1 fix(flashnode): rate limiting based on actual written data flow
close:#1000150848

Signed-off-by: clinx <chenlin1@oppo.com>

(cherry picked from commit 4320c3fc7c)
2025-12-24 17:00:13 +08:00
slasher
72cb5e8a87 feat(util): add Any2String and String2Any
. #1000334184

Signed-off-by: slasher <shenjie1@oppo.com>
2025-10-13 15:29:35 +08:00
Victor1319
d6f98b4fe6 refactor(master): support report zone, set info for node metrics. #1000138242
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-11 17:21:19 +08:00
zhumingze
e63be46cc0 fix(util): Optimizing dataNode oplog test case. #1000216688
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-08-11 17:21:18 +08:00
Victor1319
b069b5f51b fix(smux): check frame state before write data to session. #1000193713
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-11 17:21:16 +08:00
Victor1319
809d023e9e refactor(vendor): user smux in depends to replace pkg in vendor. #1000193713
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-11 17:21:16 +08:00
Victor1319
388b1cb7cf refactor(meta): add bench testcase for inode marshal. #1000114612
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:29 +08:00
Victor1319
c296a62206 feat(meta): add testcase for inode and dentry marshal. #1000114612
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:28 +08:00
Victor1319
3ad0f3d01f feat(meta): use buf pool to refactor inode marshal func. #1000094350
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:28 +08:00
Victor1319
6e05be7156 refactor(data): refactor the usage of the buffer pool during the prefetch process. #1000048465
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:59:26 +08:00
wu huocheng
4dddd2d05f fix(metric): fix the bug that value and label don't match.#1000005968
Signed-off-by: wu huocheng <wuhuocheng@oppo.com>
2025-08-08 14:59:25 +08:00
wu huocheng
1456d3c239 feat(client): add request monitor for client
Signed-off-by: wu huocheng <wuhuocheng@oppo.com>
2025-08-08 14:59:25 +08:00
baihailong
4581cbd979 feat(flashnode): add metrics MetricCacheBytes,MetricHandleReadLatency,MetricSourceDataLatency
. #1000092826

Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-08 14:59:25 +08:00
clinx
4a38fa1418 fix(client): add audit log for cross region host #1000075110
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-08 14:52:12 +08:00
clinx
79562f9cd0 feat(client): print cache size in stat file #23068759
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-08 14:52:03 +08:00
chihe
6bb14d523a bugfix(datanode): set IOLimitTicket to 3 second
close:#1000063103

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:52:02 +08:00
chihe
78c727cda3 fix(datanode): adjust log level for no leader
close:#1000001079

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:52:02 +08:00
baihailong
f2365c1319 fix(master): modify master error log and add some log for TryRun.#1000044182
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-08 14:52:02 +08:00
baihailong
603d6b5377 fix(util): use time.Now to check whether task is timeout.#1000048131
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-08 14:52:02 +08:00
chihe
b67b08df90 fix(client): do not close conn if encountering limit error
close:#1000023889

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:52:02 +08:00
chihe
f5783cd728 fix(flashnode): add write limit for flashnode
close:#1000023889

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:52:02 +08:00
chihe
6a89226dc5 feat(flashnode): supports return to client directly if data is not cached
close:#1000014246

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:52:01 +08:00
baihailong
5eef58052b feat(master): enable master config flashnode read timeout dynamically.#1000020016
Signed-off-by: baihailong <baihailong@oppo.com>
2025-08-08 14:51:45 +08:00
chihe
82a11e620c fix(client): ignore limit and context timeout error
close:#1000014246i,#1000017781

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:51:45 +08:00
chihe
baa7412321 fix(flashnode): do not close channel twice
close:#1000016077

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:51:44 +08:00
chihe
7c026a4daf fix(flashnode): delete pre-allocated size when return from InitForCacheRead
close:#1000012153

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:42:25 +08:00
chihe
ca90d3bac8 feat(master): add setRead/WriteLimits for flashnode
close:#1000004942

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:39:41 +08:00
chihe
380b8dde52 fix(flashnode): reply to client as soon as possible
close:#23109728

Signed-off-by: chihe <chihe@oppo.com>
2025-08-08 14:39:41 +08:00
Victor1319
efd90371e1 fix(client): fix client push commit failed. #22962095
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-08 14:39:41 +08:00
slasher
74a7c62171 chore(util): using newest bytespool
@formatter:off

Signed-off-by: slasher <shenjie1@oppo.com>
2025-08-07 16:20:27 +08:00
Victor1319
df827a9909 fix(meta): Resolve the issue where log level settings for the EC are ineffective #22921293
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-07 16:00:30 +08:00
Victor1319
dec11132ba refactor(master): support report monitor stats for cluster different media datanode. #22929430
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-08-07 16:00:30 +08:00
clinx
cfa8134cc7 feat(flashnode): add read and write latency metrics for cache #1000002444
Signed-off-by: clinx <chenlin1@oppo.com>
2025-08-07 16:00:30 +08:00
chihe
91965b0b44 fix(flashnode): use limitRead for read cache
close:#23123752

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:30 +08:00
chihe
9a1adf8212 fix(flashnode): use limitWrite for flashnode instead of disk
close:#23123752

Signed-off-by: chihe <chihe@oppo.com>
2025-08-07 16:00:30 +08:00