Commit Graph

988 Commits

Author SHA1 Message Date
Wu Huocheng
85cdb71774 feat(master): add default volume store mode into configuration.#1000578895
fix(master): limit the max learner number to 5.#1000587619

Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-12-26 14:48:09 +08:00
zhumingze
4c7e409a73 feat(master): Adaptation of the maximum number of large disk node dp. #1000562853
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-12-26 14:14:25 +08:00
Wu Huocheng
fa86ecde97 feat(cli): add cli for metanode tag.#1000511705
Signed-off-by: Wu Huocheng <wuhuocheng@oppo.com>
2025-12-22 11:30:50 +08:00
Victor1319
5baf97ccb5 feat(cluster): implement learner mode recovery timeout configuration. #1000560474
- Add learnerRecoverTimeoutSeconds parameter for cluster settings
- Update command line interface to accept learner recovery timeout
- Enhance API to parse and handle learnerRecoverTimeoutSeconds
- Modify cluster view to display learnerRecoverTimeoutSeconds status
- Implement logic to set learnerRecoverTimeoutSeconds in cluster

This commit enhances cluster management by allowing configuration of
the learner mode recovery timeout, improving the system's resilience
during decommissioning processes.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-12-17 14:31:54 +08:00
Victor1319
f4511216a8 feat(cluster): add enableMpDecommissionByLearner parameter for cluster management. #1000539820
- Introduce enableMpDecommissionByLearner flag for cluster settings
- Update command line interface to accept new parameter
- Enhance API to parse and handle enableMpDecommissionByLearner
- Modify cluster view to display enableMpDecommissionByLearner status
- Implement logic to set enableMpDecommissionByLearner in cluster

This commit enhances cluster management capabilities by allowing
configuration of the mp decommissioning behavior.

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-12-17 14:29:06 +08:00
zhumingze
d250ed5b92 fix(sdk): Trash Directory Structure Optimization. #1000528020
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-12-15 10:27:41 +08:00
leonrayang
86030fe047 feature(client): Reduce unessaray inode get request if quota not enabled
close:#1000519910

Signed-off-by: leonrayang <changliang@oppo.com>
2025-12-15 09:35:39 +08:00
Victor1319
177a2dda17 feat(metanode): implement learner addition and promotion functionality. #1000511705
- Add constants for learner operations
- Implement commands to add and promote learners in meta partitions
- Update API routes for learner management
- Enhance logging for learner operations
- Modify data structures to include learner information
- Ensure proper error handling for learner operations

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-12-03 14:44:53 +08:00
zhumingze
328dc547c0 feat(sdk): Add meta near read logic. #1000415324
Signed-off-by: zhumingze <zhumingze@oppo.com>
2025-11-21 14:04:36 +08:00
chihe
9c88d23091 fix(client): clear all blockCache when truncating file
close:#1000310987

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:25 +08:00
chihe
e50a3bc682 fix(client):fix some bugs for metaCacheAcceleration
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:25 +08:00
Victor1319
17f53643cf feat(stream): enhance connection pool management with cost tracking. #1000402826
- Add cost tracking to connection pool objects
- Implement SetUseCostPool method for connection pool
- Update connection handling to utilize cost in PutConnectV2
- Introduce PoolInterface for improved pool management
- Create PoolWithCost for managing connections based on cost

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-11-18 16:32:25 +08:00
chihe
ddc2f80be5 fix(client): enhance the logic of looking up for directory
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:25 +08:00
Victor1319
41045b973d feat(client): enhance directory lookup with lazy loading of child directories. #1000402826
- Add sync.Once to Dir struct for lazy initialization
- Implement lazy loading of child directories in Lookup method
- Update InodeGet to use InodeGetExt_ll for better performance
- Modify extents handling logic in InodeGet method
- Rename getExtetnsPool to GetExtetnsPool for consistency

Signed-off-by: [Your Name] <your.email@example.com>
Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-11-18 16:32:25 +08:00
chihe
4f7ef77c1b feat(client):support metaCacheAcceleration
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:25 +08:00
Victor1319
2ef64f5820 fix(client): update inode expiration time and enhance logging for extents. #1000402826
- Change DefaultInodeExpiration from 120s to 300s
- Comment out unused cache clearing logic in Release method
- Update logging in Lookup method to include extents information
- Modify ReadDir and ReadDirAll methods to use BatchInodeGetExtents
- Add extents handling in File methods for better cache management
- Introduce BatchInodeGetExtents method in MetaWrapper for batch processing

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-11-18 16:32:25 +08:00
clinx
bd9e6a89da fix(flash): check mount point and add metrics
with: #1000414729

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:24 +08:00
chihe
527307e1d6 fixc(client):fix bug with evictCacheBlock
close:#1000412030

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:24 +08:00
clinx
c128ec8ca1 fix(client): fix ut fail
close: #1000412030

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:24 +08:00
chihe
9c22ca99ca fix(client): use extentOffset to create block key for aheadRead
close:#1000412030

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:24 +08:00
chihe
c6f85392b3 fix(client): update rightOffset to make window for aheadRead move forward
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:24 +08:00
chihe
e2b929503a fix(client): check dp when creating or excuting task for aheadRead
close;#1000406278

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:24 +08:00
chihe
b8c880b609 fix(client):reset offset for aheadReading tinyExtent
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:24 +08:00
Victor1319
f0827085cc feat(client): add TCP keep-alive time configuration for connection pools. #1000402826
- Implement TcpAliveTime option in mount options
- Set TCP keep-alive time for stream and ahead read connection pools
- Update connection pool to accept timeout and minimum capacity parameters

Signed-off-by: Victor1319 <zengxuewei@oppo.com>
2025-11-18 16:32:24 +08:00
clinx
69867ff114 feat(flashnode): client warm up meta data with path
with: #1000150848

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:24 +08:00
chihe
0a498455bd fix(client): fix s3test CI test issue
close:#1000363069

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:24 +08:00
clinx
14658c0660 fix(flash): warm up task set force remote cache true
with: #1000390069

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:24 +08:00
chihe
9b6bfa1386 refactor(client): new sliding algorithm for readAhead
close:#1000048465

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:24 +08:00
chihe
3dcfd226da feat(client): support defining the size of cacheBlockSize
close:#1000261380

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:24 +08:00
clinx
e2b4cc847d fix(client): put interface uses custom errors to avoid obtaining pointer errors
with: #1000371716

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:04 +08:00
chihe
e6d332f823 fix(client):flush as sequnce
close:#1000363069

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:04 +08:00
chihe
4260e01645 fix(client): calculate remainsize in doMultiAheadRead
close:#1000367076

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:04 +08:00
clinx
73ced890e3 fix(client): Remove unused time statistics fields
with: #1000359075

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:04 +08:00
clinx
6bf625b3ba fix(client): update client dp info by master
with: #1000359075

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:04 +08:00
chihe
e048edacf6 fix(client):fix errMsg for aheadRead
close:#1000367076

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:04 +08:00
clinx
37fa2aff91 fix(flash): avoid returning network EOF
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:04 +08:00
clinx
4f5b417cb7 fix(flash): change the write packet size to 64K to avoid timeout
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:04 +08:00
chihe
1fac4b63c7 fix(client): do not wait for async flush if stream is error
close:#1000363069

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:04 +08:00
clinx
e7b40c57f1 fix(flash): set connection deadline with ctx for put
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:04 +08:00
clinx
2ad429b8fe fix(flash): do not put cache miss error to warn
with: #1000360870

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:04 +08:00
chihe
10d82562e0 fix(clinet):shuffle the order of hosts for aheadread
close:#1000340945

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:04 +08:00
clinx
7cb266dd77 fix(flash): the master distributes the flashkeylimit value
with: #1000356686

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:04 +08:00
chihe
dfefd2e616 fix(client):fix the issue with the timing of triggering the addNextTask task
close:#1000354285

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:03 +08:00
clinx
f3a992b254 fix:(flash): check key limit with no wait
with: #1000355286

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:03 +08:00
chihe
3b087273bc fix(client):fixing the prefetching sliding window logic
close:#1000354285

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:03 +08:00
chihe
fd93aee704 fix(client):add unit test for aheadread
@formatter:off

Signed-off-by: chihe <chihe@oppo.com>
2025-11-18 16:32:03 +08:00
clinx
861ed6c0e5 feat(flash): atomic update request result
with: #1000347719

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:03 +08:00
clinx
f97e6dff76 fix(flash): config client flow limit by master
with: #1000347719

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:03 +08:00
clinx
b0016bad3d fix(flash): pull handleReadTimeout when flashnode start
with: #1000347719

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:03 +08:00
clinx
7078f1da29 fix(flash): change log level to warn
with: #1000347719

Signed-off-by: clinx <chenlin1@oppo.com>
2025-11-18 16:32:03 +08:00