dragonflyoss
/
client
mirror of https://github.com/dragonflyoss/client.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,235 Commits 11 Branches 201 Tags 8.2 MiB
Commit Graph

111 Commits

Author SHA1 Message Date
Gaius 7cf2e3d800
feat(export): add overwrite option for output files (#1374) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-09-24 21:33:42 +08:00
Chlins Zhang 826aeabf08
feat: add the request sdk in dragonfly-client-util (#1333) 
Signed-off-by: chlins <chlins.zhang@gmail.com>
 2025-09-23 10:58:41 +08:00
Gaius 160f51396f
refactor: tcp storage server and client (#1361) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-09-22 17:44:20 +08:00
Fan Tianlan 9ec926f824
feat: Add TCP Client and Server Implementation for Piece Download in dragonfly-client-storage (#1359) 
Signed-off-by: ftljk <2510317228@qq.com>
 2025-09-18 15:18:03 +08:00
Gaius a2659dbc69
feat: remove loging to file in dfget dfcache and dfinit (#1355) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-09-16 18:26:17 +08:00
Chlins Zhang 2cca5c7b9b
refactor: remove the seed peer announcement to manager (#1261) 
Signed-off-by: chlins <chlins.zhang@gmail.com>
 2025-08-08 12:25:08 +08:00
this is my name 1f8a323665
docs:Modify Cache storage comments (#1277) 
Modify Cache storage comments to clarify its usage scenarios.

Signed-off-by: fu220 <2863318196@qq.com>
 2025-08-06 17:04:20 +08:00
Gaius e249089ec8
feat: support remote-ip for tracing (#1248) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-07-22 08:55:49 +00:00
Chlins Zhang d054d8ac2f
fix: rename scheduler_cluster_id in the host config (#1241) 
Signed-off-by: chlins <chlins.zhang@gmail.com>
 2025-07-21 17:37:40 +08:00
Chlins Zhang e53ed3411c
feat: support specify the schedulerClusterID in host config and carry… (#1240) 
feat: support specify the schedulerClusterID in host config and carry it when listing schedulers

Signed-off-by: chlins <chlins.zhang@gmail.com>
 2025-07-21 13:31:49 +08:00
Gaius cafb074620
feat: update default plugin directory to /usr/local/lib/dragonfly/plugins/ on Linux (#1236) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-07-17 05:58:20 +00:00
Gaius a81a67a7bc
feat: support HTTPS protocol for otel (#1206) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-06-25 15:54:01 +08:00
Gaius cdc6e30425
feat: add per-piece collection timeout for sync_pieces and sync_persistent_cache_pieces (#1205) 
* feat: add per-piece collection timeout for sync_pieces and sync_persistent_cache_pieces

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update

Signed-off-by: Gaius <gaius.qi@gmail.com>

---------

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-06-24 00:03:24 +08:00
Gaius 40c9e62ebd
feat(dragonfly-client): support http protocol for otel (#1195) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-06-19 08:54:19 +00:00
Gaius 8b6758e79e
feat(dragonfly-client-storage): add dist_threshold for disk usage calculation in GC policy (#1191) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-06-16 14:08:16 +00:00
Gaius 4bee58a863
feat(dragonfly-client): add tracing header for exporter (#1183) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-06-13 18:42:13 +08:00
Gaius c11f533637
feat(dragonfly-client): add logs for finished piece from local (#1147) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-05-12 23:47:02 +08:00
Gaius f2315f2804
feat(dragonfly-client-storage): add write_piece_timeout to storage config and enhance piece download timeout handling (#1146) 
feat(dragonfly-client-storage): add write_piece_timeout to storage config and enhance piece download timeout handling

This change introduces a `write_piece_timeout` configuration to the storage module, allowing customizable timeouts for writing pieces to storage (e.g., disk or cache). The default timeout is set to 90 seconds. The total timeout for piece operations now combines `download.piece was timeout` and `storage.write_piece_timeout`. Key changes include:

- Added `write_piece_timeout` field to `Storage` config with default and serialization support.
- Updated `wait_for_piece_finished` and `wait_for_piece_finished_by_task_id` to use combined timeout (`download.piece_timeout + storage.write_piece_timeout`).
- Introduced `DownloadPieceFinished` error for piece download timeouts and refactored `download_piece_from_source_finished` and `download_piece_from_parent_finished` to enforce timeouts using `tokio::select!`.
- Increased default `download.piece_timeout` from 60s to 120s for robustness.
- Removed `wait_for_piece_count` debug logging to simplify code.
- Updated tests to validate `write_piece_timeout` parsing.

These changes improve timeout granularity and reliability for piece operations.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-05-12 20:52:21 +08:00
Gaius 23efe2cb04
feat(dragonfly-client-config): change the default value oft the schedule_timeout (#1138) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-05-08 22:49:50 +08:00
dependabot[bot] b2c1f26ce9
chore(deps): Bump local-ip-address from 0.6.3 to 0.6.5 (#1134) 
Bumps [local-ip-address](https://github.com/LeoBorai/local-ip-address) from 0.6.3 to 0.6.5.
- [Release notes](https://github.com/LeoBorai/local-ip-address/releases)
- [Changelog](https://github.com/LeoBorai/local-ip-address/blob/main/CHANGELOG.md)
- [Commits](https://github.com/LeoBorai/local-ip-address/commits/v0.6.5)

---
updated-dependencies:
- dependency-name: local-ip-address
  dependency-version: 0.6.5
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-05-07 10:29:29 +08:00
Gaius e2c7d9000a
feat(dragonfly-client): remove dfstore command (#1109) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-04-24 10:33:49 +08:00
Zhaoxinxin 4f6417c221
Feat client config add test (#1086) 
* feat: client config add test

Signed-off-by: zhaoxinxin <1186037180@qq.com>

* feat: client config add test

Signed-off-by: zhaoxinxin <1186037180@qq.com>

* feat: client config add test

Signed-off-by: zhaoxinxin <1186037180@qq.com>

* feat: client config add test

Signed-off-by: zhaoxinxin <1186037180@qq.com>

* feat: client config add test

Signed-off-by: zhaoxinxin <1186037180@qq.com>

* feat: client config add test

Signed-off-by: zhaoxinxin <1186037180@qq.com>

---------

Signed-off-by: zhaoxinxin <1186037180@qq.com>
 2025-04-12 15:55:50 +08:00
Gaius 8631030c97
test(dragonfly-client-storage/benches): remove 1u64 when create cache (#1089) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-04-11 16:27:04 +08:00
Gaius 83bbf1973a
test(dragonfly-client-storage): add unit tests for content and fix doctest syntax (#1065) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-31 11:52:03 +08:00
Gaius fcea789ec8
feat: remove proxy cache (#1042) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-14 19:07:51 +08:00
Gaius e5b8dcb383
refactor: optimize storage cache (#1041) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-14 18:49:37 +08:00
SouthWest7 9ca89909f3
feat: add a LRU cache module for preheat jobs (#945) 
Signed-off-by: southwest miao <1403572259@qq.com>
 2025-03-14 13:47:53 +08:00
Gaius 85ad3f81d0
feat: optimize profile.release and remove tracing-flame (#1024) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-06 20:27:07 +08:00
Gaius 22c37712f0
feat(dragonfly-client/proxy): improved data transfer efficiency in the proxy (#1021) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-05 19:15:15 +08:00
Gaius cd9f5ca356
feat(dragonfly-client/proxy): add switch for cache in proxy (#1010) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-03 17:45:10 +08:00
Gaius d0fa28a879
feat: add concurrency limit for grpc server (#982) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-02-14 18:31:51 +08:00
Gaius 58da38d9f9
feat: support persist cache task when scheduler replicates task (#953) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-26 22:25:05 +08:00
Gaius 7e9ccaeaf1
chore: optimize comments for storage cache (#937) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-09 14:34:23 +08:00
SouthWest7 c19077a6c4
feat: add cache configuration support for preheat tasks (#930) 
Signed-off-by: southwest <1403572259@qq.com>
 2025-01-09 14:12:56 +08:00
Gaius f4c991c34d
feat: replace crc32c with crc-rc (#934) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-08 21:20:07 +08:00
Gaius e6849b0850
chore: optimize comments of the ParentSelector config (#927) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-03 17:43:02 +08:00
Gaius 3d91c09b0a
feat: support transfer piece content from dfdaemon (#926) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-03 17:15:50 +08:00
baowj ab9f634e36
feat: add ParentSelector configuration for dfdaemon (#917) 
Signed-off-by: baowj <bwj_678@qq.com>
 2025-01-03 16:48:27 +08:00
dependabot[bot] 5c4d591d6a
chore(deps): Bump home from 0.5.9 to 0.5.11 (#909) 
Bumps [home](https://github.com/rust-lang/cargo) from 0.5.9 to 0.5.11.
- [Changelog](https://github.com/rust-lang/cargo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/cargo/compare/home-0.5.9...home-0.5.11)

---
updated-dependencies:
- dependency-name: home
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-12-24 10:38:58 +08:00
Gaius f3289b6125
feat: add protocol for storage server (#902) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-12-17 17:56:42 +08:00
Gaius eb66100eb8
feat: add downloader for downloading piece (#894) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-12-13 14:21:59 +08:00
Gaius c445bd2962
chore: update api version to 2.0.177 (#887) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-12-06 16:39:10 +08:00
Chlins Zhang 865c7787c5
feat: support the rate limit for preheat request (#881) 
Signed-off-by: chlins <chlins.zhang@gmail.com>
Co-authored-by: suhan.zcy <suhan.zcy@antgroup.com>
 2024-12-06 16:29:50 +08:00
Gaius d8f0931ca5
feat: add gzip, deflate, brotli, zstd compressed for reqwest (#886) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-12-05 18:06:55 +08:00
Gaius 6e25a2f8b0
feat: remove dfdaemon.yaml in rpm and deb (#885) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-12-05 17:55:45 +08:00
Gaius 064a3f005c
feat: add retry middleware for http backend (#872) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-11-29 20:09:26 +08:00
Gaius 9fd770ffab
feat: add cache store for proxy (#870) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-11-28 22:27:09 +08:00
Gaius 62c62f7ec6
feat: add sse4.2 target feature for building (#867) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-11-26 18:07:50 +08:00
Gaius 10bab190a2
fix: rocksdb panic caused by out of bounds (#860) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-11-22 20:53:33 +08:00
yxxhero 07591fa862
feat(container_runtime): support podman container runtime (#812) 
Signed-off-by: yxxhero <aiopsclub@163.com>
 2024-11-04 10:37:53 +08:00