cea03ee4c0
chore(deps): bump tokio from 1.47.0 to 1.47.1
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.47.0 to 1.47.1.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.47.0...tokio-1.47.1 )
---
updated-dependencies:
- dependency-name: tokio
dependency-version: 1.47.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
2025-08-04 01:32:11 +00:00
e16aad3f23
feat: add insecure_skip_verify and certificate_chain for PreheatImage ( #518 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-08-01 14:14:22 +08:00
96a6f1a224
chore(deps): bump tokio from 1.46.1 to 1.47.0 ( #515 )
2025-08-01 10:11:50 +08:00
1e5544f041
chore(deps): bump google.golang.org/grpc from 1.73.0 to 1.74.2 ( #516 )
2025-08-01 10:11:44 +08:00
cd8b9986c1
feat(golang/proto): add PreheatImage and StatImage for scheduler
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-07-29 19:39:46 +08:00
7662562f49
feat: add PreheatImage and StatImage for scheduler ( #517 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-07-29 19:03:37 +08:00
80c539463b
feat: add Cache Task mechanism ( #512 )
...
* # Description
This pull request introduces APIs for the new Cache Task mechanism, enabling support for memory cache operations. Additionally, by refactoring the Download model and removing the load_to_cache field, the Task component now focuses exclusively on disk I/O operations, while the Cache Task handles memory cache operations. Finally, the version number of the dragonfly-api package has been incremented.
## Key Changes
### common.proto
- Added a new enum type Cache to TaskType to identify CacheTask.
- Introduced a new structure CachePeer to represent peers handling cache tasks.
- Added a new structure CacheTask to define metadata for cache tasks.
- Removed the load_to_cache field from the Download structure, as Tasks will no longer handle cache operations.
### dfdaemon.proto
- Added three RPC calls (DownloadCacheTask, StatCacheTask, DeleteCacheTask) to the DfdaemonUpload and DfdaemonDownload services for cache task management.
- Added two RPC calls (SyncCachePieces, DownloadCachePiece) to the DfdaemonUpload service for cache piece synchronization.
- Introduced 9 new message types to support requests and responses for CacheTask downloads.
### scheduler.proto
- Added five RPC calls to the Scheduler service: AnnounceCachePeer, StatCachePeer, DeleteCachePeer for cache peer management. StatCacheTask, DeleteCacheTask for cache task management.
- Introduced 16 new message types to cover the full lifecycle state transitions of cache tasks.
## Version Update
- Incremented the version of the dragonfly-api package from 2.1.47 to 2.1.48 in Cargo.toml to reflect the new changes.
## Related Issue
## Motivation and Context
- Separation of Responsibilities: Tasks now focus exclusively on disk I/O operations, while CacheTask independently handles memory cache management.
Signed-off-by: fu220 <2863318196@qq.com>
* Changed Download and introduced CacheDownload.
- Added more detailed descriptions for the CACHE type in TaskType, while clarifying that the STANDARD type interacts exclusively with disk operations.
- Removed the load_to_cache field and related information from the Download structure.
- Introduced CacheDownload for handling CacheTask downloads.
Signed-off-by: fu220 <2863318196@qq.com>
* Removed CacheDownload and directly merged into the Request
Signed-off-by: fu220 <2863318196@qq.com>
* Allow large_enum_variant in RegisterCachePeerRequest
Signed-off-by: fu220 <2863318196@qq.com>
---------
Signed-off-by: fu220 <2863318196@qq.com>
2025-07-24 18:27:23 +08:00
9c637ef230
feat: add is_finished for DownloadTaskStartedResponse ( #514 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-07-23 17:15:43 +08:00
c619a3c8ac
feat: local_only specifies whether to query task information from local client only ( #513 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-07-23 11:53:20 +08:00
8165c4bff1
feat: remove remote_ip in DownloadPersistentCachePieceRequest
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-07-22 14:24:43 +08:00
71e4d8083f
feat: add remote ip for request ( #511 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-07-22 13:02:08 +08:00
be780d75c1
feat: add remote ip for request ( #510 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-07-21 17:28:46 +08:00
0b94987d3d
feat: add scheduler cluster ID to list schedulers request ( #509 )
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2025-07-18 15:40:38 +08:00
928e93e8fe
feat: update ListTaskEntriesResponse by removing unused fields ( #508 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-07-16 19:19:03 +08:00
7d884ac8a9
chore: bump version to 2.1.42 ( #507 )
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2025-07-16 18:19:08 +08:00
ad356a5030
feat: add scheduler configuration field to UpdateSchedulerRequest ( #506 )
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2025-07-16 18:08:29 +08:00
d71ef77192
chore(deps): bump tokio from 1.45.1 to 1.46.1 ( #504 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.45.1 to 1.46.1.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.45.1...tokio-1.46.1 )
---
updated-dependencies:
- dependency-name: tokio
dependency-version: 1.46.1
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-07-15 12:13:42 +08:00
20d9c4bc90
feat: add ListTaskEntries for downloading directory ( #505 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-07-08 11:45:19 +08:00
b3635340f7
feat: add digest for download task and supports CRC32, SHA256, and SHA512 algorithms ( #502 )
...
feat: add digest for download task and supports CRC32, SHA256, and SHA512 algorithms.
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-06-27 12:26:56 +08:00
6f25e8acc6
chore(deps): bump prost-types from 0.14.0 to 0.14.1 ( #501 )
...
Bumps [prost-types](https://github.com/tokio-rs/prost ) from 0.14.0 to 0.14.1.
- [Release notes](https://github.com/tokio-rs/prost/releases )
- [Changelog](https://github.com/tokio-rs/prost/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tokio-rs/prost/compare/v0.14.0...v0.14.1 )
---
updated-dependencies:
- dependency-name: prost-types
dependency-version: 0.14.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-23 15:43:38 +08:00
17c5322a9e
chore(deps): bump prost-types from 0.13.5 to 0.14.0 ( #500 )
...
Bumps [prost-types](https://github.com/tokio-rs/prost ) from 0.13.5 to 0.14.0.
- [Release notes](https://github.com/tokio-rs/prost/releases )
- [Changelog](https://github.com/tokio-rs/prost/blob/master/CHANGELOG.md )
- [Commits](https://github.com/tokio-rs/prost/compare/v0.13.5...v0.14.0 )
---
updated-dependencies:
- dependency-name: prost-types
dependency-version: 0.14.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-16 10:56:32 +08:00
47585b7eaf
chore(deps): bump google.golang.org/grpc from 1.72.1 to 1.73.0 ( #498 )
...
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go ) from 1.72.1 to 1.73.0.
- [Release notes](https://github.com/grpc/grpc-go/releases )
- [Commits](https://github.com/grpc/grpc-go/compare/v1.72.1...v1.73.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/grpc
dependency-version: 1.73.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-06-09 10:35:47 +08:00
cc94665915
chore(deps): bump tokio from 1.45.0 to 1.45.1 ( #496 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.45.0 to 1.45.1.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.45.0...tokio-1.45.1 )
---
updated-dependencies:
- dependency-name: tokio
dependency-version: 1.45.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-26 10:32:32 +08:00
e528000637
chore(README.md): add maintainer google groups for communication channels and remove discussion group ( #495 )
...
* chore(README.md): add maintainer google groups for communication channels and remove discussion group
Signed-off-by: Gaius <gaius.qi@gmail.com>
* Update README.md
---------
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-05-23 16:04:24 +08:00
05a74d22cb
chore(deps): bump google.golang.org/grpc from 1.72.0 to 1.72.1 ( #494 )
...
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go ) from 1.72.0 to 1.72.1.
- [Release notes](https://github.com/grpc/grpc-go/releases )
- [Commits](https://github.com/grpc/grpc-go/compare/v1.72.0...v1.72.1 )
---
updated-dependencies:
- dependency-name: google.golang.org/grpc
dependency-version: 1.72.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-19 10:34:13 +08:00
9b789e3418
chore(deps): bump tokio from 1.44.2 to 1.45.0 ( #492 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.44.2 to 1.45.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.44.2...tokio-1.45.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-version: 1.45.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-19 10:33:45 +08:00
38508c2d68
chore(deps): bump golangci/golangci-lint-action from 6 to 8 ( #488 )
...
* chore(deps): bump golangci/golangci-lint-action from 6 to 8
Bumps [golangci/golangci-lint-action](https://github.com/golangci/golangci-lint-action ) from 6 to 8.
- [Release notes](https://github.com/golangci/golangci-lint-action/releases )
- [Commits](https://github.com/golangci/golangci-lint-action/compare/v6...v8 )
---
updated-dependencies:
- dependency-name: golangci/golangci-lint-action
dependency-version: '8'
dependency-type: direct:production
update-type: version-update:semver-major
...
Signed-off-by: dependabot[bot] <support@github.com>
* fix lint errors
Signed-off-by: yxxhero <aiopsclub@163.com>
---------
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: yxxhero <aiopsclub@163.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: yxxhero <aiopsclub@163.com>
2025-05-05 15:56:39 +08:00
203a7b194b
chore(deps): bump go.uber.org/mock from 0.5.1 to 0.5.2 ( #490 )
...
Bumps [go.uber.org/mock](https://github.com/uber/mock ) from 0.5.1 to 0.5.2.
- [Release notes](https://github.com/uber/mock/releases )
- [Changelog](https://github.com/uber-go/mock/blob/main/CHANGELOG.md )
- [Commits](https://github.com/uber/mock/compare/v0.5.1...v0.5.2 )
---
updated-dependencies:
- dependency-name: go.uber.org/mock
dependency-version: 0.5.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-05 15:42:39 +08:00
96fe4250ae
chore(deps): bump prost-wkt-types from 0.6.0 to 0.6.1 ( #489 )
...
Bumps [prost-wkt-types](https://github.com/fdeantoni/prost-wkt ) from 0.6.0 to 0.6.1.
- [Release notes](https://github.com/fdeantoni/prost-wkt/releases )
- [Changelog](https://github.com/fdeantoni/prost-wkt/blob/master/CHANGELOG.md )
- [Commits](https://github.com/fdeantoni/prost-wkt/compare/v0.6.0...v0.6.1 )
---
updated-dependencies:
- dependency-name: prost-wkt-types
dependency-version: 0.6.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-05-05 15:42:13 +08:00
d7a9e1c3d2
chore(deps): bump google.golang.org/grpc from 1.71.1 to 1.72.0 ( #487 )
...
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go ) from 1.71.1 to 1.72.0.
- [Release notes](https://github.com/grpc/grpc-go/releases )
- [Commits](https://github.com/grpc/grpc-go/compare/v1.71.1...v1.72.0 )
---
updated-dependencies:
- dependency-name: google.golang.org/grpc
dependency-version: 1.72.0
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-28 10:37:26 +08:00
07d2017a8a
feat: add content_for_calculating_task_id for UploadPersistentCacheTaskRequest ( #486 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-04-24 18:03:20 +08:00
18ebde934b
feat: updates the task ID calculation logic in the Download ( #485 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-04-24 17:03:12 +08:00
53d7b93edc
feat: add content_for_calculating_task_id for Download message ( #484 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-04-24 15:49:30 +08:00
e509a2c3cc
chore: bump golang version to 1.23.8 ( #483 )
...
Signed-off-by: chlins <chlins.zhang@gmail.com>
2025-04-16 19:54:38 +08:00
da640571e2
chore(deps): bump go.uber.org/mock from 0.4.0 to 0.5.1 ( #482 )
...
Bumps [go.uber.org/mock](https://github.com/uber/mock ) from 0.4.0 to 0.5.1.
- [Release notes](https://github.com/uber/mock/releases )
- [Changelog](https://github.com/uber-go/mock/blob/main/CHANGELOG.md )
- [Commits](https://github.com/uber/mock/compare/v0.4.0...v0.5.1 )
---
updated-dependencies:
- dependency-name: go.uber.org/mock
dependency-version: 0.5.1
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-14 10:40:20 +08:00
8c8e4d0b7b
chore(deps): bump tokio from 1.44.1 to 1.44.2 ( #481 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.44.1 to 1.44.2.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.44.1...tokio-1.44.2 )
---
updated-dependencies:
- dependency-name: tokio
dependency-version: 1.44.2
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-08 11:05:45 +08:00
86c6246bef
chore(deps): bump google.golang.org/grpc from 1.71.0 to 1.71.1 ( #480 )
...
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go ) from 1.71.0 to 1.71.1.
- [Release notes](https://github.com/grpc/grpc-go/releases )
- [Commits](https://github.com/grpc/grpc-go/compare/v1.71.0...v1.71.1 )
---
updated-dependencies:
- dependency-name: google.golang.org/grpc
dependency-version: 1.71.1
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-08 11:05:32 +08:00
75f50ea5ab
chore(deps): bump google.golang.org/protobuf from 1.36.5 to 1.36.6 ( #477 )
...
Bumps google.golang.org/protobuf from 1.36.5 to 1.36.6.
---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-04-01 10:30:36 +08:00
e264b50709
feat: add force_hard_link for DownloadPersistentCacheTaskRequest ( #475 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-03-28 15:35:55 +08:00
8e1782b9d8
feat: add ExchangeIBVerbsQueuePairEndpoint to DfdaemonUpload
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-03-25 18:52:55 +08:00
b7701531cf
feat: add ExchangeIBVerbsQueuePairEndpoint for DfdaemonUpload ( #474 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-03-25 18:34:27 +08:00
6bd235200f
feat: add IbVerbsConnection service to support connection between ibverbs peers ( #473 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-03-24 20:16:07 +08:00
50ab9e7b9c
feat: optimize the comment for output_path and force_hard_link ( #472 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-03-20 14:22:42 +08:00
33be225960
feat: add force_hard_link field for Download message ( #471 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-03-19 15:40:43 +08:00
d69955fe1f
chore(deps): bump tokio from 1.44.0 to 1.44.1 ( #470 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.44.0 to 1.44.1.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.44.0...tokio-1.44.1 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-03-17 10:39:55 +08:00
2c77b64e97
chore(deps): bump tokio from 1.43.0 to 1.44.0 ( #468 )
...
Bumps [tokio](https://github.com/tokio-rs/tokio ) from 1.43.0 to 1.44.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases )
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.43.0...tokio-1.44.0 )
---
updated-dependencies:
- dependency-name: tokio
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-03-11 00:09:14 +08:00
9e4f8d11bb
chore(deps): bump serde from 1.0.218 to 1.0.219 ( #469 )
...
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.218 to 1.0.219.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.218...v1.0.219 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-03-11 00:09:00 +08:00
8677f335fc
chore(deps): bump google.golang.org/grpc from 1.70.0 to 1.71.0 ( #467 )
2025-03-10 09:57:59 +08:00
be1ca95b4c
feat: remove piece_length in Task ( #466 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-02-26 11:43:43 +08:00
b040351547
feat: add validation for piece_length ( #465 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-02-24 15:52:00 +08:00
dependabot[bot]
Gaius
this is my name
Chlins Zhang