dragonflyoss
/
api
mirror of https://github.com/dragonflyoss/api.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
504 Commits 6 Branches 340 Tags 7.6 MiB
Commit Graph

326 Commits

Author SHA1 Message Date
fu220 61d686b267 merge the local_only feature from PR#513 2025-07-23 07:11:02 +00:00
Gaius c619a3c8ac
feat: local_only specifies whether to query task information from local client only (#513) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-07-23 11:53:20 +08:00
fu220 731e6468a3 Changed Download and introduced CacheDownload. 
- Added more detailed descriptions for the CACHE type in TaskType, while clarifying that the STANDARD type interacts exclusively with disk operations.
- Removed the load_to_cache field and related information from the Download structure.
- Introduced CacheDownload for handling CacheTask downloads.

Signed-off-by: fu220 <2863318196@qq.com>
 2025-07-23 03:52:19 +00:00
fu220 8a5885e249 # Description 
This pull request introduces APIs for the new Cache Task mechanism, enabling support for memory cache operations. Additionally, by refactoring the Download model and removing the load_to_cache field, the Task component now focuses exclusively on disk I/O operations, while the Cache Task handles memory cache operations. Finally, the version number of the dragonfly-api package has been incremented.

## Key Changes

### common.proto
- Added a new enum type Cache to TaskType to identify CacheTask.
- Introduced a new structure CachePeer to represent peers handling cache tasks.
- Added a new structure CacheTask to define metadata for cache tasks.
- Removed the load_to_cache field from the Download structure, as Tasks will no longer handle cache operations.

### dfdaemon.proto
- Added three RPC calls (DownloadCacheTask, StatCacheTask, DeleteCacheTask) to the DfdaemonUpload and DfdaemonDownload services for cache task management.
- Added two RPC calls (SyncCachePieces, DownloadCachePiece) to the DfdaemonUpload service for cache piece synchronization.
- Introduced 9 new message types to support requests and responses for CacheTask downloads.

### scheduler.proto
- Added five RPC calls to the Scheduler service: AnnounceCachePeer, StatCachePeer, DeleteCachePeer for cache peer management. StatCacheTask, DeleteCacheTask for cache task management.
- Introduced 16 new message types to cover the full lifecycle state transitions of cache tasks.

## Version Update
- Incremented the version of the dragonfly-api package from 2.1.47 to 2.1.48 in Cargo.toml to reflect the new changes.

## Related Issue

## Motivation and Context
- Separation of Responsibilities: Tasks now focus exclusively on disk I/O operations, while CacheTask independently handles memory cache management.

Signed-off-by: fu220 <2863318196@qq.com>
 2025-07-22 09:52:58 +00:00
Gaius 8165c4bff1
feat: remove remote_ip in DownloadPersistentCachePieceRequest 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-07-22 14:24:43 +08:00
Gaius 71e4d8083f
feat: add remote ip for request (#511) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-07-22 13:02:08 +08:00
Gaius be780d75c1
feat: add remote ip for request (#510) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-07-21 17:28:46 +08:00
Chlins Zhang 0b94987d3d
feat: add scheduler cluster ID to list schedulers request (#509) 
Signed-off-by: chlins <chlins.zhang@gmail.com>
 2025-07-18 15:40:38 +08:00
Gaius 928e93e8fe
feat: update ListTaskEntriesResponse by removing unused fields (#508) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-07-16 19:19:03 +08:00
Chlins Zhang ad356a5030
feat: add scheduler configuration field to UpdateSchedulerRequest (#506) 
Signed-off-by: chlins <chlins.zhang@gmail.com>
 2025-07-16 18:08:29 +08:00
Gaius 20d9c4bc90
feat: add ListTaskEntries for downloading directory (#505) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-07-08 11:45:19 +08:00
Gaius b3635340f7
feat: add digest for download task and supports CRC32, SHA256, and SHA512 algorithms (#502) 
feat: add digest for download task and supports CRC32, SHA256, and SHA512 algorithms.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-06-27 12:26:56 +08:00
Gaius 07d2017a8a
feat: add content_for_calculating_task_id for UploadPersistentCacheTaskRequest (#486) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-04-24 18:03:20 +08:00
Gaius 18ebde934b
feat: updates the task ID calculation logic in the Download (#485) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-04-24 17:03:12 +08:00
Gaius 53d7b93edc
feat: add content_for_calculating_task_id for Download message (#484) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-04-24 15:49:30 +08:00
Gaius e264b50709
feat: add force_hard_link for DownloadPersistentCacheTaskRequest (#475) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-28 15:35:55 +08:00
Gaius 8e1782b9d8
feat: add ExchangeIBVerbsQueuePairEndpoint to DfdaemonUpload 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-25 18:52:55 +08:00
Gaius b7701531cf
feat: add ExchangeIBVerbsQueuePairEndpoint for DfdaemonUpload (#474) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-25 18:34:27 +08:00
Gaius 6bd235200f
feat: add IbVerbsConnection service to support connection between ibverbs peers (#473) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-24 20:16:07 +08:00
Gaius 50ab9e7b9c
feat: optimize the comment for output_path and force_hard_link (#472) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-20 14:22:42 +08:00
Gaius 33be225960
feat: add force_hard_link field for Download message (#471) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-03-19 15:40:43 +08:00
Gaius be1ca95b4c
feat: remove piece_length in Task (#466) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-02-26 11:43:43 +08:00
Gaius b040351547
feat: add validation for piece_length (#465) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-02-24 15:52:00 +08:00
Gaius ff110f324b
feat: add piece_length for Persistent Cache Task (#464) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-02-24 12:26:26 +08:00
Gaius 9bee47043a
feat: add digest for DownloadPersistentCachePieceResponse (#460) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-02-14 11:04:22 +08:00
Gaius 8d312b5628
feat: change validation of the ttl in UploadPersistentCacheTaskStartedRequest (#459) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-02-12 17:05:38 +08:00
Gaius f201aeb1b8
feat: add ttl for PersistentCacheTask (#458) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-02-12 15:33:41 +08:00
KennyMcCormick ff1adb1882
add digest in DownloadPieceResponse (#457) 
Signed-off-by: cormick <cormick1080@gmail.com>
 2025-02-12 11:22:36 +08:00
Gaius 45c2817e5e
feat: add task_id for UploadPersistentCacheTask 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-26 20:21:14 +08:00
Gaius c6f625f3ad
feat: add task_id for UpdatePersistentCacheTask 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-26 19:48:49 +08:00
Gaius c8e0b2526f
feat: add UpdatePersistentCacheTask api 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-26 19:06:56 +08:00
Gaius 572faaa58f
feat: add is_replicated for DownloadPersistentCacheTaskRequest 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-26 18:08:27 +08:00
Gaius 7fde34770f
feat: add persistent field for RegisterPersistentCachePeerRequest 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-26 15:12:45 +08:00
Gaius 2c761170dd
feat: add DeletePersistentCacheTask for UploadDfdaemon 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-26 13:26:42 +08:00
Gaius c8398377dd
feat: remove DeletePersistentCacheTask in DfdaemonDownload (#452) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-26 11:06:44 +08:00
Gaius 05b74d50e3
feat: remove update_persistent_cache_task api (#451) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-24 17:52:18 +08:00
Gaius 2a23158326
feat: remove response from UpdatePersistentCacheTask 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-22 11:13:39 +08:00
Gaius d4e497d037
feat: add UpdatePersistentCacheTask to upload server (#450) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-22 10:36:51 +08:00
Gaius c7f8c2a600
feat: add UpdatePersistentCacheTask for setting the value of persistent (#449) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-21 22:14:01 +08:00
Gaius 1920f90700
feat: remove ReschedulePeerFailedRequest and ReschedulePersistentCachePeerFailedRequest 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-21 20:40:33 +08:00
Gaius 214460fd27
feat: add ReschedulePeerFailedRequest and ReschedulePersistentCachePeerFailedRequest (#448) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-21 12:38:09 +08:00
Gaius 161f9d810f
feat: add DownloadPersistentCachePiece and SyncPersistentCachePieces api (#447) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-20 12:08:33 +08:00
Gaius 86b994e4ae
feat: remove timeout from PersistentCacheTask (#444) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-17 15:27:13 +08:00
Gaius b9b98411e4
feat: remove digest field in PersistentCacheTask (#443) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-17 11:58:26 +08:00
Gaius 13a45c2c30
feat: remove host_id and task_id in RegisterPersistentCachePeerRequest (#442) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-16 15:32:33 +08:00
Gaius 352bcc2611
feat: set digest to optional for persistent cache task 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-15 14:15:43 +08:00
Gaius 76b2eac2d0
feat: add ReadPersistentCacheTask and WritePersistentCacheTask message (#441) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-15 12:14:58 +08:00
SouthWest7 bff2301ac7
feat: add 'load_to_cache' field to Download message (#437) 
Signed-off-by: southwest <1403572259@qq.com>
 2025-01-08 10:41:36 +08:00
Gaius 05f657ba25
feat: set output optional for presistent cache (#436) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-03 10:48:02 +08:00
Gaius 502a8fbe6e
feat: set output_path to optional and add need_piece_content for downloading persistent cache (#435) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2025-01-02 15:51:29 +08:00