dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,342 Commits 5 Branches 281 Tags 98 MiB
Commit Graph

44 Commits

Author SHA1 Message Date
Gaius 517aed732e
feat: optimize GetTaskJob and DeleteTaskJob (#3434) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-08-16 16:31:53 +08:00
Chongzhi Deng 8153e57ed1
feat: scheduler detects peer survivability and clears offline peers' metadata (#3353) 
feat: scheduler detects peer survivability and clears offline peers

1. The Host GC method will remove hosts that did not announce in time and their peers' metadata.
2. The scheduler Host GC interval is lowered in order to detect non-surviving hosts in time.
3. Add unit tests.

Signed-off-by: BruceAko <chongzhi@hust.edu.cn>
 2024-07-04 13:46:35 +08:00
Min 0f9c400038
feat: evalutorBase adds networktopology (#3015) 
Signed-off-by: huangmin <2107139596@qq.com>
 2024-01-29 17:28:32 +08:00
Gaius 5239a6db4b
feat: optimize scheduler default config (#3050) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-01-25 12:34:39 +08:00
Gaius 0b1157bba8
feat: replace filters with filteredQueryParams (#3049) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-01-24 22:58:06 +08:00
Gaius 5989a4d4d3
fix: peer events state failed when register task (#2979) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-26 17:12:30 +08:00
Gaius 76530ae000
feat: add prefetch to trigger seed peer downloads entire task (#2929) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-07 20:02:28 +08:00
Gaius 9608eff3bf
feat: avoid hot resolve in grpc (#2884) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-11-15 22:23:43 +08:00
Gaius 12fc630612
fix: if scheduler has no seed peer, return error in preheating (#2835) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-10-30 16:45:39 +08:00
dlut_xz 1a652e6594
feat: add InitProbedCount in AnnounceHost and DeleteHost in LeaveHost (#2722) 
Signed-off-by: fcgxz2003 <834756128@qq.com>
 2023-09-14 21:20:34 +08:00
Gaius a5b0f7404d
feat: download tiny file with https scheme (#2617) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-08-10 16:29:28 +08:00
Gaius 778b90c718
feat: add optional to build information (#2567) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-07-25 15:15:40 +08:00
Gaius bd3d76a97c
feat: update api version to 2.0.8 (#2566) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-07-25 13:45:54 +08:00
Gaius b3f23f71a3
feat: update dy7.io/api to v2 (#2558) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-07-20 23:17:57 +08:00
Gaius 1da355018b
feat: implement FindProbedHosts and add LoadRandomHosts to host manager (#2519) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: dlut_xz <52518280+fcgxz2003@users.noreply.github.com>
 2023-07-06 10:56:52 +08:00
dlut_xz 8a8d6abaae
feat: move probe interval from scheduler config to client config (#2462) 
Signed-off-by: XZ <834756128@qq.com>
 2023-06-28 17:34:58 +08:00
Gaius 5342fb97fc
fix: Interval in SyncProbesResponse (#2466) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:58 +08:00
Gaius 98aee9640d
feat: implement SyncProbes api in scheduler grpc service (#2449) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: dlut_xz <52518280+fcgxz2003@users.noreply.github.com>
 2023-06-28 17:34:58 +08:00
Gaius f610ab9c0d
test: add ParseProbedCountKeyInScheduler and Snapshot tests (#2438) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:56 +08:00
Gaius 37c588608a
feat: remove security domain (#2285) 
* feat: remove security domain

Remove security domain in dfdaemon and scheduler.
Remove SecurityGroup and SecurityRule table in manager.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:46 +08:00
dlut_xz 8d29390b51
feat: rename Record to Download in storage (#2253) 
Signed-off-by: XZ <834756128@qq.com>
 2023-06-28 17:34:45 +08:00
Gaius 2cda1def7f
feat: rename HostName to Hostname (#2205) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:40 +08:00
Gaius 6d13b4a871
feat: add metrics to service v2 (#2153) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:36 +08:00
Gaius 17649a069c
feat: implement announce peer (#2150) 
feat: implement announce peer api

Add handleDownloadPeerStartedRequest, handleDownloadPeerBackToSourceStartedRequest,
handleDownloadPeerFinishedRequest, handleDownloadPeerBackToSourceFinishedRequest,
handleDownloadPeerFailedRequest, handleDownloadPeerBackToSourceFailedRequest,
handleDownloadPieceFinishedRequest, handleDownloadPieceBackToSourceFinishedRequest,
handleDownloadPieceFailedRequest and handleDownloadPieceBackToSourceFailedRequest,
to AnnouncePeer service api.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:36 +08:00
Gaius b0e6089783
feat: change ScheduleCandidateParentsForNormalPeer implement (#2133) 
Change ScheduleCandidateParentsForNormalPeer implement.
Remove TaskStateLeave event in task GC.
Implement AnnouncePeer in service v2.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:35 +08:00
Gaius 670c892898
feat: implement v2 version of scheduler service (#2125) 
Implement StatTask, AnnounceHost and LeaveHost api in
scheduler service v2.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:34 +08:00
Gaius 7306aec508
feat: correct grpc error code and implement StatPeer and LeavePeer (#2115) 
Correct grpc error from codes.Unknow to codes.Internal in gorm
operation. Implement StatPeer and LeavePeer interface in v2 version of
grpc.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:34 +08:00
Gaius 58034e4b1f
refactor: scheduling with v2 grpc (#2104) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:32 +08:00
Gaius da8c45f2a8
feat: add host ttl to scheduler (#2089) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:31 +08:00
Gaius dacf1f01a6
feat: rename scheduler package to scheduling (#2087) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:31 +08:00
Gaius 010396a0f8
feat: use v2 version of host id and add Addrs func to seed peer (#2086) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:31 +08:00
Gaius 59856bda21
refactor: type of digest in task (#2084) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:31 +08:00
Gaius 840c599d04
refactor: task piece with v2 grpc (#2080) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:30 +08:00
Gaius d8f36a44be
feat: change piece size to length (#2079) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:30 +08:00
Gaius a5685582ce
refactor: resource task with v2 version of grpc (#2078) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:30 +08:00
Gaius f7a399b47a
feat: add v2 version of the idgen (#2056) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:29 +08:00
Gaius 0f5470b5eb
feat: update task type from v1 to v2 (#2053) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:29 +08:00
Gaius e1dd1efca1
feat: add AnnouncePeers to task in resource (#2051) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:29 +08:00
Gaius 51cc31b574
refactor: peer resource with v2 version of the grpc (#2039) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:28 +08:00
Gaius d4b55c7287
refactor: announcer and dynconfig with v2 verison of the manager grpc (#2037) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:27 +08:00
Gaius 2b9aa7bf83
refactor: resource host without scheduler v1 definition (#2036) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:27 +08:00
Gaius c1066e60f4
feat: change ok to loaded in loading func (#2010) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:25 +08:00
Gaius 1666a17827
feat: remove NetTopology from scheduler and manager (#2007) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:25 +08:00
Gaius e83fb85216
feat: add v2 verison of the grpc to scheduler (#1999) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:24 +08:00