dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,653 Commits 5 Branches 281 Tags 98 MiB
Commit Graph

153 Commits

Author SHA1 Message Date
dlut_xz 8a8d6abaae
feat: move probe interval from scheduler config to client config (#2462) 
Signed-off-by: XZ <834756128@qq.com>
 2023-06-28 17:34:58 +08:00
Gaius 5342fb97fc
fix: Interval in SyncProbesResponse (#2466) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:58 +08:00
Gaius 98aee9640d
feat: implement SyncProbes api in scheduler grpc service (#2449) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: dlut_xz <52518280+fcgxz2003@users.noreply.github.com>
 2023-06-28 17:34:58 +08:00
Gaius f610ab9c0d
test: add ParseProbedCountKeyInScheduler and Snapshot tests (#2438) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:56 +08:00
Gaius a44c084f28
feat: handle context in triggerSeedPeerTask (#2392) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:53 +08:00
Gaius 701a26a8d6
feat: hide sensitive information in log (#2369) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:51 +08:00
Gaius 71f13df1f0
feat: remove traffic_type in DownloadPeerDuration metric (#2357) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:51 +08:00
Tianxi f2130509d1
feat: add traffic type of peer task download duration (#2349) 
Co-authored-by: li.tianxi <li.tianxi@hellogroup.com>
 2023-06-28 17:34:51 +08:00
Gaius 65ec5b2906
feat: rename createRecord to createDownloadRecord (#2306) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:48 +08:00
Gaius 37c588608a
feat: remove security domain (#2285) 
* feat: remove security domain

Remove security domain in dfdaemon and scheduler.
Remove SecurityGroup and SecurityRule table in manager.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:46 +08:00
dlut_xz 8d29390b51
feat: rename Record to Download in storage (#2253) 
Signed-off-by: XZ <834756128@qq.com>
 2023-06-28 17:34:45 +08:00
Gaius 2765aa8c35
fix: fsm events failed when register task (#2225) 
fix: fsm events failed when register task.

When there is a high concurrency of registration tasks,
it can cause error InTransitionError, because of looplab/fsm library
uses optimistic locking to implement state transitions,
refer to https://github.com/looplab/fsm/blob/main/fsm.go#L312.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:42 +08:00
Gaius 2cda1def7f
feat: rename HostName to Hostname (#2205) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:40 +08:00
Gaius 224b951e63
fix: stat DownloadPeerCount and DownloadPieceCount (#2180) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:38 +08:00
Gaius 6d13b4a871
feat: add metrics to service v2 (#2153) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:36 +08:00
Gaius 17649a069c
feat: implement announce peer (#2150) 
feat: implement announce peer api

Add handleDownloadPeerStartedRequest, handleDownloadPeerBackToSourceStartedRequest,
handleDownloadPeerFinishedRequest, handleDownloadPeerBackToSourceFinishedRequest,
handleDownloadPeerFailedRequest, handleDownloadPeerBackToSourceFailedRequest,
handleDownloadPieceFinishedRequest, handleDownloadPieceBackToSourceFinishedRequest,
handleDownloadPieceFailedRequest and handleDownloadPieceBackToSourceFailedRequest,
to AnnouncePeer service api.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:36 +08:00
Gaius ff63681e88
feat: add handleRegisterSeedPeerRequest to service v2 in scheduler (#2148) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:36 +08:00
Gaius 047a55fb84
feat: add handleRegisterSeedPeerRequest to AnnouncePeer in service v2 (#2147) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:36 +08:00
Gaius b0e6089783
feat: change ScheduleCandidateParentsForNormalPeer implement (#2133) 
Change ScheduleCandidateParentsForNormalPeer implement.
Remove TaskStateLeave event in task GC.
Implement AnnouncePeer in service v2.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:35 +08:00
Gaius 670c892898
feat: implement v2 version of scheduler service (#2125) 
Implement StatTask, AnnounceHost and LeaveHost api in
scheduler service v2.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:34 +08:00
Gaius 7306aec508
feat: correct grpc error code and implement StatPeer and LeavePeer (#2115) 
Correct grpc error from codes.Unknow to codes.Internal in gorm
operation. Implement StatPeer and LeavePeer interface in v2 version of
grpc.

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:34 +08:00
Gaius 58034e4b1f
refactor: scheduling with v2 grpc (#2104) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:32 +08:00
Gaius da8c45f2a8
feat: add host ttl to scheduler (#2089) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:31 +08:00
Gaius dacf1f01a6
feat: rename scheduler package to scheduling (#2087) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:31 +08:00
Gaius 010396a0f8
feat: use v2 version of host id and add Addrs func to seed peer (#2086) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:31 +08:00
Gaius 59856bda21
refactor: type of digest in task (#2084) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:31 +08:00
Gaius 042bb64ce4
refactor: task.SizeScope with v2 grpc in scheduler (#2082) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:31 +08:00
Gaius 840c599d04
refactor: task piece with v2 grpc (#2080) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:30 +08:00
Gaius d8f36a44be
feat: change piece size to length (#2079) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:30 +08:00
Gaius a5685582ce
refactor: resource task with v2 version of grpc (#2078) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:30 +08:00
Gaius f7a399b47a
feat: add v2 version of the idgen (#2056) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:29 +08:00
Gaius 0f5470b5eb
feat: update task type from v1 to v2 (#2053) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:29 +08:00
Gaius e1dd1efca1
feat: add AnnouncePeers to task in resource (#2051) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:29 +08:00
Gaius 51cc31b574
refactor: peer resource with v2 version of the grpc (#2039) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:28 +08:00
Gaius d4b55c7287
refactor: announcer and dynconfig with v2 verison of the manager grpc (#2037) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:27 +08:00
Gaius 2b9aa7bf83
refactor: resource host without scheduler v1 definition (#2036) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:27 +08:00
Gaius b6f0435011
feat: change peer's piece type in resource (#2012) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:25 +08:00
Gaius c1066e60f4
feat: change ok to loaded in loading func (#2010) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:25 +08:00
Gaius 1666a17827
feat: remove NetTopology from scheduler and manager (#2007) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:25 +08:00
Gaius e83fb85216
feat: add v2 verison of the grpc to scheduler (#1999) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:24 +08:00
cuidajun 5764104fe0
feat: add fail_code in scheduler's DownloadFailureCount metric (#1981) 
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
 2023-06-28 17:34:23 +08:00
Gaius 1e783bd155
fix: context of trigger seed peer (#1971) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:22 +08:00
Gaius d01a742b6f
feat: update fsm stable api (#1938) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:18 +08:00
cuidajun 88f8f974ab
feat: client support 'priority' parameter (#1911) 
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
 2023-06-28 17:34:17 +08:00
Gaius 473c5d33f7
feat: update priority api (#1912) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:16 +08:00
Gaius da40946f17
feat: storage collects upload piece count, peer cost and error details (#1907) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:16 +08:00
Gaius 9cd2aa48c9
feat: priority of the register parameter is higher than parameter of the application (#1906) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:16 +08:00
Gaius d64a6d8e29
feat: trigger task with priority (#1904) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:16 +08:00
Gaius 481df276a3
feat: dynconfig adds list application in scheduler (#1903) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:15 +08:00
Gaius 63b4a868dc
refactor: back-to-source configuration (#1895) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:15 +08:00