Commit Graph

99 Commits

Author SHA1 Message Date
Gaius 473c5d33f7
feat: update priority api (#1912)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius da40946f17
feat: storage collects upload piece count, peer cost and error details (#1907)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius 9cd2aa48c9
feat: priority of the register parameter is higher than parameter of the application (#1906)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius d64a6d8e29
feat: trigger task with priority (#1904)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius 481df276a3
feat: dynconfig adds list application in scheduler (#1903)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:15 +08:00
Gaius 63b4a868dc
refactor: back-to-source configuration (#1895)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:15 +08:00
Gaius 8749814dee
feat: add the timeout of downloading piece to scheduler (#1880)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:14 +08:00
Gaius 42ae0cec68
feat: if the scheduler cannot find the peer, then return Code_SchedReregister to dfdaemon (#1875)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:13 +08:00
Gaius 5276523f11
feat: store parent information (#1867)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:13 +08:00
Gaius a9f10bd678
feat: remove MainParent from peer and add IsPieceBackToSource to piece
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:13 +08:00
cuidajun 51683c2fd9
Fix: [scheduler] destPeer keepalive when downloaded by other peer (#1865)
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:12 +08:00
Gaius 4f91332992
feat: store peer download information (#1863)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:12 +08:00
Gaius 2421ce88f4
feat: add announcer to dfdameon (#1852)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
Gaius f194f0961f
feat: scheduler adds announce host handler (#1843)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
Gaius 02543c781d
feat: optimize scope size is error (#1831)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:10 +08:00
Gaius 42223d994f
feat: optimize peer log (#1828)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
Gaius b1c049db46
feat: returns an scheduling error if the peer state is not PeerStateRunning (#1821)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
Gaius 83ec42cf25
feat: peer.UpdateAt needs to be updated during download process (#1818)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:08 +08:00
Gaius abf1c43a4e
feat: add leave host logger (#1801)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:07 +08:00
Gaius 3587ba9537
feat: scheduler's record adds ParentUploadCount and ParentUploadFailedCount (#1795)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
Gaius 7e24a85efa
feat: add calculateParentHostUploadSuccessScore to scheduler (#1789)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
Gaius 446fcc9fd7
feat: add LeaveHost handler (#1780)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
Gaius 9014c21bec
refactor: scheduler registers task (#1766)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:04 +08:00
Gaius 481f685214
feat: available peer includes state is PeerStatePending (#1756)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:03 +08:00
Gaius 14f88993ae
feat: peer will back-to-source when task switch state failed (#1754)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 61a6e545e5
feat: change FilterParentRangeLimit validation (#1752)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius bbd418542e
feat: task state is TaskStateRunning can be registered (#1751)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 036e6e56fb
feat: overwrite task url and url meta (#1740)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:01 +08:00
Gaius 500f767073
feat: remove task and host gc ttl (#1735)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:01 +08:00
Gaius 04dabff01e
fix: content length is zero when task succeed (#1732)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
Gaius 327cf4493e
feat: add TaskStateLeave to task (#1728)
Signed-off-by: Gaius <gaius.qi@gmail.com>

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
Gaius 71bb5cc4ed
feat: async create a record (#1711)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:58 +08:00
Gaius f99851fd03
feat: optimize storage log (#1703)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:58 +08:00
Gaius f354ee3861
refactor: manager and scheduler config (#1701)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
Jim Ma 73de99353d
feat: empty file e2e (#1687)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:56 +08:00
Jim Ma 743712e479
chore: add source error metrics (#1560)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:49 +08:00
cuidajun 242fb2bc37
add application-level statistics (#1559)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:45 +08:00
Gaius 5bcb53f0a9
feat: grpc consistent hashing (#1554)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:44 +08:00
Jim Ma 25e929142f
chore: optimize source error log (#1553)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:44 +08:00
Gaius 2ce864fbf6
fix: scheduler and manager tracing (#1551)
fix: scheduler and manager trace

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:44 +08:00
Gaius 4bf14f57bc
feat: schedulers create main peer record (#1539)
feat: scheduler create main peer record

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:43 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
Gaius 7c2ee7858b
refactor: set and dag with generics (#1490)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
Gaius 46deb4fccf
Use dag to represent peer scheduling topology (#1473)
* feat: use dag to represent peer scheduling topology

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
Gaius c6a019560d
feat: proxy add defaultTag field (#1462)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius 8cf344992f
feat: if peer back-to-source failed, return source metadata. (#1444)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius 30313a4caa
feat: client add create object storage (#1409)
* feat: add create object storage rest api

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:30 +08:00
Gaius 64f5e9357b
refactor: scheduler announce task (#1407)
* feat: scheduler announce normal task

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cid

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:30 +08:00
Gaius 7a30db3fba
refactor: pkg util (#1402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00