17649a069c
feat: implement announce peer ( #2150 )
...
feat: implement announce peer api
Add handleDownloadPeerStartedRequest, handleDownloadPeerBackToSourceStartedRequest,
handleDownloadPeerFinishedRequest, handleDownloadPeerBackToSourceFinishedRequest,
handleDownloadPeerFailedRequest, handleDownloadPeerBackToSourceFailedRequest,
handleDownloadPieceFinishedRequest, handleDownloadPieceBackToSourceFinishedRequest,
handleDownloadPieceFailedRequest and handleDownloadPieceBackToSourceFailedRequest,
to AnnouncePeer service api.
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:36 +08:00
047a55fb84
feat: add handleRegisterSeedPeerRequest to AnnouncePeer in service v2 ( #2147 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:36 +08:00
58034e4b1f
refactor: scheduling with v2 grpc ( #2104 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:32 +08:00
59856bda21
refactor: type of digest in task ( #2084 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:31 +08:00
840c599d04
refactor: task piece with v2 grpc ( #2080 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
a5685582ce
refactor: resource task with v2 version of grpc ( #2078 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
79024c87ca
refactor: parse http range ( #2071 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
f7a399b47a
feat: add v2 version of the idgen ( #2056 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:29 +08:00
0f5470b5eb
feat: update task type from v1 to v2 ( #2053 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:29 +08:00
e1dd1efca1
feat: add AnnouncePeers to task in resource ( #2051 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:29 +08:00
ad1956fb45
feat: init AnnouncePeerStream of the peer ( #2040 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:28 +08:00
51cc31b574
refactor: peer resource with v2 version of the grpc ( #2039 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:28 +08:00
d4b55c7287
refactor: announcer and dynconfig with v2 verison of the manager grpc ( #2037 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:27 +08:00
2b9aa7bf83
refactor: resource host without scheduler v1 definition ( #2036 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:27 +08:00
c1066e60f4
feat: change ok to loaded in loading func ( #2010 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:25 +08:00
473c5d33f7
feat: update priority api ( #1912 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
9cd2aa48c9
feat: priority of the register parameter is higher than parameter of the application ( #1906 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
d64a6d8e29
feat: trigger task with priority ( #1904 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
8749814dee
feat: add the timeout of downloading piece to scheduler ( #1880 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:14 +08:00
a9f10bd678
feat: remove MainParent from peer and add IsPieceBackToSource to piece
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:13 +08:00
f194f0961f
feat: scheduler adds announce host handler ( #1843 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
242fb2bc37
add application-level statistics ( #1559 )
...
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:45 +08:00
c381c19a5d
fix: scheduler's MainParent func ( #1550 )
...
test: scheduler get main parent
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:44 +08:00
77667721ce
feat: scheduler dynconfig returns more info ( #1545 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:43 +08:00
4bf14f57bc
feat: schedulers create main peer record ( #1539 )
...
feat: scheduler create main peer record
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:43 +08:00
d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api ( #1515 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
46deb4fccf
Use dag to represent peer scheduling topology ( #1473 )
...
* feat: use dag to represent peer scheduling topology
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
e74a05685e
fix: infinite loop in peer.Ancestors() ( #1469 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
c6a019560d
feat: proxy add defaultTag field ( #1462 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
3b426d2c54
feat: rename client/clientutil to client/util ( #1420 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
75710ab761
feat: scheduler http status ( #1414 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
64f5e9357b
refactor: scheduler announce task ( #1407 )
...
* feat: scheduler announce normal task
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cid
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:30 +08:00
9c1e05983a
feat: scheduler add seed peer ( #1298 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
913b534668
fix: tree infinite loop ( #1271 )
...
* fix: peer tree infinite loop
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: peer add Ancestors func
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:16 +08:00
65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache ( #1227 )
...
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.
For example:
- add a file into cache system
dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file
- check if a file exists in cache system
dfcache stat --cid testid --local # only check local cache
dfcache stat --cid testid # check other peers as well
- export/download a file from cache system
dfcache export --cid testid -O /path/to/output
- delete a file from cache system, both local cache and P2P network
dfcache delete -i testid -t testtag
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
5223cc1ce8
feat: add scheduler metrics ( #1139 )
...
* feat: add scheduler metrics
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate validate for url meta
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
83cdf39a9c
feat: limit tree depth ( #1099 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
557425249c
feat: optimize peer range ( #1095 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
c14d36ba6a
fix: scheduler download tiny file error ( #1052 )
...
* fix: scheduler download tiny file error
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: fix golang lint
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:55 +08:00
aa5f078a14
feat: remove host and task when peer make tree ( #1042 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
99da719ce1
feat: cdn download tiny file ( #1040 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
061c3c8752
feat: scheduler download tiny file with range header ( #1024 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
61310b55d5
feat: when cdn peer is failed, peer should be back-to-source ( #1005 )
...
* feat: schdule peer with cdn failed
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: when cdn peer is failed, peer back-to-source
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: callback
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: change scheduler default config
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
5479b3a53e
feat: stream send error code ( #986 )
...
* feat: change task and peer ttl (#984 )
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: send error code
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: add retry interval
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfdaemon report successful piece before end of piece
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: update submodule version
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:51 +08:00
97c1eb65e7
Refactor scheduler service ( #958 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
Gaius