76cf35fd5d
feat: add scope for preheating job ( #3497 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-09-14 14:20:09 +08:00
dc13a7cbd6
feat: delete the host after host leave peers during host manager gc ( #3361 )
...
Signed-off-by: BruceAko <chongzhi@hust.edu.cn>
2024-07-08 12:37:38 +08:00
8153e57ed1
feat: scheduler detects peer survivability and clears offline peers' metadata ( #3353 )
...
feat: scheduler detects peer survivability and clears offline peers
1. The Host GC method will remove hosts that did not announce in time and their peers' metadata.
2. The scheduler Host GC interval is lowered in order to detect non-surviving hosts in time.
3. Add unit tests.
Signed-off-by: BruceAko <chongzhi@hust.edu.cn>
2024-07-04 13:46:35 +08:00
0b1157bba8
feat: replace filters with filteredQueryParams ( #3049 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-24 22:58:06 +08:00
12fc630612
fix: if scheduler has no seed peer, return error in preheating ( #2835 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-10-30 16:45:39 +08:00
a5b0f7404d
feat: download tiny file with https scheme ( #2617 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-10 16:29:28 +08:00
b3f23f71a3
feat: update dy7.io/api to v2 ( #2558 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-20 23:17:57 +08:00
1da355018b
feat: implement FindProbedHosts and add LoadRandomHosts to host manager ( #2519 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: dlut_xz <52518280+fcgxz2003@users.noreply.github.com>
2023-07-06 10:56:52 +08:00
59856bda21
refactor: type of digest in task ( #2084 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:31 +08:00
a5685582ce
refactor: resource task with v2 version of grpc ( #2078 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
0f5470b5eb
feat: update task type from v1 to v2 ( #2053 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:29 +08:00
2b9aa7bf83
refactor: resource host without scheduler v1 definition ( #2036 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:27 +08:00
c1066e60f4
feat: change ok to loaded in loading func ( #2010 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:25 +08:00
f194f0961f
feat: scheduler adds announce host handler ( #1843 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
7e24a85efa
feat: add calculateParentHostUploadSuccessScore to scheduler ( #1789 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
500f767073
feat: remove task and host gc ttl ( #1735 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:01 +08:00
d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api ( #1515 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
46deb4fccf
Use dag to represent peer scheduling topology ( #1473 )
...
* feat: use dag to represent peer scheduling topology
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
64f5e9357b
refactor: scheduler announce task ( #1407 )
...
* feat: scheduler announce normal task
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cid
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:30 +08:00
9c1e05983a
feat: scheduler add seed peer ( #1298 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache ( #1227 )
...
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.
For example:
- add a file into cache system
dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file
- check if a file exists in cache system
dfcache stat --cid testid --local # only check local cache
dfcache stat --cid testid # check other peers as well
- export/download a file from cache system
dfcache export --cid testid -O /path/to/output
- delete a file from cache system, both local cache and P2P network
dfcache delete -i testid -t testtag
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
c0c443a686
fix: calculate FreeUploadLoad ( #1226 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
8f19c11f54
feat: scheduler remove inactive host ( #1135 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
02913a5442
feat: add scheduler host gc ( #989 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:51 +08:00
97c1eb65e7
Refactor scheduler service ( #958 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
Gaius