98aee9640d
feat: implement SyncProbes api in scheduler grpc service ( #2449 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: dlut_xz <52518280+fcgxz2003@users.noreply.github.com>
2023-06-28 17:34:58 +08:00
dacf1f01a6
feat: rename scheduler package to scheduling ( #2087 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:31 +08:00
e83fb85216
feat: add v2 verison of the grpc to scheduler ( #1999 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:24 +08:00
2421ce88f4
feat: add announcer to dfdameon ( #1852 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
f194f0961f
feat: scheduler adds announce host handler ( #1843 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
446fcc9fd7
feat: add LeaveHost handler ( #1780 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
61a6e545e5
feat: change FilterParentRangeLimit validation ( #1752 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
272f38f567
feat: grpc add ratelimit ( #1572 )
...
feat: grpc ratelimit
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
242fb2bc37
add application-level statistics ( #1559 )
...
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:45 +08:00
d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api ( #1515 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
c6a019560d
feat: proxy add defaultTag field ( #1462 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
c205330881
feat: dfdaemon is compatible with v2.0.2 ( #1452 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
9c1e05983a
feat: scheduler add seed peer ( #1298 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
8724f49e07
fix: scheduler typo ( #1297 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
2cfbb91174
feat: manager add seed peer ( #1293 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
7f113e0dc2
feat: add AnnounceTask and StatTask metrics ( #1256 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:14 +08:00
9c539fd425
test: AnnounceTask and StatTask ( #1254 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:14 +08:00
65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache ( #1227 )
...
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.
For example:
- add a file into cache system
dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file
- check if a file exists in cache system
dfcache stat --cid testid --local # only check local cache
dfcache stat --cid testid # check other peers as well
- export/download a file from cache system
dfcache export --cid testid -O /path/to/output
- delete a file from cache system, both local cache and P2P network
dfcache delete -i testid -t testtag
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
1025dc2dc5
feat: redirect daemon stdout stderr to file ( #1244 )
...
1. redirect daemon stdout stderr to file
2. fix wrong zap grpc log output
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
2bcdba6401
feat: add grpc health interface ( #1195 )
...
* feat: add grpc health interface
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: add dfdaemon upload server healthy interface
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
e0867ef3c8
feat: change DefaultServerOptions to variable
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
78591d0309
Optimized the log creation ( #1058 )
...
* optimize logger
Signed-off-by: sunwp <244372610@qq.com>
* resolve rpc server logger panic
Signed-off-by: sunwp <244372610@qq.com>
* resolve rpc server logger panic
Signed-off-by: sunwp <244372610@qq.com>
* reset levels nil to release init method level
Signed-off-by: sunwp <244372610@qq.com>
* golang lint
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:06 +08:00
c55e05a1e6
feat: change default scheduler filter parent limit ( #1166 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
5223cc1ce8
feat: add scheduler metrics ( #1139 )
...
* feat: add scheduler metrics
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate validate for url meta
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
54a9ed79d8
Feature: support e2e feature gates ( #1056 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
6d58de0ef1
refactor: scheduler grpc server ( #1046 )
...
* refactor: scheduler grpc server
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate mock file
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler package
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
99da719ce1
feat: cdn download tiny file ( #1040 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
43d769b0b4
fix: register task with size scope ( #1003 )
...
* feat: register task with size scope
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: fix peer manager data race
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:52 +08:00
5359ac2e75
feat: set peer state to running when scope size is SizeScope_TINY ( #1004 )
...
* chore: sync docker-compose scheduler config (#1001 )
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: set peer state to running when scope size is SizeScope_TINY
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:52 +08:00
5479b3a53e
feat: stream send error code ( #986 )
...
* feat: change task and peer ttl (#984 )
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: send error code
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: add retry interval
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfdaemon report successful piece before end of piece
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: update submodule version
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:51 +08:00
97c1eb65e7
Refactor scheduler service ( #958 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
6ec8b48dd3
fix: schedulers send invalid direct piece ( #970 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:49 +08:00
cb4202319e
feat: make idgen package public ( #931 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:47 +08:00
94fde2608c
refactor: scheduler register task ( #924 )
...
* refactor: scheduler register task
Signed-off-by: Gaius <gaius.qi@gmail.com>
* refactor: scheduler register task
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:46 +08:00
1a13ba11a8
feat: log ( #852 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:40 +08:00
c1d84fb56d
validate grpc model ( #825 )
...
* base validate
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:40 +08:00
d79a2a6877
move RPC code definition to proto file ( #829 )
...
* move rpc code to proto
* replace Cdn to CDN
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:38 +08:00
d01eef6b41
refactor: scheduler evaluator ( #805 )
...
* refactor: scheduler evaluator
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:36 +08:00
2ee0585ff3
feat: support traffic metrics by peer host ( #776 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:34 +08:00
466912aa48
docs: scheduler config ( #698 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:25 +08:00
b4e58e3c08
refactor: scheduler supervisor ( #655 )
...
* refactor: scheduler supervisor
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:49 +08:00
8583a4af3d
chore: optimize app and tracer log ( #607 )
...
Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:44 +08:00
60bee061d2
feat: client back source ( #579 )
...
* feat: client back source
Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:43 +08:00
2d8eb59005
Adjust package structure ( #539 )
...
* feat: package structure adjust
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:31:36 +08:00
Gaius