71e323f59d
feat: add context key to SyncProbes ( #2485 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:59 +08:00
e9cb38e851
feat: remove SyncNetworkTopology API ( #2296 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:47 +08:00
f8934e701b
feat: add trainer service to rpc package ( #2209 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:41 +08:00
1b9353ba8d
feat: add SyncNetworkTopology and SyncProbes to scheduler client ( #2114 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:33 +08:00
7dc3c826f2
feat: add v2 version of dfdaemon client ( #2050 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:29 +08:00
e83fb85216
feat: add v2 verison of the grpc to scheduler ( #1999 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:24 +08:00
c89234e976
feat: add manager v2 api ( #1990 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:23 +08:00
1edd36da59
feat: register reflection on grpc server ( #1943 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:19 +08:00
cf50824526
feat: change announcer validation ( #1869 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:13 +08:00
2421ce88f4
feat: add announcer to dfdameon ( #1852 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
f194f0961f
feat: scheduler adds announce host handler ( #1843 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
bdf5cd54c5
feat: call all nodes in consistent hashing and reuse grpc connection ( #1842 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
0f8b75808a
feat: add timeout grpc and job ( #1830 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:10 +08:00
04bc6ae493
feat: grpc scheduler client dial options ( #1792 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
536b039462
feat: daemon call leaveHost when exit ( #1788 )
...
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:06 +08:00
446fcc9fd7
feat: add LeaveHost handler ( #1780 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
0dedc36417
feat: grpc_retry removes WithPerRetryTimeout ( #1763 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:03 +08:00
c9755aabfc
feat: stop grpc client ( #1671 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:55 +08:00
f5e715e1f6
feat: add MaxConnectionIdle to grpc keepalive ( #1655 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:53 +08:00
9050230926
feat: refactor grpc credential ( #1612 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
ad553d949b
feat: grpc dial adds context ( #1594 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:47 +08:00
a6a44269b4
refactor: dfdaemon client and remove rpc connection pool ( #1576 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
2116636040
feat: add grpc client error interceptor ( #1575 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
9535821be7
feat: grpc removes MaxConnectionIdle ( #1574 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
272f38f567
feat: grpc add ratelimit ( #1572 )
...
feat: grpc ratelimit
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
22b8e6368e
feat: grpc add retry middleware ( #1561 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:45 +08:00
5bcb53f0a9
feat: grpc consistent hashing ( #1554 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:44 +08:00
d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api ( #1515 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
ed4c381383
feat: rename steal peers to candidate peers ( #1476 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
4d71217572
feat: generate dag mock
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
c205330881
feat: dfdaemon is compatible with v2.0.2 ( #1452 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
8cf344992f
feat: if peer back-to-source failed, return source metadata. ( #1444 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
3c107f9add
feat: report peer result with source error detail ( #1439 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:34 +08:00
93a8ebb4bc
feat: add dfstore command ( #1441 )
...
* feat: add dfstore command
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
a2511cb945
feat: rewrite interface{} to any ( #1419 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
0222649b88
feat: update namely/protoc-all image version to 1.47_0 ( #1418 )
...
* feat: update namely/protoc-all image version to 1.47_0
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate mock file
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
ad36eb64a7
feat: remove github/pkg/errors package ( #1416 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
993841e0ef
note in protobuffer file has misspelling mistake ( #1411 )
...
* spelling error, just a little mistake
Signed-off-by: 李龙峰 <lilongfeng@inspur.com>
2023-06-28 17:33:30 +08:00
64f5e9357b
refactor: scheduler announce task ( #1407 )
...
* feat: scheduler announce normal task
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cid
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:30 +08:00
e2eb30bc96
feat: change pattern from cdn to seed peer and remove kustomize shell ( #1345 )
...
* feat: change pattern from cdn to seed peer and remove kustomize shell
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:24 +08:00
5707d86e6b
feat: scheduler register interface return task type ( #1318 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:21 +08:00
2a0314e45b
refactor: scheduler grpc ( #1310 )
...
* refactor: scheduler grpc
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate protoc
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
823c722c3e
feat: support response header ( #1292 )
...
* feat: support response header via ExtendAttribute
* chore: update http pass through header
* chore: update ExtendAttribute in cdn downloader
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:19 +08:00
faa5e4e465
feat: add seed peer logic ( #1302 )
...
* feat: announce seed peer
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn logic
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn job
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfdaemon change host uuid to host id
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: go generate mocks
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn compatibility
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: change docker compose
Signed-off-by: Gaius <gaius.qi@gmail.com>
* fix: reuse panic
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: compatible with v2.0.3-beta.2
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00
429252a071
feat: implement pattern in client daemon ( #1231 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:19 +08:00
09f133fc48
feat: update scheduler PeerResult validation ( #1294 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
3b0005a052
fix: grpc total_piece_count comment ( #1289 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
4109aec042
feat: scheduler peer result validation ( #1288 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:17 +08:00
076ba20b51
feat: move dfnet to pkg dir ( #1265 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:15 +08:00
65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache ( #1227 )
...
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.
For example:
- add a file into cache system
dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file
- check if a file exists in cache system
dfcache stat --cid testid --local # only check local cache
dfcache stat --cid testid # check other peers as well
- export/download a file from cache system
dfcache export --cid testid -O /path/to/output
- delete a file from cache system, both local cache and P2P network
dfcache delete -i testid -t testtag
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
Gaius