Commit Graph

62 Commits

Author SHA1 Message Date
Gaius c89234e976
feat: add manager v2 api (#1990)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:23 +08:00
Gaius 1edd36da59
feat: register reflection on grpc server (#1943)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:19 +08:00
Gaius bdf5cd54c5
feat: call all nodes in consistent hashing and reuse grpc connection (#1842)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
Gaius 0f8b75808a
feat: add timeout grpc and job (#1830)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:10 +08:00
Gaius 0dedc36417
feat: grpc_retry removes WithPerRetryTimeout (#1763)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:03 +08:00
Gaius c9755aabfc
feat: stop grpc client (#1671)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:55 +08:00
Gaius f5e715e1f6
feat: add MaxConnectionIdle to grpc keepalive (#1655)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:53 +08:00
Gaius 43d8478507
feat: add tls policy to scheduler grpc server (#1616)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Gaius ad553d949b
feat: grpc dial adds context (#1594)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:47 +08:00
Gaius a6a44269b4
refactor: dfdaemon client and remove rpc connection pool (#1576)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
Gaius 2116636040
feat: add grpc client error interceptor (#1575)
Signed-off-by: Gaius <gaius.qi@gmail.com>

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
Gaius 9535821be7
feat: grpc removes MaxConnectionIdle (#1574)
Signed-off-by: Gaius <gaius.qi@gmail.com>

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
Gaius 272f38f567
feat: grpc add ratelimit (#1572)
feat: grpc ratelimit

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
Gaius 22b8e6368e
feat: grpc add retry middleware (#1561)
Signed-off-by: Gaius <gaius.qi@gmail.com>

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:45 +08:00
Gaius 5bcb53f0a9
feat: grpc consistent hashing (#1554)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:44 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
Gaius 93a8ebb4bc
feat: add dfstore command (#1441)
* feat: add dfstore command

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418)
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius ad36eb64a7
feat: remove github/pkg/errors package (#1416)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
Gaius f688d341bd
feat: remove cdn (#1401)
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Jim Ma 823c722c3e
feat: support response header (#1292)
* feat: support response header via ExtendAttribute
* chore: update http pass through header
* chore: update ExtendAttribute in cdn downloader

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:19 +08:00
Gaius faa5e4e465
feat: add seed peer logic (#1302)
* feat: announce seed peer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn logic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn job

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfdaemon change host uuid to host id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go generate mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn compatibility

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change docker compose

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: reuse panic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: compatible with v2.0.3-beta.2

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00
Jim Ma 49f9ebde68
feat: implement client seed mode (#1247)
* feat: implement client seed mode

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:18 +08:00
Jim Ma 7c1e315ec1
fix: client synchronizer report error lock and dial grpc timeout (#1260)
* fix: client synchronizer report error lock
* chore: remove superfluous retry to sync and get pieces from other peers
* chore: optimize back source and sync piece logic
* chore: print apk output in e2e
* fix: grpc send with io.EOF error

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:15 +08:00
Gaius 076ba20b51
feat: move dfnet to pkg dir (#1265)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:15 +08:00
Jim Ma 1025dc2dc5
feat: redirect daemon stdout stderr to file (#1244)
1. redirect daemon stdout stderr to file
2. fix wrong zap grpc log output

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
Gaius 2bcdba6401
feat: add grpc health interface (#1195)
* feat: add grpc health interface

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add dfdaemon upload server healthy interface

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 998110f2b8
feat: generate grpc protos in namely/protoc-all image (#1187)
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: makefile add protoc command

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Jim Ma 48cbd094ea
fix: rpc cdn sync piece tasks (#1168)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:07 +08:00
Gaius e0867ef3c8
feat: change DefaultServerOptions to variable
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
sunwp 78591d0309
Optimized the log creation (#1058)
* optimize logger

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* reset levels nil to release init method level

Signed-off-by: sunwp <244372610@qq.com>

* golang lint

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:06 +08:00
Jim Ma 98e95e693c
feat: implement bidirectional fetch pieces (#1165)
* feat: implement grpc server side sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:06 +08:00
sunwp 44dd19ec12
Extend conn GC time (#1130)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:03 +08:00
sunwp 0b0dd27ff8
add CDN piece download cost (#966)
Signed-off-by: sunwp <244372610@qq.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius 57cd244455
feat: generate grpc protoc (#1027)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
Gaius 97c1eb65e7
Refactor scheduler service (#958)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
sunwp 0babd6e519
CDN config (#920)
* CDN config

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:46 +08:00
Gaius f6ce817b72
feat: move dfnet to internal (#862)
* feat: move dfnet to internal

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename dfutils to util

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:41 +08:00
sunwp c1d84fb56d
validate grpc model (#825)
* base validate

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:40 +08:00
Gaius 0cb14903b2
feat: scheduler and cdn report fqdn to manager (#818)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:37 +08:00
Gaius 61f9f83b28
fix: manager typo and cdn peer id (#809)
* fix: manager typo and cdn peer id 

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:36 +08:00
Jim Ma 3d63ab2ca3
chore: update golang import lint (#780)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:34 +08:00
Gaius 466912aa48
docs: scheduler config (#698)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:25 +08:00
加菲 29eeb030af
feature: refresh proto file (#615)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:31:44 +08:00
sunwp 60bee061d2
feat: client back source (#579)
* feat: client back source

Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:43 +08:00
sunwp 09824e5631
Framework refactor (#590)
* feat: optimize grpc

Signed-off-by: santong <244372610@qq.com>

* feat: framework log

Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:42 +08:00
sunwp 6cda73b8e9
Add CDN Tracer (#555)
* feat: add cdn grpc interceptor tracer

Signed-off-by: santong <244372610@qq.com>

* feat: cdn tracer

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:31:37 +08:00
Gaius 27103e4b4e
feat: rename manager grpc (#510)
* feat: rename manager grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:26 +08:00
加菲 ae777b59eb
fix: generate proto file (#483) 2023-06-28 17:30:29 +08:00