Commit Graph

74 Commits

Author SHA1 Message Date
Jim Ma 98e95e693c
feat: implement bidirectional fetch pieces (#1165)
* feat: implement grpc server side sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:06 +08:00
Gaius 98e23e4be7
feat: update otel package version and fix otelgrpc goroutine leak (#1141)
* feat: update otel version

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: grpc.WithInsecure is deprecated

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
sunwp 44dd19ec12
Extend conn GC time (#1130)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:03 +08:00
Gaius 5223cc1ce8
feat: add scheduler metrics (#1139)
* feat: add scheduler metrics

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate validate for url meta

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
Gaius 7d778d7b95
feat: change grpc client keepalive config (#1125)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
sunwp 0b0dd27ff8
add CDN piece download cost (#966)
Signed-off-by: sunwp <244372610@qq.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius a5f385cd99
feat: remove needless manager grpc proxy (#1113)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Jim Ma 4597f74283
feat: merge ranged request storage into parent (#1078)
* feat: merge ranged request storage into parent

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Jim Ma 54a9ed79d8
Feature: support e2e feature gates (#1056)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Gaius d4ac46a0d1
refactor: manager grpc server (#1047)
* refactor: manager grpc server

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
Gaius 6d58de0ef1
refactor: scheduler grpc server (#1046)
* refactor: scheduler grpc server

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler package

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
Gaius 57cd244455
feat: generate grpc protoc (#1027)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
Jim Ma 17ff9c17be
fix: send piece result error not handled (#987)
* fix: send piece result error not handled
* chore: optimize daemon cancel logic
* chore: remove redundant log and ctx.Done check
* chore: handle piece download with 404 status

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:50 +08:00
Gaius 97c1eb65e7
Refactor scheduler service (#958)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
Gaius 0b21f66714
feat: remove stat log from scheduler (#946)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:47 +08:00
Gaius 01d022e85b
fix: size scope empty (#941)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:47 +08:00
Gaius cb4202319e
feat: make idgen package public (#931)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:47 +08:00
sunwp 0babd6e519
CDN config (#920)
* CDN config

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:46 +08:00
sunwp b0078162ca
Fixed range GRPC check (#872)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:42 +08:00
Gaius f6ce817b72
feat: move dfnet to internal (#862)
* feat: move dfnet to internal

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename dfutils to util

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:41 +08:00
Gaius 8b72144e1e
fix: error log (#863)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:41 +08:00
sunwp c1d84fb56d
validate grpc model (#825)
* base validate

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:40 +08:00
Gaius 999097e4ed
feat: support mutli manager addrs (#846)
* feat: support mutli manager addrs (#844)

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:39 +08:00
sunwp d79a2a6877
move RPC code definition to proto file (#829)
* move rpc code to proto
* replace Cdn to CDN

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:38 +08:00
Gaius 0cb14903b2
feat: scheduler and cdn report fqdn to manager (#818)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:37 +08:00
Gaius 72213eb1d4
feat: dfdaemon get scheduler list dynamically from manager (#812)
* feat: dfdaemon get scheduler list dynamically from manager

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:37 +08:00
Gaius 61f9f83b28
fix: manager typo and cdn peer id (#809)
* fix: manager typo and cdn peer id 

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:36 +08:00
Gaius 558782af00
feat: add idgen peer id (#800)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:35 +08:00
Gaius 41900a94b6
feat: optimize scheduler peer stat log (#798)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:35 +08:00
Gaius e837ae9bdf
chore: add lint errcheck and fix errcheck(#766)
* feat: add lint errcheck and fix errcheck

Signed-off-by: Gaius <gaius.qi@gmail.com>

* replace assert to require

Signed-off-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>

Co-authored-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>
2023-06-28 17:32:35 +08:00
Jim Ma 3d63ab2ca3
chore: update golang import lint (#780)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:34 +08:00
Jim Ma 2ee0585ff3
feat: support traffic metrics by peer host (#776)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:34 +08:00
Gaius c52f917323
feat: manager add grpc jaeger (#738)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:31 +08:00
Gaius 466912aa48
docs: scheduler config (#698)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:25 +08:00
Gaius 513d4f669a
feat: add manager client list scheduler interface (#694)
* feat: add manager client list scheduler interface

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:49 +08:00
Gaius fcde9dc9b5
Add manager metrics and logger (#676)
* feat: add manager metrics and logger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:49 +08:00
加菲 29eeb030af
feature: refresh proto file (#615)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:31:44 +08:00
sunwp 8583a4af3d
chore: optimize app and tracer log (#607)
Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:44 +08:00
sunwp 60bee061d2
feat: client back source (#579)
* feat: client back source

Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:43 +08:00
zzy987 15c37f99e7
chore: add copyright (#593)
* chore: add copyright

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: ci

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:42 +08:00
sunwp 09824e5631
Framework refactor (#590)
* feat: optimize grpc

Signed-off-by: santong <244372610@qq.com>

* feat: framework log

Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:42 +08:00
Gaius 79662a3bb4
feat: start process (#572)
* feat: server start process

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:38 +08:00
sunwp 6cda73b8e9
Add CDN Tracer (#555)
* feat: add cdn grpc interceptor tracer

Signed-off-by: santong <244372610@qq.com>

* feat: cdn tracer

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:31:37 +08:00
sunwp 1efd2f6cef
feat: Add distribute Schedule Tracer & Refactor scheduler (#537)
* check same cdn list avoid updating client too frequent

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:31:35 +08:00
Gaius f27770af32
Feature: Add manager charts with submodule (#525)
* chore: add charts submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:35 +08:00
Jim Ma 79db3cb8b1
chore: optimize grpc interceptor code (#536)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:35 +08:00
Jim Ma 2120051ab0
feature: enable grpc tracing (#531)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:34 +08:00
Gaius 7cfa5fda70
Feature: support mysql 5.6 (#520)
* feat: support mysql 5.6

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:34 +08:00
Jim Ma 300563bcca
Feature: support customize base image (#519)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
Gaius a187d7d7fc
feat: add task manager (#490)
* feat: add task manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:33 +08:00