Commit Graph

672 Commits

Author SHA1 Message Date
sunwp a4caf59e29
Upgrade golang lint version (#1225)
* upgrade golang lint

Signed-off-by: sunwp <244372610@qq.com>

* upgrade golang lint

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:11 +08:00
Gaius 56cd51a4b6
feat: scheduler blocks steal peers (#1224)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius ccb6495b49
feat: update manager console (#1222)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Jim Ma 73c5e3a575
fix: sync pieces hang (#1221)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius 09d41ea1b0
chore: update manager console commit (#1219)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius 288ca4eb72
feat: manager validate with config (#1218)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius 6744624e70
feat: remove kustomize template (#1216)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Jim Ma 76eff082cb
feat: add back source fail metric in client (#1214)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius 75ef6fc2d0
feat: cannot delete a cluster with existing instances (#1213)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius 913535ad7a
feat: add type to DownloadFailureCount (#1212)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius f5d372bab4
feat: if the number of failed peers in the task is greater than FailedPeerCountLimit, then scheduler notifies running peers of failure (#1211)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Jim Ma 60a1d9e53e
chore: print client stream task error log (#1210)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius bc1b807832
feat: optimize get available task (#1208)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Jim Ma a413dc4bdd
chore: report client back source error (#1209)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius 7a5857d389
feat: change scheduler and cdn listen (#1205)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius 480f7fc35e
docs: add slack and google groups (#1203)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius e33736121f
feat: scheduler add block peers set (#1202)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
yxxhero 23cb77d5b5
fix TestCheckHeader (#1201)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:33:09 +08:00
Gaius 664626ba66
feat: add grpc-health-probe to image (#1196)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 2bcdba6401
feat: add grpc health interface (#1195)
* feat: add grpc health interface

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add dfdaemon upload server healthy interface

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Jim Ma d45bffea40
fix: client miss failed piece (#1194)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 1939ceff8f
refactor: scheduler end and begin of piece (#1189)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 9d41cee1ec
chore: update workflows compatibility version (#1192)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 953622c103
feat: remove grpc error code validate (#1191)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Jim Ma 9f4b86cb2f
fix: client break error (#1190)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius 998110f2b8
feat: generate grpc protos in namely/protoc-all image (#1187)
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: makefile add protoc command

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius 1320018de1
chore: change golangci-lint min-complexity value (#1188)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Jim Ma 42046c0845
chore: optimize stream peer task (#1186)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:08 +08:00
sunwp bab1ddec60
Fix client initialization trivial things (#1176)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:08 +08:00
Gaius 04bd2ea383
feat: scheduler addresses log (#1183)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius 738e5edfbe
feat: manage GetCDN interface return scheduler info (#1184)
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager cdn add scheduler info

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Jim Ma d3c36f26ce
chore: always fallback to legacy get pieces (#1180)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius ce8505415d
feat: dfdaemon match scheduler with case insensitive (#1181)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius e77acb0692
feat: add RBAC to manager config interface (#1179)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
sunwp 104e8359a9
fix daemon cannot exit after alivetime (#1177)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:07 +08:00
Gaius 21d219175f
feat: dfdaemon get available scheduler addresses in the same cluster (#1178)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
Jim Ma 10da5fa0d6
feat: implement grpc client side sync pieces (#1167)
* feat: implement grpc client side sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: client unit test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: report sync piece error

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize pieceTaskSyncManager cancel

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:07 +08:00
yxxhero 7167c01d0f
add header check for ClientOption (#1174)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:33:07 +08:00
Gaius 9666b89c9a
feat: seacher return multiple scheduler clusters (#1175)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
yxxhero 7446cf45fa
feat: replace time.Now().Sub by time.Since (#1173)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:33:07 +08:00
sunwp b4169ace44
add dfpath error more message (#1136)
Signed-off-by: sunwp <244372610@qq.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
Jim Ma 48cbd094ea
fix: rpc cdn sync piece tasks (#1168)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:07 +08:00
Jim Ma 42e662d8b3
fix: subscriber data race (#1169)
* fix: subscriber data race

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:06 +08:00
Gaius a46a37be6c
test: fix e2e preheat case (#1170)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
Gaius e0867ef3c8
feat: change DefaultServerOptions to variable
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
sunwp 78591d0309
Optimized the log creation (#1058)
* optimize logger

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* reset levels nil to release init method level

Signed-off-by: sunwp <244372610@qq.com>

* golang lint

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:06 +08:00
Gaius c55e05a1e6
feat: change default scheduler filter parent limit (#1166)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
sunwp 67d6fb970f
Fix empty client output path (#1159)
* If the client output parameter is not specified, the client cannot automatically obtain the target file path

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:06 +08:00
Jim Ma 98e95e693c
feat: implement bidirectional fetch pieces (#1165)
* feat: implement grpc server side sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:06 +08:00
Gaius 603db21e17
feat: scheduler add default biz tag (#1164)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00