Commit Graph

1907 Commits

Author SHA1 Message Date
Gaius 480f7fc35e
docs: add slack and google groups (#1203)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius e33736121f
feat: scheduler add block peers set (#1202)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
yxxhero 23cb77d5b5
fix TestCheckHeader (#1201)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:33:09 +08:00
Gaius 664626ba66
feat: add grpc-health-probe to image (#1196)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 2bcdba6401
feat: add grpc health interface (#1195)
* feat: add grpc health interface

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add dfdaemon upload server healthy interface

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Jim Ma d45bffea40
fix: client miss failed piece (#1194)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 1939ceff8f
refactor: scheduler end and begin of piece (#1189)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 9d41cee1ec
chore: update workflows compatibility version (#1192)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 953622c103
feat: remove grpc error code validate (#1191)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Jim Ma 9f4b86cb2f
fix: client break error (#1190)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius 998110f2b8
feat: generate grpc protos in namely/protoc-all image (#1187)
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: makefile add protoc command

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius 1320018de1
chore: change golangci-lint min-complexity value (#1188)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Jim Ma 42046c0845
chore: optimize stream peer task (#1186)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:08 +08:00
sunwp bab1ddec60
Fix client initialization trivial things (#1176)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:08 +08:00
Gaius 04bd2ea383
feat: scheduler addresses log (#1183)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius 738e5edfbe
feat: manage GetCDN interface return scheduler info (#1184)
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager cdn add scheduler info

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Jim Ma d3c36f26ce
chore: always fallback to legacy get pieces (#1180)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius ce8505415d
feat: dfdaemon match scheduler with case insensitive (#1181)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius e77acb0692
feat: add RBAC to manager config interface (#1179)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
sunwp 104e8359a9
fix daemon cannot exit after alivetime (#1177)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:07 +08:00
Gaius 21d219175f
feat: dfdaemon get available scheduler addresses in the same cluster (#1178)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
Jim Ma 10da5fa0d6
feat: implement grpc client side sync pieces (#1167)
* feat: implement grpc client side sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: client unit test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: report sync piece error

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize pieceTaskSyncManager cancel

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:07 +08:00
yxxhero 7167c01d0f
add header check for ClientOption (#1174)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:33:07 +08:00
Gaius 9666b89c9a
feat: seacher return multiple scheduler clusters (#1175)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
yxxhero 7446cf45fa
feat: replace time.Now().Sub by time.Since (#1173)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:33:07 +08:00
sunwp b4169ace44
add dfpath error more message (#1136)
Signed-off-by: sunwp <244372610@qq.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
Jim Ma 48cbd094ea
fix: rpc cdn sync piece tasks (#1168)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:07 +08:00
Jim Ma 42e662d8b3
fix: subscriber data race (#1169)
* fix: subscriber data race

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:06 +08:00
Gaius a46a37be6c
test: fix e2e preheat case (#1170)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
Gaius e0867ef3c8
feat: change DefaultServerOptions to variable
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
sunwp 78591d0309
Optimized the log creation (#1058)
* optimize logger

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* reset levels nil to release init method level

Signed-off-by: sunwp <244372610@qq.com>

* golang lint

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:06 +08:00
Gaius c55e05a1e6
feat: change default scheduler filter parent limit (#1166)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
sunwp 67d6fb970f
Fix empty client output path (#1159)
* If the client output parameter is not specified, the client cannot automatically obtain the target file path

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:06 +08:00
Jim Ma 98e95e693c
feat: implement bidirectional fetch pieces (#1165)
* feat: implement grpc server side sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:06 +08:00
Gaius 603db21e17
feat: scheduler add default biz tag (#1164)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
Jim Ma 010887ab66
feat: optimize proxy performance (#1137)
* feat: optimize back source trace and logic

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: fix keepalive performance

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize generate peer id and transport performance

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: io.Copy call superfluous sendfile, then increase network latency

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:05 +08:00
sunwp f3c1080dd9
Optimize CDN GC Debug log (#1163)
* remove CDN gc Debug log

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:05 +08:00
Gaius 7adee4c2d9
feat: host remove peer (#1161)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
sunwp 266da57866
Reduce default RotateMaxBackups count (#1162)
* reduce default RotateMaxBackups count

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:05 +08:00
Gaius b3103f48ed
test: cache expire interval (#1160)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
Gaius 4e670035ed
feat: change reschdule config (#1158)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
Gaius 6aa27db850
chore: update go mod (#1156)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
Gaius 9beaf03fdf
chore: add makefile note (#1155)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
crasybest 3279173f5e
Update dfdaemon.md (#1131)
Change dfget start command
2023-06-28 17:33:05 +08:00
Gaius 4ab498837c
test: add scheduler constructSuccessPeerPacket case (#1154)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
Gaius 1bdac7e063
feat: update git submodule (#1153)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
sunwp 8bd1ac713c
Remove residues left by E2E tests (#1142)
* clean E2E test log

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:04 +08:00
sunwp ff134d0a48
fix daemon scheduler option validate bug (#1152)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:04 +08:00
Gaius 1ea700f421
feat: scheduler metrics add default value of biz tag (#1151)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
Gaius ef6e3665e6
feat: add user update interface and rename rest to service (#1148)
* feat: add user interface and rename rest to service

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: api reference

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00