Commit Graph

1907 Commits

Author SHA1 Message Date
Jim Ma 5478414751
feat: add prefetch metric in client (#1068)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius e0a494e8a8
feat: when scheduler blocks cdn, resource does not initialize cdn (#1081)
* feat: when scheduler blocks cdn, resource does not initialize cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler remove manager enable config

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius 2997c1e903
fix: pull request template typo (#1080)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius 060429c675
feat: scheduler blocks cdn (#1079)
* feat: scheduler blocks cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius d52782ff38
feat: job trigger cdn by resource (#1076)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius c7d02ef8be
docs: add metrics document (#1075)
* docs: add metrics document

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: format docs

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: change markdownlint rules

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Saksham Sharma 4a171ac5cb
Fix typos in docs (#1071)
* docs: fix typos in docs

* docs: update CONTRIBUTING.md
2023-06-28 17:32:57 +08:00
AnJia c6e2c601dc
docs: add containerd private registry configuration (#1074)
* docs: add containerd private registry configuration

Signed-off-by: 赵安家 <anjia0532@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius 6cd5f19653
docs: add containerd private registry configuration (#1073)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
AnJia 9ec889f26c
docs: add docs about preheat console (#1072)
* docs: add preheat docs

Signed-off-by: 赵安家 <anjia0532@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius 76dbfcfc5c
feat: add client request log (#1069)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
sunwp f15a04ec73
correct plugin typo (#1060)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:57 +08:00
Gaius 60b4eeb9e6
fix: when cdn download failed, scheduler should set cdn peer state PeerStateFailed (#1067)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00
Gaius e200373abb
fix: evaluate peer's parent (#1064)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 1346f6907f
chore: enable range feature gate in e2e (#1059)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
sunwp 84bfe42b2e
cdn returns begin piece (#1045)
Signed-off-by: sunwp <244372610@qq.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00
Gaius 8edc6bbf98
docs: manager installation (#1063)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 6fc2bb4de2
chore: add content length for fast stream peer task (#1061)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma f80c75efdb
Feature: prefetch ranged requests (#1053)
1. implement prefetch ranged requests
2. optimize exact http code in transport
3. simplify reuse peer task logic
4. reuse peer task for ranged request size error
5. fix data race for peer task storage

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 54a9ed79d8
Feature: support e2e feature gates (#1056)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma cc5a43c73f
feat: support change console log level (#1055)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 75ce151d3f
chore: optimize https pass through (#1054)
* chore: optimize https pass through

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: update var name

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma c14d36ba6a
fix: scheduler download tiny file error (#1052)
* fix: scheduler download tiny file error

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: fix golang lint

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:55 +08:00
Gaius 9d258aef39
feat: manager support mysql ssl connection (#1015)
* feat: manager support mysql ssl connection

Signed-off-by: Gaius <gaius.qi@gmail.com>

* refactor: manager config

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
Gaius d4ac46a0d1
refactor: manager grpc server (#1047)
* refactor: manager grpc server

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
Gaius 6d58de0ef1
refactor: scheduler grpc server (#1046)
* refactor: scheduler grpc server

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler package

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
Gaius aa5f078a14
feat: remove host and task when peer make tree (#1042)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
guoguodan 6d13c87161
Update cmd/dfget/cmd/root.go log (#1013)
add flock lock failed log

Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
Gaius 99da719ce1
feat: cdn download tiny file (#1040)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
sunwp 25832aa3d2
cdn rpc server test (#1020)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:55 +08:00
Gaius 0f03533882
fix: docker actions typo (#1041)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
Gaius 7c44dda81c
refactor: docker workflows (#1039)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 5027f9c998
chore: use buildx to build docker images in e2e (#1018)
* chore: build images concurrency

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Gaius cb2f9298ce
fix: cdn trigger peer error (#1035)
* feat: If cdn only updates IP, set cdn peers state to PeerStateLeave

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 9353aa4a62
chore: add missing pod log volumes in e2e (#1037)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Gaius 65ad608d58
feat: If cdn only updates IP, set cdn peers state to PeerStateLeave (#1038)
* feat: If cdn only updates IP, set cdn peers state to PeerStateLeave

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
Gaius efcf65c286
fix: retrigger cdn panic (#1034)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 2930651395
chore: upgrade to ginkgo v2 (#1036)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
sunwp 2c31f35ce2
add cdn get piece tasks result logs (#1019)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:54 +08:00
Jim Ma 23021dea4b
chore: add piece task metrics in daemon (#1030)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 009fbc6db1
Feature: change log level in-flight (#1023)
* feat: change log level in flight

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 621e52e9f1
chore: update outdated log (#1028)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:53 +08:00
Gaius 57cd244455
feat: generate grpc protoc (#1027)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
Gaius aea35592b3
feat: manager config model add is_boot key (#1025)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
Gaius 061c3c8752
feat: scheduler download tiny file with range header (#1024)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
Jim Ma 6e636b1125
chore: optimize metrics and trace in daemon (#1022)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:53 +08:00
Gaius 48df6370db
feat: change compatibility version to v2.0.2-rc.0 (#1017)
* feat: change compatibility version to v2.0.2-rc.0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update helm charts submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
Jim Ma a0049b17ae
chore: register to scheduler after updated running tasks (#1016)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:53 +08:00
Gaius 61310b55d5
feat: when cdn peer is failed, peer should be back-to-source (#1005)
* feat: schdule peer with cdn failed

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: when cdn peer is failed, peer back-to-source

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: callback

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change scheduler default config

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
sunwp f63c705b98
Add begin seed piece hint task registered successfully (#997)
* cdn obtainSeeds add begin seed piece hint register successfully

Signed-off-by: sunwp <244372610@qq.com>

* feat: scheduler handle begin of piece

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: trigger cdn task

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00