8edc6bbf98
docs: manager installation ( #1063 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00
6fc2bb4de2
chore: add content length for fast stream peer task ( #1061 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
f80c75efdb
Feature: prefetch ranged requests ( #1053 )
...
1. implement prefetch ranged requests
2. optimize exact http code in transport
3. simplify reuse peer task logic
4. reuse peer task for ranged request size error
5. fix data race for peer task storage
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
54a9ed79d8
Feature: support e2e feature gates ( #1056 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
cc5a43c73f
feat: support change console log level ( #1055 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
75ce151d3f
chore: optimize https pass through ( #1054 )
...
* chore: optimize https pass through
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: update var name
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
c14d36ba6a
fix: scheduler download tiny file error ( #1052 )
...
* fix: scheduler download tiny file error
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: fix golang lint
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:55 +08:00
9d258aef39
feat: manager support mysql ssl connection ( #1015 )
...
* feat: manager support mysql ssl connection
Signed-off-by: Gaius <gaius.qi@gmail.com>
* refactor: manager config
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
d4ac46a0d1
refactor: manager grpc server ( #1047 )
...
* refactor: manager grpc server
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
6d58de0ef1
refactor: scheduler grpc server ( #1046 )
...
* refactor: scheduler grpc server
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate mock file
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler package
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
aa5f078a14
feat: remove host and task when peer make tree ( #1042 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
6d13c87161
Update cmd/dfget/cmd/root.go log ( #1013 )
...
add flock lock failed log
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
99da719ce1
feat: cdn download tiny file ( #1040 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
25832aa3d2
cdn rpc server test ( #1020 )
...
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:55 +08:00
0f03533882
fix: docker actions typo ( #1041 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
7c44dda81c
refactor: docker workflows ( #1039 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
5027f9c998
chore: use buildx to build docker images in e2e ( #1018 )
...
* chore: build images concurrency
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
cb2f9298ce
fix: cdn trigger peer error ( #1035 )
...
* feat: If cdn only updates IP, set cdn peers state to PeerStateLeave
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
9353aa4a62
chore: add missing pod log volumes in e2e ( #1037 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
65ad608d58
feat: If cdn only updates IP, set cdn peers state to PeerStateLeave ( #1038 )
...
* feat: If cdn only updates IP, set cdn peers state to PeerStateLeave
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
efcf65c286
fix: retrigger cdn panic ( #1034 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
2930651395
chore: upgrade to ginkgo v2 ( #1036 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
2c31f35ce2
add cdn get piece tasks result logs ( #1019 )
...
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:54 +08:00
23021dea4b
chore: add piece task metrics in daemon ( #1030 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
009fbc6db1
Feature: change log level in-flight ( #1023 )
...
* feat: change log level in flight
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
621e52e9f1
chore: update outdated log ( #1028 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:53 +08:00
57cd244455
feat: generate grpc protoc ( #1027 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
aea35592b3
feat: manager config model add is_boot key ( #1025 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
061c3c8752
feat: scheduler download tiny file with range header ( #1024 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
6e636b1125
chore: optimize metrics and trace in daemon ( #1022 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:53 +08:00
48df6370db
feat: change compatibility version to v2.0.2-rc.0 ( #1017 )
...
* feat: change compatibility version to v2.0.2-rc.0
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: update helm charts submodule
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
a0049b17ae
chore: register to scheduler after updated running tasks ( #1016 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:53 +08:00
61310b55d5
feat: when cdn peer is failed, peer should be back-to-source ( #1005 )
...
* feat: schdule peer with cdn failed
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: when cdn peer is failed, peer back-to-source
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: callback
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: change scheduler default config
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
f63c705b98
Add begin seed piece hint task registered successfully ( #997 )
...
* cdn obtainSeeds add begin seed piece hint register successfully
Signed-off-by: sunwp <244372610@qq.com>
* feat: scheduler handle begin of piece
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: trigger cdn task
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
e9f824e0a7
chore: optimize defer and test ( #1010 )
...
* chore: optimize defer and test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: random test failed
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:53 +08:00
537667cfaa
add cdn totalpieces ( #1014 )
...
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:52 +08:00
6fee32b0f8
chore: workflow add test timeout ( #1011 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:52 +08:00
69b56e9713
feat: add actions job timout ( #1008 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:52 +08:00
c00f07c2de
Extract storage driver into peer tasks ( #998 )
...
* chore: extract storage instead load every time
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: gofmt
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:52 +08:00
c9b2c0acf8
fix: calculate piece MD5 sign when last piece download ( #1006 )
...
* fix: calculate piece md5 sign when last piece download
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:52 +08:00
43d769b0b4
fix: register task with size scope ( #1003 )
...
* feat: register task with size scope
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: fix peer manager data race
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:52 +08:00
5359ac2e75
feat: set peer state to running when scope size is SizeScope_TINY ( #1004 )
...
* chore: sync docker-compose scheduler config (#1001 )
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: set peer state to running when scope size is SizeScope_TINY
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:52 +08:00
90f77cdc4e
feat: update submodule charts ( #1002 )
...
* feat: add pprof config
* feat: update submodule helm charts
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:52 +08:00
f8ebd597e2
feat: task mutex replace sync kmutex ( #1000 )
...
* feat: trace https proxy request (#996 )
* feat: trace https proxy request
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: daemon test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove sync kmutex and add task mutex
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:52 +08:00
9a8540d211
chore: sync docker-compose scheduler config ( #1001 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:51 +08:00
5479b3a53e
feat: stream send error code ( #986 )
...
* feat: change task and peer ttl (#984 )
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: send error code
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: add retry interval
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfdaemon report successful piece before end of piece
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: update submodule version
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:51 +08:00
0c03af1979
fix: when scheduler is not available, replace the scheduler client ( #999 )
...
* fix: when scheduler is not available, just replace the scheduler client in single peer task
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:51 +08:00
c3951e0cb3
feat: trace https proxy request ( #996 )
...
* feat: trace https proxy request
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: daemon test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:51 +08:00
c87be98799
chore: parameterize tests in peer task ( #994 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:51 +08:00
88278be464
fix: total pieces count not set cause digest invalid ( #992 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:51 +08:00
Gaius