603db21e17
feat: scheduler add default biz tag ( #1164 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
7adee4c2d9
feat: host remove peer ( #1161 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
b61865e2a9
feat: scheduler trace trigger cdn ( #1147 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
eb408d136f
test: scheduler service handlePieceFail ( #1146 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
7d30dd86ae
feat: add scheduler traffic metrics ( #1143 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
5223cc1ce8
feat: add scheduler metrics ( #1139 )
...
* feat: add scheduler metrics
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate validate for url meta
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
addcf04df0
feat: task state for register ( #1132 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
58aff0c231
feat: scheduler change piece cost from nanosecond to millisecond ( #1119 )
...
* feat: change picec cost from nanoseconds to milliseconds
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler service
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
e940af77ca
fix: scheduler piece cost time ( #1118 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
c5428e0657
feat: optimize scheduler log ( #1114 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
0326f781f4
feat: optimize scheduler ( #1106 )
...
* feat: optimize scheduler
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
27fcc904c0
fix: when peer state is PeerStateSucceeded, return size scope is small ( #1103 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
557425249c
feat: optimize peer range ( #1095 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
81ea759393
test: scheduler handle failed piece ( #1084 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
060429c675
feat: scheduler blocks cdn ( #1079 )
...
* feat: scheduler blocks cdn
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
d52782ff38
feat: job trigger cdn by resource ( #1076 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
6d58de0ef1
refactor: scheduler grpc server ( #1046 )
...
* refactor: scheduler grpc server
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate mock file
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler package
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
aa5f078a14
feat: remove host and task when peer make tree ( #1042 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
99da719ce1
feat: cdn download tiny file ( #1040 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
cb2f9298ce
fix: cdn trigger peer error ( #1035 )
...
* feat: If cdn only updates IP, set cdn peers state to PeerStateLeave
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
65ad608d58
feat: If cdn only updates IP, set cdn peers state to PeerStateLeave ( #1038 )
...
* feat: If cdn only updates IP, set cdn peers state to PeerStateLeave
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
efcf65c286
fix: retrigger cdn panic ( #1034 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
61310b55d5
feat: when cdn peer is failed, peer should be back-to-source ( #1005 )
...
* feat: schdule peer with cdn failed
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: when cdn peer is failed, peer back-to-source
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: callback
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: change scheduler default config
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:53 +08:00
5359ac2e75
feat: set peer state to running when scope size is SizeScope_TINY ( #1004 )
...
* chore: sync docker-compose scheduler config (#1001 )
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: set peer state to running when scope size is SizeScope_TINY
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:52 +08:00
f8ebd597e2
feat: task mutex replace sync kmutex ( #1000 )
...
* feat: trace https proxy request (#996 )
* feat: trace https proxy request
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: daemon test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove sync kmutex and add task mutex
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:52 +08:00
5479b3a53e
feat: stream send error code ( #986 )
...
* feat: change task and peer ttl (#984 )
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: send error code
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: add retry interval
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfdaemon report successful piece before end of piece
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: update submodule version
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:51 +08:00
97c1eb65e7
Refactor scheduler service ( #958 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
7b8aaf6b31
Refactor scheduler ( #369 )
...
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:30:29 +08:00
402f1eb397
fix: log specification ( #452 )
...
Signed-off-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
Co-authored-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
2023-06-28 17:30:27 +08:00
9ece63c846
Fix: add process level for scheduler peer task status ( #435 )
...
* Fix: add process level for scheduler peer task status
Signed-off-by: 李玉海 <yuhai.lyh@alibaba-inc.com>
2023-06-28 17:30:26 +08:00
777e98784e
feature: export peer.TaskManager for embedding dragonfly in custom binary ( #434 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:19 +08:00
6cce5a9872
Feature/code spec ( #336 )
...
* Modify the code according to https://github.com/uber-go/guide/blob/master/style.md
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:24:44 +08:00
f9b4d77bb2
Fix golang lint ( #249 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
7e595898e5
Fix lint ( #244 )
...
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: lint hostIP
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: error check
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: nil pointer
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: rename taskID
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: rename peerID
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: taskID
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: licenses
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: rename
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: golangci-lint
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:37 +08:00
93d638c806
Refactor scheduler's dynconfig ( #228 )
...
* feat: scheduler's dynconfig
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: cdn manager use dynconfig
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler config
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove file
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler dynconfig
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler dynconfig
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler cdn manager
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: scheduler dynconfig log
* feat: scheduler dynconfig observers
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove scheduler dynconfig logger
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler mocks pkg rename mocks
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove reflect.DeepEqual
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: manager client
Signed-off-by: Gaius <gaius.qi@gmail.com>
* fix: scheduler start
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: scheduler dynconfig
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dynconfig watch server
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler config
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: dynconfig
Signed-off-by: Gaius <gaius.qi@gmail.com>
* fix: manager CDN hosts
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: rename scheduler dynconfig Start func
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dynconfig type
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: manager keepalive
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dynconfig netAddrs
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: scheduler config validate
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
3b6ec39a1b
Refactor task manager ( #219 )
...
* fix: get task return values
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: task manager
Signed-off-by: Gaius <gaius.qi@gmail.com>
* chore: add TODO
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: task manager test file
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: task manager
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:36 +08:00
a89e915aee
feature: remove redundant configurations ( #216 )
...
* feature: remove redundant configurations
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:29 +08:00
ed515deaf1
Refactor idgen pkg ( #211 )
...
* fix: generate TaskID
Signed-off-by: Gaius <gaius.qi@gmail.com>
* fix: remove fmt.Println
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: generate taskID and twinsTaskID
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
0af8817c1f
Merge branch main-rc to branch main
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: 李玉海 <yuhai.lyh@alibaba-inc.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: santong <weipeng.swp@alibaba-inc.com>
Co-authored-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
Co-authored-by: 加菲 <garfieldhu@aliyun.com>
2023-06-28 17:20:20 +08:00
Gaius