56cd51a4b6
feat: scheduler blocks steal peers ( #1224 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
6744624e70
feat: remove kustomize template ( #1216 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
913535ad7a
feat: add type to DownloadFailureCount ( #1212 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
f5d372bab4
feat: if the number of failed peers in the task is greater than FailedPeerCountLimit, then scheduler notifies running peers of failure ( #1211 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
bc1b807832
feat: optimize get available task ( #1208 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
7a5857d389
feat: change scheduler and cdn listen ( #1205 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
e33736121f
feat: scheduler add block peers set ( #1202 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
2bcdba6401
feat: add grpc health interface ( #1195 )
...
* feat: add grpc health interface
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: add dfdaemon upload server healthy interface
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
e0867ef3c8
feat: change DefaultServerOptions to variable
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
78591d0309
Optimized the log creation ( #1058 )
...
* optimize logger
Signed-off-by: sunwp <244372610@qq.com>
* resolve rpc server logger panic
Signed-off-by: sunwp <244372610@qq.com>
* resolve rpc server logger panic
Signed-off-by: sunwp <244372610@qq.com>
* reset levels nil to release init method level
Signed-off-by: sunwp <244372610@qq.com>
* golang lint
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:06 +08:00
c55e05a1e6
feat: change default scheduler filter parent limit ( #1166 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
98e95e693c
feat: implement bidirectional fetch pieces ( #1165 )
...
* feat: implement grpc server side sync pieces
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:06 +08:00
603db21e17
feat: scheduler add default biz tag ( #1164 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
7adee4c2d9
feat: host remove peer ( #1161 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
4e670035ed
feat: change reschdule config ( #1158 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
4ab498837c
test: add scheduler constructSuccessPeerPacket case ( #1154 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
1ea700f421
feat: scheduler metrics add default value of biz tag ( #1151 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
b61865e2a9
feat: scheduler trace trigger cdn ( #1147 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
eb408d136f
test: scheduler service handlePieceFail ( #1146 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
7d30dd86ae
feat: add scheduler traffic metrics ( #1143 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
5223cc1ce8
feat: add scheduler metrics ( #1139 )
...
* feat: add scheduler metrics
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate validate for url meta
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
8f19c11f54
feat: scheduler remove inactive host ( #1135 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
addcf04df0
feat: task state for register ( #1132 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
58aff0c231
feat: scheduler change piece cost from nanosecond to millisecond ( #1119 )
...
* feat: change picec cost from nanoseconds to milliseconds
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler service
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
e940af77ca
fix: scheduler piece cost time ( #1118 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
8ba4a12fcd
feat: when peer downloads finished, peer deletes parent ( #1116 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
c5428e0657
feat: optimize scheduler log ( #1114 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
0326f781f4
feat: optimize scheduler ( #1106 )
...
* feat: optimize scheduler
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
e2248b100c
feat: optimize depth limit func ( #1102 )
...
* feat: optimize depth limit func (#1099 )
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
27fcc904c0
fix: when peer state is PeerStateSucceeded, return size scope is small ( #1103 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
83cdf39a9c
feat: limit tree depth ( #1099 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
557425249c
feat: optimize peer range ( #1095 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
db93339f9d
test: FilterParentCount ( #1094 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
8bdfeab60b
feat: add cdn addresses log ( #1091 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
e6e9d2102a
feat: scheduler add limit count of filter parent func ( #1090 )
...
* feat: scheduler add filter parent count
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: limit filter parent count
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
3c45cdd6ac
feat: add dynamic parallel count ( #1088 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
f56de57c01
fix: delete peer's parent on PeerEventDownloadSucceeded event ( #1085 )
...
When a peer leaves, it calls scheduler's LeaveTask() interface to
notify scheduler that it's leaving. And LeaveTask() will re-schedule
all its children to find a new parent by calling ScheduleParent().
But some of this peer's children might be in PeerStateSucceeded
state, as they have finished downloading tasks from parent. So
ScheduleParent() on such children is pointless.
Let's delete peer's parent on PeerEventDownloadSucceeded event, so
its parent won't call ScheduleParent() on it again, when its parent
is leaving.
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:32:58 +08:00
81ea759393
test: scheduler handle failed piece ( #1084 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
e0a494e8a8
feat: when scheduler blocks cdn, resource does not initialize cdn ( #1081 )
...
* feat: when scheduler blocks cdn, resource does not initialize cdn
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: scheduler remove manager enable config
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
060429c675
feat: scheduler blocks cdn ( #1079 )
...
* feat: scheduler blocks cdn
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
d52782ff38
feat: job trigger cdn by resource ( #1076 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
f15a04ec73
correct plugin typo ( #1060 )
...
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:57 +08:00
60b4eeb9e6
fix: when cdn download failed, scheduler should set cdn peer state PeerStateFailed ( #1067 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00
e200373abb
fix: evaluate peer's parent ( #1064 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00
54a9ed79d8
Feature: support e2e feature gates ( #1056 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
c14d36ba6a
fix: scheduler download tiny file error ( #1052 )
...
* fix: scheduler download tiny file error
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: fix golang lint
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:55 +08:00
6d58de0ef1
refactor: scheduler grpc server ( #1046 )
...
* refactor: scheduler grpc server
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate mock file
Signed-off-by: Gaius <gaius.qi@gmail.com>
* test: scheduler package
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
aa5f078a14
feat: remove host and task when peer make tree ( #1042 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
99da719ce1
feat: cdn download tiny file ( #1040 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
cb2f9298ce
fix: cdn trigger peer error ( #1035 )
...
* feat: If cdn only updates IP, set cdn peers state to PeerStateLeave
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
Gaius