Commit Graph

1241 Commits

Author SHA1 Message Date
AnJia d939824c5f
fix: docker-compose preheat pending (#1124)
Signed-off-by: 赵安家 <anjia0532@gmail.com>
2023-06-28 17:33:02 +08:00
sunwp 17e3f933c4
get piece tasks log (#974)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:02 +08:00
sunwp bd29967c39
use os.stat replace custom stat function (#1109)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:02 +08:00
Gaius 58aff0c231
feat: scheduler change piece cost from nanosecond to millisecond (#1119)
* feat: change picec cost from nanoseconds to milliseconds

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler service

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
Jim Ma ebc1aff720
feat: support health probe in daemon (#1120)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius e940af77ca
fix: scheduler piece cost time (#1118)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
sunwp 0b0dd27ff8
add CDN piece download cost (#966)
Signed-off-by: sunwp <244372610@qq.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius 8ba4a12fcd
feat: when peer downloads finished, peer deletes parent (#1116)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius a95edf5e0d
feat: change source client dialer config (#1115)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius c5428e0657
feat: optimize scheduler log (#1114)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Jim Ma 977f095c49
chore: optimize reuse logic (#1110)
* chore: optimize reuse logic

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius a5f385cd99
feat: remove needless manager grpc proxy (#1113)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
sunwp 08d5f10517
feat: set grpc logger verbosity from env variable (#1111)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:00 +08:00
Gaius f16c5592ab
feat: change back-to-source timeout (#1112)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 0326f781f4
feat: optimize scheduler (#1106)
* feat: optimize scheduler

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Jim Ma ac4c4bb912
feat: reuse partial completed task (#1107)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius e2248b100c
feat: optimize depth limit func (#1102)
* feat: optimize depth limit func (#1099)

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 3ae66a1167
feat: change client default load limit (#1104)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 27fcc904c0
fix: when peer state is PeerStateSucceeded, return size scope is small (#1103)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 83cdf39a9c
feat: limit tree depth (#1099)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Jim Ma fc2b1f8187
chore: init url meta in rpc server (#1098)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Jim Ma 92d020f884
docs: add plugin builder (#1101)
* docs: add plugin builder

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: markdown lint

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius b7a43faf59
feat: update load limit (#1097)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius 557425249c
feat: optimize peer range (#1095)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius db93339f9d
test: FilterParentCount (#1094)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
sunwp d0665728e0
fix multi task seeds lead to panic concurrent map writes (#1093)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:59 +08:00
Gaius 8bdfeab60b
feat: add cdn addresses log (#1091)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius e6e9d2102a
feat: scheduler add limit count of filter parent func (#1090)
* feat: scheduler add filter parent count

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: limit filter parent count

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
Jim Ma 4597f74283
feat: merge ranged request storage into parent (#1078)
* feat: merge ranged request storage into parent

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius 3c45cdd6ac
feat: add dynamic parallel count (#1088)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Eryu Guan f56de57c01
fix: delete peer's parent on PeerEventDownloadSucceeded event (#1085)
When a peer leaves, it calls scheduler's LeaveTask() interface to
notify scheduler that it's leaving. And LeaveTask() will re-schedule
all its children to find a new parent by calling ScheduleParent().

But some of this peer's children might be in PeerStateSucceeded
state, as they have finished downloading tasks from parent. So
ScheduleParent() on such children is pointless.

Let's delete peer's parent on PeerEventDownloadSucceeded event, so
its parent won't call ScheduleParent() on it again, when its parent
is leaving.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:32:58 +08:00
AnJia 1c9ffcd938
feat: fix docker-compose (#1087)
upgrade to v2.0.2-rc.9

added depends on(redis and mysql)

added healthcheck

Signed-off-by: 赵安家 <anjia0532@gmail.com>
2023-06-28 17:32:58 +08:00
Jim Ma 34abb8dbbd
chore: update gorelease ldflags (#1086)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius 81ea759393
test: scheduler handle failed piece (#1084)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Jim Ma 5478414751
feat: add prefetch metric in client (#1068)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius e0a494e8a8
feat: when scheduler blocks cdn, resource does not initialize cdn (#1081)
* feat: when scheduler blocks cdn, resource does not initialize cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler remove manager enable config

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius 2997c1e903
fix: pull request template typo (#1080)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius 060429c675
feat: scheduler blocks cdn (#1079)
* feat: scheduler blocks cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius d52782ff38
feat: job trigger cdn by resource (#1076)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius c7d02ef8be
docs: add metrics document (#1075)
* docs: add metrics document

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: format docs

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: change markdownlint rules

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Saksham Sharma 4a171ac5cb
Fix typos in docs (#1071)
* docs: fix typos in docs

* docs: update CONTRIBUTING.md
2023-06-28 17:32:57 +08:00
AnJia c6e2c601dc
docs: add containerd private registry configuration (#1074)
* docs: add containerd private registry configuration

Signed-off-by: 赵安家 <anjia0532@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius 6cd5f19653
docs: add containerd private registry configuration (#1073)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
AnJia 9ec889f26c
docs: add docs about preheat console (#1072)
* docs: add preheat docs

Signed-off-by: 赵安家 <anjia0532@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius 76dbfcfc5c
feat: add client request log (#1069)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
sunwp f15a04ec73
correct plugin typo (#1060)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:57 +08:00
Gaius 60b4eeb9e6
fix: when cdn download failed, scheduler should set cdn peer state PeerStateFailed (#1067)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00
Gaius e200373abb
fix: evaluate peer's parent (#1064)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 1346f6907f
chore: enable range feature gate in e2e (#1059)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
sunwp 84bfe42b2e
cdn returns begin piece (#1045)
Signed-off-by: sunwp <244372610@qq.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:56 +08:00