Commit Graph

2448 Commits

Author SHA1 Message Date
sunwp a9be3408e7
resolve forget unlock resource lack lock (#1138)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:03 +08:00
Gaius 8f19c11f54
feat: scheduler remove inactive host (#1135)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
Gaius addcf04df0
feat: task state for register (#1132)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
Jim Ma bb73b45b46
fix: wrong md5 sign in cdn (#1126)
* fix: wrong md5 sign in cdn

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* Extract the pieces sorting rule to the GetProgress method

Signed-off-by: sunwp <244372610@qq.com>

* cal sign notice

Signed-off-by: sunwp <244372610@qq.com>

Co-authored-by: sunwp <244372610@qq.com>
2023-06-28 17:33:02 +08:00
Gaius 7d778d7b95
feat: change grpc client keepalive config (#1125)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
sunwp 4a752a47da
fix concurrent piece map panic in cdn (#1121)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:02 +08:00
Jim Ma 84eaf402c3
chore: fast back source when get pieces task failed (#1123)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:02 +08:00
AnJia d939824c5f
fix: docker-compose preheat pending (#1124)
Signed-off-by: 赵安家 <anjia0532@gmail.com>
2023-06-28 17:33:02 +08:00
sunwp 17e3f933c4
get piece tasks log (#974)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:02 +08:00
sunwp bd29967c39
use os.stat replace custom stat function (#1109)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:02 +08:00
Gaius 58aff0c231
feat: scheduler change piece cost from nanosecond to millisecond (#1119)
* feat: change picec cost from nanoseconds to milliseconds

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler service

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
Jim Ma ebc1aff720
feat: support health probe in daemon (#1120)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius e940af77ca
fix: scheduler piece cost time (#1118)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
sunwp 0b0dd27ff8
add CDN piece download cost (#966)
Signed-off-by: sunwp <244372610@qq.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius 8ba4a12fcd
feat: when peer downloads finished, peer deletes parent (#1116)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius a95edf5e0d
feat: change source client dialer config (#1115)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius c5428e0657
feat: optimize scheduler log (#1114)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Jim Ma 977f095c49
chore: optimize reuse logic (#1110)
* chore: optimize reuse logic

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius a5f385cd99
feat: remove needless manager grpc proxy (#1113)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
sunwp 08d5f10517
feat: set grpc logger verbosity from env variable (#1111)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:00 +08:00
Gaius f16c5592ab
feat: change back-to-source timeout (#1112)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 0326f781f4
feat: optimize scheduler (#1106)
* feat: optimize scheduler

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Jim Ma ac4c4bb912
feat: reuse partial completed task (#1107)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius e2248b100c
feat: optimize depth limit func (#1102)
* feat: optimize depth limit func (#1099)

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 3ae66a1167
feat: change client default load limit (#1104)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 27fcc904c0
fix: when peer state is PeerStateSucceeded, return size scope is small (#1103)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 83cdf39a9c
feat: limit tree depth (#1099)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Jim Ma fc2b1f8187
chore: init url meta in rpc server (#1098)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Jim Ma 92d020f884
docs: add plugin builder (#1101)
* docs: add plugin builder

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: markdown lint

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius b7a43faf59
feat: update load limit (#1097)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius 557425249c
feat: optimize peer range (#1095)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius db93339f9d
test: FilterParentCount (#1094)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
sunwp d0665728e0
fix multi task seeds lead to panic concurrent map writes (#1093)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:59 +08:00
Gaius 8bdfeab60b
feat: add cdn addresses log (#1091)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius e6e9d2102a
feat: scheduler add limit count of filter parent func (#1090)
* feat: scheduler add filter parent count

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: limit filter parent count

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
Jim Ma 4597f74283
feat: merge ranged request storage into parent (#1078)
* feat: merge ranged request storage into parent

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius 3c45cdd6ac
feat: add dynamic parallel count (#1088)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Eryu Guan f56de57c01
fix: delete peer's parent on PeerEventDownloadSucceeded event (#1085)
When a peer leaves, it calls scheduler's LeaveTask() interface to
notify scheduler that it's leaving. And LeaveTask() will re-schedule
all its children to find a new parent by calling ScheduleParent().

But some of this peer's children might be in PeerStateSucceeded
state, as they have finished downloading tasks from parent. So
ScheduleParent() on such children is pointless.

Let's delete peer's parent on PeerEventDownloadSucceeded event, so
its parent won't call ScheduleParent() on it again, when its parent
is leaving.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:32:58 +08:00
AnJia 1c9ffcd938
feat: fix docker-compose (#1087)
upgrade to v2.0.2-rc.9

added depends on(redis and mysql)

added healthcheck

Signed-off-by: 赵安家 <anjia0532@gmail.com>
2023-06-28 17:32:58 +08:00
Jim Ma 34abb8dbbd
chore: update gorelease ldflags (#1086)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius 81ea759393
test: scheduler handle failed piece (#1084)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Jim Ma 5478414751
feat: add prefetch metric in client (#1068)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius e0a494e8a8
feat: when scheduler blocks cdn, resource does not initialize cdn (#1081)
* feat: when scheduler blocks cdn, resource does not initialize cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler remove manager enable config

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius 2997c1e903
fix: pull request template typo (#1080)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:58 +08:00
Gaius 060429c675
feat: scheduler blocks cdn (#1079)
* feat: scheduler blocks cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius d52782ff38
feat: job trigger cdn by resource (#1076)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius c7d02ef8be
docs: add metrics document (#1075)
* docs: add metrics document

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: format docs

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: change markdownlint rules

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Saksham Sharma 4a171ac5cb
Fix typos in docs (#1071)
* docs: fix typos in docs

* docs: update CONTRIBUTING.md
2023-06-28 17:32:57 +08:00
AnJia c6e2c601dc
docs: add containerd private registry configuration (#1074)
* docs: add containerd private registry configuration

Signed-off-by: 赵安家 <anjia0532@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius 6cd5f19653
docs: add containerd private registry configuration (#1073)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00