Commit Graph

33 Commits

Author SHA1 Message Date
Gaius 913535ad7a
feat: add type to DownloadFailureCount (#1212)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius f5d372bab4
feat: if the number of failed peers in the task is greater than FailedPeerCountLimit, then scheduler notifies running peers of failure (#1211)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius bc1b807832
feat: optimize get available task (#1208)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius e33736121f
feat: scheduler add block peers set (#1202)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 603db21e17
feat: scheduler add default biz tag (#1164)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
Gaius 7adee4c2d9
feat: host remove peer (#1161)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
Gaius b61865e2a9
feat: scheduler trace trigger cdn (#1147)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00
Gaius 7d30dd86ae
feat: add scheduler traffic metrics (#1143)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
Gaius 5223cc1ce8
feat: add scheduler metrics (#1139)
* feat: add scheduler metrics

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate validate for url meta

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:03 +08:00
Gaius addcf04df0
feat: task state for register (#1132)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
Gaius 58aff0c231
feat: scheduler change piece cost from nanosecond to millisecond (#1119)
* feat: change picec cost from nanoseconds to milliseconds

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler service

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:02 +08:00
Gaius e940af77ca
fix: scheduler piece cost time (#1118)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius c5428e0657
feat: optimize scheduler log (#1114)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
Gaius 0326f781f4
feat: optimize scheduler (#1106)
* feat: optimize scheduler

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 27fcc904c0
fix: when peer state is PeerStateSucceeded, return size scope is small (#1103)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
Gaius 557425249c
feat: optimize peer range (#1095)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:59 +08:00
Gaius 060429c675
feat: scheduler blocks cdn (#1079)
* feat: scheduler blocks cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius d52782ff38
feat: job trigger cdn by resource (#1076)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:57 +08:00
Gaius 6d58de0ef1
refactor: scheduler grpc server (#1046)
* refactor: scheduler grpc server

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler package

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:55 +08:00
Gaius cb2f9298ce
fix: cdn trigger peer error (#1035)
* feat: If cdn only updates IP, set cdn peers state to PeerStateLeave

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
Gaius 65ad608d58
feat: If cdn only updates IP, set cdn peers state to PeerStateLeave (#1038)
* feat: If cdn only updates IP, set cdn peers state to PeerStateLeave

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:54 +08:00
Gaius f8ebd597e2
feat: task mutex replace sync kmutex (#1000)
* feat: trace https proxy request (#996)

* feat: trace https proxy request

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: daemon test

Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove sync kmutex and add task mutex

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:52 +08:00
Gaius 5479b3a53e
feat: stream send error code (#986)
* feat: change task and peer ttl (#984)

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: send error code

Signed-off-by: Gaius <gaius.qi@gmail.com>

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add retry interval

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfdaemon report successful piece before end of piece

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update submodule version

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:51 +08:00
Gaius 97c1eb65e7
Refactor scheduler service (#958)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
sunwp 7b8aaf6b31
Refactor scheduler (#369)
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:30:29 +08:00
Jim Ma 777e98784e
feature: export peer.TaskManager for embedding dragonfly in custom binary (#434)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:19 +08:00
sunwp 6cce5a9872
Feature/code spec (#336)
* Modify the code according to https://github.com/uber-go/guide/blob/master/style.md

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:24:44 +08:00
Gaius f9b4d77bb2
Fix golang lint (#249)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Gaius 93d638c806
Refactor scheduler's dynconfig (#228)
* feat: scheduler's dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cdn manager use dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler cdn manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler dynconfig log

* feat: scheduler dynconfig observers

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove scheduler dynconfig logger

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler mocks pkg rename mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove reflect.DeepEqual

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager client

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: scheduler start

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig watch server

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: manager CDN hosts

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename scheduler dynconfig Start func

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig type

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager keepalive

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig netAddrs

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler config validate

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
Gaius 3b6ec39a1b
Refactor task manager (#219)
* fix: get task return values

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: task manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add TODO

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: task manager test file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: task manager

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:36 +08:00
sunwp a89e915aee
feature: remove redundant configurations (#216)
* feature: remove redundant configurations

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:29 +08:00
Gaius ed515deaf1
Refactor idgen pkg (#211)
* fix: generate TaskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: remove fmt.Println

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: generate taskID and twinsTaskID

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Jim Ma 0af8817c1f
Merge branch main-rc to branch main
Signed-off-by: Jim Ma <majinjing3@gmail.com>

Co-authored-by: 李玉海 <yuhai.lyh@alibaba-inc.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: santong <weipeng.swp@alibaba-inc.com>
Co-authored-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
Co-authored-by: 加菲 <garfieldhu@aliyun.com>
2023-06-28 17:20:20 +08:00