Commit Graph

1241 Commits

Author SHA1 Message Date
Jim Ma a033e5f5be
feature: remove unsafe code in client/daemon/storage (#258)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:38 +08:00
Jim Ma a777c8882c
Fix: use atomic to avoid data race in client (#254)
* fix: use atomic to avoid data race

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: temporary disable cdnsystem&manager test for CI

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update .github/workflows/ci.yaml and codecov.yml

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update ratelimiter test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update dynconfig test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: ratelimiter and file utils test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: ratelimiter and queue test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: httputil test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feat: remove httputils

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Gaius 7ccd6af2d7
Fix scheduler test (#252)
* test: create cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: error check

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
yangjun289519474 5475ff376f
Refactor manager orm store (#248)
* refactor: manager orm store

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* refactor: manager orm store

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* refactor: manager orm store

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* Feature: support basic auth for proxy (#250)

* feature: add basic auth support for proxy

Signed-off-by: Jim Ma <majinjing3@gmail.com>Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>
Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* Fix golang lint (#249)

Signed-off-by: Gaius <gaius.qi@gmail.com>Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>
Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

Co-authored-by: hanson.yj <hanson.yj@alibaba-inc.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Gaius f9b4d77bb2
Fix golang lint (#249)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Jim Ma 59f227abf2
Feature: support basic auth for proxy (#250)
* feature: add basic auth support for proxy

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:38 +08:00
加菲 37157f1d45
refactor: remove benchmark-rate and rename not-back-source (#245)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:38 +08:00
Gaius 7e595898e5
Fix lint (#244)
* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: lint hostIP

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: error check

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: nil pointer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename taskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename peerID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: taskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: licenses

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:37 +08:00
Gaius 00b060d234
test: idgen add digest (#243)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:37 +08:00
Gaius 93d638c806
Refactor scheduler's dynconfig (#228)
* feat: scheduler's dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cdn manager use dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler cdn manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler dynconfig log

* feat: scheduler dynconfig observers

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove scheduler dynconfig logger

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler mocks pkg rename mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove reflect.DeepEqual

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager client

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: scheduler start

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig watch server

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: manager CDN hosts

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename scheduler dynconfig Start func

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig type

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager keepalive

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig netAddrs

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler config validate

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
加菲 19e70ecce8
refactor: support multi digest not only md5 (#236)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
加菲 f592032f72
Refactor cmd (#217)
* refator:cmd and path 

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
sunwp cc5e46420d
refactor: simplify to make imports more format (#230) 2023-06-28 17:22:37 +08:00
sunwp 141f604905
fix: cdn gc dead lock (#231)
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
sunwp d0e80b0b3b
fix: cfgFile nil error (#224)
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
Jim Ma 6ff264f330
Feature: add disk quota gc for daemon (#215)
* feat: add disk quota gc for daemon

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: skip marked tasks when check disk quota

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:36 +08:00
Gaius 17580da047
chore: workflows remove main-rc branch (#221)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:36 +08:00
Gaius 3b6ec39a1b
Refactor task manager (#219)
* fix: get task return values

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: task manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add TODO

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: task manager test file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: task manager

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:36 +08:00
sunwp a89e915aee
feature: remove redundant configurations (#216)
* feature: remove redundant configurations

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:29 +08:00
Gaius b1df150cc9
Detailed test information display (#212)
* chore: test detail

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: make test-coverage

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: test short

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:34 +08:00
Gaius ed515deaf1
Refactor idgen pkg (#211)
* fix: generate TaskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: remove fmt.Println

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: generate taskID and twinsTaskID

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 52cdfaa165
Fix config test (#207)
* feat: convert header and meta.Header

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: assert.EqualValues is useless for CertPool

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: transport

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add pickHeader

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: transport

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Jim Ma 48bb920806
daemon: add add additional peer id for some logs (#205)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 89f8a9b3fb
Change README.md images (#197)
* docs: change readme logo size

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: change architecture images

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: change architecture image

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 3e9f85957b
Fix code security scanning (#195)
* fix: change manager docs path

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: code security scanning

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius fedf7671bc
fix: change manager docs path (#193)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 154edb28f7
Rewrite README.md (#166)
* docs: add badge

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add badges

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change github build status badge to CI badge

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add todo badge

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: build the document structure

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: init readme

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: rename Dragonfly2 to Dragonfly

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: rename Dragonfly2 to Dragonfly

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: rename Dragonfly2 to Dragonfly

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: add community describe

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: create architecture

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Jim Ma 3969051262
daemon: create output parent directory if not exists (#188)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:21:33 +08:00
Jim Ma 3955a7d716
daemon: update default timeout and add context for downloading piece (#190)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:21:33 +08:00
Jim Ma 9528f67101
daemon: record failed code when unfinished and event for scheduler (#176)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 32e1b81ecd
chore: change manager swagger docs path and add makefile swagger command (#183)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius bc021be3cd
chore: add SECURITY.md (#181)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius 18f4e7a101
chore: change codeowners (#179)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius 1f47c98696
chore: change codeowners to dragonfly2's maintainers and reviewers (#169)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius db7ee2c39d
chore: create custom issue template (#168)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius f905ac032d
Change Dockerfile directory and clean up project (#165)
* chore: rename codecov.yml name

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: move Dockerfile to deploy directory

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove dfsync directory

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius 559b01d607
docs: add CODE_OF_CONDUCT.md (#163)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius 6c594a884b
Add CONTRIBUTING.md (#161)
* docs: add CONTRIBUTING.md

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius dc4f2f6e12
Add CODEOWNERS (#160)
* chore: add CODEOWNERS

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius c856f5e2f4
chore: add pull request and issue templates (#154)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:31 +08:00
Jim Ma 0af8817c1f
Merge branch main-rc to branch main
Signed-off-by: Jim Ma <majinjing3@gmail.com>

Co-authored-by: 李玉海 <yuhai.lyh@alibaba-inc.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: santong <weipeng.swp@alibaba-inc.com>
Co-authored-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
Co-authored-by: 加菲 <garfieldhu@aliyun.com>
2023-06-28 17:20:20 +08:00