Commit Graph

1907 Commits

Author SHA1 Message Date
Gaius a13f1e9c7a
chore: remove manager netcat-openbsd (#298)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
Gaius 0974e54e4d
small PR for code optimization. (#294) (#295)
Signed-off-by: yxxhero <aiopsclub@163.com>

Co-authored-by: yxxhero <11087727+yxxhero@users.noreply.github.com>
2023-06-28 17:22:40 +08:00
Gaius 8976072a91
docs: add CHANGELOG.md
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
yangjun289519474 1fb834edc2
refactor(manager): modify mysql table schema, orm json tag. (#283)
Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

Co-authored-by: hanson.yj <hanson.yj@alibaba-inc.com>
2023-06-28 17:22:40 +08:00
Gaius 64807eed8d
Fix hack packaging (#287)
* feat: rename dfget-daemon.yaml to dfget.yaml

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go mod

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
Gaius f5d6b454e9
Fix client document (#285)
* feat: update containerd docs
* feat: update log path

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
yangjun289519474 badd1ef73c
Add go-cache as local cache, add redis as distributed (#272)
* feat(manager): add go-cache as local cache, add redis as distributed cache, add lease based on mysql as manager keepalive owner

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* feat(manager): delete mock config

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* feat(manager): modify sch to scheduler, and replace with GetWithExpiration when call Get method of go-cache

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

Co-authored-by: hanson.yj <hanson.yj@alibaba-inc.com>
2023-06-28 17:22:39 +08:00
Gaius 84cfd5f4e3
fix: ci badge (#281)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius b2c9743794
Add release workflow and optimize other workflows (#277)
* feat: rename codeql-analysis.yml to codeql-analysis.yaml

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: release workflows

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename yaml to yml

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: optimize workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add license check workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: remove licenses check

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: workflows golang version

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: language go

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius c25792bbb8
Added GC public library (#267)
* feat: gc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: init gc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig validate

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: generate gc mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: gc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: gc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: add gc run timeout

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove return pointer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove NewWithOptions

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove gomock finish

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius 366fdc93e5
feat: remove queue package (#275)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
加菲 a8e19098fc
Feature/base options (#269)
* refactor: wrapper jaeger with telemetry

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>

* fix: viper parse common flags

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:39 +08:00
Gaius 51b0fdee11
feat: add ci badge (#265)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius c993a3c4b4
feat: remove slidingwindow and assertutils package (#263)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius b2e54875cc
Remove pidfile (#261)
* feat: remove pidfile

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove lockfile

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Jim Ma 8198af07a1
fix: change peerPacketReady to buffer channel (#256)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:38 +08:00
Jim Ma a033e5f5be
feature: remove unsafe code in client/daemon/storage (#258)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:38 +08:00
Jim Ma a777c8882c
Fix: use atomic to avoid data race in client (#254)
* fix: use atomic to avoid data race

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: temporary disable cdnsystem&manager test for CI

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update .github/workflows/ci.yaml and codecov.yml

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update ratelimiter test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update dynconfig test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: ratelimiter and file utils test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: ratelimiter and queue test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: httputil test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feat: remove httputils

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Gaius 7ccd6af2d7
Fix scheduler test (#252)
* test: create cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: error check

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
yangjun289519474 5475ff376f
Refactor manager orm store (#248)
* refactor: manager orm store

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* refactor: manager orm store

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* refactor: manager orm store

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* Feature: support basic auth for proxy (#250)

* feature: add basic auth support for proxy

Signed-off-by: Jim Ma <majinjing3@gmail.com>Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>
Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* Fix golang lint (#249)

Signed-off-by: Gaius <gaius.qi@gmail.com>Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>
Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

Co-authored-by: hanson.yj <hanson.yj@alibaba-inc.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Gaius f9b4d77bb2
Fix golang lint (#249)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Jim Ma 59f227abf2
Feature: support basic auth for proxy (#250)
* feature: add basic auth support for proxy

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:38 +08:00
加菲 37157f1d45
refactor: remove benchmark-rate and rename not-back-source (#245)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:38 +08:00
Gaius 7e595898e5
Fix lint (#244)
* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: lint hostIP

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: error check

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: nil pointer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename taskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename peerID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: taskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: licenses

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:37 +08:00
Gaius 00b060d234
test: idgen add digest (#243)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:37 +08:00
Gaius 93d638c806
Refactor scheduler's dynconfig (#228)
* feat: scheduler's dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cdn manager use dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler cdn manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler dynconfig log

* feat: scheduler dynconfig observers

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove scheduler dynconfig logger

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler mocks pkg rename mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove reflect.DeepEqual

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager client

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: scheduler start

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig watch server

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: manager CDN hosts

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename scheduler dynconfig Start func

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig type

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager keepalive

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig netAddrs

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler config validate

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
加菲 19e70ecce8
refactor: support multi digest not only md5 (#236)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
加菲 f592032f72
Refactor cmd (#217)
* refator:cmd and path 

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
sunwp cc5e46420d
refactor: simplify to make imports more format (#230) 2023-06-28 17:22:37 +08:00
sunwp 141f604905
fix: cdn gc dead lock (#231)
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
sunwp d0e80b0b3b
fix: cfgFile nil error (#224)
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
Jim Ma 6ff264f330
Feature: add disk quota gc for daemon (#215)
* feat: add disk quota gc for daemon

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: skip marked tasks when check disk quota

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:36 +08:00
Gaius 17580da047
chore: workflows remove main-rc branch (#221)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:36 +08:00
Gaius 3b6ec39a1b
Refactor task manager (#219)
* fix: get task return values

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: task manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add TODO

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: task manager test file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: task manager

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:36 +08:00
sunwp a89e915aee
feature: remove redundant configurations (#216)
* feature: remove redundant configurations

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:29 +08:00
Gaius b1df150cc9
Detailed test information display (#212)
* chore: test detail

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: make test-coverage

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: test short

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:34 +08:00
Gaius ed515deaf1
Refactor idgen pkg (#211)
* fix: generate TaskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: remove fmt.Println

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: generate taskID and twinsTaskID

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 52cdfaa165
Fix config test (#207)
* feat: convert header and meta.Header

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: assert.EqualValues is useless for CertPool

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: transport

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add pickHeader

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: transport

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Jim Ma 48bb920806
daemon: add add additional peer id for some logs (#205)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 89f8a9b3fb
Change README.md images (#197)
* docs: change readme logo size

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: change architecture images

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: change architecture image

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 3e9f85957b
Fix code security scanning (#195)
* fix: change manager docs path

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: code security scanning

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius fedf7671bc
fix: change manager docs path (#193)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 154edb28f7
Rewrite README.md (#166)
* docs: add badge

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add badges

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change github build status badge to CI badge

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add todo badge

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: build the document structure

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: init readme

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: rename Dragonfly2 to Dragonfly

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: rename Dragonfly2 to Dragonfly

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: rename Dragonfly2 to Dragonfly

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: add community describe

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: create architecture

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:33 +08:00
Jim Ma 3969051262
daemon: create output parent directory if not exists (#188)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:21:33 +08:00
Jim Ma 3955a7d716
daemon: update default timeout and add context for downloading piece (#190)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:21:33 +08:00
Jim Ma 9528f67101
daemon: record failed code when unfinished and event for scheduler (#176)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:21:33 +08:00
Gaius 32e1b81ecd
chore: change manager swagger docs path and add makefile swagger command (#183)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius bc021be3cd
chore: add SECURITY.md (#181)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius 18f4e7a101
chore: change codeowners (#179)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Gaius 1f47c98696
chore: change codeowners to dragonfly2's maintainers and reviewers (#169)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00