Commit Graph

229 Commits

Author SHA1 Message Date
yxxhero a1fed34ac1
return error in NewManagerServer func (#335)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:22:43 +08:00
sunwp 155ee02a54
Add CDN unit-tests (#338)
* feat: refactor cdn storage module & remove unused ctx & cdn test

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:43 +08:00
Gaius 1535cd835c
chore: update CI timeout (#328)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:42 +08:00
Gaius 8fe393a2f3
feat: changelog (#326)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:42 +08:00
Gaius 93df784264
Improve CONTRIBUTING.md and makefile (#325)
* docs: optimize CONTRIBUTING

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: makefile comment

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:42 +08:00
yxxhero 2228bf0aa1
Improve error handling (#324)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:22:42 +08:00
Gaius 5bf806a146
chore: remove build script's git operation (#321)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:42 +08:00
Gaius 0f3a850d9b
chore: docker building workflow (#323)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:42 +08:00
加菲 c3e49b957b
refactor: update arch (#319)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:42 +08:00
sunwp 19129f53e0
Refactor the storage function module (#289)
* feat: refactor cdn storage module

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:42 +08:00
Jim Ma f62cd7bf38
optimize log and fix typo (#311)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:41 +08:00
yangjun289519474 cf4944894d
Add sqlite, miniredis as mysql, redis mock suite, to f… (#293)
* test(manager): add sqlite, miniredis as mysql, redis mock suite, to fix manager unit test

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* fix(manager): add sync.Mutex when get/set leaseid

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* feat(manager): modify manager store config, add yaml config exaple

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* feat(manager): modify manager store config, add yaml config exaple

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* fix(manager): add comment for StoreSource

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

Co-authored-by: hanson.yj <hanson.yj@alibaba-inc.com>
2023-06-28 17:22:41 +08:00
yangjun289519474 3e2be181d6
fix(manager): modify to config from scheduler_config in swagger yaml (#317)
Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

Co-authored-by: hanson.yj <hanson.yj@alibaba-inc.com>
2023-06-28 17:22:41 +08:00
Gaius 38d44773cb
Add goreleaser NFPM (#313)
* chore: add goreleaser nfpm

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: change name template

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:41 +08:00
Jim Ma a33267de61
feature: disable resolver server config (#314)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:41 +08:00
Jim Ma fb85383a08
fix: when load config from cdn directory in dynconfig, skip sub directories (#310)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:41 +08:00
Jim Ma 6929c6e6c3
fix: Makefile and build.sh (#309)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:41 +08:00
Jim Ma 0f9270c62f
feature: update docs (#307)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:41 +08:00
Gaius 7726b0f621
Dynconfig in schduler gets the cdn configuration from the directory (#304)
* feat: add dynconfig get cdn infos from directory

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: use dynconfig.LocalSourceType

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:41 +08:00
yxxhero f117828420
add installation.namespace config for helm chart (#301)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:22:40 +08:00
yxxhero 6a7259e663
Unified error handling style (#302)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:22:40 +08:00
Gaius 0d2ca8de4c
Add nfpm build dfget (#300)
* feat: use nfpm build rpm and deb

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
Gaius a13f1e9c7a
chore: remove manager netcat-openbsd (#298)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
Gaius 0974e54e4d
small PR for code optimization. (#294) (#295)
Signed-off-by: yxxhero <aiopsclub@163.com>

Co-authored-by: yxxhero <11087727+yxxhero@users.noreply.github.com>
2023-06-28 17:22:40 +08:00
Gaius 8976072a91
docs: add CHANGELOG.md
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
yangjun289519474 1fb834edc2
refactor(manager): modify mysql table schema, orm json tag. (#283)
Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

Co-authored-by: hanson.yj <hanson.yj@alibaba-inc.com>
2023-06-28 17:22:40 +08:00
Gaius 64807eed8d
Fix hack packaging (#287)
* feat: rename dfget-daemon.yaml to dfget.yaml

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go mod

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
Gaius f5d6b454e9
Fix client document (#285)
* feat: update containerd docs
* feat: update log path

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
yangjun289519474 badd1ef73c
Add go-cache as local cache, add redis as distributed (#272)
* feat(manager): add go-cache as local cache, add redis as distributed cache, add lease based on mysql as manager keepalive owner

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* feat(manager): delete mock config

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* feat(manager): modify sch to scheduler, and replace with GetWithExpiration when call Get method of go-cache

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

Co-authored-by: hanson.yj <hanson.yj@alibaba-inc.com>
2023-06-28 17:22:39 +08:00
Gaius 84cfd5f4e3
fix: ci badge (#281)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius b2c9743794
Add release workflow and optimize other workflows (#277)
* feat: rename codeql-analysis.yml to codeql-analysis.yaml

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: release workflows

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename yaml to yml

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: optimize workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add license check workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: remove licenses check

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: workflows golang version

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: language go

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius c25792bbb8
Added GC public library (#267)
* feat: gc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: init gc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig validate

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: generate gc mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: gc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: gc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: add gc run timeout

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove return pointer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove NewWithOptions

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove gomock finish

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius 366fdc93e5
feat: remove queue package (#275)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
加菲 a8e19098fc
Feature/base options (#269)
* refactor: wrapper jaeger with telemetry

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>

* fix: viper parse common flags

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:39 +08:00
Gaius 51b0fdee11
feat: add ci badge (#265)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius c993a3c4b4
feat: remove slidingwindow and assertutils package (#263)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius b2e54875cc
Remove pidfile (#261)
* feat: remove pidfile

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove lockfile

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Jim Ma 8198af07a1
fix: change peerPacketReady to buffer channel (#256)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:38 +08:00
Jim Ma a033e5f5be
feature: remove unsafe code in client/daemon/storage (#258)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:38 +08:00
Jim Ma a777c8882c
Fix: use atomic to avoid data race in client (#254)
* fix: use atomic to avoid data race

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: temporary disable cdnsystem&manager test for CI

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update .github/workflows/ci.yaml and codecov.yml

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update ratelimiter test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update dynconfig test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: ratelimiter and file utils test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: ratelimiter and queue test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: httputil test

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feat: remove httputils

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Gaius 7ccd6af2d7
Fix scheduler test (#252)
* test: create cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: error check

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
yangjun289519474 5475ff376f
Refactor manager orm store (#248)
* refactor: manager orm store

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* refactor: manager orm store

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* refactor: manager orm store

Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* Feature: support basic auth for proxy (#250)

* feature: add basic auth support for proxy

Signed-off-by: Jim Ma <majinjing3@gmail.com>Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>
Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

* Fix golang lint (#249)

Signed-off-by: Gaius <gaius.qi@gmail.com>Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>
Signed-off-by: hanson.yj <hanson.yj@alibaba-inc.com>

Co-authored-by: hanson.yj <hanson.yj@alibaba-inc.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Gaius f9b4d77bb2
Fix golang lint (#249)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Jim Ma 59f227abf2
Feature: support basic auth for proxy (#250)
* feature: add basic auth support for proxy

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:38 +08:00
加菲 37157f1d45
refactor: remove benchmark-rate and rename not-back-source (#245)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:38 +08:00
Gaius 7e595898e5
Fix lint (#244)
* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: lint hostIP

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: error check

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: nil pointer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename taskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename peerID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: taskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: licenses

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:37 +08:00
Gaius 00b060d234
test: idgen add digest (#243)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:37 +08:00
Gaius 93d638c806
Refactor scheduler's dynconfig (#228)
* feat: scheduler's dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cdn manager use dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove file

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler cdn manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler dynconfig log

* feat: scheduler dynconfig observers

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove scheduler dynconfig logger

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler mocks pkg rename mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove reflect.DeepEqual

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager client

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: scheduler start

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig watch server

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: manager CDN hosts

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename scheduler dynconfig Start func

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig type

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager keepalive

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig netAddrs

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler config validate

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
加菲 19e70ecce8
refactor: support multi digest not only md5 (#236)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:37 +08:00
加菲 f592032f72
Refactor cmd (#217)
* refator:cmd and path 

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:37 +08:00