Commit Graph

49 Commits

Author SHA1 Message Date
Gaius 93a8ebb4bc
feat: add dfstore command (#1441)
* feat: add dfstore command

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
Jim Ma cf7debf9c4
feat: back source error detail (#1437)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:34 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418)
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius a64a842b2c
feat: update golang to 1.18.3 (#1417)
* feat: update golang version to 1.18.3

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update go mod

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
Gaius f688d341bd
feat: remove cdn (#1401)
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius 2362a670bd
fix: preheat tack id (#1375)
* fix: preheat with task id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: add end time to seed piece

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Jim Ma c8ea36186f
chore: add hack/gen-containerd-hosts.sh (#1361)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius e2eb30bc96
feat: change pattern from cdn to seed peer and remove kustomize shell (#1345)
* feat: change pattern from cdn to seed peer and remove kustomize shell

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:24 +08:00
Eryu Guan ce718920c6
fix: remove container after generating protoc (#1306)
Add '--rm' option to docker command, so container will be removed
automatically. Otherwise we'll have many exited but not removed
containers as we run 'make protoc'.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:33:19 +08:00
zzy987 cc5e1f7d27
feat: use a golang native file server to replace nginx (#1258)
* feat: use a golang native file server to replace nginx

Signed-off-by: zzy987 <nevermind@sjtu.edu.cn>
2023-06-28 17:33:17 +08:00
Eryu Guan 65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache (#1227)
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.

For example:
- add a file into cache system
  dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file

- check if a file exists in cache system
  dfcache stat --cid testid --local  # only check local cache
  dfcache stat --cid testid          # check other peers as well

- export/download a file from cache system
  dfcache export --cid testid -O /path/to/output

- delete a file from cache system, both local cache and P2P network
  dfcache delete -i testid -t testtag

Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
Gaius 29f512bc72
docs: move document from /docs to d7y.io (#1229)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius 998110f2b8
feat: generate grpc protos in namely/protoc-all image (#1187)
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: makefile add protoc command

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Jim Ma 34abb8dbbd
chore: update gorelease ldflags (#1086)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:58 +08:00
Jim Ma 5027f9c998
chore: use buildx to build docker images in e2e (#1018)
* chore: build images concurrency

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 2930651395
chore: upgrade to ginkgo v2 (#1036)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
yxxhero 2d8d449bcf
fix markdown lint error (#988)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:32:50 +08:00
Jim Ma 6134277c5c
chore: support multi daemons e2e test (#896)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:44 +08:00
Gaius 4b511f5d87
feat: lint sh (#876)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:42 +08:00
Jim Ma b82e0fa944
chore: upgrade to golang 1.17 and alpine 3.14 (#861)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:41 +08:00
Jim Ma 6bad029d81
chore: unify binary directory (#828)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:37 +08:00
Jim Ma 0ad1bf9674
Fix: source plugin not loaded (#811)
* fix: source plugin not loaded

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:36 +08:00
Gaius 90c6a8287c
chore: add compatibility test workflow (#594)
* chore: add compatibility test workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:42 +08:00
Gaius 0897fe9e78
feat: update git submodule (#560)
* feat: update git submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:37 +08:00
Gaius 908a90642b
feat: add console (#559)
* feat: add console

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:36 +08:00
Jim Ma 8180a52470
chore: optimize client rpc package name and other docs (#541)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:35 +08:00
Gaius f27770af32
Feature: Add manager charts with submodule (#525)
* chore: add charts submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:35 +08:00
Jim Ma 300563bcca
Feature: support customize base image (#519)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
Jim Ma 0df064202e
Fix: proxy for stress testing tool (#507)
* chore: fix proxy for stress testing tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
lengrongfu 7dcab772a5
fix:GOPROXY var (#488)
Signed-off-by: lengrongfu <lengrongfu@meituan.com>

Co-authored-by: lengrongfu <lengrongfu@meituan.com>
2023-06-28 17:30:29 +08:00
Gaius aff7951c47
test: E2E download concurrency (#467)
* test: E2E download concurrency

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:30:28 +08:00
Jim Ma 886c9b51ef
chore: set GOPROXY with default value (#463)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:27 +08:00
Gaius 1a2913e898
feat: Install e2e script (#451)
* feat: install e2e script

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:30:27 +08:00
Gaius fc5da6d0f7
Add E2E tests and workflow (#402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:26 +08:00
加菲 eda5839eb8
Fix client dfget bug and support digest (#432)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:30:26 +08:00
Jim Ma 777e98784e
feature: export peer.TaskManager for embedding dragonfly in custom binary (#434)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:19 +08:00
Jim Ma 5721554396
feature: update client config to Camel-Case format (#393)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:28:01 +08:00
Gaius 5653f1b800
Refactor manager (#363)
* feat: handler

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add handlers

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add models and service

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: models

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: migrate

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: database

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: create

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: CDN CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: cdn CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: security group CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cdn instances CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: associated CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: id type

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: association

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: rest

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: health and prometheus

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: ginprometheus

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: gorm naming

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename host to hostname

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename host to hostname

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add manager grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: security_group

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: security_group

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add grpc internal get cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cache time

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: database mysql

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager init

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update scheduler

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: init db

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: init db

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: register

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: tag

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: keepAlive

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: keepAlive

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: typo

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: typo

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: typo

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove println

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:28:00 +08:00
Gaius d18292b9c0
chore: change bash to sh (#383)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:27:59 +08:00
Jim Ma 25c43c762e
Feature: add kustomize yaml for deploying (#349)
* feature: add kustomize yaml for deploying

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: remove unused folder

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update documents

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update dfdaemon netns config

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update Kubernetes-with-Dragonfly.md and quick-start.md

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:27:59 +08:00
加菲 cab5ed6d2e
Feature/dfget param (#373)
* update image for arch

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>

* feature: adjust dfget grpc param

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:27:59 +08:00
Gaius 830ed6a11a
chore: remove protoc.sh (#341)
* chore: remove protoc.sh

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: add hack protoc.sh

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:43 +08:00
Gaius 5bf806a146
chore: remove build script's git operation (#321)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:42 +08:00
Jim Ma 6929c6e6c3
fix: Makefile and build.sh (#309)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:22:41 +08:00
Gaius 0d2ca8de4c
Add nfpm build dfget (#300)
* feat: use nfpm build rpm and deb

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
Gaius 64807eed8d
Fix hack packaging (#287)
* feat: rename dfget-daemon.yaml to dfget.yaml

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go mod

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:40 +08:00
Gaius f9b4d77bb2
Fix golang lint (#249)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00
Gaius f905ac032d
Change Dockerfile directory and clean up project (#165)
* chore: rename codecov.yml name

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: move Dockerfile to deploy directory

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove dfsync directory

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:21:32 +08:00
Jim Ma 0af8817c1f
Merge branch main-rc to branch main
Signed-off-by: Jim Ma <majinjing3@gmail.com>

Co-authored-by: 李玉海 <yuhai.lyh@alibaba-inc.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: santong <weipeng.swp@alibaba-inc.com>
Co-authored-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
Co-authored-by: 加菲 <garfieldhu@aliyun.com>
2023-06-28 17:20:20 +08:00