dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,226 Commits 5 Branches 281 Tags 98 MiB
Commit Graph

58 Commits

Author SHA1 Message Date
Jim Ma 5040af8b4f
feat: add s3 resource client and recursive e2e test (#1826) 
* feat: add s3 resource client
* chore: add minio server and recursive e2e test
* chore: add download grpc test tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:34:09 +08:00
cuidajun e9469d3487
fix: add fallback registry mirror in gen-containerd-host.sh (#1774) 
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
 2023-06-28 17:34:04 +08:00
Gaius aac5ade4e2
chore: update golang version to 1.19 (#1760) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:03 +08:00
Jim Ma 73de99353d
feat: empty file e2e (#1687) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:56 +08:00
Gaius 88b2c6cb69
fix: manager embed assets (#1642) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:52 +08:00
Gaius 43d8478507
feat: add tls policy to scheduler grpc server (#1616) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:50 +08:00
Jim Ma 717ac99ef5
feat: daemon support auto issue certificate (#1586) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:48 +08:00
Gaius 585884f01d
feat: manager embed frontend assets (#1523) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:42 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:41 +08:00
Gaius 93a8ebb4bc
feat: add dfstore command (#1441) 
* feat: add dfstore command

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:34 +08:00
Jim Ma cf7debf9c4
feat: back source error detail (#1437) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:34 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418) 
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:32 +08:00
Gaius a64a842b2c
feat: update golang to 1.18.3 (#1417) 
* feat: update golang version to 1.18.3

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update go mod

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:31 +08:00
Gaius f688d341bd
feat: remove cdn (#1401) 
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:29 +08:00
Gaius 2362a670bd
fix: preheat tack id (#1375) 
* fix: preheat with task id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: add end time to seed piece

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:27 +08:00
Jim Ma c8ea36186f
chore: add hack/gen-containerd-hosts.sh (#1361) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:26 +08:00
Gaius e2eb30bc96
feat: change pattern from cdn to seed peer and remove kustomize shell (#1345) 
* feat: change pattern from cdn to seed peer and remove kustomize shell

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:24 +08:00
Eryu Guan ce718920c6
fix: remove container after generating protoc (#1306) 
Add '--rm' option to docker command, so container will be removed
automatically. Otherwise we'll have many exited but not removed
containers as we run 'make protoc'.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
 2023-06-28 17:33:19 +08:00
zzy987 cc5e1f7d27
feat: use a golang native file server to replace nginx (#1258) 
* feat: use a golang native file server to replace nginx

Signed-off-by: zzy987 <nevermind@sjtu.edu.cn>
 2023-06-28 17:33:17 +08:00
Eryu Guan 65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache (#1227) 
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.

For example:
- add a file into cache system
  dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file

- check if a file exists in cache system
  dfcache stat --cid testid --local  # only check local cache
  dfcache stat --cid testid          # check other peers as well

- export/download a file from cache system
  dfcache export --cid testid -O /path/to/output

- delete a file from cache system, both local cache and P2P network
  dfcache delete -i testid -t testtag

Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:13 +08:00
Gaius 29f512bc72
docs: move document from /docs to d7y.io (#1229) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:12 +08:00
Gaius 998110f2b8
feat: generate grpc protos in namely/protoc-all image (#1187) 
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: makefile add protoc command

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:08 +08:00
Jim Ma 34abb8dbbd
chore: update gorelease ldflags (#1086) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:58 +08:00
Jim Ma 5027f9c998
chore: use buildx to build docker images in e2e (#1018) 
* chore: build images concurrency

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:54 +08:00
Jim Ma 2930651395
chore: upgrade to ginkgo v2 (#1036) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:54 +08:00
yxxhero 2d8d449bcf
fix markdown lint error (#988) 
Signed-off-by: yxxhero <aiopsclub@163.com>
 2023-06-28 17:32:50 +08:00
Jim Ma 6134277c5c
chore: support multi daemons e2e test (#896) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:44 +08:00
Gaius 4b511f5d87
feat: lint sh (#876) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:42 +08:00
Jim Ma b82e0fa944
chore: upgrade to golang 1.17 and alpine 3.14 (#861) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:41 +08:00
Jim Ma 6bad029d81
chore: unify binary directory (#828) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:37 +08:00
Jim Ma 0ad1bf9674
Fix: source plugin not loaded (#811) 
* fix: source plugin not loaded

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:36 +08:00
Gaius 90c6a8287c
chore: add compatibility test workflow (#594) 
* chore: add compatibility test workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:42 +08:00
Gaius 0897fe9e78
feat: update git submodule (#560) 
* feat: update git submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:37 +08:00
Gaius 908a90642b
feat: add console (#559) 
* feat: add console

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:36 +08:00
Jim Ma 8180a52470
chore: optimize client rpc package name and other docs (#541) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:31:35 +08:00
Gaius f27770af32
Feature: Add manager charts with submodule (#525) 
* chore: add charts submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:35 +08:00
Jim Ma 300563bcca
Feature: support customize base image (#519) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:31:33 +08:00
Jim Ma 0df064202e
Fix: proxy for stress testing tool (#507) 
* chore: fix proxy for stress testing tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:31:33 +08:00
lengrongfu 7dcab772a5
fix:GOPROXY var (#488) 
Signed-off-by: lengrongfu <lengrongfu@meituan.com>

Co-authored-by: lengrongfu <lengrongfu@meituan.com>
 2023-06-28 17:30:29 +08:00
Gaius aff7951c47
test: E2E download concurrency (#467) 
* test: E2E download concurrency

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:30:28 +08:00
Jim Ma 886c9b51ef
chore: set GOPROXY with default value (#463) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:30:27 +08:00
Gaius 1a2913e898
feat: Install e2e script (#451) 
* feat: install e2e script

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:30:27 +08:00
Gaius fc5da6d0f7
Add E2E tests and workflow (#402) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:30:26 +08:00
加菲 eda5839eb8
Fix client dfget bug and support digest (#432) 
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
 2023-06-28 17:30:26 +08:00
Jim Ma 777e98784e
feature: export peer.TaskManager for embedding dragonfly in custom binary (#434) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:30:19 +08:00
Jim Ma 5721554396
feature: update client config to Camel-Case format (#393) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:28:01 +08:00
Gaius 5653f1b800
Refactor manager (#363) 
* feat: handler

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add handlers

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add models and service

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: models

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: migrate

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: database

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: create

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: CDN CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: cdn CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: scheduler CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: security group CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cdn instances CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: associated CURD

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: id type

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: association

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: rest

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: health and prometheus

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: ginprometheus

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: gorm naming

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename host to hostname

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename host to hostname

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add manager grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: security_group

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: security_group

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add grpc internal get cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc cache

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: cache time

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: database mysql

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager init

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update scheduler

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: init db

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: init db

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dynconfig

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: register

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: tag

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: keepAlive

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: keepAlive

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: scheduler config

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: typo

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: typo

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: typo

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* test: cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove println

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:28:00 +08:00
Gaius d18292b9c0
chore: change bash to sh (#383) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:27:59 +08:00
Jim Ma 25c43c762e
Feature: add kustomize yaml for deploying (#349) 
* feature: add kustomize yaml for deploying

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: remove unused folder

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update documents

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update dfdaemon netns config

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* feature: update Kubernetes-with-Dragonfly.md and quick-start.md

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:27:59 +08:00
加菲 cab5ed6d2e
Feature/dfget param (#373) 
* update image for arch

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>

* feature: adjust dfget grpc param

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
 2023-06-28 17:27:59 +08:00