Commit Graph

62 Commits

Author SHA1 Message Date
Gaius fbb575f954
chore: add trainer to Makefile and shell (#2488)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
Garen Wen 813c2c61c9
feat:add default build param GOOS GOARCH (#2155)
Co-authored-by: wenmanxiang <wenmanxiang@baidu.com>
2023-06-28 17:34:38 +08:00
AdamQQQ 7633910441
feat: update golang version to 1.20.1 (#2117)
Signed-off-by: Qinqi Qu <quqinqi@linux.alibaba.com>
2023-06-28 17:34:34 +08:00
Gaius da40946f17
feat: storage collects upload piece count, peer cost and error details (#1907)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Jim Ma 5040af8b4f
feat: add s3 resource client and recursive e2e test (#1826)
* feat: add s3 resource client
* chore: add minio server and recursive e2e test
* chore: add download grpc test tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:09 +08:00
cuidajun e9469d3487
fix: add fallback registry mirror in gen-containerd-host.sh (#1774)
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:04 +08:00
Gaius aac5ade4e2
chore: update golang version to 1.19 (#1760)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:03 +08:00
Jim Ma 73de99353d
feat: empty file e2e (#1687)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:56 +08:00
Gaius 88b2c6cb69
fix: manager embed assets (#1642)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:52 +08:00
Gaius 43d8478507
feat: add tls policy to scheduler grpc server (#1616)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Jim Ma 717ac99ef5
feat: daemon support auto issue certificate (#1586)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:48 +08:00
Gaius 585884f01d
feat: manager embed frontend assets (#1523)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:42 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
Gaius 93a8ebb4bc
feat: add dfstore command (#1441)
* feat: add dfstore command

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
Jim Ma cf7debf9c4
feat: back source error detail (#1437)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:34 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418)
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius a64a842b2c
feat: update golang to 1.18.3 (#1417)
* feat: update golang version to 1.18.3

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update go mod

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
Gaius f688d341bd
feat: remove cdn (#1401)
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius 2362a670bd
fix: preheat tack id (#1375)
* fix: preheat with task id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: add end time to seed piece

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Jim Ma c8ea36186f
chore: add hack/gen-containerd-hosts.sh (#1361)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius e2eb30bc96
feat: change pattern from cdn to seed peer and remove kustomize shell (#1345)
* feat: change pattern from cdn to seed peer and remove kustomize shell

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:24 +08:00
Eryu Guan ce718920c6
fix: remove container after generating protoc (#1306)
Add '--rm' option to docker command, so container will be removed
automatically. Otherwise we'll have many exited but not removed
containers as we run 'make protoc'.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:33:19 +08:00
zzy987 cc5e1f7d27
feat: use a golang native file server to replace nginx (#1258)
* feat: use a golang native file server to replace nginx

Signed-off-by: zzy987 <nevermind@sjtu.edu.cn>
2023-06-28 17:33:17 +08:00
Eryu Guan 65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache (#1227)
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.

For example:
- add a file into cache system
  dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file

- check if a file exists in cache system
  dfcache stat --cid testid --local  # only check local cache
  dfcache stat --cid testid          # check other peers as well

- export/download a file from cache system
  dfcache export --cid testid -O /path/to/output

- delete a file from cache system, both local cache and P2P network
  dfcache delete -i testid -t testtag

Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
Gaius 29f512bc72
docs: move document from /docs to d7y.io (#1229)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius 998110f2b8
feat: generate grpc protos in namely/protoc-all image (#1187)
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: makefile add protoc command

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Jim Ma 34abb8dbbd
chore: update gorelease ldflags (#1086)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:58 +08:00
Jim Ma 5027f9c998
chore: use buildx to build docker images in e2e (#1018)
* chore: build images concurrency

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 2930651395
chore: upgrade to ginkgo v2 (#1036)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
yxxhero 2d8d449bcf
fix markdown lint error (#988)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:32:50 +08:00
Jim Ma 6134277c5c
chore: support multi daemons e2e test (#896)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:44 +08:00
Gaius 4b511f5d87
feat: lint sh (#876)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:42 +08:00
Jim Ma b82e0fa944
chore: upgrade to golang 1.17 and alpine 3.14 (#861)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:41 +08:00
Jim Ma 6bad029d81
chore: unify binary directory (#828)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:37 +08:00
Jim Ma 0ad1bf9674
Fix: source plugin not loaded (#811)
* fix: source plugin not loaded

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:36 +08:00
Gaius 90c6a8287c
chore: add compatibility test workflow (#594)
* chore: add compatibility test workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:42 +08:00
Gaius 0897fe9e78
feat: update git submodule (#560)
* feat: update git submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:37 +08:00
Gaius 908a90642b
feat: add console (#559)
* feat: add console

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:36 +08:00
Jim Ma 8180a52470
chore: optimize client rpc package name and other docs (#541)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:35 +08:00
Gaius f27770af32
Feature: Add manager charts with submodule (#525)
* chore: add charts submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:35 +08:00
Jim Ma 300563bcca
Feature: support customize base image (#519)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
Jim Ma 0df064202e
Fix: proxy for stress testing tool (#507)
* chore: fix proxy for stress testing tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
lengrongfu 7dcab772a5
fix:GOPROXY var (#488)
Signed-off-by: lengrongfu <lengrongfu@meituan.com>

Co-authored-by: lengrongfu <lengrongfu@meituan.com>
2023-06-28 17:30:29 +08:00
Gaius aff7951c47
test: E2E download concurrency (#467)
* test: E2E download concurrency

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:30:28 +08:00
Jim Ma 886c9b51ef
chore: set GOPROXY with default value (#463)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:27 +08:00
Gaius 1a2913e898
feat: Install e2e script (#451)
* feat: install e2e script

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:30:27 +08:00
Gaius fc5da6d0f7
Add E2E tests and workflow (#402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:26 +08:00
加菲 eda5839eb8
Fix client dfget bug and support digest (#432)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:30:26 +08:00
Jim Ma 777e98784e
feature: export peer.TaskManager for embedding dragonfly in custom binary (#434)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:19 +08:00
Jim Ma 5721554396
feature: update client config to Camel-Case format (#393)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:28:01 +08:00