Commit Graph

48 Commits

Author SHA1 Message Date
Jim Ma b0eaa169ba
fix: e2e test dfget recursive (#2458)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:57 +08:00
Gaius bf0a18230e
feat: change default value of dynconfig cache (#2203)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:40 +08:00
Waleed Malik 907774969a
chore: migrate from k8s.gcr.io to registry.k8s.io (#2186)
Signed-off-by: Waleed Malik <ahmedwaleedmalik@gmail.com>
2023-06-28 17:34:39 +08:00
Gaius e9da69dc40
feat: add auth config to manager (#2161)
Fix https://github.com/dragonflyoss/Dragonfly2/security/advisories/GHSA-hpc8-7wpm-889w.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:37 +08:00
Gaius a5685582ce
refactor: resource task with v2 version of grpc (#2078)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
Bin Liu dc950aaae2
chore: add e2e with nydus snapshotter (#1860)
Signed-off-by: bin liu <liubin0329@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius 2835f4aea6
fix: remove advertiseIP config in e2e (#1878)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:13 +08:00
Jim Ma fdd189e661
chore: enable cache list metadata e2e (#1829)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:09 +08:00
Jim Ma 5040af8b4f
feat: add s3 resource client and recursive e2e test (#1826)
* feat: add s3 resource client
* chore: add minio server and recursive e2e test
* chore: add download grpc test tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:09 +08:00
Jim Ma 876c2ae17e
feat: support split running tasks (#1794)
* feat: support split running tasks

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: go tests

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: add split runnging tasks e2e config

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: actions

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: actions

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize get running tasks logic

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize get running tasks logic

Signed-off-by: Jim Ma <majinjing3@gmail.com>

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:06 +08:00
greenhandatsjtu bc8d623b3d
feat: add traffic shaper for download tasks (#1654)
Signed-off-by: greenhandatsjtu <sunhengke@sjtu.edu.cn>
2023-06-28 17:33:59 +08:00
Jim Ma 89376d6c4e
feat: ipv6 support (#1685)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
Jim Ma 6298f9e67c
feat: split concurrent back source e2e (#1666)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:54 +08:00
Gaius 198613a357
chore: add disable seed peer action (#1653)
* chore: add disable seed peer action
* fix: concurrent back source

Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:54 +08:00
Gaius 3764af25f3
feat: change dfdaemon rate limit (#1661)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:54 +08:00
Jim Ma 1619aa300a
chore: update tls e2e cert (#1626)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:51 +08:00
Gaius 72505244fe
chore: workflows add tls e2e (#1624)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:51 +08:00
greenhandatsjtu acf4922866
feat: auto switch to concurrent back source based on download speed (#1494)
Signed-off-by: greenhandatsjtu <sunhengke@sjtu.edu.cn>
2023-06-28 17:33:40 +08:00
Gaius 0bd894adad
fix: dfdaemon unix socket (#1489)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 4e57177055
chore: upgrade kind node version (#1433)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:33 +08:00
Jim Ma 776a0fef42
feat: concurrent multiple pieces back source (#1426)
* feat: concurrent multiple pieces back source
* chore: update http source client

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:33 +08:00
jiasirui 9d092c13cd
ensure test yaml file start with --- (#1406)
Signed-off-by: jiasirui <jiasirui3@163.com>
2023-06-28 17:33:30 +08:00
Gaius 8d27830ca8
feat: dfdaemon add ns filter (#1379)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius 2362a670bd
fix: preheat tack id (#1375)
* fix: preheat with task id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: add end time to seed piece

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius 3351b2871d
fix: e2e charts config
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:24 +08:00
Gaius 6daff648a5
feat: update casbin/gorm-adapter version and change e2e charts config
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:24 +08:00
Gaius b47f321cee
test: update e2e charts config
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:24 +08:00
Gaius faa5e4e465
feat: add seed peer logic (#1302)
* feat: announce seed peer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn logic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn job

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfdaemon change host uuid to host id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go generate mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn compatibility

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change docker compose

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: reuse panic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: compatible with v2.0.3-beta.2

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00
Jim Ma 4597f74283
feat: merge ranged request storage into parent (#1078)
* feat: merge ranged request storage into parent

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Jim Ma 5027f9c998
chore: use buildx to build docker images in e2e (#1018)
* chore: build images concurrency

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 9353aa4a62
chore: add missing pod log volumes in e2e (#1037)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 37b332a366
test: dump goroutine in e2e (#980)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:50 +08:00
Gaius c95d835c6b
feat: if cdn is deleted, clear cdn related information (#967)
* feat: if cdn is deleted, clear cdn related information

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:49 +08:00
Jim Ma 6ec8b48dd3
fix: schedulers send invalid direct piece (#970)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:49 +08:00
Jim Ma aee13a46ea
chore: copy e2e proxy log to artifact (#962)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:48 +08:00
Gaius 8f903ccf24
docs: dir path (#904)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:44 +08:00
Jim Ma 6134277c5c
chore: support multi daemons e2e test (#896)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:44 +08:00
Jim Ma 6546115359
feat: support dump http content in client for debugging (#770)
* feat: support dump http content in client for debugging

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:33 +08:00
Gaius 061e25c3e5
feat: preheat cluster (#731)
* feat: preheat cluster

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:30 +08:00
Gaius ad6697300b
feat: export e2e logs (#732)
* feat: export e2e logs 

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:30 +08:00
Gaius 79841a2b82
feat: compatibility e2e with matrix (#599)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:43 +08:00
Gaius 90c6a8287c
chore: add compatibility test workflow (#594)
* chore: add compatibility test workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:42 +08:00
Gaius f27770af32
Feature: Add manager charts with submodule (#525)
* chore: add charts submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:35 +08:00
Jim Ma 300563bcca
Feature: support customize base image (#519)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
Gaius aff7951c47
test: E2E download concurrency (#467)
* test: E2E download concurrency

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:30:28 +08:00
Jim Ma 39a004b469
Add e2e dfget test cases (#450)
* test: rename e2e/util to e2e/e2eutil

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* test: add dfget e2e test

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:27 +08:00
Gaius 4021289442
test: E2E test use kind's containerd (#448)
* test: E2E test use kind's containerd

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:30:26 +08:00
Gaius fc5da6d0f7
Add E2E tests and workflow (#402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:26 +08:00