Commit Graph

97 Commits

Author SHA1 Message Date
Gaius abe46a2c23
test: close dfget back-to-souce (#1317)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
Gaius faa5e4e465
feat: add seed peer logic (#1302)
* feat: announce seed peer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn logic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn job

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfdaemon change host uuid to host id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go generate mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn compatibility

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change docker compose

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: reuse panic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: compatible with v2.0.3-beta.2

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00
Jim Ma 7c1e315ec1
fix: client synchronizer report error lock and dial grpc timeout (#1260)
* fix: client synchronizer report error lock
* chore: remove superfluous retry to sync and get pieces from other peers
* chore: optimize back source and sync piece logic
* chore: print apk output in e2e
* fix: grpc send with io.EOF error

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:15 +08:00
Gaius a46a37be6c
test: fix e2e preheat case (#1170)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
Jim Ma 4597f74283
feat: merge ranged request storage into parent (#1078)
* feat: merge ranged request storage into parent

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Jim Ma 1346f6907f
chore: enable range feature gate in e2e (#1059)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 54a9ed79d8
Feature: support e2e feature gates (#1056)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 5027f9c998
chore: use buildx to build docker images in e2e (#1018)
* chore: build images concurrency

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 9353aa4a62
chore: add missing pod log volumes in e2e (#1037)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 2930651395
chore: upgrade to ginkgo v2 (#1036)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 37b332a366
test: dump goroutine in e2e (#980)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:50 +08:00
Gaius c95d835c6b
feat: if cdn is deleted, clear cdn related information (#967)
* feat: if cdn is deleted, clear cdn related information

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:49 +08:00
Jim Ma 6ec8b48dd3
fix: schedulers send invalid direct piece (#970)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:49 +08:00
Jim Ma aee13a46ea
chore: copy e2e proxy log to artifact (#962)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:48 +08:00
yojay11717 b2848a982c
fix typos for test/readme (#933)
Signed-off-by: yojay11717 <lanyujie@inspur.com>
2023-06-28 17:32:47 +08:00
Gaius cb4202319e
feat: make idgen package public (#931)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:47 +08:00
Eng Zer Jun f579d3c9ce
refactor: move from io/ioutil to io and os packages (#906)
* chore: run `go fmt ./...`

This commit synchronizes `//go:build` lines with `// +build` lines.

Reference: https://go.googlesource.com/proposal/+/master/design/draft-gobuild.md
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>

* refactor: move from io/ioutil to io and os packages

The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil. This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2023-06-28 17:32:45 +08:00
Gaius 8f903ccf24
docs: dir path (#904)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:44 +08:00
sunwp eaca95d24e
Load source plugins (#894)
* unit test

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:44 +08:00
Jim Ma 6134277c5c
chore: support multi daemons e2e test (#896)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:44 +08:00
Gaius 0cb14903b2
feat: scheduler and cdn report fqdn to manager (#818)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:37 +08:00
Gaius 61f9f83b28
fix: manager typo and cdn peer id (#809)
* fix: manager typo and cdn peer id 

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:36 +08:00
Gaius e837ae9bdf
chore: add lint errcheck and fix errcheck(#766)
* feat: add lint errcheck and fix errcheck

Signed-off-by: Gaius <gaius.qi@gmail.com>

* replace assert to require

Signed-off-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>

Co-authored-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>
2023-06-28 17:32:35 +08:00
Gaius c92787d0f7
test: preheat image (#794)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:35 +08:00
Gaius a6b7c4697e
chore: add markdown lint (#779)
* chore: add markdown lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: fix markdown lint errors

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:34 +08:00
Jim Ma 3d63ab2ca3
chore: update golang import lint (#780)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:34 +08:00
Jim Ma 6546115359
feat: support dump http content in client for debugging (#770)
* feat: support dump http content in client for debugging

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:33 +08:00
Gaius 1dccea01ce
feat: add jobs api (#751)
* feat: add jobs api

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:32 +08:00
Gaius 061e25c3e5
feat: preheat cluster (#731)
* feat: preheat cluster

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:30 +08:00
Gaius ad6697300b
feat: export e2e logs (#732)
* feat: export e2e logs 

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:30 +08:00
Gaius 984a0dab13
test: preheat e2e (#627)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:45 +08:00
zzy987 d68ba8b944
fix: preheat-e2e timeout (#602)
Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:43 +08:00
Gaius 79841a2b82
feat: compatibility e2e with matrix (#599)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:43 +08:00
Gaius 90c6a8287c
chore: add compatibility test workflow (#594)
* chore: add compatibility test workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:42 +08:00
zzy987 15c37f99e7
chore: add copyright (#593)
* chore: add copyright

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: ci

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:42 +08:00
zzy987 74696f3109
Add preheat e2e test (#582)
* feat: create preheat_test.go

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add post request

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: try to fix header name

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: try fix page not found

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: try to install kubectl in cdn pod

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: remove sudo

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: put curl in manager

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: correct json content

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: correct request url

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: check curl result

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: correct request url

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: check the cmd string in github environment

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: use service

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: delete cluster-name

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: use " in header

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: curl command format

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: use idgen.taskid to get the filename

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: add an error message

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add concurrency test

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: ab use proxy

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add curl pod

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add function CurlCommand

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: variable usage

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: remove curl in cdn pod

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: modify code format

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: use curl in file-server

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: correct command in file-server

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: add a e2e-test, check if it is the reason of no preheat

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: can test preheat now

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: check result after concurrency test

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: add comments, add function check preheat result

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: delete e2e_test in e2e/manager

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: refactor curlCommand, add func getCDNs getFS

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add image preheat

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: rename functions

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: delete functions, use stable task id in test

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:42 +08:00
Gaius 4963da47aa
test: print merge commit (#581)
* test: printf merge commit

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:39 +08:00
Gaius 38b6d7d833
test: compare image commit (#538)
* feat: compare image commit

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:35 +08:00
Gaius f27770af32
Feature: Add manager charts with submodule (#525)
* chore: add charts submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:35 +08:00
Jim Ma 94e35fa9df
chore: optimize compute piece size function (#528)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:34 +08:00
Jim Ma 300563bcca
Feature: support customize base image (#519)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
Jim Ma 0df064202e
Fix: proxy for stress testing tool (#507)
* chore: fix proxy for stress testing tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
Jim Ma 9f657c234c
feat: Add stress testing tool for daemon (#506)
* feature: add stress testing tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:30 +08:00
Gaius aff7951c47
test: E2E download concurrency (#467)
* test: E2E download concurrency

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:30:28 +08:00
Jim Ma 39a004b469
Add e2e dfget test cases (#450)
* test: rename e2e/util to e2e/e2eutil

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* test: add dfget e2e test

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:27 +08:00
Gaius 4021289442
test: E2E test use kind's containerd (#448)
* test: E2E test use kind's containerd

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:30:26 +08:00
Gaius fc5da6d0f7
Add E2E tests and workflow (#402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:26 +08:00