Commit Graph

53 Commits

Author SHA1 Message Date
Jim Ma b0eaa169ba
fix: e2e test dfget recursive (#2458)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:57 +08:00
Gaius b5c5b5b2e6
feat: implement Enqueue and AverageRTT in probes.go (#2393)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:53 +08:00
Gaius d66126f6a4
test: improve timeout in recursive download (#2367)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:51 +08:00
Gaius b1171f4bd4
feat: rename manager/model to manager/models (#2191)
The manager model package is renamed to models to
prevent the same name as the future inference model database table.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:39 +08:00
Gaius 79024c87ca
refactor: parse http range (#2071)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
Gaius f7a399b47a
feat: add v2 version of the idgen (#2056)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:29 +08:00
Jim Ma 068dc8a799
chore: print e2e exec output (#1963)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:21 +08:00
Jim Ma 0546fe4898
chore: create log dir (#1947)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:20 +08:00
Jim Ma ea02bbefde
chore: update e2e test (#1839)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:10 +08:00
Jim Ma 5040af8b4f
feat: add s3 resource client and recursive e2e test (#1826)
* feat: add s3 resource client
* chore: add minio server and recursive e2e test
* chore: add download grpc test tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:09 +08:00
Jim Ma 55d5308b19
fix: open end range in concurrent back source (#1764)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:03 +08:00
Jim Ma 73de99353d
feat: empty file e2e (#1687)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:56 +08:00
Gaius 198613a357
chore: add disable seed peer action (#1653)
* chore: add disable seed peer action
* fix: concurrent back source

Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:54 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
Gaius 3b426d2c54
feat: rename client/clientutil to client/util (#1420)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius 7a30db3fba
refactor: pkg util (#1402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius 2362a670bd
fix: preheat tack id (#1375)
* fix: preheat with task id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: add end time to seed piece

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius 5de118bce2
feat: e2e seed peer (#1358)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:25 +08:00
Gaius 3bd1f03c43
feat: custom preheat tag parameters (#1324)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:21 +08:00
Gaius abe46a2c23
test: close dfget back-to-souce (#1317)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
Gaius faa5e4e465
feat: add seed peer logic (#1302)
* feat: announce seed peer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn logic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn job

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfdaemon change host uuid to host id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go generate mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn compatibility

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change docker compose

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: reuse panic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: compatible with v2.0.3-beta.2

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00
Jim Ma 7c1e315ec1
fix: client synchronizer report error lock and dial grpc timeout (#1260)
* fix: client synchronizer report error lock
* chore: remove superfluous retry to sync and get pieces from other peers
* chore: optimize back source and sync piece logic
* chore: print apk output in e2e
* fix: grpc send with io.EOF error

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:15 +08:00
Gaius a46a37be6c
test: fix e2e preheat case (#1170)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
Jim Ma 4597f74283
feat: merge ranged request storage into parent (#1078)
* feat: merge ranged request storage into parent

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Jim Ma 1346f6907f
chore: enable range feature gate in e2e (#1059)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 54a9ed79d8
Feature: support e2e feature gates (#1056)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 2930651395
chore: upgrade to ginkgo v2 (#1036)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Jim Ma 37b332a366
test: dump goroutine in e2e (#980)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:50 +08:00
Gaius c95d835c6b
feat: if cdn is deleted, clear cdn related information (#967)
* feat: if cdn is deleted, clear cdn related information

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:49 +08:00
Jim Ma aee13a46ea
chore: copy e2e proxy log to artifact (#962)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:48 +08:00
Gaius cb4202319e
feat: make idgen package public (#931)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:47 +08:00
sunwp eaca95d24e
Load source plugins (#894)
* unit test

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:44 +08:00
Jim Ma 6134277c5c
chore: support multi daemons e2e test (#896)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:44 +08:00
Gaius 61f9f83b28
fix: manager typo and cdn peer id (#809)
* fix: manager typo and cdn peer id 

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:36 +08:00
Gaius c92787d0f7
test: preheat image (#794)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:35 +08:00
Jim Ma 3d63ab2ca3
chore: update golang import lint (#780)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:34 +08:00
Gaius 1dccea01ce
feat: add jobs api (#751)
* feat: add jobs api

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:32 +08:00
Gaius 061e25c3e5
feat: preheat cluster (#731)
* feat: preheat cluster

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:30 +08:00
Gaius ad6697300b
feat: export e2e logs (#732)
* feat: export e2e logs 

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:30 +08:00
Gaius 984a0dab13
test: preheat e2e (#627)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:45 +08:00
zzy987 d68ba8b944
fix: preheat-e2e timeout (#602)
Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:43 +08:00
Gaius 79841a2b82
feat: compatibility e2e with matrix (#599)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:43 +08:00
Gaius 90c6a8287c
chore: add compatibility test workflow (#594)
* chore: add compatibility test workflow

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:42 +08:00
zzy987 15c37f99e7
chore: add copyright (#593)
* chore: add copyright

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: ci

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:42 +08:00
zzy987 74696f3109
Add preheat e2e test (#582)
* feat: create preheat_test.go

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add post request

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: try to fix header name

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: try fix page not found

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: try to install kubectl in cdn pod

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: remove sudo

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: put curl in manager

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: correct json content

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: correct request url

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: check curl result

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: correct request url

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: check the cmd string in github environment

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: use service

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: delete cluster-name

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: use " in header

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: curl command format

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: use idgen.taskid to get the filename

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: add an error message

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add concurrency test

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: ab use proxy

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add curl pod

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add function CurlCommand

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: variable usage

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: remove curl in cdn pod

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: modify code format

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: use curl in file-server

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: correct command in file-server

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: add a e2e-test, check if it is the reason of no preheat

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: can test preheat now

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: check result after concurrency test

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: add comments, add function check preheat result

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: delete e2e_test in e2e/manager

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: refactor curlCommand, add func getCDNs getFS

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* feat: add image preheat

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: rename functions

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* fix: delete functions, use stable task id in test

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:42 +08:00
Gaius 4963da47aa
test: print merge commit (#581)
* test: printf merge commit

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:39 +08:00
Gaius 38b6d7d833
test: compare image commit (#538)
* feat: compare image commit

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:35 +08:00
Jim Ma 300563bcca
Feature: support customize base image (#519)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
Gaius aff7951c47
test: E2E download concurrency (#467)
* test: E2E download concurrency

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:30:28 +08:00