Commit Graph

1907 Commits

Author SHA1 Message Date
Jim Ma d0ca987798
fix: reuse non-end range request (#1333)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:22 +08:00
Gaius dc3eedf4f3
fix: http range header validation (#1334)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:22 +08:00
Gaius acf5e59b81
chore: check large files in pull request (#1332)
* chore: check large files

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:22 +08:00
Gaius 8ddd197367
test: watchdog
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:22 +08:00
Gaius 3e8072daaa
fix: nfpms maintainer (#1326)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:22 +08:00
Jim Ma 3c6af10433
feat: add sync piece watchdog (#1272)
* feat: add sync piece watchdog

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:21 +08:00
Gaius 3fa7c7be75
feat: scheduler handles seed peer failed (#1325)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:21 +08:00
Gaius 3bd1f03c43
feat: custom preheat tag parameters (#1324)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:21 +08:00
Gaius 605865d3a9
feat: client add tls verify config (#1323)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:21 +08:00
Gaius 5707d86e6b
feat: scheduler register interface return task type (#1318)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:21 +08:00
Jim Ma 3a9f160e7a
fix: reuse seed panic (#1319)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:21 +08:00
Jim Ma 1a8b293a66
fix: seed peer did not send done seed result and no content length send (#1316)
fix: seed peer did not send done seed result
fix: unknown length back source seed did not send content length to other peers

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:21 +08:00
Gaius abe46a2c23
test: close dfget back-to-souce (#1317)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
Gaius b64412515a
feat: get active peer count (#1315)
* feat: get active peer count

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add peers handler

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
Gaius 999f5919c6
feat: reduce dynconfig log (#1312)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
Gaius 2a0314e45b
refactor: scheduler grpc (#1310)
* refactor: scheduler grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
Jim Ma f3750b1ac0
feat: back source when receive seed request (#1309)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:20 +08:00
Gaius 3556a0f9d4
feat: update helm charts submodule (#1308)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
Eryu Guan f7e06c717d
feat: add vsock network type support (#1303)
So we support connecting dfdaemon running on host outside of VM via
virtio-vsock device.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:33:20 +08:00
Jim Ma 823c722c3e
feat: support response header (#1292)
* feat: support response header via ExtendAttribute
* chore: update http pass through header
* chore: update ExtendAttribute in cdn downloader

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:19 +08:00
Eryu Guan ce718920c6
fix: remove container after generating protoc (#1306)
Add '--rm' option to docker command, so container will be removed
automatically. Otherwise we'll have many exited but not removed
containers as we run 'make protoc'.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:33:19 +08:00
Gaius faa5e4e465
feat: add seed peer logic (#1302)
* feat: announce seed peer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn logic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn job

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfdaemon change host uuid to host id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go generate mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn compatibility

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change docker compose

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: reuse panic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: compatible with v2.0.3-beta.2

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00
Jim Ma 26cd8f0e22
fix: digest reader and unit tests (#1305)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:19 +08:00
Jim Ma c6bd71cc93
feat: support more digest like sha256 (#1304)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:19 +08:00
Jim Ma 429252a071
feat: implement pattern in client daemon (#1231)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:19 +08:00
Gaius 9c1e05983a
feat: scheduler add seed peer (#1298)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
Eryu Guan 77225e1633
feat: don't gc client rpc connection if ExpireTime is 0 (#1296)
In case we don't want to GC client connections in some special
circumstances.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:33:18 +08:00
Gaius 8724f49e07
fix: scheduler typo (#1297)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
Gaius 09f133fc48
feat: update scheduler PeerResult validation (#1294)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
Gaius 2cfbb91174
feat: manager add seed peer (#1293)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
Jim Ma 49f9ebde68
feat: implement client seed mode (#1247)
* feat: implement client seed mode

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:18 +08:00
Jim Ma 474a8d0e5c
fix: keep accept header (#1291)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:18 +08:00
Gaius 3b0005a052
fix: grpc total_piece_count comment (#1289)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
Gaius 4109aec042
feat: scheduler peer result validation (#1288)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:17 +08:00
Gaius ca8961ed09
refactor: scheduler task SizeScope (#1287)
* refactor: scheduler task SizeScope

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:17 +08:00
zzy987 cc5e1f7d27
feat: use a golang native file server to replace nginx (#1258)
* feat: use a golang native file server to replace nginx

Signed-off-by: zzy987 <nevermind@sjtu.edu.cn>
2023-06-28 17:33:17 +08:00
AnJia b39a0a0cdc
fix: run.sh threw error on mac (#1285)
Signed-off-by: AnJia <anjia0532@gmail.com>
2023-06-28 17:33:17 +08:00
Jim Ma 4e08126f55
feat: support build arm&&arm64 dfget (#1286)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:17 +08:00
Gaius 8b9230ae88
fix: docker compose run.sh (#1282)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:17 +08:00
Gaius 4497de122a
fix: legacy cdn peer (#1283)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:17 +08:00
Gaius 68040e2b0f
feat: update filter parent (#1279)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:17 +08:00
Jim Ma afdac331bb
chore: add target peer id in sync piece trace (#1278)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:16 +08:00
Gaius 6fac39b3ca
fix: filter parent condition (#1277)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:16 +08:00
Jim Ma 3682b26647
feat: in tree plugin (#1276)
* feat: in tree plugin

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:16 +08:00
Jim Ma 8fdf52cdc5
fix: dfget daemon console log invalid (#1275)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:16 +08:00
Gaius 7acb092706
fix: scheduler config validation (#1274)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:16 +08:00
AnJia 341b8610e1
fix: run.sh threw error on mac (#1273)
Signed-off-by: AnJia <anjia0532@gmail.com>
2023-06-28 17:33:16 +08:00
Gaius 913b534668
fix: tree infinite loop (#1271)
* fix: peer tree infinite loop

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: peer add Ancestors func

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:16 +08:00
Jim Ma 16759c0339
chore: optimize create synchronizer logic (#1269)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:16 +08:00
Gaius 51ea3c5641
test: fix storage backups (#1270)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:16 +08:00