37c588608a
feat: remove security domain ( #2285 )
...
* feat: remove security domain
Remove security domain in dfdaemon and scheduler.
Remove SecurityGroup and SecurityRule table in manager.
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:46 +08:00
cc42334e4d
fix: backsource first piece timeout ( #2083 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:31 +08:00
79024c87ca
refactor: parse http range ( #2071 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
f7a399b47a
feat: add v2 version of the idgen ( #2056 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:29 +08:00
304448009f
refactor: piece_dispatcher considering score of parent peer ( #1978 )
...
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:26 +08:00
1666a17827
feat: remove NetTopology from scheduler and manager ( #2007 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:25 +08:00
2c8ecac6e2
fix: dferror not convert ( #2001 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:24 +08:00
e83fb85216
feat: add v2 verison of the grpc to scheduler ( #1999 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:24 +08:00
acdb05ccba
fix: daemon recognize Code_SchedForbidden ( #1994 )
...
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:24 +08:00
004d237537
feat: corrupt data check ( #1946 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:20 +08:00
9c8d82e294
feat: create synchronizers concurrently ( #1941 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:19 +08:00
7cb802aeb7
feat: remove legacy peers support ( #1939 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:19 +08:00
ff79c3148a
feat: random pieces download ( #1918 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:18 +08:00
f528df2b0a
chore: optimize reregister ( #1888 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:14 +08:00
0a8f5118c9
feat: support reregister peer task in client ( #1876 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:13 +08:00
7e90f43a53
chore: update dst peer log ( #1844 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:11 +08:00
6fd389c27a
fix: otel goroutine leak ( #1815 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:08 +08:00
0e83c7f58f
feat: add otel trace in log ( #1804 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:07 +08:00
876c2ae17e
feat: support split running tasks ( #1794 )
...
* feat: support split running tasks
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: go tests
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: add split runnging tasks e2e config
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: actions
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: actions
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: optimize get running tasks logic
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: optimize get running tasks logic
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:06 +08:00
c9bfe9eb08
feat: unregister failed task storage ( #1717 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:00 +08:00
bc8d623b3d
feat: add traffic shaper for download tasks ( #1654 )
...
Signed-off-by: greenhandatsjtu <sunhengke@sjtu.edu.cn>
2023-06-28 17:33:59 +08:00
73de99353d
feat: empty file e2e ( #1687 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:56 +08:00
7224801bae
feat: refactor peertask option ( #1600 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:48 +08:00
ecfe467585
feat: add client grpc dial timeout ( #1599 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:48 +08:00
717ac99ef5
feat: daemon support auto issue certificate ( #1586 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:48 +08:00
a6a44269b4
refactor: dfdaemon client and remove rpc connection pool ( #1576 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
25e929142f
chore: optimize source error log ( #1553 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:44 +08:00
f6506115a7
feat: support grpc recursive download ( #1518 )
...
* feat: daemon grpc recursive download
* fix: init storage error
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:42 +08:00
d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api ( #1515 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
3b539f9abf
fix: wait first peer packet fail ( #1500 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:39 +08:00
de35b14db9
fix: one piece task sometimes backsource after succeed ( #1499 )
...
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:39 +08:00
ed4c381383
feat: rename steal peers to candidate peers ( #1476 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
8cf344992f
feat: if peer back-to-source failed, return source metadata. ( #1444 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
3c107f9add
feat: report peer result with source error detail ( #1439 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:34 +08:00
cf7debf9c4
feat: back source error detail ( #1437 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:34 +08:00
776a0fef42
feat: concurrent multiple pieces back source ( #1426 )
...
* feat: concurrent multiple pieces back source
* chore: update http source client
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:33 +08:00
3b426d2c54
feat: rename client/clientutil to client/util ( #1420 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
ad36eb64a7
feat: remove github/pkg/errors package ( #1416 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
15d3274224
feat: rename digest func and add new digest func ( #1405 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
7a30db3fba
refactor: pkg util ( #1402 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
f688d341bd
feat: remove cdn ( #1401 )
...
* feat: remove cdn
Signed-off-by: Gaius <gaius.qi@gmail.com>
* docs: generate swagger
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
a3bc931850
fix: register fail panic ( #1351 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:25 +08:00
3c6af10433
feat: add sync piece watchdog ( #1272 )
...
* feat: add sync piece watchdog
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:21 +08:00
1a8b293a66
fix: seed peer did not send done seed result and no content length send ( #1316 )
...
fix: seed peer did not send done seed result
fix: unknown length back source seed did not send content length to other peers
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:21 +08:00
2a0314e45b
refactor: scheduler grpc ( #1310 )
...
* refactor: scheduler grpc
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate protoc
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
823c722c3e
feat: support response header ( #1292 )
...
* feat: support response header via ExtendAttribute
* chore: update http pass through header
* chore: update ExtendAttribute in cdn downloader
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:19 +08:00
faa5e4e465
feat: add seed peer logic ( #1302 )
...
* feat: announce seed peer
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn logic
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn job
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfdaemon change host uuid to host id
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: go generate mocks
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn compatibility
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: change docker compose
Signed-off-by: Gaius <gaius.qi@gmail.com>
* fix: reuse panic
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: compatible with v2.0.3-beta.2
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00
49f9ebde68
feat: implement client seed mode ( #1247 )
...
* feat: implement client seed mode
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:18 +08:00
16759c0339
chore: optimize create synchronizer logic ( #1269 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:16 +08:00
4d3e4e703f
fix: acquire empty dst pid ( #1268 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:15 +08:00
Gaius