8a8d6abaae
feat: move probe interval from scheduler config to client config ( #2462 )
...
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:58 +08:00
8c905d9b8d
feat: enable configuration of some directory modes for dfdaemon ( #2340 )
...
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
b5c5b5b2e6
feat: implement Enqueue and AverageRTT in probes.go ( #2393 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:53 +08:00
37c588608a
feat: remove security domain ( #2285 )
...
* feat: remove security domain
Remove security domain in dfdaemon and scheduler.
Remove SecurityGroup and SecurityRule table in manager.
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:46 +08:00
558d8527e5
fix: local dynconfig panic in Notify ( #2266 )
...
Fix local dynconfig panic in Notify and
add scheduler addr test in config.
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:45 +08:00
6ad8db588c
feat: local dynconfig notifies data in client ( #2264 )
...
Dfdaemon will fail the health check if there is no available scheduler address.
So in the case of local dynconfig, the address of scheduler should be passed.
For dfdaemon health check, please refer to https://github.com/dragonflyoss/Dragonfly2/pull/2130 .
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:45 +08:00
2cda1def7f
feat: rename HostName to Hostname ( #2205 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:40 +08:00
bf0a18230e
feat: change default value of dynconfig cache ( #2203 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:40 +08:00
c672e75ed8
test: add Validate test to scheduler config ( #2129 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:35 +08:00
6ae36555be
test: refactor client validate ut ( #2126 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:34 +08:00
a9df345d5b
test: add unit tests for DaemonConfig.Validate() ( #2119 )
...
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:34:34 +08:00
bbeba99da5
fix: validate daemon gcInterval config ( #2118 )
...
If gcInterval is set to 0s or negative value, dfdaemon will panic as
panic: non-positive interval for NewTicker
goroutine 132 [running]:
time.NewTicker(0x0?)
Fix it by validating it as well.
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:34:34 +08:00
f9759ca926
feat: dynconfig resolves addresses with host ( #2109 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:33 +08:00
1d1aec5e0d
refactor: support reload scheduler addresses for local Dynconfig in client ( #2107 )
...
feat: support reload scheduler addresses for local Dynconfig in client
Add OnNotify to client dynconfig, it will listen changes of the
local configuration.
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:33 +08:00
c10b6da498
feat: support reload scheduler addresses for local Dynconfig ( #2091 )
...
Dynconfig only supports refresh new configs from manager, but local
dynconfig is unable to reload scheduler addresses when local config file
is updated.
Now we introduce new Dynconfig method 'SetConfig()', which sets the
given DaemonOption to struct dynconfigLocal, and register it as a
watcher of WatchConfig(), which will reload config file periodically. So
that dynconfigLocal.GetResolveSchedulerAddrs() will get new scheduler
addresses.
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
2023-06-28 17:34:33 +08:00
304448009f
refactor: piece_dispatcher considering score of parent peer ( #1978 )
...
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:26 +08:00
7e69d8bed6
feat: support source client option ( #2008 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:25 +08:00
1666a17827
feat: remove NetTopology from scheduler and manager ( #2007 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:25 +08:00
d71c90f138
fix: manager typo ( #1995 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:24 +08:00
c89234e976
feat: add manager v2 api ( #1990 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:23 +08:00
2833353d0d
fix:scheduler's health client not close ( #1975 )
...
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:22 +08:00
008eeb980b
feat: add IPAddresses and DNSNames to sans of the cert ( #1930 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
731ecc1234
feat: change yaml field type from string to net.IP ( #1929 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
ff79c3148a
feat: random pieces download ( #1918 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:18 +08:00
ffa80c1eb9
refactor: dynconfig without Unmarshal ( #1926 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
91454c8a60
feat: remove callsystem and pattern ( #1925 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:17 +08:00
88f8f974ab
feat: client support 'priority' parameter ( #1911 )
...
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:17 +08:00
e1b89dc6f0
feat: add health check to service ( #1889 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:14 +08:00
a1b65218db
feat: optimize gc package ( #1855 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:12 +08:00
ef6ad12587
feat: add announcer to scheduler ( #1854 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:12 +08:00
2421ce88f4
feat: add announcer to dfdameon ( #1852 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
43b9c39149
feat: when dfdaemon disable object storage, dynconfig can't fetch manager ( #1845 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
f194f0961f
feat: scheduler adds announce host handler ( #1843 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
0f8b75808a
feat: add timeout grpc and job ( #1830 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:10 +08:00
ba58047871
feat: optional save list metadata to p2p ( #1822 )
...
* feat: save list metadata to p2p
* chore: optimize rpc download worker logic
* feat: add expire header reclaim logic
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:09 +08:00
4bd7d413f2
feat: add workHome and pluginDir to configuration ( #1807 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:08 +08:00
0e83c7f58f
feat: add otel trace in log ( #1804 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:07 +08:00
876c2ae17e
feat: support split running tasks ( #1794 )
...
* feat: support split running tasks
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: go tests
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: add split runnging tasks e2e config
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: actions
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: actions
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: optimize get running tasks logic
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* chore: optimize get running tasks logic
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:06 +08:00
327cf4493e
feat: add TaskStateLeave to task ( #1728 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
491b309620
feat: support concurrent recursive download ( #1714 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:59 +08:00
9573d5a659
fix: docker compose config ( #1713 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:59 +08:00
bc8d623b3d
feat: add traffic shaper for download tasks ( #1654 )
...
Signed-off-by: greenhandatsjtu <sunhengke@sjtu.edu.cn>
2023-06-28 17:33:59 +08:00
9f098362fb
refactor: pkg basic ( #1712 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:58 +08:00
89376d6c4e
feat: ipv6 support ( #1685 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
3764af25f3
feat: change dfdaemon rate limit ( #1661 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:54 +08:00
da06e48d3e
feat: change storage strategy to simple ( #1658 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:53 +08:00
563f892b0d
feat: add missing client version for ListSchedulers ( #1657 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:53 +08:00
b6c395a6cb
feat: add cert spec to security configuration ( #1621 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:51 +08:00
4d9261af7d
feat: check whether scheduler is in the same cluster ( #1620 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
13580f89f2
refactor: dfpath for certify cache dir ( #1618 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
dlut_xz