sunwp
67d6fb970f
Fix empty client output path ( #1159 )
...
* If the client output parameter is not specified, the client cannot automatically obtain the target file path
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:06 +08:00
sunwp
ff134d0a48
fix daemon scheduler option validate bug ( #1152 )
...
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:04 +08:00
Jim Ma
ebc1aff720
feat: support health probe in daemon ( #1120 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:01 +08:00
Jim Ma
4597f74283
feat: merge ranged request storage into parent ( #1078 )
...
* feat: merge ranged request storage into parent
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:59 +08:00
Jim Ma
f80c75efdb
Feature: prefetch ranged requests ( #1053 )
...
1. implement prefetch ranged requests
2. optimize exact http code in transport
3. simplify reuse peer task logic
4. reuse peer task for ranged request size error
5. fix data race for peer task storage
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma
c3951e0cb3
feat: trace https proxy request ( #996 )
...
* feat: trace https proxy request
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: daemon test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:51 +08:00
Gaius
54d6542aa6
feat: change task and peer ttl ( #984 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
Gaius
97c1eb65e7
Refactor scheduler service ( #958 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
Jim Ma
c38bba2612
feat: merge same tasks in daemon ( #977 )
...
* feat: merge same tasks in daemon
* test: add tiny file test in daemon
* fix: when validate digest disabled, did not store metadata
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:49 +08:00
Jim Ma
a54ae4fae4
feat: add default DiskGCThresholdPercent and ignore it when is 0 ( #971 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:49 +08:00
Christian Bourgeois
b4cc13db41
feat: Add useProxies to registryMirror allowing to mirror more anything ( #965 )
...
* feat: add useProxies to registryMirror to allow mirroring anything
Signed-off-by: momiji <teq1uila-free01@yahoo.fr>
2023-06-28 17:32:49 +08:00
Jim Ma
38178804e8
feat: add daemon metrics support ( #960 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:48 +08:00
Jim Ma
b7f8ad4e20
feat: support disk usage gc in client ( #953 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:48 +08:00
Jim Ma
062687e4c7
feat: support recursive download in dfget ( #932 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:47 +08:00
Jim Ma
7ba341fc5c
fix: infinitely get pieces when piece num is invalid ( #926 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:47 +08:00
Eng Zer Jun
f579d3c9ce
refactor: move from io/ioutil to io and os packages ( #906 )
...
* chore: run `go fmt ./...`
This commit synchronizes `//go:build` lines with `// +build` lines.
Reference: https://go.googlesource.com/proposal/+/master/design/draft-gobuild.md
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
* refactor: move from io/ioutil to io and os packages
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2023-06-28 17:32:45 +08:00
Gaius
9800a211da
feat: add data directory ( #910 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:44 +08:00
Gaius
c2c721bc78
refactor: dfpath pkg ( #879 )
...
* feat: dfpath
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfpath
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: path
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: plugin
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:43 +08:00
Jim Ma
540cd233a0
feat: support customize transport in daemon ( #866 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:41 +08:00
Gaius
f6ce817b72
feat: move dfnet to internal ( #862 )
...
* feat: move dfnet to internal
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: rename dfutils to util
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:41 +08:00
Gaius
4459a02223
feat: get scheduler list with advertise ip ( #848 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:39 +08:00
Gaius
999097e4ed
feat: support mutli manager addrs ( #846 )
...
* feat: support mutli manager addrs (#844 )
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:39 +08:00
Gaius
613abf8861
feat: add package reachable ( #822 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:37 +08:00
Gaius
0cb14903b2
feat: scheduler and cdn report fqdn to manager ( #818 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:37 +08:00
Gaius
72213eb1d4
feat: dfdaemon get scheduler list dynamically from manager ( #812 )
...
* feat: dfdaemon get scheduler list dynamically from manager
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:37 +08:00
Jim Ma
3d63ab2ca3
chore: update golang import lint ( #780 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:34 +08:00
Jim Ma
6546115359
feat: support dump http content in client for debugging ( #770 )
...
* feat: support dump http content in client for debugging
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:33 +08:00
Jim Ma
6534659d74
chore: enable calculate digest ( #656 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:48 +08:00
Gaius
f46f370b32
feat: add piece download timeout ( #621 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:44 +08:00
sunwp
89fec9d5c0
feat: avoid report peer result fail due to context cancel & add backsource tracer ( #606 )
...
Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:43 +08:00
Jim Ma
37910d1fd7
feat: add sni proxy support ( #600 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:43 +08:00
Gaius
66e3ca538f
feat: optimize scheduler start server ( #558 )
...
* feat: optimize scheduler start server
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:37 +08:00
Jim Ma
fdf2b688fa
feat: back source when no available peers or scheduler error ( #521 )
...
* feature: back source when no available peers
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:34 +08:00
sunwp
4d49d77d5c
scheduler concurrent bug fix ( #513 )
...
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:31:33 +08:00
Jim Ma
0df064202e
Fix: proxy for stress testing tool ( #507 )
...
* chore: fix proxy for stress testing tool
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:33 +08:00
sunwp
6c8cf122f8
Rescheduler parent/children later when no candidates and add schedule log ( #497 )
...
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:30:29 +08:00
Jim Ma
45846893ce
feature: add multiple registry mirrors support ( #479 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:28 +08:00
Jim Ma
c4d306a6c3
fix: dead lock when pt.failedPieceCh is full ( #466 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:28 +08:00
zzy987
402f1eb397
fix: log specification ( #452 )
...
Signed-off-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
Co-authored-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
2023-06-28 17:30:27 +08:00
Jim Ma
975e8a9058
feature: rename PeerHost to Daemon in client ( #438 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:30:26 +08:00
加菲
eda5839eb8
Fix client dfget bug and support digest ( #432 )
...
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:30:26 +08:00
Jim Ma
35ff8da689
fix: update mapsturcture decode and remove unused config ( #396 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:28:01 +08:00
Jim Ma
5721554396
feature: update client config to Camel-Case format ( #393 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:28:01 +08:00
Jim Ma
a8a90edce0
feature: support setns in client ( #378 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:27:59 +08:00
Jim Ma
5175e8009a
Fix: infinite recursion in MkDirAll ( #358 )
...
* fix: infinite recursion in MkDirAll
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* disable manager test, enable cdn test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:27:51 +08:00
sunwp
6cce5a9872
Feature/code spec ( #336 )
...
* Modify the code according to https://github.com/uber-go/guide/blob/master/style.md
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:24:44 +08:00
Jim Ma
5b9c3033f8
Support peer task data multiplex ( #347 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:23:35 +08:00
加菲
a8e19098fc
Feature/base options ( #269 )
...
* refactor: wrapper jaeger with telemetry
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
* fix: viper parse common flags
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:22:39 +08:00
Gaius
b2e54875cc
Remove pidfile ( #261 )
...
* feat: remove pidfile
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove lockfile
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:39 +08:00
Gaius
f9b4d77bb2
Fix golang lint ( #249 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:22:38 +08:00