776a0fef42
feat: concurrent multiple pieces back source ( #1426 )
...
* feat: concurrent multiple pieces back source
* chore: update http source client
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:33 +08:00
0222649b88
feat: update namely/protoc-all image version to 1.47_0 ( #1418 )
...
* feat: update namely/protoc-all image version to 1.47_0
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate mock file
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
ad36eb64a7
feat: remove github/pkg/errors package ( #1416 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
3682b26647
feat: in tree plugin ( #1276 )
...
* feat: in tree plugin
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:16 +08:00
a95edf5e0d
feat: change source client dialer config ( #1115 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:01 +08:00
f16c5592ab
feat: change back-to-source timeout ( #1112 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:00 +08:00
c38bba2612
feat: merge same tasks in daemon ( #977 )
...
* feat: merge same tasks in daemon
* test: add tiny file test in daemon
* fix: when validate digest disabled, did not store metadata
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:49 +08:00
beaf4ce18d
feat: update source.Response and source client interface ( #945 )
...
* feat: update source.Response and source client interface
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:48 +08:00
062687e4c7
feat: support recursive download in dfget ( #932 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:47 +08:00
705c5ed342
fix: plugin dir is empty ( #922 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:46 +08:00
eaca95d24e
Load source plugins ( #894 )
...
* unit test
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:44 +08:00
c2c721bc78
refactor: dfpath pkg ( #879 )
...
* feat: dfpath
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfpath
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: path
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: plugin
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:43 +08:00
929fe7db2d
Fix load source plugins ( #892 )
...
* load source plugins
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:43 +08:00
ff3a542fde
chore: update UnknownSourceFileLen ( #888 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:43 +08:00
46105b0986
unify back source interface ( #877 )
...
* unify back source interface
Signed-off-by: sunwp <244372610@qq.com>
* metaData Spelling correction
Signed-off-by: sunwp <244372610@qq.com>
* hdfs compile
Signed-off-by: sunwp <244372610@qq.com>
* hdfs compile
Signed-off-by: sunwp <244372610@qq.com>
* hdfs unit test
Signed-off-by: sunwp <244372610@qq.com>
* reset fqdn
Signed-off-by: sunwp <244372610@qq.com>
* new seed task with header
Signed-off-by: sunwp <244372610@qq.com>
* unify back source interface
Signed-off-by: sunwp <244372610@qq.com>
* add unit tests & rename CheckRespCode -> CheckResponseCode & rename GetLastModifiedMillis -> GetLastModified
Signed-off-by: sunwp <244372610@qq.com>
* add request test
Signed-off-by: sunwp <244372610@qq.com>
* golang lint
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:42 +08:00
0ad1bf9674
Fix: source plugin not loaded ( #811 )
...
* fix: source plugin not loaded
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:36 +08:00
fdf2b688fa
feat: back source when no available peers or scheduler error ( #521 )
...
* feature: back source when no available peers
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:34 +08:00
7b8aaf6b31
Refactor scheduler ( #369 )
...
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:30:29 +08:00
4751a92db6
feat: CDN implementation supports HDFS type storage ( #420 )
...
Signed-off-by: lengrongfu <lengrongfu@meituan.com>
2023-06-28 17:30:27 +08:00
402f1eb397
fix: log specification ( #452 )
...
Signed-off-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
Co-authored-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
2023-06-28 17:30:27 +08:00
158ea2ec4a
fix: wrong cache header ( #423 )
...
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:28:03 +08:00
2d825f5a96
feat: Add plugin support for resource ( #291 )
...
* feature: add plugin support for resource
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: skip link for mockgen import
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* feature: add generate in Makefile
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: remove unused package
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: remove unused test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* feature: remove unused import package
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:28:01 +08:00
5175e8009a
Fix: infinite recursion in MkDirAll ( #358 )
...
* fix: infinite recursion in MkDirAll
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* disable manager test, enable cdn test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:27:51 +08:00
6cce5a9872
Feature/code spec ( #336 )
...
* Modify the code according to https://github.com/uber-go/guide/blob/master/style.md
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:24:44 +08:00
155ee02a54
Add CDN unit-tests ( #338 )
...
* feat: refactor cdn storage module & remove unused ctx & cdn test
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:43 +08:00
Jim Ma