10ec7d2bbc
fix: go plugin test build error ( #912 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:45 +08:00
eaca95d24e
Load source plugins ( #894 )
...
* unit test
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:44 +08:00
0096c613b0
Fix hdfs test ( #902 )
...
* unit test
Signed-off-by: sunwp <244372610@qq.com>
* fix hdfs range test
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:44 +08:00
23747be9d3
unit test ( #898 )
...
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:44 +08:00
c2c721bc78
refactor: dfpath pkg ( #879 )
...
* feat: dfpath
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfpath
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: path
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: plugin
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:43 +08:00
929fe7db2d
Fix load source plugins ( #892 )
...
* load source plugins
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:43 +08:00
ff3a542fde
chore: update UnknownSourceFileLen ( #888 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:43 +08:00
46105b0986
unify back source interface ( #877 )
...
* unify back source interface
Signed-off-by: sunwp <244372610@qq.com>
* metaData Spelling correction
Signed-off-by: sunwp <244372610@qq.com>
* hdfs compile
Signed-off-by: sunwp <244372610@qq.com>
* hdfs compile
Signed-off-by: sunwp <244372610@qq.com>
* hdfs unit test
Signed-off-by: sunwp <244372610@qq.com>
* reset fqdn
Signed-off-by: sunwp <244372610@qq.com>
* new seed task with header
Signed-off-by: sunwp <244372610@qq.com>
* unify back source interface
Signed-off-by: sunwp <244372610@qq.com>
* add unit tests & rename CheckRespCode -> CheckResponseCode & rename GetLastModifiedMillis -> GetLastModified
Signed-off-by: sunwp <244372610@qq.com>
* add request test
Signed-off-by: sunwp <244372610@qq.com>
* golang lint
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:42 +08:00
0ad1bf9674
Fix: source plugin not loaded ( #811 )
...
* fix: source plugin not loaded
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:36 +08:00
806f2ef11d
feat: calculate piece metadata digest ( #787 )
...
* feat: calculate piece metadata digest
* fix: back source not work in midway
* chore: add partial back source test
* chore: optimize digest log
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:35 +08:00
3d63ab2ca3
chore: update golang import lint ( #780 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:34 +08:00
52cf43a31d
feat: clear hashcircler and maputils package ( #768 )
...
* feat: clear hashcircler and maputils package
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:33 +08:00
359d11367e
chore: rename cdnsystem to cdn ( #626 )
...
Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:46 +08:00
376219a78b
feat: beautify scheduler & CDN log ( #618 )
...
* feat: beautify scheduler & CDN log
Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:45 +08:00
15c37f99e7
chore: add copyright ( #593 )
...
* chore: add copyright
Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
* chore: ci
Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:42 +08:00
f65275d896
feat: skip verify when back to source ( #586 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:31:39 +08:00
2d8eb59005
Adjust package structure ( #539 )
...
* feat: package structure adjust
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:31:36 +08:00
fdf2b688fa
feat: back source when no available peers or scheduler error ( #521 )
...
* feature: back source when no available peers
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:31:34 +08:00
7b8aaf6b31
Refactor scheduler ( #369 )
...
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:30:29 +08:00
4751a92db6
feat: CDN implementation supports HDFS type storage ( #420 )
...
Signed-off-by: lengrongfu <lengrongfu@meituan.com>
2023-06-28 17:30:27 +08:00
402f1eb397
fix: log specification ( #452 )
...
Signed-off-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
Co-authored-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
2023-06-28 17:30:27 +08:00
158ea2ec4a
fix: wrong cache header ( #423 )
...
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:28:03 +08:00
2d825f5a96
feat: Add plugin support for resource ( #291 )
...
* feature: add plugin support for resource
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: skip link for mockgen import
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* feature: add generate in Makefile
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: remove unused package
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* fix: remove unused test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* feature: remove unused import package
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:28:01 +08:00
f344a0c566
Repair wrong piece info ( #382 )
...
* cdn error definition
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
* fix: write wrong piece info
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:27:59 +08:00
5175e8009a
Fix: infinite recursion in MkDirAll ( #358 )
...
* fix: infinite recursion in MkDirAll
Signed-off-by: Jim Ma <majinjing3@gmail.com>
* disable manager test, enable cdn test
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:27:51 +08:00
6cce5a9872
Feature/code spec ( #336 )
...
* Modify the code according to https://github.com/uber-go/guide/blob/master/style.md
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:24:44 +08:00
155ee02a54
Add CDN unit-tests ( #338 )
...
* feat: refactor cdn storage module & remove unused ctx & cdn test
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:22:43 +08:00
Jim Ma