Commit Graph

16 Commits

Author SHA1 Message Date
sunwp 25f8cd56dd
Fix hdfs write (#948)
* rename reader to limitedReader

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:49 +08:00
Jim Ma beaf4ce18d
feat: update source.Response and source client interface (#945)
* feat: update source.Response and source client interface

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:48 +08:00
sunwp 0a152e01e9
Fix HDFS File reader (#940)
* remove unused hdfs writeTo method

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:48 +08:00
Eng Zer Jun f579d3c9ce
refactor: move from io/ioutil to io and os packages (#906)
* chore: run `go fmt ./...`

This commit synchronizes `//go:build` lines with `// +build` lines.

Reference: https://go.googlesource.com/proposal/+/master/design/draft-gobuild.md
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>

* refactor: move from io/ioutil to io and os packages

The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil. This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2023-06-28 17:32:45 +08:00
Jim Ma 10ec7d2bbc
fix: go plugin test build error (#912)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:45 +08:00
sunwp 0096c613b0
Fix hdfs test (#902)
* unit test

Signed-off-by: sunwp <244372610@qq.com>

* fix hdfs range test

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:44 +08:00
sunwp 23747be9d3
unit test (#898)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:44 +08:00
Jim Ma ff3a542fde
chore: update UnknownSourceFileLen (#888)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:43 +08:00
sunwp 46105b0986
unify back source interface (#877)
* unify back source interface

Signed-off-by: sunwp <244372610@qq.com>

* metaData Spelling correction

Signed-off-by: sunwp <244372610@qq.com>

* hdfs compile

Signed-off-by: sunwp <244372610@qq.com>

* hdfs compile

Signed-off-by: sunwp <244372610@qq.com>

* hdfs unit test

Signed-off-by: sunwp <244372610@qq.com>

* reset fqdn

Signed-off-by: sunwp <244372610@qq.com>

* new seed task with header

Signed-off-by: sunwp <244372610@qq.com>

* unify back source interface

Signed-off-by: sunwp <244372610@qq.com>

* add unit tests & rename CheckRespCode -> CheckResponseCode & rename GetLastModifiedMillis -> GetLastModified

Signed-off-by: sunwp <244372610@qq.com>

* add request test

Signed-off-by: sunwp <244372610@qq.com>

* golang lint

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:42 +08:00
Jim Ma 806f2ef11d
feat: calculate piece metadata digest (#787)
* feat: calculate piece metadata digest
* fix: back source not work in midway
* chore: add partial back source test
* chore: optimize digest log

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:35 +08:00
Jim Ma 3d63ab2ca3
chore: update golang import lint (#780)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:34 +08:00
sunwp 359d11367e
chore: rename cdnsystem to cdn (#626)
Signed-off-by: santong <244372610@qq.com>
2023-06-28 17:31:46 +08:00
zzy987 15c37f99e7
chore: add copyright (#593)
* chore: add copyright

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>

* chore: ci

Signed-off-by: zzy987 <67889264+zzy987@users.noreply.github.com>
2023-06-28 17:31:42 +08:00
sunwp 2d8eb59005
Adjust package structure (#539)
* feat: package structure adjust

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:31:36 +08:00
lengrongfu 4751a92db6
feat: CDN implementation supports HDFS type storage (#420)
Signed-off-by: lengrongfu <lengrongfu@meituan.com>
2023-06-28 17:30:27 +08:00
Jim Ma 5175e8009a
Fix: infinite recursion in MkDirAll (#358)
* fix: infinite recursion in MkDirAll

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* disable manager test, enable cdn test

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:27:51 +08:00