dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,653 Commits 5 Branches 281 Tags 98 MiB
Commit Graph

48 Commits

Author SHA1 Message Date
Jim Ma bb29a234f4
chore: update dfget recursive log (#2459) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:34:58 +08:00
Jim Ma 94a7c7639f
feat: update resource director (#2243) 
* feat: update resource director
* chore: add digest check for oras

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:34:44 +08:00
Jim Ma 144335ffb1
feat: add authinfo injector (#2149) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:34:43 +08:00
Gaius 7dc3c826f2
feat: add v2 version of dfdaemon client (#2050) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:29 +08:00
Gaius 91454c8a60
feat: remove callsystem and pattern (#1925) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:17 +08:00
cuidajun 88f8f974ab
feat: client support 'priority' parameter (#1911) 
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
 2023-06-28 17:34:17 +08:00
Jim Ma 5040af8b4f
feat: add s3 resource client and recursive e2e test (#1826) 
* feat: add s3 resource client
* chore: add minio server and recursive e2e test
* chore: add download grpc test tool

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:34:09 +08:00
Gaius 58f7bbbb9f
refactor: idgen pkg (#1715) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:59 +08:00
Gaius 9f098362fb
refactor: pkg basic (#1712) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:58 +08:00
Jim Ma 89376d6c4e
feat: ipv6 support (#1685) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:57 +08:00
Gaius a6a44269b4
refactor: dfdaemon client and remove rpc connection pool (#1576) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:46 +08:00
cuidajun 242fb2bc37
add application-level statistics (#1559) 
Signed-off-by: bigerous <bigerous@qq.com>
 2023-06-28 17:33:45 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:41 +08:00
cuidajun 8173c11d3a
fix oss client download bug; support oss recursive download; (#1448) 
* feat: dfget support oss recursive download

Signed-off-by: bigerous <bigerous@qq.com>

* refactor recursive download

Signed-off-by: bigerous <bigerous@qq.com>

* remove URLEntry interface, use simple struct

Signed-off-by: bigerous <bigerous@qq.com>
 2023-06-28 17:33:36 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418) 
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:32 +08:00
Gaius ad36eb64a7
feat: remove github/pkg/errors package (#1416) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:31 +08:00
Gaius 15d3274224
feat: rename digest func and add new digest func (#1405) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:29 +08:00
Gaius e66b567eed
refactor: digest package (#1403) 
* refactor: digest package

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:29 +08:00
Gaius 7a30db3fba
refactor: pkg util (#1402) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:29 +08:00
greenhandatsjtu 69f5d61e99
fix: downloadFromSource() doesn't validate response (#1400) 
Signed-off-by: greenhandatsjtu <sunhengke@sjtu.edu.cn>
 2023-06-28 17:33:29 +08:00
1037husterljx 512f242a4a
fix: dfget ratelimit params (#1391) 
Signed-off-by: ljx373327 <ljx373327@alibaba-inc.com>
 2023-06-28 17:33:28 +08:00
yxxhero 7446cf45fa
feat: replace time.Now().Sub by time.Since (#1173) 
Signed-off-by: yxxhero <aiopsclub@163.com>
 2023-06-28 17:33:07 +08:00
Jim Ma 4597f74283
feat: merge ranged request storage into parent (#1078) 
* feat: merge ranged request storage into parent

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:59 +08:00
Jim Ma f80c75efdb
Feature: prefetch ranged requests (#1053) 
1. implement prefetch ranged requests
2. optimize exact http code in transport
3. simplify reuse peer task logic
4. reuse peer task for ranged request size error
5. fix data race for peer task storage

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:56 +08:00
Jim Ma beaf4ce18d
feat: update source.Response and source client interface (#945) 
* feat: update source.Response and source client interface

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:48 +08:00
Jim Ma 062687e4c7
feat: support recursive download in dfget (#932) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:47 +08:00
Gaius cb4202319e
feat: make idgen package public (#931) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:47 +08:00
Eng Zer Jun f579d3c9ce
refactor: move from io/ioutil to io and os packages (#906) 
* chore: run `go fmt ./...`

This commit synchronizes `//go:build` lines with `// +build` lines.

Reference: https://go.googlesource.com/proposal/+/master/design/draft-gobuild.md
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>

* refactor: move from io/ioutil to io and os packages

The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil. This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
 2023-06-28 17:32:45 +08:00
sunwp 46105b0986
unify back source interface (#877) 
* unify back source interface

Signed-off-by: sunwp <244372610@qq.com>

* metaData Spelling correction

Signed-off-by: sunwp <244372610@qq.com>

* hdfs compile

Signed-off-by: sunwp <244372610@qq.com>

* hdfs compile

Signed-off-by: sunwp <244372610@qq.com>

* hdfs unit test

Signed-off-by: sunwp <244372610@qq.com>

* reset fqdn

Signed-off-by: sunwp <244372610@qq.com>

* new seed task with header

Signed-off-by: sunwp <244372610@qq.com>

* unify back source interface

Signed-off-by: sunwp <244372610@qq.com>

* add unit tests & rename CheckRespCode -> CheckResponseCode & rename GetLastModifiedMillis -> GetLastModified

Signed-off-by: sunwp <244372610@qq.com>

* add request test

Signed-off-by: sunwp <244372610@qq.com>

* golang lint

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:32:42 +08:00
sunwp c1d84fb56d
validate grpc model (#825) 
* base validate

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:32:40 +08:00
Jim Ma 3d63ab2ca3
chore: update golang import lint (#780) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:34 +08:00
加菲 cddd25e908
fix: adjust dfget download log (#564) 
* fix: adjust dfget download log

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
 2023-06-28 17:31:37 +08:00
zzy987 39ce5d98c0
let cdn support sha256 (#517) 
cdn support sha256 digest
 2023-06-28 17:31:34 +08:00
lengrongfu 4751a92db6
feat: CDN implementation supports HDFS type storage (#420) 
Signed-off-by: lengrongfu <lengrongfu@meituan.com>
 2023-06-28 17:30:27 +08:00
zzy987 402f1eb397
fix: log specification (#452) 
Signed-off-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>

Co-authored-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
 2023-06-28 17:30:27 +08:00
加菲 eda5839eb8
Fix client dfget bug and support digest (#432) 
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
 2023-06-28 17:30:26 +08:00
Jim Ma 777e98784e
feature: export peer.TaskManager for embedding dragonfly in custom binary (#434) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:30:19 +08:00
加菲 cab5ed6d2e
Feature/dfget param (#373) 
* update image for arch

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>

* feature: adjust dfget grpc param

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
 2023-06-28 17:27:59 +08:00
sunwp 6cce5a9872
Feature/code spec (#336) 
* Modify the code according to https://github.com/uber-go/guide/blob/master/style.md

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:24:44 +08:00
Louhwz 10958e52cf
fix: check health too long when dfdaemon is unavailable (#344) 
Signed-off-by: louhwz <872188659@qq.com>
 2023-06-28 17:22:43 +08:00
sunwp 155ee02a54
Add CDN unit-tests (#338) 
* feat: refactor cdn storage module & remove unused ctx & cdn test

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:22:43 +08:00
yxxhero 6a7259e663
Unified error handling style (#302) 
Signed-off-by: yxxhero <aiopsclub@163.com>
 2023-06-28 17:22:40 +08:00
Gaius 0974e54e4d
small PR for code optimization. (#294) (#295) 
Signed-off-by: yxxhero <aiopsclub@163.com>

Co-authored-by: yxxhero <11087727+yxxhero@users.noreply.github.com>
 2023-06-28 17:22:40 +08:00
Gaius f9b4d77bb2
Fix golang lint (#249) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:22:38 +08:00
加菲 37157f1d45
refactor: remove benchmark-rate and rename not-back-source (#245) 
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
 2023-06-28 17:22:38 +08:00
Gaius 7e595898e5
Fix lint (#244) 
* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: lint hostIP

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: error check

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: nil pointer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename taskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename peerID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: taskID

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: licenses

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: golangci-lint

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:22:37 +08:00
加菲 19e70ecce8
refactor: support multi digest not only md5 (#236) 
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
 2023-06-28 17:22:37 +08:00
加菲 f592032f72
Refactor cmd (#217) 
* refator:cmd and path 

Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
 2023-06-28 17:22:37 +08:00