dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,186 Commits 5 Branches 281 Tags 98 MiB
Commit Graph

78 Commits

Author SHA1 Message Date
Gaius 501a7be05b
feat: trigger download task by stream (#3200) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-04-17 10:26:34 +08:00
Jim Ma 48846e2ff6
feat: peer exchange (#3141) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2024-04-09 18:29:57 +08:00
Gaius cce656a60b
feat: remove otel in client (#3169) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-04-08 17:26:25 +08:00
Gaius a7498d703c
feat: add leave host to dfdaemon (#3070) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2024-02-08 14:17:23 +08:00
realityone 9a1c74406a
fix potential deadlock in dynconfig resolver (#3024) 2024-01-16 11:02:40 +08:00
Gaius 6b93ef8e5e
feat: trigger download by task id (#2970) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-25 17:37:12 +08:00
Gaius 8f06364ee4
feat: add WithStatsHandler and StatsHandler replace deprecated func (#2959) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-19 20:18:48 +08:00
Gaius 0c591e46a3
feat: optimize trigger download task return empty (#2958) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-19 18:41:32 +08:00
Gaius ec66fd1229
feat: implement trigger download task by seed peer in v2 (#2957) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-19 16:18:02 +08:00
Gaius 003376c6d3
feat: optimize parameters in seed peer DownloadTask (#2947) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-19 11:37:00 +08:00
Gaius 1d75ddf3c0
chore: update api version to v2.0.59 (#2923) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-06 20:24:55 +08:00
Gaius 11829e35df
feat: update api version to v2.0.56 (#2891) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-11-21 14:02:24 +08:00
Gaius ef1be37ee2
feat: change ratelimit's DefaultQPS and DefaultBurst (#2872) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-11-09 22:25:00 +08:00
Gaius 12fc630612
fix: if scheduler has no seed peer, return error in preheating (#2835) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-10-30 16:45:39 +08:00
Gaius 3b55ae4300
fix: otelgrpc.UnaryClientInterceptor memory leak (#2772) 
fix: calling otelgrpc.UnaryClientInterceptor repeatedly creates multiple Int64Histogram resulting in a memory leak

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-10-08 16:20:46 +08:00
Gaius b3f23f71a3
feat: update dy7.io/api to v2 (#2558) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-07-20 23:17:57 +08:00
Jim Ma f5aff5e27f
feat: enhance daemon health check (#2130) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:34:35 +08:00
Gaius a5685582ce
refactor: resource task with v2 version of grpc (#2078) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:30 +08:00
Gaius 7dc3c826f2
feat: add v2 version of dfdaemon client (#2050) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:29 +08:00
Gaius c89234e976
feat: add manager v2 api (#1990) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:23 +08:00
Gaius 1edd36da59
feat: register reflection on grpc server (#1943) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:19 +08:00
Gaius 0f8b75808a
feat: add timeout grpc and job (#1830) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:10 +08:00
Gaius 0dedc36417
feat: grpc_retry removes WithPerRetryTimeout (#1763) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:03 +08:00
Gaius c9755aabfc
feat: stop grpc client (#1671) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:55 +08:00
Gaius f5e715e1f6
feat: add MaxConnectionIdle to grpc keepalive (#1655) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:53 +08:00
Jim Ma 717ac99ef5
feat: daemon support auto issue certificate (#1586) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:48 +08:00
Gaius ad553d949b
feat: grpc dial adds context (#1594) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:47 +08:00
Gaius 9e30632a39
feat: dfdaemon add convert interceptor (#1582) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:47 +08:00
Gaius a6a44269b4
refactor: dfdaemon client and remove rpc connection pool (#1576) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:46 +08:00
Gaius 9535821be7
feat: grpc removes MaxConnectionIdle (#1574) 
Signed-off-by: Gaius <gaius.qi@gmail.com>

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:46 +08:00
Gaius 272f38f567
feat: grpc add ratelimit (#1572) 
feat: grpc ratelimit

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:46 +08:00
Jim Ma f6506115a7
feat: support grpc recursive download (#1518) 
* feat: daemon grpc recursive download
* fix: init storage error

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:42 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:41 +08:00
Gaius 93a8ebb4bc
feat: add dfstore command (#1441) 
* feat: add dfstore command

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:34 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:32 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418) 
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:32 +08:00
Gaius ad36eb64a7
feat: remove github/pkg/errors package (#1416) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:31 +08:00
Gaius 64f5e9357b
refactor: scheduler announce task (#1407) 
* feat: scheduler announce normal task

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cid

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:30 +08:00
Gaius f688d341bd
feat: remove cdn (#1401) 
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:29 +08:00
Gaius e2eb30bc96
feat: change pattern from cdn to seed peer and remove kustomize shell (#1345) 
* feat: change pattern from cdn to seed peer and remove kustomize shell

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:24 +08:00
Eryu Guan f7e06c717d
feat: add vsock network type support (#1303) 
So we support connecting dfdaemon running on host outside of VM via
virtio-vsock device.

Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>
 2023-06-28 17:33:20 +08:00
Jim Ma 7c1e315ec1
fix: client synchronizer report error lock and dial grpc timeout (#1260) 
* fix: client synchronizer report error lock
* chore: remove superfluous retry to sync and get pieces from other peers
* chore: optimize back source and sync piece logic
* chore: print apk output in e2e
* fix: grpc send with io.EOF error

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:15 +08:00
Gaius 076ba20b51
feat: move dfnet to pkg dir (#1265) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:15 +08:00
Eryu Guan 65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache (#1227) 
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.

For example:
- add a file into cache system
  dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file

- check if a file exists in cache system
  dfcache stat --cid testid --local  # only check local cache
  dfcache stat --cid testid          # check other peers as well

- export/download a file from cache system
  dfcache export --cid testid -O /path/to/output

- delete a file from cache system, both local cache and P2P network
  dfcache delete -i testid -t testtag

Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:13 +08:00
Jim Ma 1025dc2dc5
feat: redirect daemon stdout stderr to file (#1244) 
1. redirect daemon stdout stderr to file
2. fix wrong zap grpc log output

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:13 +08:00
Gaius 998110f2b8
feat: generate grpc protos in namely/protoc-all image (#1187) 
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* chore: makefile add protoc command

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:08 +08:00
Gaius e0867ef3c8
feat: change DefaultServerOptions to variable 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:06 +08:00
sunwp 78591d0309
Optimized the log creation (#1058) 
* optimize logger

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* reset levels nil to release init method level

Signed-off-by: sunwp <244372610@qq.com>

* golang lint

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:33:06 +08:00
Jim Ma 98e95e693c
feat: implement bidirectional fetch pieces (#1165) 
* feat: implement grpc server side sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:06 +08:00
sunwp 44dd19ec12
Extend conn GC time (#1130) 
Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:33:03 +08:00