dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,653 Commits 5 Branches 281 Tags 98 MiB
Commit Graph

60 Commits

Author SHA1 Message Date
Gaius 71e323f59d
feat: add context key to SyncProbes (#2485) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:59 +08:00
Gaius e9cb38e851
feat: remove SyncNetworkTopology API (#2296) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:47 +08:00
Gaius f8934e701b
feat: add trainer service to rpc package (#2209) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:41 +08:00
Gaius 1b9353ba8d
feat: add SyncNetworkTopology and SyncProbes to scheduler client (#2114) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:33 +08:00
Gaius 7dc3c826f2
feat: add v2 version of dfdaemon client (#2050) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:29 +08:00
Gaius e83fb85216
feat: add v2 verison of the grpc to scheduler (#1999) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:24 +08:00
Gaius c89234e976
feat: add manager v2 api (#1990) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:23 +08:00
Gaius cf50824526
feat: change announcer validation (#1869) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:13 +08:00
Gaius 2421ce88f4
feat: add announcer to dfdameon (#1852) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:11 +08:00
Gaius f194f0961f
feat: scheduler adds announce host handler (#1843) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:11 +08:00
Gaius bdf5cd54c5
feat: call all nodes in consistent hashing and reuse grpc connection (#1842) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:11 +08:00
Gaius 0f8b75808a
feat: add timeout grpc and job (#1830) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:10 +08:00
Gaius 04bc6ae493
feat: grpc scheduler client dial options (#1792) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:06 +08:00
cuidajun 536b039462
feat: daemon call leaveHost when exit (#1788) 
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>

Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
 2023-06-28 17:34:06 +08:00
Gaius 446fcc9fd7
feat: add LeaveHost handler (#1780) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:06 +08:00
Gaius 0dedc36417
feat: grpc_retry removes WithPerRetryTimeout (#1763) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:03 +08:00
Gaius c9755aabfc
feat: stop grpc client (#1671) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:55 +08:00
Jim Ma 9050230926
feat: refactor grpc credential (#1612) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:50 +08:00
Gaius ad553d949b
feat: grpc dial adds context (#1594) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:47 +08:00
Gaius a6a44269b4
refactor: dfdaemon client and remove rpc connection pool (#1576) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:46 +08:00
Gaius 2116636040
feat: add grpc client error interceptor (#1575) 
Signed-off-by: Gaius <gaius.qi@gmail.com>

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:46 +08:00
Gaius 272f38f567
feat: grpc add ratelimit (#1572) 
feat: grpc ratelimit

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:46 +08:00
Gaius 22b8e6368e
feat: grpc add retry middleware (#1561) 
Signed-off-by: Gaius <gaius.qi@gmail.com>

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:45 +08:00
Gaius 5bcb53f0a9
feat: grpc consistent hashing (#1554) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: bigerous <bigerous@qq.com>
 2023-06-28 17:33:44 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:41 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418) 
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:32 +08:00
Gaius ad36eb64a7
feat: remove github/pkg/errors package (#1416) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:31 +08:00
Gaius 2a0314e45b
refactor: scheduler grpc (#1310) 
* refactor: scheduler grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:20 +08:00
Gaius 076ba20b51
feat: move dfnet to pkg dir (#1265) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:15 +08:00
Eryu Guan 65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache (#1227) 
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.

For example:
- add a file into cache system
  dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file

- check if a file exists in cache system
  dfcache stat --cid testid --local  # only check local cache
  dfcache stat --cid testid          # check other peers as well

- export/download a file from cache system
  dfcache export --cid testid -O /path/to/output

- delete a file from cache system, both local cache and P2P network
  dfcache delete -i testid -t testtag

Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:13 +08:00
Gaius 1939ceff8f
refactor: scheduler end and begin of piece (#1189) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:09 +08:00
Gaius 04bd2ea383
feat: scheduler addresses log (#1183) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:08 +08:00
sunwp 44dd19ec12
Extend conn GC time (#1130) 
Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:33:03 +08:00
Gaius 97c1eb65e7
Refactor scheduler service (#958) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:50 +08:00
Gaius cb4202319e
feat: make idgen package public (#931) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:47 +08:00
Gaius f6ce817b72
feat: move dfnet to internal (#862) 
* feat: move dfnet to internal

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename dfutils to util

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:41 +08:00
sunwp d79a2a6877
move RPC code definition to proto file (#829) 
* move rpc code to proto
* replace Cdn to CDN

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:32:38 +08:00
Gaius 72213eb1d4
feat: dfdaemon get scheduler list dynamically from manager (#812) 
* feat: dfdaemon get scheduler list dynamically from manager

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:37 +08:00
Gaius e837ae9bdf
chore: add lint errcheck and fix errcheck(#766) 
* feat: add lint errcheck and fix errcheck

Signed-off-by: Gaius <gaius.qi@gmail.com>

* replace assert to require

Signed-off-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>

Co-authored-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:32:35 +08:00
Jim Ma 3d63ab2ca3
chore: update golang import lint (#780) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:34 +08:00
sunwp 60bee061d2
feat: client back source (#579) 
* feat: client back source

Signed-off-by: santong <244372610@qq.com>
 2023-06-28 17:31:43 +08:00
sunwp 09824e5631
Framework refactor (#590) 
* feat: optimize grpc

Signed-off-by: santong <244372610@qq.com>

* feat: framework log

Signed-off-by: santong <244372610@qq.com>
 2023-06-28 17:31:42 +08:00
sunwp 1efd2f6cef
feat: Add distribute Schedule Tracer & Refactor scheduler (#537) 
* check same cdn list avoid updating client too frequent

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:31:35 +08:00
Jim Ma 2120051ab0
feature: enable grpc tracing (#531) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:31:34 +08:00
sunwp 4d49d77d5c
scheduler concurrent bug fix (#513) 
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:31:33 +08:00
sunwp a15ce877c7
fix: scheduler concurrent dead lock (#509) 
* fix scheduler concurrent dead lock

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:31:33 +08:00
Gaius 27103e4b4e
feat: rename manager grpc (#510) 
* feat: rename manager grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:26 +08:00
sunwp 9ffa58c8f6
feat: Add schedule log (#495) 
* feat: add bad node log

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:30:29 +08:00
zzy987 402f1eb397
fix: log specification (#452) 
Signed-off-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>

Co-authored-by: 张哲溢 <zhangzheyi@zhangzheyideMacBook-Pro.local>
 2023-06-28 17:30:27 +08:00
Jim Ma 38a14f5a30
feature: report peer result when failed to register (#433) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:30:26 +08:00