dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,020 Commits 5 Branches 281 Tags 98 MiB
Commit Graph

115 Commits

Author SHA1 Message Date
Gaius 1643750f78
feat: add log for resolver and dynconfig (#2945) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-12-15 18:58:54 +08:00
Jim Ma 839e476ecb
chore: optimize sync pieces error report (#2925) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-12-14 11:23:15 +08:00
karl 21c19a9218
fix: CANNOT connet to Redis with special password #2893 (#2894) 
Co-authored-by: karlhjm <karl.jm.huang@gmail.com>
 2023-11-22 10:28:00 +08:00
Gaius 9608eff3bf
feat: avoid hot resolve in grpc (#2884) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-11-15 22:23:43 +08:00
Gaius 334eb2e4dc
feat: avoid hot reload when dynconfig refresh data (#2866) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-11-08 20:40:53 +08:00
Gaius 12fc630612
fix: if scheduler has no seed peer, return error in preheating (#2835) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-10-30 16:45:39 +08:00
Guangwen Feng 229b942bea
test: add unit test for MarshalResponse (#2683) 
Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
 2023-08-29 23:27:47 +08:00
Gaius fe28ba4c8e
feat: merge sync peer with peer table in manager (#2668) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-08-24 10:28:08 +08:00
Gaius dfde8bdce6
feat: add sync peer job for scheduler (#2663) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-08-22 19:58:27 +08:00
Gaius 05a66805cc
fix: directories created via os.MkdirAll are not checked for permissions (#2613) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-08-09 13:52:26 +08:00
Gaius b3f23f71a3
feat: update dy7.io/api to v2 (#2558) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-07-20 23:17:57 +08:00
Gaius c7e43be4e1
feat: add training service (#2543) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-07-12 17:19:25 +08:00
Gaius a7f3c7c0b9
feat: add GNNModelIDV1 and MLPModelIDV1 in idgen (#2540) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-07-12 14:32:41 +08:00
Gaius 0ffc55b6d4
refactor: trainer server module (#2486) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:35:00 +08:00
dlut_xz e20bb9743e
feat: add trainer cmd and trainer service (#2479) 
Signed-off-by: XZ <834756128@qq.com>
 2023-06-28 17:34:59 +08:00
ZouYu bc4ca6270b
test: add unit test for ComputePieceCount (#2401) 
Signed-off-by: Zou Yu <zouy.fnst@fujitsu.com>
 2023-06-28 17:34:54 +08:00
Gaius b80b4acbe4
feat: optimize job new in internal (#2341) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:49 +08:00
Gaius a5685582ce
refactor: resource task with v2 version of grpc (#2078) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:30 +08:00
Jim Ma 2c8ecac6e2
fix: dferror not convert (#2001) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:34:24 +08:00
Jim Ma 0546fe4898
chore: create log dir (#1947) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:34:20 +08:00
Gaius ffa80c1eb9
refactor: dynconfig without Unmarshal (#1926) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:18 +08:00
walleliu fa11e30b99
fix machinery redis broker address format err (#1916) 2023-06-28 17:34:17 +08:00
Gaius f120c8778b
feat: support redis sentinal (#1910) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:16 +08:00
Gaius d64a6d8e29
feat: trigger task with priority (#1904) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:16 +08:00
Gaius 10ae70db79
feat: change log rotate size (#1879) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:14 +08:00
Gaius 2421ce88f4
feat: add announcer to dfdameon (#1852) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:11 +08:00
Gaius 42223d994f
feat: optimize peer log (#1828) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:09 +08:00
Gaius d2f98d1429
feat: optimize preheat log (#1827) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:09 +08:00
cuidajun 3b1e805ce6
chore: add timestamp to stdout&stderr (#1781) 
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
 2023-06-28 17:34:05 +08:00
Gaius 27d8cf51db
feat: gin logger rotation (#1749) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:34:02 +08:00
Gaius 29d4452277
feat: support redis cluster (#1667) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:54 +08:00
Gaius 13580f89f2
refactor: dfpath for certify cache dir (#1618) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:50 +08:00
Jim Ma 98fb1fc427
feat: add grpc mux transport (#1602) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:49 +08:00
Gaius 5bcb53f0a9
feat: grpc consistent hashing (#1554) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: bigerous <bigerous@qq.com>
 2023-06-28 17:33:44 +08:00
Gaius 439ad71230
feat: gc removes logrus (#1548) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:44 +08:00
Gaius c216872b5d
feat: store preheat result (#1516) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:41 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:41 +08:00
Jim Ma 776a0fef42
feat: concurrent multiple pieces back source (#1426) 
* feat: concurrent multiple pieces back source
* chore: update http source client

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:33 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:32 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418) 
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:32 +08:00
Gaius ad36eb64a7
feat: remove github/pkg/errors package (#1416) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:31 +08:00
Gaius f688d341bd
feat: remove cdn (#1401) 
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:29 +08:00
Gaius 233aac29db
feat: redirect stdout and stderr to file (#1399) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:29 +08:00
Gaius 866eafe2c7
feat: remove preheat tag validate with required (#1363) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:26 +08:00
Gaius e2eb30bc96
feat: change pattern from cdn to seed peer and remove kustomize shell (#1345) 
* feat: change pattern from cdn to seed peer and remove kustomize shell

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:24 +08:00
Gaius faa5e4e465
feat: add seed peer logic (#1302) 
* feat: announce seed peer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn logic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn job

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfdaemon change host uuid to host id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go generate mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn compatibility

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change docker compose

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: reuse panic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: compatible with v2.0.3-beta.2

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:19 +08:00
Gaius 076ba20b51
feat: move dfnet to pkg dir (#1265) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:15 +08:00
Eryu Guan 65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache (#1227) 
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.

For example:
- add a file into cache system
  dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file

- check if a file exists in cache system
  dfcache stat --cid testid --local  # only check local cache
  dfcache stat --cid testid          # check other peers as well

- export/download a file from cache system
  dfcache export --cid testid -O /path/to/output

- delete a file from cache system, both local cache and P2P network
  dfcache delete -i testid -t testtag

Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:33:13 +08:00
Jim Ma 517ed6c51e
fix: client sync piece panic (#1246) 
* fix: client sync piece panic

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize sync piece log

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: daemon panic when register fail

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:13 +08:00
yxxhero 7167c01d0f
add header check for ClientOption (#1174) 
Signed-off-by: yxxhero <aiopsclub@163.com>
 2023-06-28 17:33:07 +08:00