Commit Graph

119 Commits

Author SHA1 Message Date
Gaius 4abb179d5b
feat: support preheating by v2 grpc protocol (#3201)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-17 15:39:34 +08:00
Gaius 856cc374c5
chore: update go-redis verison to v9 (#3182)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-09 12:27:49 +08:00
embroede 79c3390d8c
feat: make log rotation settings configurable (#3085)
Signed-off-by: Edward Broeder <eddie.broeder@intel.com>
2024-02-28 16:36:43 +08:00
Gaius 0b1157bba8
feat: replace filters with filteredQueryParams (#3049)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-24 22:58:06 +08:00
Gaius 1643750f78
feat: add log for resolver and dynconfig (#2945)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-15 18:58:54 +08:00
Jim Ma 839e476ecb
chore: optimize sync pieces error report (#2925)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-12-14 11:23:15 +08:00
karl 21c19a9218
fix: CANNOT connet to Redis with special password #2893 (#2894)
Co-authored-by: karlhjm <karl.jm.huang@gmail.com>
2023-11-22 10:28:00 +08:00
Gaius 9608eff3bf
feat: avoid hot resolve in grpc (#2884)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-15 22:23:43 +08:00
Gaius 334eb2e4dc
feat: avoid hot reload when dynconfig refresh data (#2866)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-08 20:40:53 +08:00
Gaius 12fc630612
fix: if scheduler has no seed peer, return error in preheating (#2835)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-10-30 16:45:39 +08:00
Guangwen Feng 229b942bea
test: add unit test for MarshalResponse (#2683)
Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
2023-08-29 23:27:47 +08:00
Gaius fe28ba4c8e
feat: merge sync peer with peer table in manager (#2668)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-24 10:28:08 +08:00
Gaius dfde8bdce6
feat: add sync peer job for scheduler (#2663)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-22 19:58:27 +08:00
Gaius 05a66805cc
fix: directories created via os.MkdirAll are not checked for permissions (#2613)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-09 13:52:26 +08:00
Gaius b3f23f71a3
feat: update dy7.io/api to v2 (#2558)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-20 23:17:57 +08:00
Gaius c7e43be4e1
feat: add training service (#2543)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 17:19:25 +08:00
Gaius a7f3c7c0b9
feat: add GNNModelIDV1 and MLPModelIDV1 in idgen (#2540)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 14:32:41 +08:00
Gaius 0ffc55b6d4
refactor: trainer server module (#2486)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
dlut_xz e20bb9743e
feat: add trainer cmd and trainer service (#2479)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:59 +08:00
ZouYu bc4ca6270b
test: add unit test for ComputePieceCount (#2401)
Signed-off-by: Zou Yu <zouy.fnst@fujitsu.com>
2023-06-28 17:34:54 +08:00
Gaius b80b4acbe4
feat: optimize job new in internal (#2341)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:49 +08:00
Gaius a5685582ce
refactor: resource task with v2 version of grpc (#2078)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
Jim Ma 2c8ecac6e2
fix: dferror not convert (#2001)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:24 +08:00
Jim Ma 0546fe4898
chore: create log dir (#1947)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:20 +08:00
Gaius ffa80c1eb9
refactor: dynconfig without Unmarshal (#1926)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
walleliu fa11e30b99
fix machinery redis broker address format err (#1916) 2023-06-28 17:34:17 +08:00
Gaius f120c8778b
feat: support redis sentinal (#1910)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius d64a6d8e29
feat: trigger task with priority (#1904)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius 10ae70db79
feat: change log rotate size (#1879)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:14 +08:00
Gaius 2421ce88f4
feat: add announcer to dfdameon (#1852)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
Gaius 42223d994f
feat: optimize peer log (#1828)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
Gaius d2f98d1429
feat: optimize preheat log (#1827)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
cuidajun 3b1e805ce6
chore: add timestamp to stdout&stderr (#1781)
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:05 +08:00
Gaius 27d8cf51db
feat: gin logger rotation (#1749)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 29d4452277
feat: support redis cluster (#1667)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:54 +08:00
Gaius 13580f89f2
refactor: dfpath for certify cache dir (#1618)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Jim Ma 98fb1fc427
feat: add grpc mux transport (#1602)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:49 +08:00
Gaius 5bcb53f0a9
feat: grpc consistent hashing (#1554)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:44 +08:00
Gaius 439ad71230
feat: gc removes logrus (#1548)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:44 +08:00
Gaius c216872b5d
feat: store preheat result (#1516)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:41 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
Jim Ma 776a0fef42
feat: concurrent multiple pieces back source (#1426)
* feat: concurrent multiple pieces back source
* chore: update http source client

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:33 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418)
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius ad36eb64a7
feat: remove github/pkg/errors package (#1416)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
Gaius f688d341bd
feat: remove cdn (#1401)
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius 233aac29db
feat: redirect stdout and stderr to file (#1399)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius 866eafe2c7
feat: remove preheat tag validate with required (#1363)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius e2eb30bc96
feat: change pattern from cdn to seed peer and remove kustomize shell (#1345)
* feat: change pattern from cdn to seed peer and remove kustomize shell

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:24 +08:00
Gaius faa5e4e465
feat: add seed peer logic (#1302)
* feat: announce seed peer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn logic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn job

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfdaemon change host uuid to host id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go generate mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn compatibility

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change docker compose

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: reuse panic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: compatible with v2.0.3-beta.2

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00