Gaius
4abb179d5b
feat: support preheating by v2 grpc protocol ( #3201 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-17 15:39:34 +08:00
Gaius
856cc374c5
chore: update go-redis verison to v9 ( #3182 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-09 12:27:49 +08:00
embroede
79c3390d8c
feat: make log rotation settings configurable ( #3085 )
...
Signed-off-by: Edward Broeder <eddie.broeder@intel.com>
2024-02-28 16:36:43 +08:00
Gaius
0b1157bba8
feat: replace filters with filteredQueryParams ( #3049 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-24 22:58:06 +08:00
Gaius
1643750f78
feat: add log for resolver and dynconfig ( #2945 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-12-15 18:58:54 +08:00
Jim Ma
839e476ecb
chore: optimize sync pieces error report ( #2925 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-12-14 11:23:15 +08:00
karl
21c19a9218
fix: CANNOT connet to Redis with special password #2893 ( #2894 )
...
Co-authored-by: karlhjm <karl.jm.huang@gmail.com>
2023-11-22 10:28:00 +08:00
Gaius
9608eff3bf
feat: avoid hot resolve in grpc ( #2884 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-15 22:23:43 +08:00
Gaius
334eb2e4dc
feat: avoid hot reload when dynconfig refresh data ( #2866 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-11-08 20:40:53 +08:00
Gaius
12fc630612
fix: if scheduler has no seed peer, return error in preheating ( #2835 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-10-30 16:45:39 +08:00
Guangwen Feng
229b942bea
test: add unit test for MarshalResponse ( #2683 )
...
Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
2023-08-29 23:27:47 +08:00
Gaius
fe28ba4c8e
feat: merge sync peer with peer table in manager ( #2668 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-24 10:28:08 +08:00
Gaius
dfde8bdce6
feat: add sync peer job for scheduler ( #2663 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-22 19:58:27 +08:00
Gaius
05a66805cc
fix: directories created via os.MkdirAll are not checked for permissions ( #2613 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-09 13:52:26 +08:00
Gaius
b3f23f71a3
feat: update dy7.io/api to v2 ( #2558 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-20 23:17:57 +08:00
Gaius
c7e43be4e1
feat: add training service ( #2543 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 17:19:25 +08:00
Gaius
a7f3c7c0b9
feat: add GNNModelIDV1 and MLPModelIDV1 in idgen ( #2540 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 14:32:41 +08:00
Gaius
0ffc55b6d4
refactor: trainer server module ( #2486 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
dlut_xz
e20bb9743e
feat: add trainer cmd and trainer service ( #2479 )
...
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:59 +08:00
ZouYu
bc4ca6270b
test: add unit test for ComputePieceCount ( #2401 )
...
Signed-off-by: Zou Yu <zouy.fnst@fujitsu.com>
2023-06-28 17:34:54 +08:00
Gaius
b80b4acbe4
feat: optimize job new in internal ( #2341 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:49 +08:00
Gaius
a5685582ce
refactor: resource task with v2 version of grpc ( #2078 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
Jim Ma
2c8ecac6e2
fix: dferror not convert ( #2001 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:24 +08:00
Jim Ma
0546fe4898
chore: create log dir ( #1947 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:20 +08:00
Gaius
ffa80c1eb9
refactor: dynconfig without Unmarshal ( #1926 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
walleliu
fa11e30b99
fix machinery redis broker address format err ( #1916 )
2023-06-28 17:34:17 +08:00
Gaius
f120c8778b
feat: support redis sentinal ( #1910 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius
d64a6d8e29
feat: trigger task with priority ( #1904 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius
10ae70db79
feat: change log rotate size ( #1879 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:14 +08:00
Gaius
2421ce88f4
feat: add announcer to dfdameon ( #1852 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
Gaius
42223d994f
feat: optimize peer log ( #1828 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
Gaius
d2f98d1429
feat: optimize preheat log ( #1827 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
cuidajun
3b1e805ce6
chore: add timestamp to stdout&stderr ( #1781 )
...
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:05 +08:00
Gaius
27d8cf51db
feat: gin logger rotation ( #1749 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius
29d4452277
feat: support redis cluster ( #1667 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:54 +08:00
Gaius
13580f89f2
refactor: dfpath for certify cache dir ( #1618 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Jim Ma
98fb1fc427
feat: add grpc mux transport ( #1602 )
...
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:49 +08:00
Gaius
5bcb53f0a9
feat: grpc consistent hashing ( #1554 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:44 +08:00
Gaius
439ad71230
feat: gc removes logrus ( #1548 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:44 +08:00
Gaius
c216872b5d
feat: store preheat result ( #1516 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:41 +08:00
Gaius
d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api ( #1515 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
Jim Ma
776a0fef42
feat: concurrent multiple pieces back source ( #1426 )
...
* feat: concurrent multiple pieces back source
* chore: update http source client
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:33 +08:00
Gaius
a2511cb945
feat: rewrite interface{} to any ( #1419 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius
0222649b88
feat: update namely/protoc-all image version to 1.47_0 ( #1418 )
...
* feat: update namely/protoc-all image version to 1.47_0
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: generate mock file
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius
ad36eb64a7
feat: remove github/pkg/errors package ( #1416 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
Gaius
f688d341bd
feat: remove cdn ( #1401 )
...
* feat: remove cdn
Signed-off-by: Gaius <gaius.qi@gmail.com>
* docs: generate swagger
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius
233aac29db
feat: redirect stdout and stderr to file ( #1399 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius
866eafe2c7
feat: remove preheat tag validate with required ( #1363 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius
e2eb30bc96
feat: change pattern from cdn to seed peer and remove kustomize shell ( #1345 )
...
* feat: change pattern from cdn to seed peer and remove kustomize shell
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:24 +08:00
Gaius
faa5e4e465
feat: add seed peer logic ( #1302 )
...
* feat: announce seed peer
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn logic
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn job
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfdaemon change host uuid to host id
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: go generate mocks
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn compatibility
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: change docker compose
Signed-off-by: Gaius <gaius.qi@gmail.com>
* fix: reuse panic
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: compatible with v2.0.3-beta.2
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00