Commit Graph

458 Commits

Author SHA1 Message Date
Gaius 6addfdf8f4
feat: change DownloadPeerDuration metric type to summary (#2794)
feat: change DownloadPeerDuration metric to Summary

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-10-11 19:25:49 +08:00
Gaius 82a5b7bf6d
feat: add content-length label to DownloadPeerDuration metric (#2792)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-10-11 16:26:13 +08:00
Sasha Melentyev d189e18026
chore: gofmt -w -r 'interface{} -> any' . (#2790)
Signed-off-by: Sasha Melentyev <sasha@melentyev.io>
2023-10-11 10:39:34 +08:00
guangwu a3f2aae26c
chore: remove refs to deprecated io/ioutil (#2754)
Signed-off-by: guoguangwu <guoguangwu@magic-shield.com>
2023-09-26 10:09:57 +08:00
Gaius b65c1019ed
feat: update api to v2.0.29 with optional (#2751)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-09-22 14:19:16 +08:00
dlut_xz 5289f03289
fix: snapshot network topology id (#2746)
fix snapshot network topology id

Signed-off-by: XZ <834756128@qq.com>
2023-09-19 16:07:08 +08:00
Gaius 60080f2e98
fix: if network topology is nil, LeaveHost panic in scheduler (#2727)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-09-14 21:26:22 +08:00
dlut_xz 1a652e6594
feat: add InitProbedCount in AnnounceHost and DeleteHost in LeaveHost (#2722)
Signed-off-by: fcgxz2003 <834756128@qq.com>
2023-09-14 21:20:34 +08:00
Gaius 51596b645b
fix: Vertex.DeleteInEdges and Vertex.DeleteOutEdges functions are not thread safe (#2688)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-30 16:48:07 +08:00
Gaius fe28ba4c8e
feat: merge sync peer with peer table in manager (#2668)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-24 10:28:08 +08:00
Gaius dfde8bdce6
feat: add sync peer job for scheduler (#2663)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-22 19:58:27 +08:00
Gaius f3b92900af
feat: peer announces scheduler cluster id to scheduler (#2652)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-21 22:00:05 +08:00
Gaius 5b7ea5da2a
Revert "feat: replace fmt.Sprintf with net.JoinHostPort" (#2649)
Revert "feat: replace fmt.Sprintf with net.JoinHostPort (#2642)"

This reverts commit a6863f9b19.
2023-08-17 17:21:50 +08:00
Gaius a6863f9b19
feat: replace fmt.Sprintf with net.JoinHostPort (#2642)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-16 16:45:14 +08:00
Jim Ma 0e04a56177
chore: check task id (#2636)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-08-15 23:04:50 +08:00
Gaius 732819bbe9
feat: case insensitive string comparison in evaluater package of the manager (#2632)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-15 14:14:36 +08:00
Gaius a5b0f7404d
feat: download tiny file with https scheme (#2617)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-10 16:29:28 +08:00
Gaius afa665c091
fix: incorrect log message in the scheduler (#2618)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-10 11:25:54 +08:00
Gaius 094b79d5fd
fix: usage of architecture-dependent int type in the scheduler (#2619)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-09 19:46:57 +08:00
Gaius 77c91cb1e5
feat: add lock to dag vertex and replace rand.Seed with rand.New (#2614)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-09 14:53:47 +08:00
Gaius bd140f1104
refactor: file close error
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-08 12:08:15 +08:00
Jim Ma 342438eae6
chore: optimize unhandled file close error (#2599)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-08-08 11:48:29 +08:00
Jim Ma 1b9d2b03d7
fix: improper use strings.TrimLeft (#2603)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-08-07 17:55:27 +08:00
Guangwen Feng 8c82fb6290
test: add unit test for seedPeerClient.Addrs (#2589)
Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
2023-08-01 12:06:52 +08:00
Min 864943f418
chore: change tainer address port from 9000 to 9090 in scheduler (#2571)
Signed-off-by: huangmin <2107139596@qq.com>
2023-07-25 17:32:02 +08:00
Gaius 778b90c718
feat: add optional to build information (#2567)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-25 15:15:40 +08:00
Gaius bd3d76a97c
feat: update api version to 2.0.8 (#2566)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-25 13:45:54 +08:00
Gaius b4a390db08
feat: update api version to v2.0.7 (#2560)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-25 11:24:56 +08:00
Gaius b3f23f71a3
feat: update dy7.io/api to v2 (#2558)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-20 23:17:57 +08:00
dlut_xz be6d8085c7
feat: add finished piece count element in types (#2557)
Signed-off-by: XZ <834756128@qq.com>
2023-07-19 10:28:24 +08:00
Gaius cede829140
feat: update api verison to v1.9.7 and compatible with tiny task response (#2547)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-13 15:37:04 +08:00
Gaius c7e43be4e1
feat: add training service (#2543)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 17:19:25 +08:00
dlut_xz 650cc67d8d
fix: storage and announcer unit tests (#2542)
Signed-off-by: XZ <834756128@qq.com>
2023-07-12 16:50:49 +08:00
Gaius 9d1e07c3a3
feat: implement Train grpc api in trainer (#2541)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 15:46:27 +08:00
Gaius a7f3c7c0b9
feat: add GNNModelIDV1 and MLPModelIDV1 in idgen (#2540)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 14:32:41 +08:00
Gaius 2cb0acc1e9
refactor: store pieceRecords in download record (#2539)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 11:08:27 +08:00
dlut_xz aa95dfe52d
feat: add pieces element in download record (#2531)
Signed-off-by: XZ <834756128@qq.com>
2023-07-12 10:35:20 +08:00
dlut_xz a45fcd9558
feat: remove ProbedAt function in network topology (#2529)
Signed-off-by: XZ <834756128@qq.com>
2023-07-11 10:30:20 +08:00
Gaius 1da355018b
feat: implement FindProbedHosts and add LoadRandomHosts to host manager (#2519)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: dlut_xz <52518280+fcgxz2003@users.noreply.github.com>
2023-07-06 10:56:52 +08:00
Guangwen Feng 4a83dd8ccd
test: add unit tests for DownloadCount and NetworkTopologyCount (#2512)
test: add unit test for DownloadCount and NetworkTopologyCount

Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
2023-07-04 17:13:25 +08:00
dlut_xz 5cfa4d2493
test: replace keys with scan in redis client (#2509)
Signed-off-by: XZ <834756128@qq.com>
2023-07-04 17:11:39 +08:00
Guangwen Feng a797274813
test: optimize config in scheduler (#2511)
Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
2023-07-04 17:11:01 +08:00
Gaius 9a36cc5aa1
feat: set scan count for redis client (#2508)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-04 15:13:00 +08:00
Gaius 1d1e69620c
feat: replace keys with scan in redis client (#2507)
It's not recommended to use the KEYS prefix:* command to get all the keys in a Redis instance,
especially in production environments, because it can be a slow and resource-intensive operation
that can impact the performance of the Redis instance.

Instead, you can iterate over Redis keys that match some pattern using the SCAN command,
refer to https://redis.uptrace.dev/guide/get-all-keys.html.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-04 12:18:06 +08:00
Gaius 0ffc55b6d4
refactor: trainer server module (#2486)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
dlut_xz 8a8d6abaae
feat: move probe interval from scheduler config to client config (#2462)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:58 +08:00
Gaius 5342fb97fc
fix: Interval in SyncProbesResponse (#2466)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:58 +08:00
Gaius 98aee9640d
feat: implement SyncProbes api in scheduler grpc service (#2449)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: dlut_xz <52518280+fcgxz2003@users.noreply.github.com>
2023-06-28 17:34:58 +08:00
Gaius c984444d4b
test: add TestAnnouncer_Serve test
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
Gaius 38b550c666
feat: remove dirty file
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00