Commit Graph

2247 Commits

Author SHA1 Message Date
dependabot[bot] e5ebce9e48
chore(deps): bump github.com/bits-and-blooms/bitset from 1.7.0 to 1.8.0 (#2551)
Bumps [github.com/bits-and-blooms/bitset](https://github.com/bits-and-blooms/bitset) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/bits-and-blooms/bitset/releases)
- [Commits](https://github.com/bits-and-blooms/bitset/compare/v1.7.0...v1.8.0)

---
updated-dependencies:
- dependency-name: github.com/bits-and-blooms/bitset
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 11:28:44 +08:00
dependabot[bot] de5bc37713
chore(deps): bump google.golang.org/api from 0.130.0 to 0.131.0 (#2549)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.130.0 to 0.131.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.130.0...v0.131.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 11:28:27 +08:00
dependabot[bot] 93f17f576d
chore(deps): bump github.com/MysteriousPotato/go-lockable from 0.2.0 to 1.0.0 (#2548)
chore(deps): bump github.com/MysteriousPotato/go-lockable

Bumps [github.com/MysteriousPotato/go-lockable](https://github.com/MysteriousPotato/go-lockable) from 0.2.0 to 1.0.0.
- [Release notes](https://github.com/MysteriousPotato/go-lockable/releases)
- [Commits](https://github.com/MysteriousPotato/go-lockable/compare/v0.2.0...v1.0.0)

---
updated-dependencies:
- dependency-name: github.com/MysteriousPotato/go-lockable
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-18 11:28:02 +08:00
Gaius cede829140
feat: update api verison to v1.9.7 and compatible with tiny task response (#2547)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-13 15:37:04 +08:00
dlut_xz 1cdcf6bc10
test: trainer serivce unit tests (#2545)
Signed-off-by: XZ <834756128@qq.com>
2023-07-13 13:31:00 +08:00
dlut_xz 0490a7b001
fix: if condition judgment of clearing file in trainer service (#2544)
Signed-off-by: XZ <834756128@qq.com>
2023-07-12 21:38:08 +08:00
Gaius c7e43be4e1
feat: add training service (#2543)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 17:19:25 +08:00
dlut_xz 650cc67d8d
fix: storage and announcer unit tests (#2542)
Signed-off-by: XZ <834756128@qq.com>
2023-07-12 16:50:49 +08:00
Gaius 9d1e07c3a3
feat: implement Train grpc api in trainer (#2541)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 15:46:27 +08:00
Gaius a7f3c7c0b9
feat: add GNNModelIDV1 and MLPModelIDV1 in idgen (#2540)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 14:32:41 +08:00
Gaius 2cb0acc1e9
refactor: store pieceRecords in download record (#2539)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 11:08:27 +08:00
dlut_xz aa95dfe52d
feat: add pieces element in download record (#2531)
Signed-off-by: XZ <834756128@qq.com>
2023-07-12 10:35:20 +08:00
Min d0b9bbe138
test: add unit test for model and digest (#2538)
Signed-off-by: MinH-09 <2107139596@qq.com>
2023-07-11 16:14:04 +08:00
Gaius 01287f4fe7
fix: change model state in the same scheduler id (#2537)
* fix: change model state

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove objectStorageConfig in manager rpcserver

Signed-off-by: Gaius <gaius.qi@gmail.com>

---------

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-11 11:23:44 +08:00
dependabot[bot] 28f162a43c
chore(deps): bump github.com/shirou/gopsutil/v3 from 3.23.5 to 3.23.6 (#2535)
Bumps [github.com/shirou/gopsutil/v3](https://github.com/shirou/gopsutil) from 3.23.5 to 3.23.6.
- [Release notes](https://github.com/shirou/gopsutil/releases)
- [Commits](https://github.com/shirou/gopsutil/compare/v3.23.5...v3.23.6)

---
updated-dependencies:
- dependency-name: github.com/shirou/gopsutil/v3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-11 10:34:31 +08:00
dependabot[bot] 6fb518caec
chore(deps): bump gorm.io/driver/postgres from 1.5.0 to 1.5.2 (#2534)
Bumps [gorm.io/driver/postgres](https://github.com/go-gorm/postgres) from 1.5.0 to 1.5.2.
- [Commits](https://github.com/go-gorm/postgres/compare/v1.5.0...v1.5.2)

---
updated-dependencies:
- dependency-name: gorm.io/driver/postgres
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-11 10:34:00 +08:00
dependabot[bot] 9ed62a2dbc
chore(deps): bump google.golang.org/api from 0.129.0 to 0.130.0 (#2533)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.129.0 to 0.130.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.129.0...v0.130.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-11 10:31:58 +08:00
dependabot[bot] e2b334aefc
chore(deps): bump golang.org/x/oauth2 from 0.9.0 to 0.10.0 (#2532)
Bumps [golang.org/x/oauth2](https://github.com/golang/oauth2) from 0.9.0 to 0.10.0.
- [Commits](https://github.com/golang/oauth2/compare/v0.9.0...v0.10.0)

---
updated-dependencies:
- dependency-name: golang.org/x/oauth2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-11 10:31:39 +08:00
dlut_xz a45fcd9558
feat: remove ProbedAt function in network topology (#2529)
Signed-off-by: XZ <834756128@qq.com>
2023-07-11 10:30:20 +08:00
Gaius 355d9dd10d
feat: add update model rest api (#2530)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-10 18:19:14 +08:00
Gaius a8f7c56b4a
refactor: create model grpc api in manager (#2528)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-10 17:35:26 +08:00
Min 6301d22028
feat: manager adds createModel function (#2521)
Signed-off-by: MinH-09 <2107139596@qq.com>
Signed-off-by: huangmin <2107139596@qq.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: XZ <834756128@qq.com>
2023-07-10 10:34:11 +08:00
dlut_xz 4b2759c245
fix: scheduler.template.yaml comments (#2526)
Signed-off-by: XZ <834756128@qq.com>
2023-07-07 18:31:04 +08:00
Gaius bfb6440e1b
chore: add fcgxz2003 to maintainer (#2522)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-06 17:28:46 +08:00
MisakaCloud 512ad52c73
fix: also add ca to RootCAs (#2516)
Signed-off-by: MisakaCloud <xjdzch@126.com>
2023-07-06 17:28:16 +08:00
Gaius 1da355018b
feat: implement FindProbedHosts and add LoadRandomHosts to host manager (#2519)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: dlut_xz <52518280+fcgxz2003@users.noreply.github.com>
2023-07-06 10:56:52 +08:00
Gaius d74ef9894e
test: optimize TestDigest_HashFile (#2515)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-05 09:43:31 +08:00
Guangwen Feng a683fff40e
test: improve hash file encode test case in digest test (#2513)
Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
2023-07-04 21:39:08 +08:00
Guangwen Feng 4a83dd8ccd
test: add unit tests for DownloadCount and NetworkTopologyCount (#2512)
test: add unit test for DownloadCount and NetworkTopologyCount

Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
2023-07-04 17:13:25 +08:00
dlut_xz 5cfa4d2493
test: replace keys with scan in redis client (#2509)
Signed-off-by: XZ <834756128@qq.com>
2023-07-04 17:11:39 +08:00
Guangwen Feng a797274813
test: optimize config in scheduler (#2511)
Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
2023-07-04 17:11:01 +08:00
Gaius 9a36cc5aa1
feat: set scan count for redis client (#2508)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-04 15:13:00 +08:00
Gaius 1d1e69620c
feat: replace keys with scan in redis client (#2507)
It's not recommended to use the KEYS prefix:* command to get all the keys in a Redis instance,
especially in production environments, because it can be a slow and resource-intensive operation
that can impact the performance of the Redis instance.

Instead, you can iterate over Redis keys that match some pattern using the SCAN command,
refer to https://redis.uptrace.dev/guide/get-all-keys.html.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-04 12:18:06 +08:00
dependabot[bot] fbd23d1df2
chore(deps): bump gorm.io/gorm from 1.25.1 to 1.25.2 (#2505)
Bumps [gorm.io/gorm](https://github.com/go-gorm/gorm) from 1.25.1 to 1.25.2.
- [Release notes](https://github.com/go-gorm/gorm/releases)
- [Commits](https://github.com/go-gorm/gorm/compare/v1.25.1...v1.25.2)

---
updated-dependencies:
- dependency-name: gorm.io/gorm
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-04 12:17:00 +08:00
dependabot[bot] 9da77c8244
chore(deps): bump github.com/MysteriousPotato/go-lockable from 0.1.0 to 0.2.0 (#2504)
chore(deps): bump github.com/MysteriousPotato/go-lockable

Bumps [github.com/MysteriousPotato/go-lockable](https://github.com/MysteriousPotato/go-lockable) from 0.1.0 to 0.2.0.
- [Release notes](https://github.com/MysteriousPotato/go-lockable/releases)
- [Commits](https://github.com/MysteriousPotato/go-lockable/compare/v0.1.0...v0.2.0)

---
updated-dependencies:
- dependency-name: github.com/MysteriousPotato/go-lockable
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-04 12:16:37 +08:00
dependabot[bot] a35e83b626
chore(deps): bump google.golang.org/api from 0.128.0 to 0.129.0 (#2503)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.128.0 to 0.129.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.128.0...v0.129.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-04 12:16:11 +08:00
dependabot[bot] 52b36cb63e
chore(deps): bump google.golang.org/protobuf from 1.30.0 to 1.31.0 (#2502)
Bumps google.golang.org/protobuf from 1.30.0 to 1.31.0.

---
updated-dependencies:
- dependency-name: google.golang.org/protobuf
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-04 12:15:47 +08:00
dependabot[bot] 3586704c21
chore(deps): bump github.com/casbin/casbin/v2 from 2.68.0 to 2.71.1 (#2501)
Bumps [github.com/casbin/casbin/v2](https://github.com/casbin/casbin) from 2.68.0 to 2.71.1.
- [Release notes](https://github.com/casbin/casbin/releases)
- [Changelog](https://github.com/casbin/casbin/blob/master/.releaserc.json)
- [Commits](https://github.com/casbin/casbin/compare/v2.68.0...v2.71.1)

---
updated-dependencies:
- dependency-name: github.com/casbin/casbin/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-07-04 12:15:25 +08:00
Min 07366174b5
feat: manager adds trainer config (#2494)
Signed-off-by: huangmin <2107139596@qq.com>
2023-06-29 18:51:24 +08:00
Gaius b58879a0c3
feat: add inference client in grpc (#2493)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 23:27:38 +08:00
Gaius 91a9d6f261
feat: remove cdn examples in grpc
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:41:38 +08:00
dlut_xz c5fd00e0e4
test: add client daemon network topology unit tests (#2490)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:35:00 +08:00
Gaius a0d14c58b8
feat: add network topology to daemon (#2489)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
dlut_xz 883496cb14
feat: implement probe interface in client daemon (#2473)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:35:00 +08:00
Gaius fbb575f954
chore: add trainer to Makefile and shell (#2488)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
Gaius 0ffc55b6d4
refactor: trainer server module (#2486)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
Gaius aa96962d4c
chore: build trainer binary and publish trainer docker image (#2487)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
dlut_xz e20bb9743e
feat: add trainer cmd and trainer service (#2479)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:59 +08:00
Gaius 71e323f59d
feat: add context key to SyncProbes (#2485)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:59 +08:00
dependabot[bot] 205e990c1b
chore(deps): bump github.com/onsi/ginkgo/v2 from 2.9.4 to 2.11.0 (#2484)
Bumps [github.com/onsi/ginkgo/v2](https://github.com/onsi/ginkgo) from 2.9.4 to 2.11.0.
- [Release notes](https://github.com/onsi/ginkgo/releases)
- [Changelog](https://github.com/onsi/ginkgo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/onsi/ginkgo/compare/v2.9.4...v2.11.0)

---
updated-dependencies:
- dependency-name: github.com/onsi/ginkgo/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:59 +08:00