Commit Graph

1907 Commits

Author SHA1 Message Date
Gaius 91a9d6f261
feat: remove cdn examples in grpc
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:41:38 +08:00
dlut_xz c5fd00e0e4
test: add client daemon network topology unit tests (#2490)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:35:00 +08:00
Gaius a0d14c58b8
feat: add network topology to daemon (#2489)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
dlut_xz 883496cb14
feat: implement probe interface in client daemon (#2473)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:35:00 +08:00
Gaius fbb575f954
chore: add trainer to Makefile and shell (#2488)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
Gaius 0ffc55b6d4
refactor: trainer server module (#2486)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
Gaius aa96962d4c
chore: build trainer binary and publish trainer docker image (#2487)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
dlut_xz e20bb9743e
feat: add trainer cmd and trainer service (#2479)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:59 +08:00
Gaius 71e323f59d
feat: add context key to SyncProbes (#2485)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:59 +08:00
dependabot[bot] 205e990c1b
chore(deps): bump github.com/onsi/ginkgo/v2 from 2.9.4 to 2.11.0 (#2484)
Bumps [github.com/onsi/ginkgo/v2](https://github.com/onsi/ginkgo) from 2.9.4 to 2.11.0.
- [Release notes](https://github.com/onsi/ginkgo/releases)
- [Changelog](https://github.com/onsi/ginkgo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/onsi/ginkgo/compare/v2.9.4...v2.11.0)

---
updated-dependencies:
- dependency-name: github.com/onsi/ginkgo/v2
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:59 +08:00
dependabot[bot] 10fde7c6fe
chore(deps): bump github.com/go-playground/validator/v10 from 10.14.0 to 10.14.1 (#2483)
chore(deps): bump github.com/go-playground/validator/v10

Bumps [github.com/go-playground/validator/v10](https://github.com/go-playground/validator) from 10.14.0 to 10.14.1.
- [Release notes](https://github.com/go-playground/validator/releases)
- [Commits](https://github.com/go-playground/validator/compare/v10.14.0...v10.14.1)

---
updated-dependencies:
- dependency-name: github.com/go-playground/validator/v10
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:59 +08:00
dependabot[bot] 63fef7e213
chore(deps): bump github.com/prometheus/client_golang from 1.15.0 to 1.16.0 (#2481)
chore(deps): bump github.com/prometheus/client_golang

Bumps [github.com/prometheus/client_golang](https://github.com/prometheus/client_golang) from 1.15.0 to 1.16.0.
- [Release notes](https://github.com/prometheus/client_golang/releases)
- [Changelog](https://github.com/prometheus/client_golang/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prometheus/client_golang/compare/v1.15.0...v1.16.0)

---
updated-dependencies:
- dependency-name: github.com/prometheus/client_golang
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:59 +08:00
dependabot[bot] c50b366631
chore(deps): bump google.golang.org/api from 0.114.0 to 0.128.0 (#2478)
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.114.0 to 0.128.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.114.0...v0.128.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:59 +08:00
dependabot[bot] d3169e7fb5
chore(deps): bump github.com/stretchr/testify from 1.8.3 to 1.8.4 (#2476)
Bumps [github.com/stretchr/testify](https://github.com/stretchr/testify) from 1.8.3 to 1.8.4.
- [Release notes](https://github.com/stretchr/testify/releases)
- [Commits](https://github.com/stretchr/testify/compare/v1.8.3...v1.8.4)

---
updated-dependencies:
- dependency-name: github.com/stretchr/testify
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:59 +08:00
dependabot[bot] fb7ee44ebf
chore(deps): bump go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc from 0.41.1 to 0.42.0 (#2475)
chore(deps): bump go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc

Bumps [go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc](https://github.com/open-telemetry/opentelemetry-go-contrib) from 0.41.1 to 0.42.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go-contrib/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go-contrib/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go-contrib/compare/zpages/v0.41.1...zpages/v0.42.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:59 +08:00
dependabot[bot] 5cf1a13a83
chore(deps): bump golang.org/x/crypto from 0.9.0 to 0.10.0 (#2474)
Bumps [golang.org/x/crypto](https://github.com/golang/crypto) from 0.9.0 to 0.10.0.
- [Commits](https://github.com/golang/crypto/compare/v0.9.0...v0.10.0)

---
updated-dependencies:
- dependency-name: golang.org/x/crypto
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:59 +08:00
Jim Ma bdfeb48f02
feat: daemon store file exclusive (#2465)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:59 +08:00
Jim Ma 58ff1be8bd
feat: update lint action to solve cache conflict (#2472)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:58 +08:00
Jim Ma 5ce650b973
feat: update kind action (#2470)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:58 +08:00
dlut_xz 8a8d6abaae
feat: move probe interval from scheduler config to client config (#2462)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:58 +08:00
Gaius b2cb2ed024
feat: add Access-Control-Expose-Headers to headers (#2467)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:58 +08:00
Gaius 5342fb97fc
fix: Interval in SyncProbesResponse (#2466)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:58 +08:00
Gaius cb5f336060
chore: update grpc proto version (#2463)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:58 +08:00
Jim Ma bb29a234f4
chore: update dfget recursive log (#2459)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:58 +08:00
Jim Ma 9137707139
feat: support breakpoint resume for running tasks (#2457)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:58 +08:00
Gaius 98aee9640d
feat: implement SyncProbes api in scheduler grpc service (#2449)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: XZ <834756128@qq.com>
Co-authored-by: dlut_xz <52518280+fcgxz2003@users.noreply.github.com>
2023-06-28 17:34:58 +08:00
Gaius 8b7ceb60b5
feat: optimize dfpath format (#2460)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
embroede 8c905d9b8d
feat: enable configuration of some directory modes for dfdaemon (#2340)
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
Jim Ma b0eaa169ba
fix: e2e test dfget recursive (#2458)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:57 +08:00
Gaius c984444d4b
test: add TestAnnouncer_Serve test
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
Gaius 38b550c666
feat: remove dirty file
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
Gaius c8583237e4
fix: announcer in scheduler (#2451)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
Gaius 8634495f2c
test: optimize announcer in scheduler (#2448)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
Min 4ef338d5da
test: announcer adds tests (#2377)
Signed-off-by: MinH-09 <2107139596@qq.com>
2023-06-28 17:34:57 +08:00
Gaius 146f82c453
feat: optimize announcer in scheduler and client (#2445)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
Gaius 33cc68159b
chore: update grpc api definition to v1.9.0 (#2444)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
fyx 7d03903a21
test: add storage unit tests of trainer (#2437)
Signed-off-by: MIchaelFU0403 <1078537664@qq.com>
2023-06-28 17:34:56 +08:00
Gaius 7f4d4d2ec0
feat: change DefaultProbeInterval to 20 minute (#2440)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:56 +08:00
dependabot[bot] a2d7a7a18e
chore(deps): bump github.com/shirou/gopsutil/v3 from 3.23.3 to 3.23.5 (#2434)
Bumps [github.com/shirou/gopsutil/v3](https://github.com/shirou/gopsutil) from 3.23.3 to 3.23.5.
- [Release notes](https://github.com/shirou/gopsutil/releases)
- [Commits](https://github.com/shirou/gopsutil/compare/v3.23.3...v3.23.5)

---
updated-dependencies:
- dependency-name: github.com/shirou/gopsutil/v3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:56 +08:00
dependabot[bot] 7ba52ca450
chore(deps): bump google.golang.org/grpc from 1.56.0-dev to 1.57.0-dev (#2433)
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.56.0-dev to 1.57.0-dev.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.56.0-dev...v1.57.0-dev)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:56 +08:00
dependabot[bot] a645c921ad
chore(deps): bump k8s.io/component-base from 0.26.0 to 0.27.2 (#2432)
Bumps [k8s.io/component-base](https://github.com/kubernetes/component-base) from 0.26.0 to 0.27.2.
- [Commits](https://github.com/kubernetes/component-base/compare/v0.26.0...v0.27.2)

---
updated-dependencies:
- dependency-name: k8s.io/component-base
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:34:56 +08:00
Gaius 691e884d35
feat: remove useless fields in network topology (#2439)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:56 +08:00
Gaius f610ab9c0d
test: add ParseProbedCountKeyInScheduler and Snapshot tests (#2438)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:56 +08:00
Gaius 0d3cc98f25
feat: add storage to trainer (#2431)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:56 +08:00
Gaius 274c6d04e6
feat: support to collect and snapshot in network topology (#2429)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:56 +08:00
dlut_xz 7fbe7553f9
test: optimize network topology and probes unit tests (#2425)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:56 +08:00
Gaius 7546bfc945
feat: add ip to uk_scheduler index and uk_seed_peer index in manager (#2426)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:55 +08:00
dlut_xz e6049d2362
test: add delete host unit tests (#2424)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:55 +08:00
ZouYu bf562a8078
test: add unit test for Bytes.Set (#2422)
Signed-off-by: Zou Yu <zouy.fnst@fujitsu.com>
2023-06-28 17:34:55 +08:00
ZouYu 021fcd0429
test: add unit test for MakeProbedAtKeyInScheduler (#2423)
Signed-off-by: Zou Yu <zouy.fnst@fujitsu.com>
2023-06-28 17:34:55 +08:00