Commit Graph

179 Commits

Author SHA1 Message Date
Gaius 642cc5d0f3
feat: scheduler adds filter range limit (#1497)
* feat: scheduler adds filter range limit

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
Gaius 7d3c9d539d
refactor: cache key for peer (#1483)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 7f8dc02708
feat: manager support postgres (#1459)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius 812ff5557b
fix: metrics reduces labels (#1457)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius cc758e30d3
refactor: rewrite math max and min with generics (#1447)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius b3884178fb
feat: change local cache ttl (#1436)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
1037husterljx 3eccba8e21
Added unit tests on configuration (#1430)
Signed-off-by: ljx373327 <ljx373327@alibaba-inc.com>

Co-authored-by: ljx373327 <ljx373327@alibaba-inc.com>
2023-06-28 17:33:33 +08:00
Jim Ma 776a0fef42
feat: concurrent multiple pieces back source (#1426)
* feat: concurrent multiple pieces back source
* chore: update http source client

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:33 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418)
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius ad36eb64a7
feat: remove github/pkg/errors package (#1416)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
embroede d7b1bef09b
feat: enable configuration of the tls parameter for the mysql connection. i.e. tls=preferred (#1300)
* Default to tls=preferred for mysql connection

For communication from manager to mysql server, use `tls=preferred`
parameter to enable TLS whenever possible.

Signed-off-by: Edward Broeder <eddie.broeder@intel.com>

* Make mysql tls parameter configurable

Allow the user to specify the tls setting for the
mysql connection. An example would be setting tls
to "preferred", or "true". This is separate to
the tlsConfig config parameter, which is used to
set up a custom tls config, where tls key/certs
are specified.

See the tls parameter section in the below link:
https://pkg.go.dev/github.com/go-sql-driver/mysql#section-readme

Signed-off-by: Edward Broeder <eddie.broeder@intel.com>
2023-06-28 17:33:31 +08:00
Gaius 4f2f760b5e
chore: update submodule version
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
Gaius 30313a4caa
feat: client add create object storage (#1409)
* feat: add create object storage rest api

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:30 +08:00
Gaius 5aa7e27cfe
feat: seed peer add object storage port (#1408)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:30 +08:00
Gaius 7a30db3fba
refactor: pkg util (#1402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius f688d341bd
feat: remove cdn (#1401)
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius d392b9f8aa
feat: add seed peer for list scheduler grpc interface (#1393)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:28 +08:00
Gaius 171c0d54ee
feat: dfdaemon add object storage rest api (#1390)
* feat: dfdaemon add object storage rest api

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:28 +08:00
Gaius 4889a37886
feat: replace gin-gonic/gin with gorilla/mux (#1389)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:28 +08:00
chmod100 2441ae85c9
fix: count error & totalPage error (#1373) (#1376)
Signed-off-by: LetFu <letfu@outlook.com>
2023-06-28 17:33:27 +08:00
Gaius 5b323b00b4
fix: manager router middlewares order (#1385)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius 0544527aea
feat: add enable config to peer gauge (#1382)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius 2362a670bd
fix: preheat tack id (#1375)
* fix: preheat with task id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: add end time to seed piece

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius 31a2c27a7c
feat: dynconfig add object storage (#1369)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius e3cfd49808
feat: manager add bucket interface (#1368)
* feat: manager add bucket interface

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: add bucket swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius e9a6be1ea8
feat: add objectstorage pkg (#1366)
* feat: add objectstorage pkg

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius 866eafe2c7
feat: remove preheat tag validate with required (#1363)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius 085b4375aa
feat: update console and helm-charts submodule (#1355)
* feat: update submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:25 +08:00
Gaius 372a82e516
feat: add security group id with scheduler cluster (#1354)
* feat: add security group id with scheduler cluster

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:25 +08:00
Gaius 74233b1077
fix: create_at timestamp (#1341)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:23 +08:00
Gaius 3bd1f03c43
feat: custom preheat tag parameters (#1324)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:21 +08:00
Gaius b64412515a
feat: get active peer count (#1315)
* feat: get active peer count

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add peers handler

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:20 +08:00
Gaius faa5e4e465
feat: add seed peer logic (#1302)
* feat: announce seed peer

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn logic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn job

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfdaemon change host uuid to host id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: go generate mocks

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: remove cdn compatibility

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: change docker compose

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: reuse panic

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: compatible with v2.0.3-beta.2

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00
Gaius 2cfbb91174
feat: manager add seed peer (#1293)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:18 +08:00
Jim Ma 1025dc2dc5
feat: redirect daemon stdout stderr to file (#1244)
1. redirect daemon stdout stderr to file
2. fix wrong zap grpc log output

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
Gaius 1d126fa016
feat: update to v2.0.2 (#1232)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius ccb6495b49
feat: update manager console (#1222)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius 09d41ea1b0
chore: update manager console commit (#1219)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius 288ca4eb72
feat: manager validate with config (#1218)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius 75ef6fc2d0
feat: cannot delete a cluster with existing instances (#1213)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius f5d372bab4
feat: if the number of failed peers in the task is greater than FailedPeerCountLimit, then scheduler notifies running peers of failure (#1211)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius 2bcdba6401
feat: add grpc health interface (#1195)
* feat: add grpc health interface

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add dfdaemon upload server healthy interface

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 738e5edfbe
feat: manage GetCDN interface return scheduler info (#1184)
* feat: generate manager protoc

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: manager cdn add scheduler info

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius ce8505415d
feat: dfdaemon match scheduler with case insensitive (#1181)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:08 +08:00
Gaius e77acb0692
feat: add RBAC to manager config interface (#1179)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
Gaius 9666b89c9a
feat: seacher return multiple scheduler clusters (#1175)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:07 +08:00
Gaius c55e05a1e6
feat: change default scheduler filter parent limit (#1166)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:06 +08:00
Gaius 7adee4c2d9
feat: host remove peer (#1161)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:05 +08:00
Gaius 4ab498837c
test: add scheduler constructSuccessPeerPacket case (#1154)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:04 +08:00