Commit Graph

300 Commits

Author SHA1 Message Date
Gaius 7551b71743
fix: count of total page in pagination (#1993)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:23 +08:00
Gaius c89234e976
feat: add manager v2 api (#1990)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:23 +08:00
Gaius 4755fca7f2
feat: searcher can not found candidate scheduler clusters, return all scheduler clusters (#1991)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:23 +08:00
cuidajun 29b8ade7ef
docs: fix manager swag error (#1982)
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:22 +08:00
Gaius e4fc6d5c85
feat: add S3ForcePathStyle to object storage (#1976)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:22 +08:00
Gaius 008eeb980b
feat: add IPAddresses and DNSNames to sans of the cert (#1930)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
Gaius 731ecc1234
feat: change yaml field type from string to net.IP (#1929)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
Gaius af76512b2a
feat: update version guage metrics (#1927)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
Gaius 73ebf093bb
fix: application not found (#1924)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:17 +08:00
Gaius c20c457abd
feat: handle application not found (#1913)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius 473c5d33f7
feat: update priority api (#1912)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius f120c8778b
feat: support redis sentinal (#1910)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Bin Liu da32249444
feat: update submodule console (#1908)
Signed-off-by: bin liu <liubin0329@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius 481df276a3
feat: dynconfig adds list application in scheduler (#1903)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:15 +08:00
Gaius 265375c0e9
feat: rename url priority struct and remove PriorityLevel constants (#1902)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:15 +08:00
Gaius d4bd4ef37b
feat: add priority to application in manager (#1901)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:15 +08:00
Gaius 63b4a868dc
refactor: back-to-source configuration (#1895)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:15 +08:00
Gaius 8023aba2cf
feat: remove relation of application (#1894)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:15 +08:00
Gaius 45ad287250
feat: add mysql read and write timeout (#1868)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:13 +08:00
Gaius 68172eee24
feat: manager changes filterParentLimit value (#1859)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:12 +08:00
Gaius 2421ce88f4
feat: add announcer to dfdameon (#1852)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
Gaius fc0eccaf74
feat: optimize manager log (#1846)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
Gaius f194f0961f
feat: scheduler adds announce host handler (#1843)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
Gaius ca9afc5b9d
feat: update concurrent-map version (#1837)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:10 +08:00
Gaius 0f8b75808a
feat: add timeout grpc and job (#1830)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:10 +08:00
Gaius d2f98d1429
feat: optimize preheat log (#1827)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
Gaius 3da67311ea
feat: optimize preheat (#1824)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
Gaius 4bd7d413f2
feat: add workHome and pluginDir to configuration (#1807)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:08 +08:00
Gaius 7e24a85efa
feat: add calculateParentHostUploadSuccessScore to scheduler (#1789)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
glin-gogogo e4957158e8
feat: obs object storage support (#1758) 2023-06-28 17:34:03 +08:00
Gaius 0a870e0844
fix: manager PeerGauge (#1761)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:03 +08:00
Gaius 2543ecbc38
chore: update console submodule (#1755)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 61a6e545e5
feat: change FilterParentRangeLimit validation (#1752)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 27d8cf51db
feat: gin logger rotation (#1749)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 25384fc345
chore: update console submodule (#1748)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 6b385cf8fb
fix: gorm can not update is_default field (#1731)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
Gaius 8a98a4ab9f
feat: searcher calculates cluster type (#1729)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:00 +08:00
Gaius f354ee3861
refactor: manager and scheduler config (#1701)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
Jim Ma 89376d6c4e
feat: ipv6 support (#1685)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
Gaius 791d031be9
feat: manager add advertiseIP (#1695)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
Gaius 13caf6f0c2
refactor: listenIP and advertiseIP (#1694)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:56 +08:00
cuidajun 8e095a09c9
fix: manager redis config convert (#1680)
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:33:55 +08:00
Gaius 65f231fb68
chore: update helm-charts submodule version (#1669)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:55 +08:00
Gaius 29d4452277
feat: support redis cluster (#1667)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:54 +08:00
Gaius 15d35b1464
feat: set created_at and updated_at to timestamp (#1659)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:54 +08:00
Gaius 42e5e2700d
feat: stat peer metrics with memory cache (#1660)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:54 +08:00
Gaius b6c395a6cb
feat: add cert spec to security configuration (#1621)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:51 +08:00
Gaius 6fcf059dca
feat: manager add cert spec (#1619)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Gaius 13580f89f2
refactor: dfpath for certify cache dir (#1618)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Gaius 43d8478507
feat: add tls policy to scheduler grpc server (#1616)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Gaius 307839ecbd
feat: add tls policy to manager grpc server (#1611)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Gaius 9ab33635c5
feat: manager init cert for grpc server (#1603)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:49 +08:00
Jim Ma c5a8512cb6
feat: add common serialize package (#1601)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:48 +08:00
Jim Ma 5e1037d72f
chore: update new manager (#1597)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:48 +08:00
Gaius 71059d2393
feat: PeerGauge adds version and commit labels (#1596)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:48 +08:00
Jim Ma 717ac99ef5
feat: daemon support auto issue certificate (#1586)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:48 +08:00
Gaius 066fc3f3af
feat: add default metrics address (#1595)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:47 +08:00
Gaius 5b802eac0d
feat: manager add certificate config (#1583)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:47 +08:00
Jim Ma 539c772948
feat: manager implements issue certificate grpc (#1577)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:47 +08:00
Gaius 272f38f567
feat: grpc add ratelimit (#1572)
feat: grpc ratelimit

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:46 +08:00
Gaius a88e57e077
feat: manager adds model and model version grpc api (#1569)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:45 +08:00
Gaius 393c8bfb5a
feat: model version add training result (#1558)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:44 +08:00
Gaius 8134308065
feat: storage calculate the count of records (#1557)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:44 +08:00
Gaius 485c1faba7
feat: model and model version api removes auth (#1556)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:44 +08:00
Gaius 2ce864fbf6
fix: scheduler and manager tracing (#1551)
fix: scheduler and manager trace

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:44 +08:00
Gaius 72b20dc00b
feat: scheduler and manager change graceful stop timeout (#1540)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:43 +08:00
Gaius 984d1d06e9
feat: change update model api (#1538)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:43 +08:00
Gaius 5da2d83990
feat: manager adds model and model version api (#1530)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:42 +08:00
Gaius 585884f01d
feat: manager embed frontend assets (#1523)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:42 +08:00
Gaius c216872b5d
feat: store preheat result (#1516)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:41 +08:00
Gaius d79f6405ff
feat: replace grpc package with https://github.com/dragonflyoss/api (#1515)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:41 +08:00
Gaius 642cc5d0f3
feat: scheduler adds filter range limit (#1497)
* feat: scheduler adds filter range limit

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
Gaius 7d3c9d539d
refactor: cache key for peer (#1483)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 7f8dc02708
feat: manager support postgres (#1459)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius 812ff5557b
fix: metrics reduces labels (#1457)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius cc758e30d3
refactor: rewrite math max and min with generics (#1447)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius b3884178fb
feat: change local cache ttl (#1436)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
1037husterljx 3eccba8e21
Added unit tests on configuration (#1430)
Signed-off-by: ljx373327 <ljx373327@alibaba-inc.com>

Co-authored-by: ljx373327 <ljx373327@alibaba-inc.com>
2023-06-28 17:33:33 +08:00
Jim Ma 776a0fef42
feat: concurrent multiple pieces back source (#1426)
* feat: concurrent multiple pieces back source
* chore: update http source client

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:33 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius 0222649b88
feat: update namely/protoc-all image version to 1.47_0 (#1418)
* feat: update namely/protoc-all image version to 1.47_0

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate mock file

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius ad36eb64a7
feat: remove github/pkg/errors package (#1416)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
embroede d7b1bef09b
feat: enable configuration of the tls parameter for the mysql connection. i.e. tls=preferred (#1300)
* Default to tls=preferred for mysql connection

For communication from manager to mysql server, use `tls=preferred`
parameter to enable TLS whenever possible.

Signed-off-by: Edward Broeder <eddie.broeder@intel.com>

* Make mysql tls parameter configurable

Allow the user to specify the tls setting for the
mysql connection. An example would be setting tls
to "preferred", or "true". This is separate to
the tlsConfig config parameter, which is used to
set up a custom tls config, where tls key/certs
are specified.

See the tls parameter section in the below link:
https://pkg.go.dev/github.com/go-sql-driver/mysql#section-readme

Signed-off-by: Edward Broeder <eddie.broeder@intel.com>
2023-06-28 17:33:31 +08:00
Gaius 4f2f760b5e
chore: update submodule version
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:31 +08:00
Gaius 30313a4caa
feat: client add create object storage (#1409)
* feat: add create object storage rest api

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:30 +08:00
Gaius 5aa7e27cfe
feat: seed peer add object storage port (#1408)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:30 +08:00
Gaius 7a30db3fba
refactor: pkg util (#1402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius f688d341bd
feat: remove cdn (#1401)
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius d392b9f8aa
feat: add seed peer for list scheduler grpc interface (#1393)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:28 +08:00
Gaius 171c0d54ee
feat: dfdaemon add object storage rest api (#1390)
* feat: dfdaemon add object storage rest api

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:28 +08:00
Gaius 4889a37886
feat: replace gin-gonic/gin with gorilla/mux (#1389)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:28 +08:00
chmod100 2441ae85c9
fix: count error & totalPage error (#1373) (#1376)
Signed-off-by: LetFu <letfu@outlook.com>
2023-06-28 17:33:27 +08:00
Gaius 5b323b00b4
fix: manager router middlewares order (#1385)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius 0544527aea
feat: add enable config to peer gauge (#1382)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius 2362a670bd
fix: preheat tack id (#1375)
* fix: preheat with task id

Signed-off-by: Gaius <gaius.qi@gmail.com>

* fix: add end time to seed piece

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius 31a2c27a7c
feat: dynconfig add object storage (#1369)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius e3cfd49808
feat: manager add bucket interface (#1368)
* feat: manager add bucket interface

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: add bucket swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius e9a6be1ea8
feat: add objectstorage pkg (#1366)
* feat: add objectstorage pkg

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius 866eafe2c7
feat: remove preheat tag validate with required (#1363)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:26 +08:00
Gaius 085b4375aa
feat: update console and helm-charts submodule (#1355)
* feat: update submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: update submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:25 +08:00