Commit Graph

58 Commits

Author SHA1 Message Date
Gaius 4e65b41202
feat: add logLevel and remove verbose (#4157)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-06-24 07:27:28 +00:00
Gaius cee86a5341
feat: update Redis connection pool configuration (#4086)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-05-20 12:30:56 +08:00
Gaius 545f8c078e
feat(manager): add redis proxy for manager and support redis username (#4041)
feat(manager): add redis proxy for manager

Signed-off-by: Gaius <gaius.qi@gmail.com>
2025-05-08 03:46:47 +00:00
Chlins Zhang 50083ff6b4
refactor: remove legacy job gc config (#3995)
Signed-off-by: chlins <chlins.zhang@gmail.com>
2025-04-25 07:03:11 +00:00
Gaius a97584a104
feat: delete jobs in batches (#3682)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-04 12:32:32 +08:00
Gaius aa78396155
feat: optimize implement of the sync peers (#3677)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-11-29 21:13:12 +08:00
Gaius b31e5bea91
feat: add rate limit for job open api by cluster (#3638)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-11-08 15:18:07 +08:00
Gaius e3b85839ab
feat: support set self-signed cert for service (#3568)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-10-11 23:42:34 +08:00
Gaius ea850f7f95
feat: support preheat with self-signed certs (#3541)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-09-26 22:51:11 +08:00
Gaius d5eef60114
feat: clean up expired jobs to prevent performance problems (#3504)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-09-11 22:44:14 +08:00
Gaius 75d624260f
feat: add ratelimit for job in manager (#3480)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-09-03 18:36:51 +08:00
Gaius e0e96543d8
feat: remove trainer and model
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-08-27 14:03:04 +08:00
embroede 79c3390d8c
feat: make log rotation settings configurable (#3085)
Signed-off-by: Edward Broeder <eddie.broeder@intel.com>
2024-02-28 16:36:43 +08:00
Gaius ea28581bbe
feat: update scheduler and seed peer by ip and port (#3012)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-01-10 12:36:45 +08:00
pbannykh 189ea6c61c
fix: add option to disable prepared statement for postgres (#2768)
* fix: add option to disable prepared statement for postgres

Signed-off-by: bannykh <bannykh@tochka.com>

* fix: add option to disable prepared statement for postgres

Signed-off-by: bannykh <bannykh@tochka.com>

---------

Signed-off-by: bannykh <bannykh@tochka.com>
2023-10-08 10:47:01 +08:00
Gaius fe28ba4c8e
feat: merge sync peer with peer table in manager (#2668)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-24 10:28:08 +08:00
Gaius dfde8bdce6
feat: add sync peer job for scheduler (#2663)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-22 19:58:27 +08:00
Gaius c04462e93c
feat: peer information is changed from being stored in metrics to being stored in mysql (#2654)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-22 10:38:27 +08:00
Gaius a5b0f7404d
feat: download tiny file with https scheme (#2617)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-10 16:29:28 +08:00
Gaius 7f67bc52ab
feat: add tls client config for preheat in manager (#2612)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-08-08 22:54:19 +08:00
Gaius 75ddb8b554
feat: support tls in manager rest server (#2580)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-31 16:36:57 +08:00
Min 07366174b5
feat: manager adds trainer config (#2494)
Signed-off-by: huangmin <2107139596@qq.com>
2023-06-29 18:51:24 +08:00
Gaius ad9d279dc5
feat: remove compatibility logic for manager config testing (#2342)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:50 +08:00
Gaius 87a7f1e130
feat: add advertisePort to manager (#2189)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:39 +08:00
Gaius e9da69dc40
feat: add auth config to manager (#2161)
Fix https://github.com/dragonflyoss/Dragonfly2/security/advisories/GHSA-hpc8-7wpm-889w.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:37 +08:00
Gaius c672e75ed8
test: add Validate test to scheduler config (#2129)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:35 +08:00
Gaius 06022edd15
test: add Validate test to manager config (#2128)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:35 +08:00
Gaius e4fc6d5c85
feat: add S3ForcePathStyle to object storage (#1976)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:22 +08:00
Gaius 008eeb980b
feat: add IPAddresses and DNSNames to sans of the cert (#1930)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
Gaius 731ecc1234
feat: change yaml field type from string to net.IP (#1929)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:18 +08:00
Gaius f120c8778b
feat: support redis sentinal (#1910)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius 4bd7d413f2
feat: add workHome and pluginDir to configuration (#1807)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:08 +08:00
Gaius f354ee3861
refactor: manager and scheduler config (#1701)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
Jim Ma 89376d6c4e
feat: ipv6 support (#1685)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
Gaius 791d031be9
feat: manager add advertiseIP (#1695)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:57 +08:00
Gaius 13caf6f0c2
refactor: listenIP and advertiseIP (#1694)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:56 +08:00
Gaius 29d4452277
feat: support redis cluster (#1667)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:54 +08:00
Gaius b6c395a6cb
feat: add cert spec to security configuration (#1621)
Signed-off-by: Gaius <gaius.qi@gmail.com>
Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:51 +08:00
Gaius 6fcf059dca
feat: manager add cert spec (#1619)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Gaius 13580f89f2
refactor: dfpath for certify cache dir (#1618)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Gaius 307839ecbd
feat: add tls policy to manager grpc server (#1611)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Gaius 5b802eac0d
feat: manager add certificate config (#1583)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:47 +08:00
Gaius 5da2d83990
feat: manager adds model and model version api (#1530)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:42 +08:00
Gaius 585884f01d
feat: manager embed frontend assets (#1523)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:42 +08:00
Gaius 7f8dc02708
feat: manager support postgres (#1459)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
1037husterljx 3eccba8e21
Added unit tests on configuration (#1430)
Signed-off-by: ljx373327 <ljx373327@alibaba-inc.com>

Co-authored-by: ljx373327 <ljx373327@alibaba-inc.com>
2023-06-28 17:33:33 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
embroede d7b1bef09b
feat: enable configuration of the tls parameter for the mysql connection. i.e. tls=preferred (#1300)
* Default to tls=preferred for mysql connection

For communication from manager to mysql server, use `tls=preferred`
parameter to enable TLS whenever possible.

Signed-off-by: Edward Broeder <eddie.broeder@intel.com>

* Make mysql tls parameter configurable

Allow the user to specify the tls setting for the
mysql connection. An example would be setting tls
to "preferred", or "true". This is separate to
the tlsConfig config parameter, which is used to
set up a custom tls config, where tls key/certs
are specified.

See the tls parameter section in the below link:
https://pkg.go.dev/github.com/go-sql-driver/mysql#section-readme

Signed-off-by: Edward Broeder <eddie.broeder@intel.com>
2023-06-28 17:33:31 +08:00
Gaius 0544527aea
feat: add enable config to peer gauge (#1382)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:27 +08:00
Gaius e9a6be1ea8
feat: add objectstorage pkg (#1366)
* feat: add objectstorage pkg

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:26 +08:00