Commit Graph

300 Commits

Author SHA1 Message Date
Gaius 0ffc55b6d4
refactor: trainer server module (#2486)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
Gaius b2cb2ed024
feat: add Access-Control-Expose-Headers to headers (#2467)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:58 +08:00
embroede 8c905d9b8d
feat: enable configuration of some directory modes for dfdaemon (#2340)
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:57 +08:00
Gaius 7546bfc945
feat: add ip to uk_scheduler index and uk_seed_peer index in manager (#2426)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:55 +08:00
Gaius 81817666e5
feat: move redis key to pkg/redis package (#2378)
Network Topology adds functions to new redis key and move the manager's redis key to pkg/redis.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:52 +08:00
Gaius 25edc40937
fix: evaluate after filter (#2363)
Since the final length of the filter is the candidateParentLimit used,
the parents after the filter is the returned parents.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:51 +08:00
Gaius b97c0cb0ae
feat: remove deprecated field in manager and scheduler (#2345)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:50 +08:00
Gaius ad9d279dc5
feat: remove compatibility logic for manager config testing (#2342)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:50 +08:00
Gaius ca23e97e9a
feat: add CORS middleware to manager (#2304)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:48 +08:00
Gaius 8787b0b239
feat: add Access-Control-Allow-Credentials to rest api (#2302)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:48 +08:00
Gaius e403e62551
feat: move redis package to pkg dir (#2294)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:47 +08:00
Gaius 95237bd5f8
feat: optimize model rest api in manager (#2291)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:47 +08:00
MinH-09 43a2bf2407
feat: add model operation api (#2276)
Signed-off-by: MinH-09 <2107139596@qq.com>
2023-06-28 17:34:47 +08:00
Gaius aa90014804
feat: add cluster api in manager (#2288)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:47 +08:00
Gaius 37c588608a
feat: remove security domain (#2285)
* feat: remove security domain

Remove security domain in dfdaemon and scheduler.
Remove SecurityGroup and SecurityRule table in manager.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:46 +08:00
Gaius 65bf673d2d
fix: ip and hostname params in FindSchedulerClusters (#2249)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:44 +08:00
Gaius 86fb02b333
feat: update d7y.io/api package and change cpu percent validation (#2236)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:43 +08:00
Gaius 4f65acf24e
feat: when the cache is missing, change the error log to a warning log (#2235)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:43 +08:00
Gaius 7900835c48
feat: if the scheduler feature is not in feature flags, then it will stop providing the featrue (#2234)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:43 +08:00
Gaius acb8f70f90
feat: add logger.CoreLogger to searcher plugin (#2232)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:42 +08:00
Gaius 152e0c0946
feat: add log to searcher plugin (#2231)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:42 +08:00
Gaius 7a1ae0a2ee
test: add new metrics test to service (#2212)
test: add new metric test to service

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:41 +08:00
Gaius 6b7dcfef50
feat: add CreateModel func to manager grpc client (#2207)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:41 +08:00
Gaius 6ac9f7f305
feat: rename SecurityService to Security (#2206)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:41 +08:00
Gaius 2cda1def7f
feat: rename HostName to Hostname (#2205)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:40 +08:00
Gaius 9639918c0f
feat: remove model migration (#2204)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:40 +08:00
Gaius bf0a18230e
feat: change default value of dynconfig cache (#2203)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:40 +08:00
Gaius 729a856f45
feat: add index uk_model to model table (#2196) 2023-06-28 17:34:39 +08:00
Gaius 6bc886a8a2
feat: remove model api (#2194)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:39 +08:00
Gaius ae884dde79
feat: add inference model table in database (#2192)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:39 +08:00
Gaius b1171f4bd4
feat: rename manager/model to manager/models (#2191)
The manager model package is renamed to models to
prevent the same name as the future inference model database table.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:39 +08:00
Gaius 87a7f1e130
feat: add advertisePort to manager (#2189)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:39 +08:00
Gaius a2c7155751
fix: manager metrics Subsystem (#2175)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:38 +08:00
Gaius 8b65c0c913
feat: add error log to database in manager (#2172)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:38 +08:00
Gaius e9da69dc40
feat: add auth config to manager (#2161)
Fix https://github.com/dragonflyoss/Dragonfly2/security/advisories/GHSA-hpc8-7wpm-889w.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:37 +08:00
Gaius 6d13b4a871
feat: add metrics to service v2 (#2153)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:36 +08:00
Gaius 87873bf146
feat: add SearchSchedulerClusterCount metric to manager (#2152)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:36 +08:00
Matias Insaurralde 0b4a76ca80
Compile API group regexp only once (#2135)
refactor: compile API group regexp only once
2023-06-28 17:34:35 +08:00
Gaius c672e75ed8
test: add Validate test to scheduler config (#2129)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:35 +08:00
Gaius 06022edd15
test: add Validate test to manager config (#2128)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:35 +08:00
Gaius 7306aec508
feat: correct grpc error code and implement StatPeer and LeavePeer (#2115)
Correct grpc error from codes.Unknow to codes.Internal in gorm
operation. Implement StatPeer and LeavePeer interface in v2 version of
grpc.

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:34 +08:00
Gaius 31011b3021
refactor: preheat job (#2113)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:33 +08:00
Gaius 81785231e9
feat: add CIDR affinity to searcher (#2111)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:33 +08:00
Gaius 2f4cc5d24f
feat: remove Scopes and SecurityGroup in seed peer cluster (#2110)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:33 +08:00
Gaius 58034e4b1f
refactor: scheduling with v2 grpc (#2104)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:32 +08:00
Gaius 79024c87ca
refactor: parse http range (#2071)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:30 +08:00
Gaius 1409e37ba3
feat: set gorm log level (#2063) 2023-06-28 17:34:29 +08:00
Gaius c1066e60f4
feat: change ok to loaded in loading func (#2010)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:25 +08:00
Gaius 1666a17827
feat: remove NetTopology from scheduler and manager (#2007)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:25 +08:00
Gaius e83fb85216
feat: add v2 verison of the grpc to scheduler (#1999)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:24 +08:00