9d1e07c3a3
feat: implement Train grpc api in trainer ( #2541 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 15:46:27 +08:00
a7f3c7c0b9
feat: add GNNModelIDV1 and MLPModelIDV1 in idgen ( #2540 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-07-12 14:32:41 +08:00
aa95dfe52d
feat: add pieces element in download record ( #2531 )
...
Signed-off-by: XZ <834756128@qq.com>
2023-07-12 10:35:20 +08:00
4a83dd8ccd
test: add unit tests for DownloadCount and NetworkTopologyCount ( #2512 )
...
test: add unit test for DownloadCount and NetworkTopologyCount
Signed-off-by: Guangwen Feng <fenggw-fnst@fujitsu.com>
2023-07-04 17:13:25 +08:00
691e884d35
feat: remove useless fields in network topology ( #2439 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:56 +08:00
f610ab9c0d
test: add ParseProbedCountKeyInScheduler and Snapshot tests ( #2438 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:56 +08:00
274c6d04e6
feat: support to collect and snapshot in network topology ( #2429 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:56 +08:00
ddcea685e7
fix: when bufferSize is zero, storage can not write data to file ( #2366 )
...
When bufferSize is zero, createDownload and createNetworkTopology
can not write data to file, because buffer is empty.
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:51 +08:00
91853edb07
feat: add network topology storage interface ( #2286 )
...
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:47 +08:00
37c588608a
feat: remove security domain ( #2285 )
...
* feat: remove security domain
Remove security domain in dfdaemon and scheduler.
Remove SecurityGroup and SecurityRule table in manager.
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:46 +08:00
8d29390b51
feat: rename Record to Download in storage ( #2253 )
...
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:45 +08:00
2b9aa7bf83
refactor: resource host without scheduler v1 definition ( #2036 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:27 +08:00
1666a17827
feat: remove NetTopology from scheduler and manager ( #2007 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:25 +08:00
da40946f17
feat: storage collects upload piece count, peer cost and error details ( #1907 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
8749814dee
feat: add the timeout of downloading piece to scheduler ( #1880 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:14 +08:00
3af4cc7a0f
feat: scheduler supports storage config ( #1864 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:12 +08:00
4f91332992
feat: store peer download information ( #1863 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:12 +08:00
3587ba9537
feat: scheduler's record adds ParentUploadCount and ParentUploadFailedCount ( #1795 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
7e24a85efa
feat: add calculateParentHostUploadSuccessScore to scheduler ( #1789 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:06 +08:00
8134308065
feat: storage calculate the count of records ( #1557 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:44 +08:00
ff29d150e0
feat: add MultiReadCloser and storage add open func ( #1546 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:43 +08:00
c6a019560d
feat: proxy add defaultTag field ( #1462 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
faa5e4e465
feat: add seed peer logic ( #1302 )
...
* feat: announce seed peer
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn logic
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn job
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: dfdaemon change host uuid to host id
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: go generate mocks
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: remove cdn compatibility
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: change docker compose
Signed-off-by: Gaius <gaius.qi@gmail.com>
* fix: reuse panic
Signed-off-by: Gaius <gaius.qi@gmail.com>
* feat: compatible with v2.0.3-beta.2
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:19 +08:00
51ea3c5641
test: fix storage backups ( #1270 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:16 +08:00
34f5a83f03
test: scheduler storage ( #1257 )
...
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:14 +08:00
b2c9577e7b
Add csv storage to scheduler ( #1234 )
...
* feat: scheduler add csv storage for peer data
* feat: add storage configuration to scheduler
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
Gaius