Commit Graph

1241 Commits

Author SHA1 Message Date
Gaius 7c2ee7858b
refactor: set and dag with generics (#1490)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
cuidajun 1d7c87627c
fix: oss client judge directory bug (#1488)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:38 +08:00
Gaius 0bd894adad
fix: dfdaemon unix socket (#1489)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Jim Ma c921c265c5
fix: init storage error (#1486)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:38 +08:00
Jim Ma 59060ef277
fix: back source error (#1485)
Signed-off-by: Jim Ma <majinjing3@gmail.com>

Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 6991583ef0
fix: keepalive with ip
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 7d3c9d539d
refactor: cache key for peer (#1483)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 5bf763c119
test: find parent with ancestor (#1482)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 527990620b
refactor: scheduler training configuration
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
wd665544 1880429e73
add config 2023-06-28 17:33:38 +08:00
Gaius 9cb3417986
refactor: dag GetSourceVertices and GetSinkVertices func
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
wd665544 434e8c704f
add dag interface 2023-06-28 17:33:37 +08:00
Gaius 885bcf682f
feat: remove test print
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
Gaius ed4c381383
feat: rename steal peers to candidate peers (#1476)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
Gaius 46deb4fccf
Use dag to represent peer scheduling topology (#1473)
* feat: use dag to represent peer scheduling topology

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
Gaius f9d2736ae8
feat: scheduler merge end of piece and piece from seed peer (#1474)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
zc 1936acfd07
adjust the configuration check sequence (#1467)
Signed-off-by: zc <zc2638@qq.com>
2023-06-28 17:33:37 +08:00
Gaius 96e62223b4
feat: dfdaemon add default healthy config (#1472)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
cuidajun abec6d3a84
fix: upload_manager write header in time (#1471)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:37 +08:00
Gaius cd0ecceacf
feat: dag adds LenVertex and RangeVertex func (#1470)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius e74a05685e
fix: infinite loop in peer.Ancestors() (#1469)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius 4d71217572
feat: generate dag mock
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius c79bd943bb
feat: add directed acyclic graph package (#1468)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
cuidajun c6654cb4ae
fix: upload_manager write header immediately when it is ready (#1466)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:36 +08:00
1037husterljx 31032e05aa
fix [4000] digest not set error (#1465)
Signed-off-by: ljx373327 <ljx373327@alibaba-inc.com>

Co-authored-by: ljx373327 <ljx373327@alibaba-inc.com>
2023-06-28 17:33:36 +08:00
cuidajun 8173c11d3a
fix oss client download bug; support oss recursive download; (#1448)
* feat: dfget support oss recursive download

Signed-off-by: bigerous <bigerous@qq.com>

* refactor recursive download

Signed-off-by: bigerous <bigerous@qq.com>

* remove URLEntry interface, use simple struct

Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:36 +08:00
Gaius c6a019560d
feat: proxy add defaultTag field (#1462)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius 7f8dc02708
feat: manager support postgres (#1459)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
cuidajun acbe5d70c7
fix dfget disable-back-source flag error (#1449)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:35 +08:00
Gaius 601993aa46
feat: use os.PathSeparator to generate object key
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius 812ff5557b
fix: metrics reduces labels (#1457)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius 70ed392263
feat: scheduler add data dir (#1453)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius c205330881
feat: dfdaemon is compatible with v2.0.2 (#1452)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius b8b0fb1ba7
fix: depth limit (#1451)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius 9b7e8d70c8
feat: add slices util package
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Jim Ma 9f360c1b03
feat: reload proxy option (#1443)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:35 +08:00
Jim Ma 1cf39f3f9b
chore: check header length before update (#1445)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius cc758e30d3
refactor: rewrite math max and min with generics (#1447)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius f499d66598
fix: dfpath creates redundant directories (#1446)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
Gaius 8cf344992f
feat: if peer back-to-source failed, return source metadata. (#1444)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
Jim Ma 3c107f9add
feat: report peer result with source error detail (#1439)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:34 +08:00
Gaius 1ab97de237
fix: release package name (#1442)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
Jim Ma 181a6ba87f
chore: update test/tools/no-content-length/main.go (#1440)
* chore: update test/tools/no-content-length/main.go

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:34 +08:00
Gaius 93a8ebb4bc
feat: add dfstore command (#1441)
* feat: add dfstore command

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
Jim Ma cf7debf9c4
feat: back source error detail (#1437)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:34 +08:00
Gaius b3884178fb
feat: change local cache ttl (#1436)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:34 +08:00
1037husterljx 3eccba8e21
Added unit tests on configuration (#1430)
Signed-off-by: ljx373327 <ljx373327@alibaba-inc.com>

Co-authored-by: ljx373327 <ljx373327@alibaba-inc.com>
2023-06-28 17:33:33 +08:00
Gaius 9eaf08a193
feat: if service can not found fqdn, replace fqdn with hostname (#1435)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:33 +08:00
Gaius f68ce30f26
feat: remove errors package (#1434)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:33 +08:00
Gaius 4e57177055
chore: upgrade kind node version (#1433)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:33 +08:00