Commit Graph

904 Commits

Author SHA1 Message Date
Jim Ma ddfdb24dbf
fix: auto switch to concurrent back source (#1507)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:40 +08:00
dependabot[bot] 9e1329296e
chore(deps): bump go.opentelemetry.io/otel/exporters/jaeger from 1.7.0 to 1.8.0 (#1506)
chore(deps): bump go.opentelemetry.io/otel/exporters/jaeger

Bumps [go.opentelemetry.io/otel/exporters/jaeger](https://github.com/open-telemetry/opentelemetry-go) from 1.7.0 to 1.8.0.
- [Release notes](https://github.com/open-telemetry/opentelemetry-go/releases)
- [Changelog](https://github.com/open-telemetry/opentelemetry-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/open-telemetry/opentelemetry-go/compare/v1.7.0...v1.8.0)

---
updated-dependencies:
- dependency-name: go.opentelemetry.io/otel/exporters/jaeger
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:40 +08:00
dependabot[bot] ecb70ffcd9
chore(deps): bump github.com/swaggo/gin-swagger from 1.5.0 to 1.5.1 (#1505)
Bumps [github.com/swaggo/gin-swagger](https://github.com/swaggo/gin-swagger) from 1.5.0 to 1.5.1.
- [Release notes](https://github.com/swaggo/gin-swagger/releases)
- [Changelog](https://github.com/swaggo/gin-swagger/blob/master/.goreleaser.yml)
- [Commits](https://github.com/swaggo/gin-swagger/compare/v1.5.0...v1.5.1)

---
updated-dependencies:
- dependency-name: github.com/swaggo/gin-swagger
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:40 +08:00
dependabot[bot] 3ce78367eb
chore(deps): bump github.com/schollz/progressbar/v3 from 3.8.6 to 3.8.7 (#1502)
Bumps [github.com/schollz/progressbar/v3](https://github.com/schollz/progressbar) from 3.8.6 to 3.8.7.
- [Release notes](https://github.com/schollz/progressbar/releases)
- [Commits](https://github.com/schollz/progressbar/compare/v3.8.6...v3.8.7)

---
updated-dependencies:
- dependency-name: github.com/schollz/progressbar/v3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-06-28 17:33:40 +08:00
greenhandatsjtu acf4922866
feat: auto switch to concurrent back source based on download speed (#1494)
Signed-off-by: greenhandatsjtu <sunhengke@sjtu.edu.cn>
2023-06-28 17:33:40 +08:00
Jim Ma d4815e816e
feat: enable dependabot (#1501)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:40 +08:00
Jim Ma 3b539f9abf
fix: wait first peer packet fail (#1500)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:39 +08:00
cuidajun de35b14db9
fix: one piece task sometimes backsource after succeed (#1499)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:39 +08:00
Gaius ebb9296eb9
chore: dragonfly updates version to v2.0.5 (#1498)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
Gaius 642cc5d0f3
feat: scheduler adds filter range limit (#1497)
* feat: scheduler adds filter range limit

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
Gaius 9e3d728dc2
fix: random vertices (#1496)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
Gaius 8a874964b7
feat: scheduler set workhome (#1493)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
Gaius caa16978e7
fix: dfstore command-line tool name (#1492)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
Gaius 7c2ee7858b
refactor: set and dag with generics (#1490)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:39 +08:00
cuidajun 1d7c87627c
fix: oss client judge directory bug (#1488)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:38 +08:00
Gaius 0bd894adad
fix: dfdaemon unix socket (#1489)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Jim Ma c921c265c5
fix: init storage error (#1486)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:38 +08:00
Jim Ma 59060ef277
fix: back source error (#1485)
Signed-off-by: Jim Ma <majinjing3@gmail.com>

Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 6991583ef0
fix: keepalive with ip
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 7d3c9d539d
refactor: cache key for peer (#1483)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 5bf763c119
test: find parent with ancestor (#1482)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
Gaius 527990620b
refactor: scheduler training configuration
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:38 +08:00
wd665544 1880429e73
add config 2023-06-28 17:33:38 +08:00
Gaius 9cb3417986
refactor: dag GetSourceVertices and GetSinkVertices func
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
wd665544 434e8c704f
add dag interface 2023-06-28 17:33:37 +08:00
Gaius 885bcf682f
feat: remove test print
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
Gaius ed4c381383
feat: rename steal peers to candidate peers (#1476)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
Gaius 46deb4fccf
Use dag to represent peer scheduling topology (#1473)
* feat: use dag to represent peer scheduling topology

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
Gaius f9d2736ae8
feat: scheduler merge end of piece and piece from seed peer (#1474)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
zc 1936acfd07
adjust the configuration check sequence (#1467)
Signed-off-by: zc <zc2638@qq.com>
2023-06-28 17:33:37 +08:00
Gaius 96e62223b4
feat: dfdaemon add default healthy config (#1472)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:37 +08:00
cuidajun abec6d3a84
fix: upload_manager write header in time (#1471)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:37 +08:00
Gaius cd0ecceacf
feat: dag adds LenVertex and RangeVertex func (#1470)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius e74a05685e
fix: infinite loop in peer.Ancestors() (#1469)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius 4d71217572
feat: generate dag mock
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius c79bd943bb
feat: add directed acyclic graph package (#1468)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
cuidajun c6654cb4ae
fix: upload_manager write header immediately when it is ready (#1466)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:36 +08:00
1037husterljx 31032e05aa
fix [4000] digest not set error (#1465)
Signed-off-by: ljx373327 <ljx373327@alibaba-inc.com>

Co-authored-by: ljx373327 <ljx373327@alibaba-inc.com>
2023-06-28 17:33:36 +08:00
cuidajun 8173c11d3a
fix oss client download bug; support oss recursive download; (#1448)
* feat: dfget support oss recursive download

Signed-off-by: bigerous <bigerous@qq.com>

* refactor recursive download

Signed-off-by: bigerous <bigerous@qq.com>

* remove URLEntry interface, use simple struct

Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:36 +08:00
Gaius c6a019560d
feat: proxy add defaultTag field (#1462)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
Gaius 7f8dc02708
feat: manager support postgres (#1459)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:36 +08:00
cuidajun acbe5d70c7
fix dfget disable-back-source flag error (#1449)
Signed-off-by: bigerous <bigerous@qq.com>
2023-06-28 17:33:35 +08:00
Gaius 601993aa46
feat: use os.PathSeparator to generate object key
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius 812ff5557b
fix: metrics reduces labels (#1457)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius 70ed392263
feat: scheduler add data dir (#1453)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius c205330881
feat: dfdaemon is compatible with v2.0.2 (#1452)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius b8b0fb1ba7
fix: depth limit (#1451)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Gaius 9b7e8d70c8
feat: add slices util package
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:35 +08:00
Jim Ma 9f360c1b03
feat: reload proxy option (#1443)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:35 +08:00
Jim Ma 1cf39f3f9b
chore: check header length before update (#1445)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:35 +08:00