Commit Graph

2448 Commits

Author SHA1 Message Date
Jim Ma 902fbb031b
chore: optimize sync pieces (#1253)
* chore: optimize sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:14 +08:00
Gaius 34f5a83f03
test: scheduler storage (#1257)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:14 +08:00
Gaius 7f113e0dc2
feat: add AnnounceTask and StatTask metrics (#1256)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:14 +08:00
Gaius fe7b5fe0b4
fix: error message (#1255)
* fix: error message

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:14 +08:00
Gaius 9c539fd425
test: AnnounceTask and StatTask (#1254)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:14 +08:00
sunwp 21153f2249
fix too_many_pings & grpc waitOnHeader block (#1242)
Signed-off-by: sunwp <244372610@qq.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:14 +08:00
Eryu Guan 65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache (#1227)
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.

For example:
- add a file into cache system
  dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file

- check if a file exists in cache system
  dfcache stat --cid testid --local  # only check local cache
  dfcache stat --cid testid          # check other peers as well

- export/download a file from cache system
  dfcache export --cid testid -O /path/to/output

- delete a file from cache system, both local cache and P2P network
  dfcache delete -i testid -t testtag

Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
Jim Ma 1025dc2dc5
feat: redirect daemon stdout stderr to file (#1244)
1. redirect daemon stdout stderr to file
2. fix wrong zap grpc log output

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
Jim Ma 5323b67f6a
chore: update pull request template (#1251)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
Jim Ma 517ed6c51e
fix: client sync piece panic (#1246)
* fix: client sync piece panic

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize sync piece log

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: daemon panic when register fail

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
Gaius f26a63b96e
feat: registerTask returns to the task in time (#1250)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
Gaius b2c9577e7b
Add csv storage to scheduler (#1234)
* feat: scheduler add csv storage for peer data
* feat: add storage configuration to scheduler

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
Jim Ma 5efbaaed80
fix: client superfluous usage gc (#1243)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
Jim Ma 41d5ee6beb
fix: client sync send unsafe call (#1240)
* fix: client sync send unsafe call

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
Jim Ma 1f79e76a4b
fix: client unexpected timeout (#1239)
* fix: client unexpected timeout

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
AnJia 3ccf3ae929
feat: docker-compose write log to file (#1236)
* feat: write log to file

Signed-off-by: anjia0532 <anjia0532@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius d9a3b223f7
feat: update docker compose version (#1235)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius 7121251ace
chore: update compatibility version to v2.0.2
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius 325fe0eff1
chore: update helm-charts commit
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius 392a74d3a6
chore: generate change log
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
sunwp 4cff6abb98
upgrade nginx version of CDN image to fix issue #1150 (#1230)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:12 +08:00
Gaius 3c857143d6
fix: goreleaser config
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius 1d126fa016
feat: update to v2.0.2 (#1232)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius 29f512bc72
docs: move document from /docs to d7y.io (#1229)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:12 +08:00
Gaius 3fdde9b891
fix: make generate (#1228)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius c0c443a686
fix: calculate FreeUploadLoad (#1226)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
sunwp a4caf59e29
Upgrade golang lint version (#1225)
* upgrade golang lint

Signed-off-by: sunwp <244372610@qq.com>

* upgrade golang lint

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:11 +08:00
Gaius 56cd51a4b6
feat: scheduler blocks steal peers (#1224)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius ccb6495b49
feat: update manager console (#1222)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Jim Ma 73c5e3a575
fix: sync pieces hang (#1221)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius 09d41ea1b0
chore: update manager console commit (#1219)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius 288ca4eb72
feat: manager validate with config (#1218)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:11 +08:00
Gaius 6744624e70
feat: remove kustomize template (#1216)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Jim Ma 76eff082cb
feat: add back source fail metric in client (#1214)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius 75ef6fc2d0
feat: cannot delete a cluster with existing instances (#1213)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius 913535ad7a
feat: add type to DownloadFailureCount (#1212)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius f5d372bab4
feat: if the number of failed peers in the task is greater than FailedPeerCountLimit, then scheduler notifies running peers of failure (#1211)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Jim Ma 60a1d9e53e
chore: print client stream task error log (#1210)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius bc1b807832
feat: optimize get available task (#1208)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Jim Ma a413dc4bdd
chore: report client back source error (#1209)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius 7a5857d389
feat: change scheduler and cdn listen (#1205)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:10 +08:00
Gaius 480f7fc35e
docs: add slack and google groups (#1203)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius e33736121f
feat: scheduler add block peers set (#1202)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
yxxhero 23cb77d5b5
fix TestCheckHeader (#1201)
Signed-off-by: yxxhero <aiopsclub@163.com>
2023-06-28 17:33:09 +08:00
Gaius 664626ba66
feat: add grpc-health-probe to image (#1196)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 2bcdba6401
feat: add grpc health interface (#1195)
* feat: add grpc health interface

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add dfdaemon upload server healthy interface

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Jim Ma d45bffea40
fix: client miss failed piece (#1194)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 1939ceff8f
refactor: scheduler end and begin of piece (#1189)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 9d41cee1ec
chore: update workflows compatibility version (#1192)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00
Gaius 953622c103
feat: remove grpc error code validate (#1191)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:09 +08:00