Commit Graph

1235 Commits

Author SHA1 Message Date
Gaius 59df0b9275
fix: when the task has started and did not download the data, gc is failed (#915)
fix: if the task has started and did not download the data, gc is failed

Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-25 21:26:27 +08:00
Gaius 41a1b343d9
chore: update cargo version to 0.1.126 (#914)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-25 17:28:35 +08:00
dependabot[bot] 6b131a11ba
chore(deps): Bump bytes from 1.8.0 to 1.9.0 (#913)
Bumps [bytes](https://github.com/tokio-rs/bytes) from 1.8.0 to 1.9.0.
- [Release notes](https://github.com/tokio-rs/bytes/releases)
- [Changelog](https://github.com/tokio-rs/bytes/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tokio-rs/bytes/compare/v1.8.0...v1.9.0)

---
updated-dependencies:
- dependency-name: bytes
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-24 10:40:27 +08:00
dependabot[bot] 54eb7bd6a1
chore(deps): Bump libc from 0.2.168 to 0.2.169 (#912)
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.168 to 0.2.169.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Changelog](https://github.com/rust-lang/libc/blob/0.2.169/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.168...0.2.169)

---
updated-dependencies:
- dependency-name: libc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-24 10:40:03 +08:00
dependabot[bot] f4e7ce2b5e
chore(deps): Bump serde_json from 1.0.133 to 1.0.134 (#911)
Bumps [serde_json](https://github.com/serde-rs/json) from 1.0.133 to 1.0.134.
- [Release notes](https://github.com/serde-rs/json/releases)
- [Commits](https://github.com/serde-rs/json/compare/v1.0.133...v1.0.134)

---
updated-dependencies:
- dependency-name: serde_json
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-24 10:39:43 +08:00
dependabot[bot] 3d8a32921e
chore(deps): Bump tokio-stream from 0.1.16 to 0.1.17 (#910)
Bumps [tokio-stream](https://github.com/tokio-rs/tokio) from 0.1.16 to 0.1.17.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-stream-0.1.16...tokio-stream-0.1.17)

---
updated-dependencies:
- dependency-name: tokio-stream
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-24 10:39:20 +08:00
dependabot[bot] 5c4d591d6a
chore(deps): Bump home from 0.5.9 to 0.5.11 (#909)
Bumps [home](https://github.com/rust-lang/cargo) from 0.5.9 to 0.5.11.
- [Changelog](https://github.com/rust-lang/cargo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/cargo/compare/home-0.5.9...home-0.5.11)

---
updated-dependencies:
- dependency-name: home
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-24 10:38:58 +08:00
Gaius 568967dab2
chore: rename repo Dragonfly2 to dragonfly (#908)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-20 17:13:27 +08:00
Gaius 70b8925b74
test: add unit tests for calculate_piece_range (#907)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-20 13:37:40 +08:00
Gaius 6ace03a0e6
feat: calculate piece range and store the actual piece reader (#906)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-19 21:56:41 +08:00
Gaius 64341d6c1d
feat: replace redirect_stderr with args.verbose (#905)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-19 12:21:02 +08:00
Gaius 4f97de3d16
docs: optimize performance optimization guidance (#904)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-18 17:55:28 +08:00
KennyMcCormick 710edc676a
add doc for optimization (#903)
Signed-off-by: cormick <cormick1080@gmail.com>
2024-12-18 17:32:14 +08:00
Gaius f3289b6125
feat: add protocol for storage server (#902)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-17 17:56:42 +08:00
Gaius c67f13e231
feat: rename remote peer to parent (#901)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-17 16:19:28 +08:00
aliazlan-t d6b613e333
Fix dfinit issue when containerd config_path have multiple paths (#895)
* Fix dfinit issue when containerd config_path have multiple paths

* Update containerd.rs - lint fix
2024-12-17 11:04:10 +08:00
dependabot[bot] ea2d3fbd5d
chore(deps): Bump libc from 0.2.167 to 0.2.168 (#897)
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.167 to 0.2.168.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Changelog](https://github.com/rust-lang/libc/blob/0.2.168/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.167...0.2.168)

---
updated-dependencies:
- dependency-name: libc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-17 10:49:20 +08:00
dependabot[bot] 84654e00b8
chore(deps): Bump tokio from 1.41.1 to 1.42.0 (#898)
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.41.1 to 1.42.0.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-1.41.1...tokio-1.42.0)

---
updated-dependencies:
- dependency-name: tokio
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-17 10:48:48 +08:00
dependabot[bot] 10d227ce2d
chore(deps): Bump http from 1.1.0 to 1.2.0 (#899)
Bumps [http](https://github.com/hyperium/http) from 1.1.0 to 1.2.0.
- [Release notes](https://github.com/hyperium/http/releases)
- [Changelog](https://github.com/hyperium/http/blob/master/CHANGELOG.md)
- [Commits](https://github.com/hyperium/http/compare/v1.1.0...v1.2.0)

---
updated-dependencies:
- dependency-name: http
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-17 10:48:32 +08:00
dependabot[bot] 94e5af22f6
chore(deps): Bump serde from 1.0.215 to 1.0.216 (#900)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.215 to 1.0.216.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.215...v1.0.216)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-17 10:48:16 +08:00
dependabot[bot] dd51becb26
chore(deps): Bump sysinfo from 0.32.0 to 0.32.1 (#896)
Bumps [sysinfo](https://github.com/GuillaumeGomez/sysinfo) from 0.32.0 to 0.32.1.
- [Changelog](https://github.com/GuillaumeGomez/sysinfo/blob/master/CHANGELOG.md)
- [Commits](https://github.com/GuillaumeGomez/sysinfo/compare/v0.32.0...v0.32.1)

---
updated-dependencies:
- dependency-name: sysinfo
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-17 10:47:58 +08:00
Gaius eb66100eb8
feat: add downloader for downloading piece (#894)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-13 14:21:59 +08:00
dependabot[bot] df39410f21
chore(deps): Bump blake3 from 1.5.4 to 1.5.5 (#892)
Bumps [blake3](https://github.com/BLAKE3-team/BLAKE3) from 1.5.4 to 1.5.5.
- [Release notes](https://github.com/BLAKE3-team/BLAKE3/releases)
- [Commits](https://github.com/BLAKE3-team/BLAKE3/compare/1.5.4...1.5.5)

---
updated-dependencies:
- dependency-name: blake3
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-09 20:16:57 +08:00
dependabot[bot] 009c535338
chore(deps): Bump tokio-util from 0.7.12 to 0.7.13 (#891)
Bumps [tokio-util](https://github.com/tokio-rs/tokio) from 0.7.12 to 0.7.13.
- [Release notes](https://github.com/tokio-rs/tokio/releases)
- [Commits](https://github.com/tokio-rs/tokio/compare/tokio-util-0.7.12...tokio-util-0.7.13)

---
updated-dependencies:
- dependency-name: tokio-util
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-09 20:16:34 +08:00
dependabot[bot] c835aa6a2e
chore(deps): Bump libloading from 0.8.5 to 0.8.6 (#890)
Bumps [libloading](https://github.com/nagisa/rust_libloading) from 0.8.5 to 0.8.6.
- [Commits](https://github.com/nagisa/rust_libloading/compare/0.8.5...0.8.6)

---
updated-dependencies:
- dependency-name: libloading
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-09 20:16:15 +08:00
dependabot[bot] 56557dd8e5
chore(deps): Bump serde from 1.0.210 to 1.0.215 (#889)
Bumps [serde](https://github.com/serde-rs/serde) from 1.0.210 to 1.0.215.
- [Release notes](https://github.com/serde-rs/serde/releases)
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.210...v1.0.215)

---
updated-dependencies:
- dependency-name: serde
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-09 20:15:56 +08:00
dependabot[bot] 6fefb298f5
chore(deps): Bump anyhow from 1.0.93 to 1.0.94 (#888)
Bumps [anyhow](https://github.com/dtolnay/anyhow) from 1.0.93 to 1.0.94.
- [Release notes](https://github.com/dtolnay/anyhow/releases)
- [Commits](https://github.com/dtolnay/anyhow/compare/1.0.93...1.0.94)

---
updated-dependencies:
- dependency-name: anyhow
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-09 20:15:37 +08:00
Gaius b6cc0c2427
feat: remove zstd for tonic (#893)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-09 20:15:15 +08:00
Gaius c445bd2962
chore: update api version to 2.0.177 (#887)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-06 16:39:10 +08:00
Chlins Zhang 865c7787c5
feat: support the rate limit for preheat request (#881)
Signed-off-by: chlins <chlins.zhang@gmail.com>
Co-authored-by: suhan.zcy <suhan.zcy@antgroup.com>
2024-12-06 16:29:50 +08:00
Gaius d8f0931ca5
feat: add gzip, deflate, brotli, zstd compressed for reqwest (#886)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-05 18:06:55 +08:00
Gaius 6e25a2f8b0
feat: remove dfdaemon.yaml in rpm and deb (#885)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-05 17:55:45 +08:00
Gaius 31edec8fd4
chore: change the default config for rpm and deb (#884)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-05 14:09:16 +08:00
Gaius 47e38cbe04
feat: optimize logs for server started (#883)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-05 13:42:11 +08:00
KennyMcCormick 4b682b9c09
fix barrier synchronization on components exit for dfdaemon (#871)
Signed-off-by: cormick <cormick1080@gmail.com>
2024-12-05 11:12:16 +08:00
Gaius 1917e76478
chore: add auto-req no for building rpm (#882)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-04 21:34:42 +08:00
Gaius 436ed92bcd
chore: add no-build for cargo deb
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-04 16:40:16 +08:00
Gaius 6f4fbdd47d
chore: exclude hdfs for building
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-04 16:21:04 +08:00
Gaius 4be92a6a38
chore: change crate-type for hdfs examples
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-04 15:13:50 +08:00
Gaius a62b442bd6
chore: use gzip compress for building rpm and deb (#880)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-04 14:19:53 +08:00
Gaius 91e571d960
feat: rename tracing_grpc.rs to interceptor.rs (#879)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-12-03 10:49:08 +08:00
dependabot[bot] 3048372486
chore(deps): Bump libc from 0.2.164 to 0.2.167 (#878)
Bumps [libc](https://github.com/rust-lang/libc) from 0.2.164 to 0.2.167.
- [Release notes](https://github.com/rust-lang/libc/releases)
- [Changelog](https://github.com/rust-lang/libc/blob/0.2.167/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/libc/compare/0.2.164...0.2.167)

---
updated-dependencies:
- dependency-name: libc
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-03 10:30:56 +08:00
dependabot[bot] e643048c04
chore(deps): Bump tracing-subscriber from 0.3.18 to 0.3.19 (#877)
Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.3.18 to 0.3.19.
- [Release notes](https://github.com/tokio-rs/tracing/releases)
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-subscriber-0.3.18...tracing-subscriber-0.3.19)

---
updated-dependencies:
- dependency-name: tracing-subscriber
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-03 10:30:40 +08:00
dependabot[bot] cc72251280
chore(deps): Bump thiserror from 1.0.65 to 1.0.69 (#876)
Bumps [thiserror](https://github.com/dtolnay/thiserror) from 1.0.65 to 1.0.69.
- [Release notes](https://github.com/dtolnay/thiserror/releases)
- [Commits](https://github.com/dtolnay/thiserror/compare/1.0.65...1.0.69)

---
updated-dependencies:
- dependency-name: thiserror
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-03 10:30:20 +08:00
dependabot[bot] f199922060
chore(deps): Bump http-range-header from 0.4.1 to 0.4.2 (#875)
Bumps [http-range-header](https://github.com/MarcusGrass/parse-range-headers) from 0.4.1 to 0.4.2.
- [Release notes](https://github.com/MarcusGrass/parse-range-headers/releases)
- [Changelog](https://github.com/MarcusGrass/http-range-header/blob/0.4.2/Changelog.md)
- [Commits](https://github.com/MarcusGrass/parse-range-headers/compare/0.4.1...0.4.2)

---
updated-dependencies:
- dependency-name: http-range-header
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-03 10:30:01 +08:00
dependabot[bot] 25e8646d55
chore(deps): Bump tracing from 0.1.40 to 0.1.41 (#874)
Bumps [tracing](https://github.com/tokio-rs/tracing) from 0.1.40 to 0.1.41.
- [Release notes](https://github.com/tokio-rs/tracing/releases)
- [Commits](https://github.com/tokio-rs/tracing/compare/tracing-0.1.40...tracing-0.1.41)

---
updated-dependencies:
- dependency-name: tracing
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-12-03 10:29:44 +08:00
Junduo Dong c291a8cfff
feat: enhance client otel tracing and linking to scheduler & manager (#873) 2024-12-01 12:45:29 +08:00
Gaius 189f09bf45
chore: update cargo verison
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-11-29 20:10:06 +08:00
Gaius 064a3f005c
feat: add retry middleware for http backend (#872)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-11-29 20:09:26 +08:00
Gaius 9fd770ffab
feat: add cache store for proxy (#870)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-11-28 22:27:09 +08:00