Commit Graph

83 Commits

Author SHA1 Message Date
Lzzzt 0eb6341445
test: add unit tests for `BackendFactory` (#695)
Signed-off-by: lzzzt <liuzitao0123@gmail.com>
2024-08-29 22:38:32 +08:00
Gaius 9a339187df
feat: optimize operator of the object_storage (#701)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-08-29 16:19:31 +08:00
Zyyeric bc7719672f
feat: Add GCS credential path and change GCS url scheme to gs (#675)
Signed-off-by: Zyyeric <eric1976808123@gmail.com>
2024-08-29 15:39:30 +08:00
Gaius b4c0e817d6
feat: add tracing flame for dfdaemon (#694)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-08-28 10:34:24 +08:00
Gaius e440144734
test: format unit test in backend (#686)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-08-26 11:25:37 +08:00
Lzzzt 8f3e5f3ca7
test: add unitest for oss (#647)
Signed-off-by: lzzzt <liuzitao0123@gmail.com>
2024-08-26 10:57:51 +08:00
Gaius 03af1cfd01
feat: add metrics of the backend request (#672)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-08-16 17:01:12 +08:00
Gaius 9ecc4d2659
fix: too_many_pings error for scheduler server (#670)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-08-15 16:57:35 +08:00
Gaius e7f7c50fa4
feat: calculate piece length by file length (#661)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-08-12 21:09:10 +08:00
dependabot[bot] 434a395493
chore(deps): Bump libloading from 0.8.4 to 0.8.5 (#634)
Bumps [libloading](https://github.com/nagisa/rust_libloading) from 0.8.4 to 0.8.5.
- [Commits](https://github.com/nagisa/rust_libloading/compare/0.8.4...0.8.5)

---
updated-dependencies:
- dependency-name: libloading
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-07-30 13:37:59 +08:00
Lzzzt b32b685481
fix: fix url encode/decode bug (#628)
Signed-off-by: Lzzzt <liuzitao0123@gmail.com>
2024-07-26 15:24:58 +08:00
Gaius e676cfb2a6
refactor: download directory from object storage (#614)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-07-19 19:49:49 +08:00
Gaius 0dda25083f
feat: change http test dependencies in backend (#600)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-07-16 18:06:24 +08:00
Gaius 62ebd60058
feat: add object storage(s3, gcs, abs, oss, obs, cos) for backend (#598)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-07-16 17:47:39 +08:00
Zyyeric cd6f981ca0
feat: S3 Support for Single File Download (#577)
Signed-off-by: Zyyeric <eric1976808123@gmail.com>
2024-07-16 10:51:36 +08:00
Gaius 3654a5e253
refactor: oss implements in backend (#592)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-07-15 19:56:00 +08:00
Lzzzt a59f9bbb40
feat: support OSS protocol to download single file (#583)
Signed-off-by: Lzzzt <liuzitao0123@gmail.com>
2024-07-15 12:07:39 +08:00
Gaius 8d44be49be
feat: optimize log for piece id with tracing instrument (#585)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-07-11 15:09:13 +08:00
dependabot[bot] 5c65144899
chore(deps): Bump libloading from 0.8.3 to 0.8.4 (#555)
Bumps [libloading](https://github.com/nagisa/rust_libloading) from 0.8.3 to 0.8.4.
- [Commits](https://github.com/nagisa/rust_libloading/compare/0.8.3...0.8.4)

---
updated-dependencies:
- dependency-name: libloading
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-06-25 11:58:29 +08:00
Gaius d500a0f6c0
feat: add error log for backend (#522)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-06-05 14:19:17 +08:00
Gaius b348881f31
feat: support proxy HTTPS from nydus (#515)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-05-31 16:04:47 +08:00
Gaius 468462e9ae
feat: use public backend request, backend response and backend error (#510)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-05-28 23:07:24 +08:00
Gaius 8d0598b639
feat: add pretty print for dfget (#420)
* feat: add pretty print for dfget

Signed-off-by: Gaius <gaius.qi@gmail.com>

* Trigger CI

---------

Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-24 23:18:46 +08:00
Gaius 9a23510e9e
chore: set publish false in examples Cargo.yaml
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 20:29:17 +08:00
Gaius 520ba176a7
feat: add HDFS plugin examples for backend (#402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 14:41:11 +08:00
Gaius e2ad7cc0b6
feat: support plugin feature for backend (#400)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 11:36:38 +08:00
AngrySean a62f5b3960
unittest: improve code coverage (#392)
* unittest: improve code coverage

Signed-off-by: xujihui1985 <xujihui1985@gmail.com>

* fix: use get request to mimic head request

oss do not support HEAD request, so use get to mimic the head request

Signed-off-by: xujihui1985 <xujihui1985@gmail.com>

* chore: cargo fmt

---------

Signed-off-by: xujihui1985 <xujihui1985@gmail.com>
2024-04-17 15:18:05 +08:00
Gaius 680cd27cf0
feat: add trait for backend (#390)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-16 14:33:04 +08:00
AngrySean 7d18b2d7a0
Refactor: extract error module (#375)
Co-authored-by: Xu Jihui <jihui.xjh@bytedance.com>
2024-04-15 11:37:49 +08:00
Gaius d9dcf86be3
feat: add native tls for backend client (#377)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-09 21:21:15 +08:00
Gaius e7f53a09e1
chore: remove readme in sub crates (#303)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-03-07 10:28:10 +08:00
Gaius 701837329e
refactor: add dragonfly-client crate (#299)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-03-05 17:44:04 +08:00
Gaius 2fda6c7ea3
refactor: add dragonfly-client-backend crate (#298)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-03-05 17:01:36 +08:00