Commit Graph

1235 Commits

Author SHA1 Message Date
Gaius 31df0aa29d
chore: update crate version
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-27 00:14:43 +08:00
Gaius 8a7b281136
chore: add tools for dfdaemon container (#425)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-27 00:13:37 +08:00
Gaius e21e4d1ba4
feat: optimize log of the interested pieces (#424)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-26 18:00:16 +08:00
Gaius bf0b6cec81
feat: optimize log of th available schedulers (#423)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-26 16:29:05 +08:00
Gaius da1682693e
fix: semaphore to limit spawn (#422)
fix: semaphore to limit spawn

Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-25 16:05:57 +08:00
Gaius 4bb57e1a86
feat: remove await when download task (#421)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-25 15:24:31 +08:00
Gaius 8d0598b639
feat: add pretty print for dfget (#420)
* feat: add pretty print for dfget

Signed-off-by: Gaius <gaius.qi@gmail.com>

* Trigger CI

---------

Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-24 23:18:46 +08:00
Gaius 14c9e3ba37
feat: add health server for dfdaemon (#419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-24 21:22:05 +08:00
Gaius d254e13591
fix: hardlink failed when file is not exists (#418)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-24 12:06:32 +08:00
Gaius 698c9039a6
chore: update cargo version to v0.1.36 (#417)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 23:53:41 +08:00
Gaius 6d572b04ad
chore: change rust-toolchain to 1.75.0 to match Dockerfile build image (#416)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 21:11:13 +08:00
imtsuki 8cc8813552
chore: pin rust version to 1.77.2 to prevent rocksdb bug (#414)
Change-Id: I6cd315ed953169cd5ecfc5f579fe6c2d24220e0f

Signed-off-by: imtsuki <jianxin.qiu@outlook.com>
2024-04-23 17:07:45 +08:00
Gaius 797f2f02c6
chore: change gitignore for vendor (#415)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 17:06:15 +08:00
Gaius c16bde519e
fix: typo in dfdaemon.rs (#413)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 17:03:30 +08:00
Gaius fe7e25c99d
chore: add License for storage_engine (#412)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 11:55:13 +08:00
imtsuki 76aa34206f
feat: extract storage engine into traits (#401)
Signed-off-by: imtsuki <me@qjx.app>
2024-04-23 10:45:16 +08:00
Gaius 24921dc195
chore: add apache2-utils to Dockerfile (#406)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-22 18:01:34 +08:00
Gaius 8dfb776eed
chore: update version to v0.1.34
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-22 11:41:10 +08:00
Gaius de0b0db3f9
chore: add curl for client Dockerfile (#405)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-22 11:38:12 +08:00
Gaius 2ec8002355
chore: update version to v0.1.33
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 20:34:30 +08:00
Gaius 9a23510e9e
chore: set publish false in examples Cargo.yaml
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 20:29:17 +08:00
Gaius 7e002f781b
chore: udpate Cargo version to v0.1.32
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 18:10:27 +08:00
Gaius b2ff71c7b9
fix: plugin Cargo.yaml path in Dockerfile
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 14:56:54 +08:00
Gaius c9403fa3b5
chore: add plugin Cargo.yaml to Dockerfile (#403)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 14:54:21 +08:00
Gaius 520ba176a7
feat: add HDFS plugin examples for backend (#402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 14:41:11 +08:00
Gaius e2ad7cc0b6
feat: support plugin feature for backend (#400)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 11:36:38 +08:00
Gaius dc70300f0d
feat: super replace with crate (#395)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-17 15:33:20 +08:00
Gaius 84a0e28c35
feat: add error log for grpc handler (#394)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-17 15:25:50 +08:00
imtsuki c60dd7aa5f
Refactor: wrap rocksdb transaction operations in closures (#393)
* refactor: wrap rocksdb txn operations in closures

Signed-off-by: imtsuki <me@qjx.app>

* use generics for CF_NAME

Signed-off-by: imtsuki <me@qjx.app>

* address review comments

Change-Id: I86eccaf3cd9cc2b1128ec89c4a2cf041947a87ea
Signed-off-by: imtsuki <jianxin.qiu@outlook.com>

---------

Signed-off-by: imtsuki <me@qjx.app>
Signed-off-by: imtsuki <jianxin.qiu@outlook.com>
2024-04-17 15:20:11 +08:00
AngrySean a62f5b3960
unittest: improve code coverage (#392)
* unittest: improve code coverage

Signed-off-by: xujihui1985 <xujihui1985@gmail.com>

* fix: use get request to mimic head request

oss do not support HEAD request, so use get to mimic the head request

Signed-off-by: xujihui1985 <xujihui1985@gmail.com>

* chore: cargo fmt

---------

Signed-off-by: xujihui1985 <xujihui1985@gmail.com>
2024-04-17 15:18:05 +08:00
Gaius d671de44e8
feat: update server implements download task api (#391)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-16 22:09:06 +08:00
Gaius 680cd27cf0
feat: add trait for backend (#390)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-16 14:33:04 +08:00
Gaius 5ee42844ae
feat: optimize error mod (#384)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-15 12:21:00 +08:00
AngrySean 7d18b2d7a0
Refactor: extract error module (#375)
Co-authored-by: Xu Jihui <jihui.xjh@bytedance.com>
2024-04-15 11:37:49 +08:00
Gaius e148d2a899
feat: add logs for generate cert (#383)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-15 10:57:28 +08:00
Gaius e5dd578f8b
chore: update version to v0.1.30 (#382)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-11 12:16:01 +08:00
Gaius 1d843cc5a3
docs: fix typo in README.md (#381)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-11 11:09:59 +08:00
Gaius d6f4c613b6
chore: update version to v0.1.29 (#380)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-10 17:30:24 +08:00
Gaius eb6591943f
feat: add prefetch feature for proxy server (#379)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-10 17:13:12 +08:00
Gaius 37b8054bba
chore: update version to v0.1.28 (#378)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-09 22:59:10 +08:00
Gaius d9dcf86be3
feat: add native tls for backend client (#377)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-09 21:21:15 +08:00
Gaius ac332ca438
chore: add ca-certificates package to client dockerfile (#376)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-09 19:53:54 +08:00
Gaius 2dcd95a9f0
chore: update version to v0.1.27 (#374)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-08 22:27:53 +08:00
Gaius 831dbd3438
feat: if registry is not set, create config_path for contianerd (#373)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-08 20:29:55 +08:00
Gaius d0e0647f5c
feat: optimize enum for container runtime (#366)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-08 11:37:29 +08:00
AngrySean 2d019e1764
refactor: convert container runtime config to enum, as containerd and… (#361)
* refactor: replace docker/containerd config with enum type

containerd and docker runtime is exclusive exists, so use an enum is
more appropriate

* fix: rebase and fix confict

* chore: fix cargo fmt

* chore: fix cargo clippy
2024-04-08 10:58:59 +08:00
dependabot[bot] 8ec7841af3
chore(deps): Bump h2 from 0.3.24 to 0.3.26 (#365)
Bumps [h2](https://github.com/hyperium/h2) from 0.3.24 to 0.3.26.
- [Release notes](https://github.com/hyperium/h2/releases)
- [Changelog](https://github.com/hyperium/h2/blob/v0.3.26/CHANGELOG.md)
- [Commits](https://github.com/hyperium/h2/compare/v0.3.24...v0.3.26)

---
updated-dependencies:
- dependency-name: h2
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-04-08 10:51:35 +08:00
Gaius 1b85a6346e
feat: change memtable memory limit in rocksdb (#364)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-03 16:48:15 +08:00
Gaius f40d2e50e7
chore: split push client image and push dfinit image in actions (#363)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-03 15:31:48 +08:00
Gaius e2b34fef4b
fix: if plugins key is not exist, dfinit can not find index in containerd (#362)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-03 15:18:23 +08:00