Commit Graph

1195 Commits

Author SHA1 Message Date
Gaius 4849535dc8
feat: add buffer size config for dfdaemon (#434)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-29 14:44:46 +08:00
Gaius 9d945195a7
chore: add pprof and graphviz for dfdameon container (#433)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-29 12:15:19 +08:00
Gaius aa11bf97af
feat: change buffer size to 32KB (#432)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-29 12:14:49 +08:00
Gaius 46967b8421
chore: update cargo version to v0.1.42
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-29 10:49:55 +08:00
Gaius ac45582fc8
feat: add stats and background_threads features for jemalloc (#431)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-29 10:47:38 +08:00
Gaius 7d83cabdc8
feat: optimize grpc log (#430)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-29 10:41:10 +08:00
Gaius e2bc48aad1
chore: add free disk in actions (#429)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-28 21:41:51 +08:00
Gaius b271aef323
chore: add linux-perf to dfdaemon (#428)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-28 17:54:19 +08:00
Gaius d8227ea58d
feat: add heap profiling to dfdaemon (#427)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-28 17:47:36 +08:00
Gaius c0abdab232
feat: add profiling to dfdaemon (#426)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-28 16:05:58 +08:00
Gaius 31df0aa29d
chore: update crate version
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-27 00:14:43 +08:00
Gaius 8a7b281136
chore: add tools for dfdaemon container (#425)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-27 00:13:37 +08:00
Gaius e21e4d1ba4
feat: optimize log of the interested pieces (#424)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-26 18:00:16 +08:00
Gaius bf0b6cec81
feat: optimize log of th available schedulers (#423)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-26 16:29:05 +08:00
Gaius da1682693e
fix: semaphore to limit spawn (#422)
fix: semaphore to limit spawn

Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-25 16:05:57 +08:00
Gaius 4bb57e1a86
feat: remove await when download task (#421)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-25 15:24:31 +08:00
Gaius 8d0598b639
feat: add pretty print for dfget (#420)
* feat: add pretty print for dfget

Signed-off-by: Gaius <gaius.qi@gmail.com>

* Trigger CI

---------

Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-24 23:18:46 +08:00
Gaius 14c9e3ba37
feat: add health server for dfdaemon (#419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-24 21:22:05 +08:00
Gaius d254e13591
fix: hardlink failed when file is not exists (#418)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-24 12:06:32 +08:00
Gaius 698c9039a6
chore: update cargo version to v0.1.36 (#417)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 23:53:41 +08:00
Gaius 6d572b04ad
chore: change rust-toolchain to 1.75.0 to match Dockerfile build image (#416)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 21:11:13 +08:00
imtsuki 8cc8813552
chore: pin rust version to 1.77.2 to prevent rocksdb bug (#414)
Change-Id: I6cd315ed953169cd5ecfc5f579fe6c2d24220e0f

Signed-off-by: imtsuki <jianxin.qiu@outlook.com>
2024-04-23 17:07:45 +08:00
Gaius 797f2f02c6
chore: change gitignore for vendor (#415)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 17:06:15 +08:00
Gaius c16bde519e
fix: typo in dfdaemon.rs (#413)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 17:03:30 +08:00
Gaius fe7e25c99d
chore: add License for storage_engine (#412)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-23 11:55:13 +08:00
imtsuki 76aa34206f
feat: extract storage engine into traits (#401)
Signed-off-by: imtsuki <me@qjx.app>
2024-04-23 10:45:16 +08:00
Gaius 24921dc195
chore: add apache2-utils to Dockerfile (#406)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-22 18:01:34 +08:00
Gaius 8dfb776eed
chore: update version to v0.1.34
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-22 11:41:10 +08:00
Gaius de0b0db3f9
chore: add curl for client Dockerfile (#405)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-22 11:38:12 +08:00
Gaius 2ec8002355
chore: update version to v0.1.33
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 20:34:30 +08:00
Gaius 9a23510e9e
chore: set publish false in examples Cargo.yaml
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 20:29:17 +08:00
Gaius 7e002f781b
chore: udpate Cargo version to v0.1.32
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 18:10:27 +08:00
Gaius b2ff71c7b9
fix: plugin Cargo.yaml path in Dockerfile
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 14:56:54 +08:00
Gaius c9403fa3b5
chore: add plugin Cargo.yaml to Dockerfile (#403)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 14:54:21 +08:00
Gaius 520ba176a7
feat: add HDFS plugin examples for backend (#402)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 14:41:11 +08:00
Gaius e2ad7cc0b6
feat: support plugin feature for backend (#400)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-18 11:36:38 +08:00
Gaius dc70300f0d
feat: super replace with crate (#395)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-17 15:33:20 +08:00
Gaius 84a0e28c35
feat: add error log for grpc handler (#394)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-17 15:25:50 +08:00
imtsuki c60dd7aa5f
Refactor: wrap rocksdb transaction operations in closures (#393)
* refactor: wrap rocksdb txn operations in closures

Signed-off-by: imtsuki <me@qjx.app>

* use generics for CF_NAME

Signed-off-by: imtsuki <me@qjx.app>

* address review comments

Change-Id: I86eccaf3cd9cc2b1128ec89c4a2cf041947a87ea
Signed-off-by: imtsuki <jianxin.qiu@outlook.com>

---------

Signed-off-by: imtsuki <me@qjx.app>
Signed-off-by: imtsuki <jianxin.qiu@outlook.com>
2024-04-17 15:20:11 +08:00
AngrySean a62f5b3960
unittest: improve code coverage (#392)
* unittest: improve code coverage

Signed-off-by: xujihui1985 <xujihui1985@gmail.com>

* fix: use get request to mimic head request

oss do not support HEAD request, so use get to mimic the head request

Signed-off-by: xujihui1985 <xujihui1985@gmail.com>

* chore: cargo fmt

---------

Signed-off-by: xujihui1985 <xujihui1985@gmail.com>
2024-04-17 15:18:05 +08:00
Gaius d671de44e8
feat: update server implements download task api (#391)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-16 22:09:06 +08:00
Gaius 680cd27cf0
feat: add trait for backend (#390)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-16 14:33:04 +08:00
Gaius 5ee42844ae
feat: optimize error mod (#384)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-15 12:21:00 +08:00
AngrySean 7d18b2d7a0
Refactor: extract error module (#375)
Co-authored-by: Xu Jihui <jihui.xjh@bytedance.com>
2024-04-15 11:37:49 +08:00
Gaius e148d2a899
feat: add logs for generate cert (#383)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-15 10:57:28 +08:00
Gaius e5dd578f8b
chore: update version to v0.1.30 (#382)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-11 12:16:01 +08:00
Gaius 1d843cc5a3
docs: fix typo in README.md (#381)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-11 11:09:59 +08:00
Gaius d6f4c613b6
chore: update version to v0.1.29 (#380)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-10 17:30:24 +08:00
Gaius eb6591943f
feat: add prefetch feature for proxy server (#379)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-10 17:13:12 +08:00
Gaius 37b8054bba
chore: update version to v0.1.28 (#378)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-04-09 22:59:10 +08:00