dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
672 Commits 5 Branches 281 Tags 98 MiB
Commit Graph

66 Commits

Author SHA1 Message Date
yxxhero 7167c01d0f
add header check for ClientOption (#1174) 
Signed-off-by: yxxhero <aiopsclub@163.com>
 2023-06-28 17:33:07 +08:00
sunwp 78591d0309
Optimized the log creation (#1058) 
* optimize logger

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* reset levels nil to release init method level

Signed-off-by: sunwp <244372610@qq.com>

* golang lint

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:33:06 +08:00
Jim Ma 98e95e693c
feat: implement bidirectional fetch pieces (#1165) 
* feat: implement grpc server side sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:33:06 +08:00
sunwp 266da57866
Reduce default RotateMaxBackups count (#1162) 
* reduce default RotateMaxBackups count

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:33:05 +08:00
sunwp 08d5f10517
feat: set grpc logger verbosity from env variable (#1111) 
Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:33:00 +08:00
Jim Ma f80c75efdb
Feature: prefetch ranged requests (#1053) 
1. implement prefetch ranged requests
2. optimize exact http code in transport
3. simplify reuse peer task logic
4. reuse peer task for ranged request size error
5. fix data race for peer task storage

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:56 +08:00
Jim Ma cc5a43c73f
feat: support change console log level (#1055) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:56 +08:00
Jim Ma 009fbc6db1
Feature: change log level in-flight (#1023) 
* feat: change log level in flight

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:54 +08:00
Gaius 97c1eb65e7
Refactor scheduler service (#958) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:50 +08:00
Gaius 0b21f66714
feat: remove stat log from scheduler (#946) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:47 +08:00
sunwp a1ab42790f
Optimaze GC log (#923) 
* optimaze gc log

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:32:47 +08:00
sunwp 7965ed70fe
Set totalPieceCount when the file length is available (#930) 
* set totalPieceCount when the file length is available

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:32:47 +08:00
Gaius cb4202319e
feat: make idgen package public (#931) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:47 +08:00
Gaius 1cde964259
feat: make dfpath public (#929) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:46 +08:00
Gaius 94fde2608c
refactor: scheduler register task (#924) 
* refactor: scheduler register task

Signed-off-by: Gaius <gaius.qi@gmail.com>

* refactor: scheduler register task

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:46 +08:00
sunwp e252ef5880
Adjust CDN module package (#893) 
* adjust CDN code package structure

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:32:46 +08:00
Eng Zer Jun f579d3c9ce
refactor: move from io/ioutil to io and os packages (#906) 
* chore: run `go fmt ./...`

This commit synchronizes `//go:build` lines with `// +build` lines.

Reference: https://go.googlesource.com/proposal/+/master/design/draft-gobuild.md
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>

* refactor: move from io/ioutil to io and os packages

The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil. This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
 2023-06-28 17:32:45 +08:00
Gaius a3659820f0
test: idgen peer id (#913) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:45 +08:00
Gaius 9800a211da
feat: add data directory (#910) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:44 +08:00
Gaius c2c721bc78
refactor: dfpath pkg (#879) 
* feat: dfpath

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfpath

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: path

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: plugin

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:43 +08:00
Gaius f6ce817b72
feat: move dfnet to internal (#862) 
* feat: move dfnet to internal

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: rename dfutils to util

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:41 +08:00
sunwp 44730a2e46
unify piece size (#854) 
* unify piece size

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:32:40 +08:00
Gaius d13042bfb5
feat: plugin log (#843) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:39 +08:00
sunwp d79a2a6877
move RPC code definition to proto file (#829) 
* move rpc code to proto
* replace Cdn to CDN

Signed-off-by: sunwp <244372610@qq.com>
 2023-06-28 17:32:38 +08:00
Jim Ma 8042aea64c
feat: support list plugin (#819) 
* feat: support list plugin

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optmize plugin output

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:37 +08:00
Gaius 0cb14903b2
feat: scheduler and cdn report fqdn to manager (#818) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:37 +08:00
Gaius 72213eb1d4
feat: dfdaemon get scheduler list dynamically from manager (#812) 
* feat: dfdaemon get scheduler list dynamically from manager

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:37 +08:00
Jim Ma 0ad1bf9674
Fix: source plugin not loaded (#811) 
* fix: source plugin not loaded

Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:36 +08:00
Gaius 61f9f83b28
fix: manager typo and cdn peer id (#809) 
* fix: manager typo and cdn peer id 

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:36 +08:00
Gaius d01eef6b41
refactor: scheduler evaluator (#805) 
* refactor: scheduler evaluator

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:36 +08:00
Gaius 558782af00
feat: add idgen peer id (#800) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:35 +08:00
Gaius e837ae9bdf
chore: add lint errcheck and fix errcheck(#766) 
* feat: add lint errcheck and fix errcheck

Signed-off-by: Gaius <gaius.qi@gmail.com>

* replace assert to require

Signed-off-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>

Co-authored-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:32:35 +08:00
Jim Ma 3d63ab2ca3
chore: update golang import lint (#780) 
Signed-off-by: Jim Ma <majinjing3@gmail.com>
 2023-06-28 17:32:34 +08:00
Gaius 1dccea01ce
feat: add jobs api (#751) 
* feat: add jobs api

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:32 +08:00
Gaius 03774882fd
feat: add job logger (#740) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:31 +08:00
Gaius 061e25c3e5
feat: preheat cluster (#731) 
* feat: preheat cluster

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:30 +08:00
Gaius 466912aa48
docs: scheduler config (#698) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:32:25 +08:00
Gaius b4e58e3c08
refactor: scheduler supervisor (#655) 
* refactor: scheduler supervisor

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:49 +08:00
sunwp 60bee061d2
feat: client back source (#579) 
* feat: client back source

Signed-off-by: santong <244372610@qq.com>
 2023-06-28 17:31:43 +08:00
Gaius 79662a3bb4
feat: start process (#572) 
* feat: server start process

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:38 +08:00
Gaius 962a171bcd
feat: rename task to job (#544) 
* feat: rename task to job

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:35 +08:00
Gaius 3657d8f8c4
feature: optimize manager project layout (#540) 
* feat: optimize manager project layout

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: add file license

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:35 +08:00
sunwp 1efd2f6cef
feat: Add distribute Schedule Tracer & Refactor scheduler (#537) 
* check same cdn list avoid updating client too frequent

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:31:35 +08:00
Gaius f27770af32
Feature: Add manager charts with submodule (#525) 
* chore: add charts submodule

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:35 +08:00
zzy987 39ce5d98c0
let cdn support sha256 (#517) 
cdn support sha256 digest
 2023-06-28 17:31:34 +08:00
Gaius a187d7d7fc
feat: add task manager (#490) 
* feat: add task manager

Signed-off-by: Gaius <gaius.qi@gmail.com>

Co-authored-by: zzy987 <67889264+zzy987@users.noreply.github.com>
 2023-06-28 17:31:33 +08:00
sunwp a15ce877c7
fix: scheduler concurrent dead lock (#509) 
* fix scheduler concurrent dead lock

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:31:33 +08:00
Gaius 27103e4b4e
feat: rename manager grpc (#510) 
* feat: rename manager grpc

Signed-off-by: Gaius <gaius.qi@gmail.com>
 2023-06-28 17:31:26 +08:00
sunwp 9ffa58c8f6
feat: Add schedule log (#495) 
* feat: add bad node log

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:30:29 +08:00
sunwp 7b8aaf6b31
Refactor scheduler (#369) 
Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
 2023-06-28 17:30:29 +08:00