Commit Graph

36 Commits

Author SHA1 Message Date
Gaius 0ffc55b6d4
refactor: trainer server module (#2486)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:35:00 +08:00
dlut_xz e20bb9743e
feat: add trainer cmd and trainer service (#2479)
Signed-off-by: XZ <834756128@qq.com>
2023-06-28 17:34:59 +08:00
Jim Ma 0546fe4898
chore: create log dir (#1947)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:34:20 +08:00
Gaius d64a6d8e29
feat: trigger task with priority (#1904)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:16 +08:00
Gaius 10ae70db79
feat: change log rotate size (#1879)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:14 +08:00
Gaius 2421ce88f4
feat: add announcer to dfdameon (#1852)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:11 +08:00
Gaius 42223d994f
feat: optimize peer log (#1828)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
Gaius d2f98d1429
feat: optimize preheat log (#1827)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:09 +08:00
cuidajun 3b1e805ce6
chore: add timestamp to stdout&stderr (#1781)
Signed-off-by: bigerous <cuidajun.cdj@alibaba-inc.com>
2023-06-28 17:34:05 +08:00
Gaius 27d8cf51db
feat: gin logger rotation (#1749)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:34:02 +08:00
Gaius 13580f89f2
refactor: dfpath for certify cache dir (#1618)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:50 +08:00
Jim Ma 98fb1fc427
feat: add grpc mux transport (#1602)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:49 +08:00
Gaius c216872b5d
feat: store preheat result (#1516)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:41 +08:00
Gaius a2511cb945
feat: rewrite interface{} to any (#1419)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:32 +08:00
Gaius f688d341bd
feat: remove cdn (#1401)
* feat: remove cdn

Signed-off-by: Gaius <gaius.qi@gmail.com>

* docs: generate swagger

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Gaius 233aac29db
feat: redirect stdout and stderr to file (#1399)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:29 +08:00
Eryu Guan 65fa8a1680
feat: define and implement new dfdaemon APIs to make dragonfly2 work as a distributed cache (#1227)
Introduce a new dfcache command which uses dfcache SDK interface to
interactive with dfdaemon and operate on P2P cache system.

For example:
- add a file into cache system
  dfcache import --cid sha256:xxxxxx --tag testtag /path/to/file

- check if a file exists in cache system
  dfcache stat --cid testid --local  # only check local cache
  dfcache stat --cid testid          # check other peers as well

- export/download a file from cache system
  dfcache export --cid testid -O /path/to/output

- delete a file from cache system, both local cache and P2P network
  dfcache delete -i testid -t testtag

Signed-off-by: Gaius <gaius.qi@gmail.com>
Signed-off-by: Eryu Guan <eguan@linux.alibaba.com>

Co-authored-by: Jim Ma <majinjing3@gmail.com>
Co-authored-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:33:13 +08:00
Jim Ma 517ed6c51e
fix: client sync piece panic (#1246)
* fix: client sync piece panic

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* chore: optimize sync piece log

Signed-off-by: Jim Ma <majinjing3@gmail.com>

* fix: daemon panic when register fail

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:13 +08:00
sunwp 78591d0309
Optimized the log creation (#1058)
* optimize logger

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* resolve rpc server logger panic

Signed-off-by: sunwp <244372610@qq.com>

* reset levels nil to release init method level

Signed-off-by: sunwp <244372610@qq.com>

* golang lint

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:06 +08:00
Jim Ma 98e95e693c
feat: implement bidirectional fetch pieces (#1165)
* feat: implement grpc server side sync pieces

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:33:06 +08:00
sunwp 266da57866
Reduce default RotateMaxBackups count (#1162)
* reduce default RotateMaxBackups count

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:05 +08:00
sunwp 08d5f10517
feat: set grpc logger verbosity from env variable (#1111)
Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:33:00 +08:00
Jim Ma cc5a43c73f
feat: support change console log level (#1055)
Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:56 +08:00
Jim Ma 009fbc6db1
Feature: change log level in-flight (#1023)
* feat: change log level in flight

Signed-off-by: Jim Ma <majinjing3@gmail.com>
2023-06-28 17:32:54 +08:00
Gaius 97c1eb65e7
Refactor scheduler service (#958)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:50 +08:00
Gaius 0b21f66714
feat: remove stat log from scheduler (#946)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:47 +08:00
sunwp a1ab42790f
Optimaze GC log (#923)
* optimaze gc log

Signed-off-by: sunwp <244372610@qq.com>
2023-06-28 17:32:47 +08:00
Gaius c2c721bc78
refactor: dfpath pkg (#879)
* feat: dfpath

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: dfpath

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: path

Signed-off-by: Gaius <gaius.qi@gmail.com>

* feat: plugin

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:43 +08:00
Gaius d13042bfb5
feat: plugin log (#843)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:39 +08:00
Gaius e837ae9bdf
chore: add lint errcheck and fix errcheck(#766)
* feat: add lint errcheck and fix errcheck

Signed-off-by: Gaius <gaius.qi@gmail.com>

* replace assert to require

Signed-off-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>

Co-authored-by: 孙伟鹏 <weipeng.swp@alibaba-inc.com>
2023-06-28 17:32:35 +08:00
Gaius 1dccea01ce
feat: add jobs api (#751)
* feat: add jobs api

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:32 +08:00
Gaius 03774882fd
feat: add job logger (#740)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:31 +08:00
Gaius 061e25c3e5
feat: preheat cluster (#731)
* feat: preheat cluster

Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:32:30 +08:00
sunwp 9ffa58c8f6
feat: Add schedule log (#495)
* feat: add bad node log

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
2023-06-28 17:30:29 +08:00
加菲 eda5839eb8
Fix client dfget bug and support digest (#432)
Signed-off-by: zuozheng.hzz <zuozheng.hzz@alibaba-inc.com>
2023-06-28 17:30:26 +08:00
sunwp 6cce5a9872
Feature/code spec (#336)
* Modify the code according to https://github.com/uber-go/guide/blob/master/style.md

Signed-off-by: santong <weipeng.swp@alibaba-inc.com>
Signed-off-by: Gaius <gaius.qi@gmail.com>
2023-06-28 17:24:44 +08:00