Dragonfly is an open source P2P-based file distribution and image acceleration system. It is hosted by the Cloud Native Computing Foundation (CNCF) as an Incubating Level Project.
Go to file
Gaius 53f5e9c79c
feat: add persistent cache task for scheduler (#3545)
Signed-off-by: Gaius <gaius.qi@gmail.com>
2024-09-29 21:21:37 +08:00
.github chore(deps): bump github/codeql-action from 3.26.2 to 3.26.8 (#3530) 2024-09-24 10:44:37 +08:00
api feat: add scheduler features api for manager (#3488) 2024-09-09 15:23:27 +08:00
build feat: remove trainer and model 2024-08-27 14:03:04 +08:00
client feat: rename `scheduler/resource` to `scheduler/resource/standard` (#3542) 2024-09-29 12:22:29 +08:00
client-rs@d385ef28c7 chore: update client version (#3496) 2024-09-10 22:35:02 +08:00
cmd feat: remove trainer and model 2024-08-27 14:03:04 +08:00
deploy feat: support preheat with self-signed certs (#3541) 2024-09-26 22:51:11 +08:00
docs docs: add security audit report (#2729) 2023-09-15 14:44:41 +08:00
hack fix: make e2e test (#3487) 2024-09-24 12:25:12 +08:00
internal feat: add persistent cache task for scheduler (#3545) 2024-09-29 21:21:37 +08:00
manager feat: increase interval of the preheat polling (#3544) 2024-09-29 18:15:53 +08:00
pkg feat: add persistent cache task for scheduler (#3545) 2024-09-29 21:21:37 +08:00
scheduler feat: add persistent cache task for scheduler (#3545) 2024-09-29 21:21:37 +08:00
test feat: increase interval of the preheat polling (#3544) 2024-09-29 18:15:53 +08:00
version chore: release v2.1.0 (#2597) 2023-08-04 14:52:53 +08:00
.gitignore chore: change gitignore for vendor (#3225) 2024-04-23 17:08:53 +08:00
.gitmodules chore: add client-rs submodule to main (#3114) 2024-03-12 21:18:42 +08:00
.golangci.yml feat: manager add advertiseIP (#1695) 2023-06-28 17:33:57 +08:00
.goreleaser.yml chore: remove sboms in goreleaser 2024-09-18 18:50:37 +08:00
.markdownlint.yml docs: add metrics document (#1075) 2023-06-28 17:32:57 +08:00
ADOPTERS.md docs: add iQIYI to ADOPTERS.md (#3248) 2024-05-07 12:41:48 +08:00
CHANGELOG.md chore: fix typo (#3435) 2024-08-15 17:19:22 +08:00
CODE_OF_CONDUCT.md docs: add slack and google groups (#1203) 2023-06-28 17:33:09 +08:00
CONTRIBUTING.md Update CONTRIBUTING.md (#2836) 2023-10-30 17:32:54 +08:00
GOVERNANCE.md docs: add the responsibilities of contributor roles (#3345) 2024-06-26 23:14:59 +08:00
LICENSE Merge branch main-rc to branch main 2023-06-28 17:20:20 +08:00
MAINTAINERS.md chore: add yyzai384 to maintainers (#3018) 2024-01-12 12:01:03 +08:00
Makefile feat: remove trainer and model 2024-08-27 14:03:04 +08:00
OWNERS.md chore: add yyzai384 to maintainers (#3018) 2024-01-12 12:01:03 +08:00
README.md docs: fixed the badge uri of the OpenSSF Scorecard (#3520) 2024-09-19 14:26:46 +08:00
SECURITY.md docs: add slack and google groups (#1203) 2023-06-28 17:33:09 +08:00
codecov.yml feat: change default value of dynconfig cache (#2203) 2023-06-28 17:34:40 +08:00
go.mod feat: update new task type(TaskType_STANDARD, TaskType_PERSISTENT, TaskType_PERSISTENT_CACHE) (#3540) 2024-09-27 14:01:17 +08:00
go.sum feat: update new task type(TaskType_STANDARD, TaskType_PERSISTENT, TaskType_PERSISTENT_CACHE) (#3540) 2024-09-27 14:01:17 +08:00

README.md

Dragonfly

alt

GitHub release Artifact Hub CI Coverage Go Report Card Open Source Helpers TODOs Discussions Twitter GoDoc OpenSSF Best Practices OpenSSF Scorecard LICENSE

Provide efficient, stable and secure file distribution and image acceleration based on p2p technology to be the best practice and standard solution in cloud native architectures.

Introduction

Dragonfly is an open source P2P-based file distribution and image acceleration system. It is hosted by the Cloud Native Computing Foundation (CNCF) as an Incubating Level Project. Its goal is to tackle all distribution problems in cloud native architectures. Currently Dragonfly focuses on being:

  • Simple: Well-defined user-facing API (HTTP), non-invasive to all container engines;
  • Efficient: Seed peer support, P2P based file distribution to save enterprise bandwidth;
  • Intelligent: Host-level speed limit, intelligent flow control due to host detection;
  • Secure: Block transmission encryption, HTTPS connection support.

Architecture

alt

Manager: Maintain the relationship between each P2P cluster, dynamic configuration management and RBAC. It also includes a front-end console, which is convenient for users to visually operate the cluster.

Scheduler: Select the optimal download parent peer for the download peer. Exceptions control Dfdaemon's back-to-source.

Seed Peer: Dfdaemon turns on the Seed Peer mode can be used as a back-to-source download peer in a P2P cluster, which is the root peer for download in the entire cluster.

Peer: Deploy with dfdaemon, based on the C/S architecture, it provides the dfget command download tool, and the dfget daemon running daemon to provide task download capabilities.

Documentation

You can find the full documentation on the d7y.io.

Security

Security Audit

A third party security audit was performed by Trail of Bits, you can see the full report here.

Community

Join the conversation and help the community.

Contributing

You should check out our CONTRIBUTING and develop the project together.

Code of Conduct

Please refer to our Code of Conduct.