dragonflyoss
/
dragonfly
mirror of https://github.com/dragonflyoss/dragonfly.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Dragonfly is an open source P2P-based file distribution and image acceleration system. It is hosted by the Cloud Native Computing Foundation (CNCF) as an Incubating Level Project.
33 Commits 5 Branches 281 Tags 98 MiB
Go 98.4%
Shell 0.6%
Roff 0.4%
Makefile 0.4%
Dockerfile 0.2%
Go to file
Gaius 00b060d234
test: idgen add digest (#243) 
Signed-off-by: Gaius <gaius.qi@gmail.com>
 		2023-06-28 17:22:37 +08:00
.github chore: workflows remove main-rc branch (#221) 2023-06-28 17:22:36 +08:00
api feature: remove redundant configurations (#216) 2023-06-28 17:22:29 +08:00
build Change Dockerfile directory and clean up project (#165) 2023-06-28 17:21:32 +08:00
cdnsystem refactor: support multi digest not only md5 (#236) 2023-06-28 17:22:37 +08:00
client refactor: support multi digest not only md5 (#236) 2023-06-28 17:22:37 +08:00
cmd Refactor scheduler's dynconfig (#228) 2023-06-28 17:22:37 +08:00
deploy Change Dockerfile directory and clean up project (#165) 2023-06-28 17:21:32 +08:00
docs Refactor cmd (#217) 2023-06-28 17:22:37 +08:00
hack Change Dockerfile directory and clean up project (#165) 2023-06-28 17:21:32 +08:00
internal Refactor scheduler's dynconfig (#228) 2023-06-28 17:22:37 +08:00
manager Refactor cmd (#217) 2023-06-28 17:22:37 +08:00
pkg test: idgen add digest (#243) 2023-06-28 17:22:37 +08:00
scheduler Refactor scheduler's dynconfig (#228) 2023-06-28 17:22:37 +08:00
version Merge branch main-rc to branch main 2023-06-28 17:20:20 +08:00
.gitignore Merge branch main-rc to branch main 2023-06-28 17:20:20 +08:00
.golangci.yml Merge branch main-rc to branch main 2023-06-28 17:20:20 +08:00
CODE_OF_CONDUCT.md chore: change manager swagger docs path and add makefile swagger command (#183) 2023-06-28 17:21:32 +08:00
CONTRIBUTING.md Rewrite README.md (#166) 2023-06-28 17:21:33 +08:00
LICENSE Merge branch main-rc to branch main 2023-06-28 17:20:20 +08:00
Makefile Detailed test information display (#212) 2023-06-28 17:21:34 +08:00
README.md Change README.md images (#197) 2023-06-28 17:21:33 +08:00
SECURITY.md chore: add SECURITY.md (#181) 2023-06-28 17:21:32 +08:00
codecov.yml Change Dockerfile directory and clean up project (#165) 2023-06-28 17:21:32 +08:00
go.mod Refactor cmd (#217) 2023-06-28 17:22:37 +08:00
go.sum Refactor cmd (#217) 2023-06-28 17:22:37 +08:00

README.md

Dragonfly

alt

GitHub release CI Coverage Go Report Card Open Source Helpers TODOs Discussions Twitter GoDoc LICENSE

Provide efficient, stable, secure, low-cost file and image distribution services to be the best practice and standard solution in the related Cloud-Native area.

Features

  • Implement P2P files distribution with various storage types (HDFS, storage services from various cloud vendors, Maven, Yum, etc.) through a unified back-to-source adapter layer.
  • Support more distribution modes: active pull, active push, real-time synchronization, remote replication, automatic warm-up, cross-cloud transmission, etc.
  • Provide separation and decoupling between systems, scheduling and plug-in CDN. Support on-demand deployment with flexible types: light or heavy, inside or outside, to meet the actual needs of different scenarios.
  • Newly designed P2P protocol framework based on GRPC with improved efficiency and stability.
  • Perform encrypted transmission, account-based transmission authentication and rate limit, and multi-tenant isolation mechanism.
  • Bear more efficient IO methods: multithreaded IO, memory mapping, DMA, etc.
  • Advocate dynamic compression, in-memory file systems, and more efficient scheduling algorithms to improve distribution efficiency.
  • Client allows third-party software to natively integrate Dragonfly’s P2P capabilities through C/S mode.
  • Productivity: Support file uploading, task management of various distribution modes, data visualization, global control, etc.
  • Consistent internal and external versions, shared core features, and individual extensions of non-generic features.
  • Enhanced integration with ecology: Harbor, Nydus (on-demand image download), warehouse services for various cloud vendors, etc.

Architecture

alt

Manager: Used to manage the dynamic configuration that each module depends on, and provide keepalive and metrics functions.

Scheduler: The tracker and scheduler in the P2P network that choose appropriate downloading net-path for each peer.

CDN: A CDN server that caches downloaded data from source to avoid downloading same files repeatedly.

Daemon: Used for pulling images only. It establishes a proxy between containerd/CRI-O and registry.

Dfget: The client of Dragonfly used for downloading files. It's similar to wget.

Getting Started

Documentation

You can find the Dragonfly documentation on the website.

Community

Welcome developers to actively participate in community discussions and contribute code to Dragonfly. We will remain concerned about the issues discussed in the community and respond quickly.

Contributing

You should check out our CONTRIBUTING and develop the project together.

Code of Conduct

Please refer to our Code of Conduct.