18c9cc8bcc
* Change to use component to replace containerOp for any sequencer * Remove context input and change results path * 1: Update to use component rather than containerOp 2: Fix lint/license issue |
||
|---|---|---|
| .github | ||
| .tekton | ||
| api | ||
| backend | ||
| components | ||
| contrib | ||
| docs | ||
| frontend | ||
| guides | ||
| hack | ||
| images | ||
| install | ||
| manifests | ||
| proxy | ||
| samples | ||
| scripts | ||
| sdk | ||
| tekton-catalog | ||
| test | ||
| third_party | ||
| tools | ||
| v2 | ||
| .cloudbuild.yaml | ||
| .dockerignore | ||
| .gitattributes | ||
| .gitignore | ||
| .pylintrc | ||
| .readthedocs.yml | ||
| .release.cloudbuild.yaml | ||
| .style.yapf | ||
| .travis.yml | ||
| CONTRIBUTING.md | ||
| LICENSE | ||
| Makefile | ||
| OWNERS | ||
| README.md | ||
| VERSION | ||
| go.mod | ||
| go.sum | ||
| package-lock.json | ||
| package.json | ||
README.md
Kubeflow Pipelines with Tekton
Project bringing Kubeflow Pipelines and Tekton together. The project is driven according to this design doc. The current code allows you run Kubeflow Pipelines with Tekton backend end to end.
- Create your Pipeline using Kubeflow Pipelines DSL, and compile it to Tekton YAML.
- Upload the compiled Tekton YAML to KFP engine (API and UI), and run end to end with logging and artifacts tracking enabled.
For more details about the project please follow this detailed blog post. Additionally, look at these slides as well as this deep dive presentation for demos.
Note: If you are interested in a sister project built on top of Kubeflow Pipelines with Tekton, please try Machine Learning eXchange (MLX), Data and AI Assets Catalog and Execution Engine. It introduces a 'Component Registry' for Kubeflow Pipelines, amongst other things.
Tekton
The Tekton Pipelines project provides Kubernetes-style resources for declaring CI/CD-style pipelines. Tekton introduces several new Custom Resource Definitions (CRDs) including Task, Pipeline, TaskRun, and PipelineRun. A PipelineRun represents a single running instance of a Pipeline and is responsible for creating a Pod for each of its Tasks and as many containers within each Pod as it has Steps. Please look for more details in Tekton repo.
Kubeflow Pipeline with Tekton Backend
We are currently using Kubeflow Pipelines 1.5.0 and Tekton >= 0.25.0 for this project.
Get Started using Kubeflow Pipelines with Tekton
Install Kubeflow Pipelines with Tekton backend
KFP Tekton Pipelines User Guide
Development Guides
Compilation Tests Status Report
Design Guides
KFP, Argo and Tekton Features Comparison