Machine Learning Pipelines for Kubeflow
Go to file
Yuan (Bob) Gong 25958081e6
chore(v2): parameter passing. Fixes #6151 (#6208)
* chore(v2): publish output parameters

* chore(v2): resolve input parameters from producer task

* chore(v2): add implicit parameter dependencies to DAG tasks

* test(v2): add verification for v2 tests

* fix compiler unit test
2021-08-05 18:25:50 -07:00
.github chore: configure semantic pull requests bot. Fixes #5942 (#5950) 2021-06-30 00:02:36 -07:00
api chore: make directories before downloading api dependency proto (#6245) 2021-08-05 14:28:42 -07:00
backend fix: fix a spelling error (#6236) 2021-08-05 17:17:46 -07:00
components chore: update component owner file (#6239) 2021-08-05 08:43:18 -07:00
contrib
docs
frontend feat(frontend): Select node using execution ID via router param in run detail page. Partial #5977 (#6218) 2021-08-04 17:59:18 -07:00
hack feat: upgrade argo-workflows to v3.1.0. Part of #5718 (#5922) 2021-06-28 04:37:14 -07:00
manifests revert: "feat!: use argo emissary executor by default. Fixes #5718" (#6230) 2021-08-04 13:55:17 -07:00
proxy
samples chore(v2): parameter passing. Fixes #6151 (#6208) 2021-08-05 18:25:50 -07:00
sdk feat(sdk): Enable the use of Executor from KFP package for v2 lightweight components (#6202) 2021-08-05 14:53:03 -07:00
test feat: upgrade to argo v3.1.5-patch (#6228) 2021-08-04 06:55:41 -07:00
third_party feat: upgrade to argo v3.1.5-patch (#6228) 2021-08-04 06:55:41 -07:00
tools
v2 chore(v2): parameter passing. Fixes #6151 (#6208) 2021-08-05 18:25:50 -07:00
.cloudbuild.yaml feat: upgrade to argo v3.1.5-patch (#6228) 2021-08-04 06:55:41 -07:00
.dockerignore refactor: migrate to api/v2alpha1/go/pipelinespec (#6016) 2021-07-13 00:05:17 -07:00
.gitattributes
.gitignore chore(frontend): Migrate kubeflow/frontend to KFP frontend. Fix #5705 (#5963) 2021-07-03 04:16:49 -07:00
.pylintrc
.readthedocs.yml
.release.cloudbuild.yaml feat: upgrade to argo v3.1.5-patch (#6228) 2021-08-04 06:55:41 -07:00
.style.yapf
AUTHORS
CHANGELOG.md chore(release): bumped version to 1.7.0-rc.2 2021-07-22 12:23:43 +00:00
CONTRIBUTING.md
LICENSE
OWNERS
README.md chore: Updates argoproj/argo URLs to argoproj/argo-workflows (#5969) 2021-07-06 21:52:20 -07:00
RELEASE.md revert: feat: change release tags to vX.Y.Z. Part of #5954 (#6034) 2021-07-14 14:43:56 +08:00
ROADMAP.md
VERSION chore(release): bumped version to 1.7.0-rc.2 2021-07-22 12:23:43 +00:00
developer_guide.md chore(visualization): Revert to tensorflow image because tfx image is too big. Fix #6053 (#6061) 2021-07-15 20:16:38 -07:00
go-licenses.yaml feat: pipeline spec as a separate go module (#6000) 2021-07-12 20:51:16 -07:00
go.mod feat: upgrade to argo v3.1.5-patch (#6228) 2021-08-04 06:55:41 -07:00
go.sum feat: upgrade to argo v3.1.5-patch (#6228) 2021-08-04 06:55:41 -07:00
package-lock.json
package.json
release-status-check.png
retry-release-on-tag.png
verify-retry-the-right-build.png

README.md

Coverage Status SDK: Documentation Status

Overview of the Kubeflow pipelines service

Kubeflow is a machine learning (ML) toolkit that is dedicated to making deployments of ML workflows on Kubernetes simple, portable, and scalable.

Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.

The Kubeflow pipelines service has the following goals:

  • End to end orchestration: enabling and simplifying the orchestration of end to end machine learning pipelines
  • Easy experimentation: making it easy for you to try numerous ideas and techniques, and manage your various trials/experiments.
  • Easy re-use: enabling you to re-use components and pipelines to quickly cobble together end to end solutions, without having to re-build each time.

Documentation

Install Kubeflow Pipelines from an overview of several options.

Get started with your first pipeline and read further information in the Kubeflow Pipelines overview.

See the various ways you can use the Kubeflow Pipelines SDK.

See the Kubeflow Pipelines API doc for API specification.

Consult the Python SDK reference docs when writing pipelines using the Python SDK.

Refer to the versioning policy and feature stages documentation for more information about how we manage versions and feature stages (such as Alpha, Beta, and Stable).

Contributing to Kubeflow Pipelines

Before you start contributing to Kubeflow Pipelines, read the guidelines in How to Contribute. To learn how to build and deploy Kubeflow Pipelines from source code, read the developer guide.

Kubeflow Pipelines Community Meeting

The meeting is happening every other Wed 10-11AM (PST) Calendar Invite or Join Meeting Directly

Meeting notes

Kubeflow Pipelines Slack Channel

#kubeflow-pipelines

Blog posts

Acknowledgments

Kubeflow pipelines uses Argo by default under the hood to orchestrate Kubernetes resources. The Argo community has been very supportive and we are very grateful. Additionally there is Tekton backend available as well. To access it, please refer to Kubeflow Pipelines with Tekton repository.