Machine Learning Pipelines for Kubeflow
Go to file
Alexey Volkov cd4aa7d71f
refactor(components): De-hardcoded local output paths. (#4495)
* Components - De-hardcoded local output paths.

* pip install pathlib2

* Added component.yaml changes
2021-06-08 01:13:45 -07:00
.github chore: remove cherry pick process from pull request template (#5525) 2021-04-22 11:12:42 -07:00
api Update pipeline_spec.proto (#5787) 2021-06-03 16:00:36 -07:00
backend fix(scheduledworkflow): Set location to make CRON timezone work, Fixes #2653 (#5800) 2021-06-07 05:19:51 -07:00
components refactor(components): De-hardcoded local output paths. (#4495) 2021-06-08 01:13:45 -07:00
contrib chore(deps): bump jinja2 from 2.10.1 to 2.11.3 in /contrib/components/openvino/ovms-deployer/containers (#5341) 2021-03-19 19:26:16 -07:00
docs Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
frontend feat(frontend): Support v2 confusion matrix visualization. Issue #5668 (#5781) 2021-06-03 11:36:36 -07:00
hack Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
manifests feat: update MLMD to 1.0.0 (#5786) 2021-06-03 10:34:36 -07:00
proxy Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
samples chore(launcher): move artifact metadata to metadata struct field. Fixes #5788 (#5793) 2021-06-07 22:37:45 -07:00
sdk chore: add link and Python 3.8/3.9 classifiers to setup.py (#5715) 2021-06-04 12:47:48 -07:00
test feat: update MLMD to 1.0.0 (#5786) 2021-06-03 10:34:36 -07:00
third_party Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
tools Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
v2 test(v2): presubmit unit tests of v2 (#5802) 2021-06-07 22:37:52 -07:00
.cloudbuild.yaml feat: update MLMD to 1.0.0 (#5786) 2021-06-03 10:34:36 -07:00
.dockerignore Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
.gitattributes Support filtering on storage state (#629) 2019-01-11 11:01:01 -08:00
.gitignore test(v2): v2 experimental sample test infra. Part of #3505 (#5337) 2021-03-25 01:32:46 -07:00
.pylintrc fix(sdk): Fixes #4703: conflict between .pylintrc and .yapf (#4706) 2020-11-01 14:34:51 -08:00
.readthedocs.yml chore: Clean up KFP SDK docstrings, make formatting a little more consistent (#4218) 2020-08-04 00:33:47 +08:00
.release.cloudbuild.yaml feat: update MLMD to 1.0.0 (#5786) 2021-06-03 10:34:36 -07:00
.style.yapf Simplified the style config (#4002) 2020-06-17 00:28:48 -07:00
AUTHORS chore: set up AUTHORS file. Fixes #5470 (#5766) 2021-06-01 02:49:05 -07:00
CHANGELOG.md chore(release): bumped version to 1.6.0 2021-05-24 13:36:51 +08:00
CONTRIBUTING.md chore: Update Development guide for KFP frontend: link to KFP cluster deployment (#5011) 2021-02-02 07:58:43 -08:00
LICENSE Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
OWNERS chore: Adding chensun in KFP root OWNERS (#5747) 2021-05-27 15:46:59 -07:00
README.md Add references for Tekton backend (#4821) 2021-02-10 08:08:57 -08:00
RELEASE.md chore(release): update docker.sock: permission denied resolution (#5451) 2021-04-12 21:57:52 +08:00
ROADMAP.md ROADMAP.md cosmetic changes (#846) 2019-02-22 15:03:45 -08:00
VERSION chore(release): bumped version to 1.6.0 2021-05-24 13:36:51 +08:00
developer_guide.md fix(backend): remove Bazel from building the API. Part of #3250 (#4906) 2021-02-16 16:58:30 -08:00
go.mod Backend - Added modern time formatters (#5464) 2021-05-19 17:24:45 -07:00
go.sum Backend - Added modern time formatters (#5464) 2021-05-19 17:24:45 -07:00
package-lock.json chore(release): set up conventional commit changelog tool. Part of #3920 (#4033) 2020-06-23 03:51:40 -07:00
package.json chore(release): set up conventional commit changelog tool. Part of #3920 (#4033) 2020-06-23 03:51:40 -07:00
release-status-check.png docs(release): update RELEASE.md (#4832) 2020-11-29 23:30:50 -08:00
retry-release-on-tag.png chore(doc): update release doc with caveats on `release-on-tag` retry (#4917) 2021-02-01 02:22:02 -08:00
verify-retry-the-right-build.png chore(doc): update release doc with caveats on `release-on-tag` retry (#4917) 2021-02-01 02:22:02 -08:00

README.md

Coverage Status SDK: Documentation Status

Overview of the Kubeflow pipelines service

Kubeflow is a machine learning (ML) toolkit that is dedicated to making deployments of ML workflows on Kubernetes simple, portable, and scalable.

Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.

The Kubeflow pipelines service has the following goals:

  • End to end orchestration: enabling and simplifying the orchestration of end to end machine learning pipelines
  • Easy experimentation: making it easy for you to try numerous ideas and techniques, and manage your various trials/experiments.
  • Easy re-use: enabling you to re-use components and pipelines to quickly cobble together end to end solutions, without having to re-build each time.

Documentation

Install Kubeflow Pipelines from an overview of several options.

Get started with your first pipeline and read further information in the Kubeflow Pipelines overview.

See the various ways you can use the Kubeflow Pipelines SDK.

See the Kubeflow Pipelines API doc for API specification.

Consult the Python SDK reference docs when writing pipelines using the Python SDK.

Refer to the versioning policy and feature stages documentation for more information about how we manage versions and feature stages (such as Alpha, Beta, and Stable).

Contributing to Kubeflow Pipelines

Before you start contributing to Kubeflow Pipelines, read the guidelines in How to Contribute. To learn how to build and deploy Kubeflow Pipelines from source code, read the developer guide.

Kubeflow Pipelines Community Meeting

The meeting is happening every other Wed 10-11AM (PST) Calendar Invite or Join Meeting Directly

Meeting notes

Kubeflow Pipelines Slack Channel

#kubeflow-pipelines

Blog posts

Acknowledgments

Kubeflow pipelines uses Argo by default under the hood to orchestrate Kubernetes resources. The Argo community has been very supportive and we are very grateful. Additionally there is Tekton backend available as well. To access it, please refer to Kubeflow Pipelines with Tekton repository.