Machine Learning Pipelines for Kubeflow
Go to file
Jiaxiao Zheng 497d016e85 Expose an API for appending params/names/descriptions in a programmable way. (#2082)
* Refactor. Expose a public API to append pipeline param without interacting with dsl.Pipeline obj.

* Add unit test and fix.

* Fix docstring.

* Fix test

* Fix test

* Fix two nit problems

* Refactor
2019-09-10 17:58:47 -07:00
.github/ISSUE_TEMPLATE add issue template (#1492) 2019-06-22 08:42:11 -07:00
backend Fix bug where source and variables are not accessible to visualization (#2012) 2019-09-10 08:34:53 -07:00
components Release - Fixed the deprecated component image build (#2063) 2019-09-09 16:26:53 -07:00
contrib Make wget quieter (#2069) 2019-09-09 14:32:54 -07:00
docs Set theme jekyll-theme-minimal 2019-05-31 14:14:31 -07:00
frontend Make wget quieter (#2069) 2019-09-09 14:32:54 -07:00
manifests fix (#2079) 2019-09-10 02:16:55 -07:00
proxy Lint Python code for undefined names (#1721) 2019-08-21 15:04:31 -07:00
samples Add cmle tpu sample link (#2074) 2019-09-09 18:56:54 -07:00
sdk Expose an API for appending params/names/descriptions in a programmable way. (#2082) 2019-09-10 17:58:47 -07:00
test Use GCSHelper to upload test result (#2078) 2019-09-10 09:06:55 -07:00
third_party clean up owner file (#1928) 2019-08-22 15:29:19 -07:00
.cloudbuild.yaml move old gcp components to deprecated folder (#2031) 2019-09-06 16:29:20 -07:00
.dockerignore Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
.gitattributes Support filtering on storage state (#629) 2019-01-11 11:01:01 -08:00
.gitignore WithItems Support (#1868) 2019-08-23 21:00:28 -07:00
.release.cloudbuild.yaml update release cb yaml (#2022) 2019-09-03 10:56:57 -07:00
.travis.yml Make wget quieter (#2069) 2019-09-09 14:32:54 -07:00
BUILD.bazel apiserver: Remove TFX output artifact recording to metadatastore (#1904) 2019-08-21 13:44:31 -07:00
CHANGELOG.md Update changelog for 0.1.27 (#1935) 2019-08-22 18:23:18 -07:00
CONTRIBUTING.md Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
LICENSE Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
Makefile Fix Makefile to add licenses using Go modules. (#674) 2019-01-14 15:25:27 -08:00
OWNERS clean up owner file (#1928) 2019-08-22 15:29:19 -07:00
README.md Updated links in READMEs. (#1544) 2019-06-24 16:32:07 -07:00
ROADMAP.md ROADMAP.md cosmetic changes (#846) 2019-02-22 15:03:45 -08:00
WORKSPACE apiserver: Remove TFX output artifact recording to metadatastore (#1904) 2019-08-21 13:44:31 -07:00
developer_guide.md Added README.md for Python based visualizations (#1853) 2019-08-30 11:06:57 -07:00
envoy.Dockerfile Add execution list and details pages (#2059) 2019-09-06 22:31:18 -07:00
envoy.yaml Adds Metadata Artifacts to UI (#2057) 2019-09-06 13:19:19 -07:00
go.mod move pipeline runner service account to backend (#1988) 2019-08-29 16:03:14 -07:00
go.sum move pipeline runner service account to backend (#1988) 2019-08-29 16:03:14 -07:00

README.md

Build Status Coverage Status SDK: Documentation Status

Overview of the Kubeflow pipelines service

Kubeflow is a machine learning (ML) toolkit that is dedicated to making deployments of ML workflows on Kubernetes simple, portable, and scalable.

Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.

The Kubeflow pipelines service has the following goals:

  • End to end orchestration: enabling and simplifying the orchestration of end to end machine learning pipelines
  • Easy experimentation: making it easy for you to try numerous ideas and techniques, and manage your various trials/experiments.
  • Easy re-use: enabling you to re-use components and pipelines to quickly cobble together end to end solutions, without having to re-build each time.

Documentation

Get started with your first pipeline and read further information in the Kubeflow Pipelines overview.

See the various ways you can use the Kubeflow Pipelines SDK.

See the Kubeflow Pipelines API doc for API specification.

Consult the Python SDK reference docs when writing pipelines using the Python SDK.

Blog posts

Acknowledgments

Kubeflow pipelines uses Argo under the hood to orchestrate Kubernetes resources. The Argo community has been very supportive and we are very grateful.