Machine Learning Pipelines for Kubeflow
Go to file
Alexey Volkov b6bc24a014
SDK - Added pinned dependency snapshot (#3303)
* SDK - Added pinned dependency snapshot

* Downgraded zipp

The zipp package has dropped support for python3.5. https://zipp.readthedocs.io/en/latest/history.html#v2-0-0
https://github.com/jaraco/zipp/issues/28

* Fixing sample building in the backend Dockerfile

Installing SDK using pip.
Using SDK's requirements.txt.

* Enabled kubernetes v11

* Reverted the backend/Dockerfile for now

* Fixed the version of kfp-server-api
2020-03-30 00:53:53 -07:00
.github/ISSUE_TEMPLATE Update BUG_REPORT.md 2020-02-24 11:43:15 +08:00
backend [Backend][Multi-user] Adjust/implement run api for multiuser support (#3337) 2020-03-27 14:47:54 -07:00
components Release be497983cd (#3327) 2020-03-21 18:54:44 -07:00
contrib Make wget quieter (#2069) 2019-09-09 14:32:54 -07:00
docs Docs - Added the kfp root members (#2183) 2019-10-07 18:33:19 -07:00
frontend [UI] Tensorboard support for multi user (#3355) 2020-03-26 19:50:22 -07:00
manifests Manifests: Rename metadata gRPC server's resources to metadata-grpc-* (#3108) 2020-03-26 22:22:23 -07:00
proxy [Proxy] Split domain name (#2851) 2020-01-16 14:00:31 -08:00
release Post-submit test for Hosted/MKP (mpdev verify) (#3193) 2020-03-23 17:20:47 -07:00
samples [Sample] CI Sample: Kaggle (#3021) 2020-03-27 09:48:24 -07:00
sdk SDK - Added pinned dependency snapshot (#3303) 2020-03-30 00:53:53 -07:00
test [Test] Add argo retry in sample/integration tests to reduce flakiness. (#3365) 2020-03-26 21:38:22 -07:00
third_party pin envoy (#2968) 2020-02-03 12:49:25 -08:00
tools done (#3028) 2020-02-11 18:34:15 -08:00
.cloudbuild.yaml Post-submit test for Hosted/MKP (mpdev verify) (#3193) 2020-03-23 17:20:47 -07:00
.dockerignore Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
.gitattributes Support filtering on storage state (#629) 2019-01-11 11:01:01 -08:00
.gitignore License crawler for third party golang libraries (#2393) 2019-10-25 03:15:40 -07:00
.pylintrc [Request for comments] Add config for yapf and pylintrc (#2446) 2019-10-21 12:34:22 -07:00
.release.cloudbuild.yaml Reduce steps for release cloud build yaml (#3331) 2020-03-22 22:55:26 -07:00
.style.yapf [Request for comments] Add config for yapf and pylintrc (#2446) 2019-10-21 12:34:22 -07:00
.travis.yml Switch head to TF2 (#3299) 2020-03-17 10:28:22 -07:00
BUILD.bazel apiserver: Remove TFX output artifact recording to metadatastore (#1904) 2019-08-21 13:44:31 -07:00
CHANGELOG.md Update CHANGELOG for 0.3.0 (#3349) 2020-03-23 20:56:47 -07:00
CONTRIBUTING.md fix link validation complaint. (#2727) 2019-12-18 21:49:56 -08:00
LICENSE Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
Makefile Fix Makefile to add licenses using Go modules. (#674) 2019-01-14 15:25:27 -08:00
OWNERS clean up owner file (#1928) 2019-08-22 15:29:19 -07:00
README.md add community meeting/slack onto README (#2613) 2019-11-18 13:57:41 -08:00
ROADMAP.md ROADMAP.md cosmetic changes (#846) 2019-02-22 15:03:45 -08:00
VERSION Post-submit test for Hosted/MKP (mpdev verify) (#3193) 2020-03-23 17:20:47 -07:00
WORKSPACE Clean up kataras dependency (#3240) 2020-03-09 17:51:44 +08:00
developer_guide.md fix doc link (#2681) 2019-12-03 22:44:57 -08:00
go.mod Clean up kataras dependency (#3240) 2020-03-09 17:51:44 +08:00
go.sum Add pipeline version to job/run integration test so that job/run is c… (#3270) 2020-03-16 16:45:40 +08:00

README.md

Build Status Coverage Status SDK: Documentation Status

Overview of the Kubeflow pipelines service

Kubeflow is a machine learning (ML) toolkit that is dedicated to making deployments of ML workflows on Kubernetes simple, portable, and scalable.

Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.

The Kubeflow pipelines service has the following goals:

  • End to end orchestration: enabling and simplifying the orchestration of end to end machine learning pipelines
  • Easy experimentation: making it easy for you to try numerous ideas and techniques, and manage your various trials/experiments.
  • Easy re-use: enabling you to re-use components and pipelines to quickly cobble together end to end solutions, without having to re-build each time.

Documentation

Get started with your first pipeline and read further information in the Kubeflow Pipelines overview.

See the various ways you can use the Kubeflow Pipelines SDK.

See the Kubeflow Pipelines API doc for API specification.

Consult the Python SDK reference docs when writing pipelines using the Python SDK.

Kubeflow Pipelines Community Meeting

The meeting is happening every other Wed 10-11AM (PST) Calendar Invite or Join Meeting Directly

Meeting notes

Kubeflow Pipelines Slack Channel

#kubeflow-pipelines

Blog posts

Acknowledgments

Kubeflow pipelines uses Argo under the hood to orchestrate Kubernetes resources. The Argo community has been very supportive and we are very grateful.