Machine Learning Pipelines for Kubeflow
Go to file
Nicholas Thomson f0f8e5d178
[AWS SageMaker] De-hardcode output paths in AWS components (#4119)
* Update input arguments

* Remove fileOutputs

* Update outputs to new paths

* Modify integ test artifact path

* Add unit test for new output format

* Add unit test for write_output

* Migrate tests into test_utils

* Add clarifying comment

* Remove output path file extension

* Update license to 0.5.2

* Update component to 0.5.2

* Add 0.5.2 to changelog

* Remove JSON
2020-07-06 14:39:57 -07:00
.github chore(release): set up conventional commit changelog tool. Part of #3920 (#4033) 2020-06-23 03:51:40 -07:00
backend fix: increase TFX version from 0.20.2 to 0.22.0. Fixes #4084, fixes #4114 (#4133) 2020-07-02 00:40:46 -07:00
components [AWS SageMaker] De-hardcode output paths in AWS components (#4119) 2020-07-06 14:39:57 -07:00
contrib Make wget quieter (#2069) 2019-09-09 14:32:54 -07:00
docs Docs - Show inherited members in the kfp.dsl docs (#4025) 2020-06-18 19:25:58 -07:00
frontend better native-keras based sample (#3900) 2020-06-22 02:24:40 -07:00
hack chore(release): set up conventional commit changelog tool. Part of #3920 (#4033) 2020-06-23 03:51:40 -07:00
manifests feat(deployment): marketplace - allow specifying gcs bucket directly (#4112) 2020-07-01 20:18:00 -07:00
proxy chore: remove inactive reviewers (#4111) 2020-06-30 19:10:06 -07:00
samples fix: increase TFX version from 0.20.2 to 0.22.0. Fixes #4084, fixes #4114 (#4133) 2020-07-02 00:40:46 -07:00
sdk test(sdk): SDK - Added the mock package to the test requirements (#4132) 2020-07-02 01:24:46 -07:00
test test: Added presubmit unit tests for the backend visualizations (#4136) 2020-07-02 13:42:47 -07:00
third_party chore: remove inactive reviewers (#4111) 2020-06-30 19:10:06 -07:00
tools Add labels to plots (#3811) 2020-05-27 13:04:37 +08:00
.cloudbuild.yaml test: postsubmit - fix cloudbuild job filtering. Part of #4046 (#4122) 2020-07-01 19:32:18 +08:00
.dockerignore Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
.gitattributes Support filtering on storage state (#629) 2019-01-11 11:01:01 -08:00
.gitignore [Release] Automate release script for all the changes (#3777) 2020-06-03 08:44:18 -07:00
.pylintrc [Request for comments] Add config for yapf and pylintrc (#2446) 2019-10-21 12:34:22 -07:00
.release.cloudbuild.yaml test: postsubmit - fix cloudbuild job filtering. Part of #4046 (#4122) 2020-07-01 19:32:18 +08:00
.style.yapf Simplified the style config (#4002) 2020-06-17 00:28:48 -07:00
.travis.yml test(sdk): Travis - Fixed pipeline validation (4064) 2020-06-28 19:30:14 -07:00
BUILD.bazel apiserver: Remove TFX output artifact recording to metadatastore (#1904) 2019-08-21 13:44:31 -07:00
CHANGELOG.md 0.5.1 changelog (#3706) 2020-05-07 01:05:09 -07:00
CONTRIBUTING.md chore(release): set up conventional commit changelog tool. Part of #3920 (#4033) 2020-06-23 03:51:40 -07:00
LICENSE Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
Makefile Fix Makefile to add licenses using Go modules. (#674) 2019-01-14 15:25:27 -08:00
OWNERS Add Bobgy to OWNERS (#3926) 2020-06-08 20:03:17 -07:00
README.md Update travis CI status badge to use .com version instead of outdated .org version (#3968) 2020-06-17 19:12:05 -07:00
RELEASE.md docs(release): introduce release schedule, refine instructions (#4105) 2020-06-30 05:08:05 -07:00
ROADMAP.md ROADMAP.md cosmetic changes (#846) 2019-02-22 15:03:45 -08:00
VERSION feat(deployment): marketplace - allow specifying gcs bucket directly (#4112) 2020-07-01 20:18:00 -07:00
WORKSPACE Upadate backend BUILD files (#3455) 2020-04-10 14:45:48 -07:00
developer_guide.md fix doc link (#2681) 2019-12-03 22:44:57 -08:00
go.mod [API] Add license header to python api client files (#3897) 2020-06-04 10:23:24 +08:00
go.sum [API] Add license header to python api client files (#3897) 2020-06-04 10:23:24 +08:00
package-lock.json chore(release): set up conventional commit changelog tool. Part of #3920 (#4033) 2020-06-23 03:51:40 -07:00
package.json chore(release): set up conventional commit changelog tool. Part of #3920 (#4033) 2020-06-23 03:51:40 -07:00

README.md

Build Status Coverage Status SDK: Documentation Status

Overview of the Kubeflow pipelines service

Kubeflow is a machine learning (ML) toolkit that is dedicated to making deployments of ML workflows on Kubernetes simple, portable, and scalable.

Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.

The Kubeflow pipelines service has the following goals:

  • End to end orchestration: enabling and simplifying the orchestration of end to end machine learning pipelines
  • Easy experimentation: making it easy for you to try numerous ideas and techniques, and manage your various trials/experiments.
  • Easy re-use: enabling you to re-use components and pipelines to quickly cobble together end to end solutions, without having to re-build each time.

Documentation

Get started with your first pipeline and read further information in the Kubeflow Pipelines overview.

See the various ways you can use the Kubeflow Pipelines SDK.

See the Kubeflow Pipelines API doc for API specification.

Consult the Python SDK reference docs when writing pipelines using the Python SDK.

Kubeflow Pipelines Community Meeting

The meeting is happening every other Wed 10-11AM (PST) Calendar Invite or Join Meeting Directly

Meeting notes

Kubeflow Pipelines Slack Channel

#kubeflow-pipelines

Blog posts

Acknowledgments

Kubeflow pipelines uses Argo under the hood to orchestrate Kubernetes resources. The Argo community has been very supportive and we are very grateful.