Machine Learning Pipelines for Kubeflow
Go to file
ananth102 d159475f1a
Test: Update pytest xdist dependency in Sagemaker KFP integration test (#8389)
* fix: stable version

* fix: update python

* fix: update xdist instead of pytest
2022-10-27 20:54:19 +00:00
.github
api
backend feat(backend): Include namespace in Pipeline API model. Part of #4197 (#8375) 2022-10-26 17:56:30 +00:00
components Test: Update pytest xdist dependency in Sagemaker KFP integration test (#8389) 2022-10-27 20:54:19 +00:00
contrib
docs chore(sdk): improve KFP SDK reference documentation (#8337) 2022-10-17 19:58:53 +00:00
frontend fix(frontend): Create recurring run by default from recurring run entry point (#8384) 2022-10-21 17:47:10 +00:00
hack
manifests chore(release): bumped version to 2.0.0-alpha.6 2022-10-14 23:22:02 +00:00
proxy
samples feat(samples): Full Kubeflow E2E sample using KFPv2. (#8303) 2022-10-18 21:47:58 +00:00
sdk feat(sdk): add --build-image option to 'kfp components build' to allow users to skip docker build. Fixes #8382 for 2.0 (#8387) 2022-10-26 15:58:31 +00:00
test chore(backend): move v1 api to v1beta1 package and folder (#8376) 2022-10-26 07:11:30 +00:00
third_party
tools
.cloudbuild.yaml fix(backend): Upgrade mysql to 8.0.26 (#8351) 2022-10-14 07:34:04 +00:00
.dockerignore
.gitattributes
.gitignore
.isort.cfg
.pre-commit-config.yaml
.pylintrc
.readthedocs.yml
.release.cloudbuild.yaml fix(backend): Upgrade mysql to 8.0.26 (#8351) 2022-10-14 07:34:04 +00:00
.style.yapf
AUTHORS
CHANGELOG.md chore(release): bumped version to 2.0.0-alpha.6 2022-10-14 23:22:02 +00:00
CONTRIBUTING.md
LICENSE
OWNERS
README.md
RELEASE.md
ROADMAP.md
VERSION chore(release): bumped version to 2.0.0-alpha.6 2022-10-14 23:22:02 +00:00
developer_guide.md
go.mod
go.sum
mypy.ini
package-lock.json
package.json
release-status-check.png
requirements.txt
retry-release-on-tag.png
verify-retry-the-right-build.png

README.md

Coverage Status SDK Documentation Status SDK Package version SDK Supported Python versions

Overview of the Kubeflow pipelines service

Kubeflow is a machine learning (ML) toolkit that is dedicated to making deployments of ML workflows on Kubernetes simple, portable, and scalable.

Kubeflow pipelines are reusable end-to-end ML workflows built using the Kubeflow Pipelines SDK.

The Kubeflow pipelines service has the following goals:

  • End to end orchestration: enabling and simplifying the orchestration of end to end machine learning pipelines
  • Easy experimentation: making it easy for you to try numerous ideas and techniques, and manage your various trials/experiments.
  • Easy re-use: enabling you to re-use components and pipelines to quickly cobble together end to end solutions, without having to re-build each time.

Installation

  • Install Kubeflow Pipelines from choices described in Installation Options for Kubeflow Pipelines.

  • [Alpha] Starting from Kubeflow Pipelines 1.7, try out Emissary Executor. Emissary executor is Container runtime agnostic meaning you are able to run Kubeflow Pipelines on Kubernetes cluster with any Container runtimes. The default Docker executor depends on Docker container runtime, which will be deprecated on Kubernetes 1.20+.

Documentation

Get started with your first pipeline and read further information in the Kubeflow Pipelines overview.

See the various ways you can use the Kubeflow Pipelines SDK.

See the Kubeflow Pipelines API doc for API specification.

Consult the Python SDK reference docs when writing pipelines using the Python SDK.

Refer to the versioning policy and feature stages documentation for more information about how we manage versions and feature stages (such as Alpha, Beta, and Stable).

Contributing to Kubeflow Pipelines

Before you start contributing to Kubeflow Pipelines, read the guidelines in How to Contribute. To learn how to build and deploy Kubeflow Pipelines from source code, read the developer guide.

Kubeflow Pipelines Community Meeting

The meeting is happening every other Wed 10-11AM (PST) Calendar Invite or Join Meeting Directly

Meeting notes

Kubeflow Pipelines Slack Channel

#kubeflow-pipelines

Blog posts

Acknowledgments

Kubeflow pipelines uses Argo Workflows by default under the hood to orchestrate Kubernetes resources. The Argo community has been very supportive and we are very grateful. Additionally there is Tekton backend available as well. To access it, please refer to Kubeflow Pipelines with Tekton repository.