kubeflow
/
examples
mirror of https://github.com/kubeflow/examples.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
A repository to host extended examples and tutorials
546 Commits 86 Branches 4 Tags 291 MiB
Jsonnet 62.2%
Jupyter Notebook 31.3%
Python 5.1%
Shell 0.3%
Dockerfile 0.3%
Other 0.7%
Go to file
sefgsefg 2ccd411e5e
Merge dd6c9d4aa7 into f43e99ff22 		2025-04-15 00:34:40 +00:00
.github Label bot should alias feature to kind/feature 2020-02-13 06:22:23 -08:00
Chinese-multiperson-voice-recognition-transfer-learning add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
FaceNet-distributed-training Add files via upload (#890) 2021-10-26 18:35:26 -07:00
Facial-Keypoint-Detection add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
G-research-crypto-forecasting-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
Natural-Language-Processing add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
RAG-pipeline-with-nodered add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
american-express-default-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
bluebook-for-bulldozers-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
cnn template Add files via upload 2022-11-18 11:23:33 +08:00
code_search add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
codelab-image Update Ksonnet version, Add Python2 pip (#216) 2018-08-07 22:58:20 -07:00
codes add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
demos add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
digit-recognition-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
facial-keypoints-detection-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
financial_time_series Bump tensorflow in /financial_time_series/tensorflow_model 2022-02-10 08:34:39 +00:00
github_issue_summarization add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
h-and-m-fash-rec-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
house-prices-kaggle-competition Bound example dependencies to avoid future warnings and issues (#997) 2022-10-03 16:39:21 +00:00
jpx-tokyo-stock-exchange-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
kfp-spark Fix image path in kfp-spark 2022-01-14 17:36:21 +05:30
kserve update kserve to version 0.15.0 (#1180) 2025-04-14 07:24:52 +05:30
mnist add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
named_entity_recognition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
natural-language-processing-with-disaster-tweets-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
object_detection add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
openvaccine-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
pipelines add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
pipelines-demo add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
prophet_bento_timeseries bentoml, fairing, kserving and prophet example (#801) 2020-06-27 22:56:14 -07:00
py Delete the notebook tests because they are outdated. (#808) 2020-07-07 01:23:58 -07:00
pytorch_mnist add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
store-sales-forecasting-kaggle-competition Update the salesforce example to import scikit learn (#1019) 2022-11-30 14:48:16 +00:00
telco-customer-churn-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
tensorflow-horovod Mpi example (#690) 2019-12-09 17:49:29 -08:00
tensorflow_cuj add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
test add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
titanic-kaggle-competition add RAG pipeline with nodered example 2024-06-21 19:54:17 +08:00
xgboost_ames_housing Bump joblib from 0.12.0 to 1.2.0 in /xgboost_ames_housing/seldon_serve (#998) 2022-09-30 18:34:55 +00:00
xgboost_synthetic add cd command 2022-02-03 14:18:48 +05:30
.gitignore Add .cache dir to gitignore (#573) 2019-06-15 06:52:10 -07:00
.pylintrc Create a notebook for mnist E2E on GCP (#723) 2020-02-16 19:15:28 -08:00
CONTRIBUTING.md Enable periodic tests for mnist & GH issue examples. (#486) 2019-01-22 16:10:17 -08:00
LICENSE Initial commit 2018-02-01 13:13:10 -08:00
OWNERS Update OWNERS (#1049) 2023-08-05 16:51:33 +00:00
README.md Notify users that these examples are out-of-date (#1178) 2024-11-29 22:37:55 +00:00
prow_config.yaml Fix tekton_run yaml file path for mnist-notebook (#810) 2020-07-08 12:13:08 -07:00

README.md

⚠️ kubeflow/examples Repository is not Maintained

This repository is no longer actively maintained, and some examples may be outdated or non-functional. For the working examples, please refer to the GitHub repositories of the individual Kubeflow components.

If you are interested in contributing to the kubeflow/examples repository, we encourage you to join the Kubeflow community calls and share your interest.

Help wanted blog post

Blog post: HELP WANTED: Repackaging Kaggle Getting Started into Kubeflow Examples

higlights:

  • We'd like to help bolster the kubeflow/examples repo
  • Help people get involved in open source/kubeflow project/community
  • Give people an opportunity to make a little side hustle income

Kubeflow Examples

A repository to share extended Kubeflow examples and tutorials to demonstrate machine learning concepts, data science workflows, and Kubeflow deployments. The examples illustrate the happy path, acting as a starting point for new users and a reference guide for experienced users.

This repository is home to the following types of examples and demos:

End-to-end

Named Entity Recognition

Author: Sascha Heyer

This example covers the following concepts:

  1. Build reusable pipeline components
  2. Run Kubeflow Pipelines with Jupyter notebooks
  3. Train a Named Entity Recognition model on a Kubernetes cluster
  4. Deploy a Keras model to AI Platform
  5. Use Kubeflow metrics
  6. Use Kubeflow visualizations

GitHub issue summarization

Author: Hamel Husain

This example covers the following concepts:

  1. Natural Language Processing (NLP) with Keras and Tensorflow
  2. Connecting to Jupyterhub
  3. Shared persistent storage
  4. Training a Tensorflow model
    1. CPU
    2. GPU
  5. Serving with Seldon Core
  6. Flask front-end

Pachyderm Example - GitHub issue summarization

Author: Nick Harvey & Daniel Whitenack

This example covers the following concepts:

  1. A production pipeline for pre-processing, training, and model export
  2. CI/CD for model binaries, building and deploying a docker image for serving in Seldon
  3. Full tracking of what data produced which model, and what model is being used for inference
  4. Automatic updates of models based on changes to training data or code
  5. Training with single node Tensorflow and distributed TF-jobs

Pytorch MNIST

Author: David Sabater

This example covers the following concepts:

  1. Distributed Data Parallel (DDP) training with Pytorch on CPU and GPU
  2. Shared persistent storage
  3. Training a Pytorch model
    1. CPU
    2. GPU
  4. Serving with Seldon Core
  5. Flask front-end

MNIST

Author: Elson Rodriguez

This example covers the following concepts:

  1. Image recognition of handwritten digits
  2. S3 storage
  3. Training automation with Argo
  4. Monitoring with Argo UI and Tensorboard
  5. Serving with Tensorflow

Distributed Object Detection

Author: Daniel Castellanos

This example covers the following concepts:

  1. Gathering and preparing the data for model training using K8s jobs
  2. Using Kubeflow tf-job and tf-operator to launch a distributed object training job
  3. Serving the model through Kubeflow's tf-serving

Financial Time Series

Author: Sven Degroote

This example covers the following concepts:

  1. Deploying Kubeflow to a GKE cluster
  2. Exploration via JupyterHub (prospect data, preprocess data, develop ML model)
  3. Training several tensorflow models at scale with TF-jobs
  4. Deploy and serve with TF-serving
  5. Iterate training and serving
  6. Training on GPU
  7. Using Kubeflow Pipelines to automate ML workflow

Pipelines

Simple notebook pipeline

Author: Zane Durante

This example covers the following concepts:

  1. How to create pipeline components from python functions in jupyter notebook
  2. How to compile and run a pipeline from jupyter notebook

MNIST Pipelines

Author: Dan Sanche and Jin Chi He

This example covers the following concepts:

  1. Run MNIST Pipelines sample on a Google Cloud Platform (GCP).
  2. Run MNIST Pipelines sample for on premises cluster.

Component-focused

XGBoost - Ames housing price prediction

Author: Puneith Kaul

This example covers the following concepts:

  1. Training an XGBoost model
  2. Shared persistent storage
  3. GCS and GKE
  4. Serving with Seldon Core

Demos

Demos are for showing Kubeflow or one of its components publicly, with the intent of highlighting product vision, not necessarily teaching. In contrast, the goal of the examples is to provide a self-guided walkthrough of Kubeflow or one of its components, for the purpose of teaching you how to install and use the product.

In an example, all commands should be embedded in the process and explained. In a demo, most details should be done behind the scenes, to optimize for on-stage rhythm and limited timing.

You can find the demos in the /demos directory.

Third-party hosted

Source Example Description

Get Involved

In the interest of fostering an open and welcoming environment, we as contributors and maintainers pledge to making participation in our project and our community a harassment-free experience for everyone, regardless of age, body size, disability, ethnicity, gender identity and expression, level of experience, education, socio-economic status, nationality, personal appearance, race, religion, or sexual identity and orientation.

The Kubeflow community is guided by our Code of Conduct, which we encourage everybody to read before participating.