kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
pipelines/samples/contrib/arena-samples
History
Alexey Volkov 7b6957ae06 SDK - Client - Added a way to set experiment name using environment variables (#2292) 
* SDK - Client - Added a way to set experiment name using environment variables

This is useful for launching notebooks or pipeline files that submit
themselves for execution.

* Switched to subprocess.run which supports env

* Setting the environment variable differently
Looks like `subprocess.run` uses `PATH` to search for the program.

* Convert return code to string

* Changed the way the experiment name is being set

* Changed how the notebook installs the SDK

Notebook is overriding the SDK that's being tested.

* Not installing the KFP SDK package

* Removed the experiment_name from samples and configs.

* Changed the SDK installation lines in samples

Otherwise the sample tests do not correctly test the new SDK code.
 		2019-10-14 14:55:51 -07:00
..
mpi Restructure samples (#1710) 2019-08-01 17:31:37 -07:00
standalonejob SDK - Client - Added a way to set experiment name using environment variables (#2292) 2019-10-14 14:55:51 -07:00
README.md Restructure samples (#1710) 2019-08-01 17:31:37 -07:00
arena.yaml Restructure samples (#1710) 2019-08-01 17:31:37 -07:00
arena_launcher_rbac.yaml Restructure samples (#1710) 2019-08-01 17:31:37 -07:00

README.md

Arena demo

There are a series of examples about how to build deeplearning models with Arena. These demos will show how to run a pipeline standalone Job, MPI Job, TFJob(PS mode) and TensorFlow Estimator Job.

Setup

  1. Install the arena
kubectl create -f https://raw.githubusercontent.com/kubeflow/pipelines/eb830cd73ca148e5a1a6485a9374c2dc068314bc/samples/arena-samples/arena.yaml
  1. Add addtional RBAC role to service account pipeline-runner
kubectl create -f https://raw.githubusercontent.com/kubeflow/pipelines/eb830cd73ca148e5a1a6485a9374c2dc068314bc/samples/arena-samples/arena_launcher_rbac.yaml

Demos