Commit Graph

17 Commits

Author SHA1 Message Date
Ajay Gopinathan d5316f0754 Use latest Tensorflow image for Tensorboard. (#2140)
* Use latest Tensorflow image for Tensorboard.

* Fix tests
2019-09-20 21:43:32 -07:00
IronPan bbfe5e09cc move pipeline runner service account to backend (#1988)
* move pipeline runner service account to backend

* revert swf change

* revert swf change

* update tests

* update tests

* Update compiler.py

revert python change for backward compatibility

* Update compiler.py

revert python change for backward compatibility
2019-08-29 16:03:14 -07:00
IronPan a9602fbc3f
Add API to rerun the pipeline (#1720)
* add resubmit proto

* add compiled code

* fix

* add resubmit proto

* add

* refactor

* update builder

* refactor

* refactor

* refactor

* refactor

* refactor

* refactor

* add test

* add test

* add test

* add test

* fix test

* fix test

* fix test

* fix test

* fix test

* fix test

* fix test

* address comments

* add comments

* change request body def

* recompile api

* retry instead of resubmit

* update test

* update test

* fix tests

* fix tests

* fix tests

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* add error handling

* reorder the call

* remove logic to update the database entry

* add mock

* add tests for rerousrce manager

* update error handling logic

* fix tests

* address comments
2019-08-07 13:59:06 -07:00
jingzhang36 784c4f12b7 viewer controller is now namespaced so no need for cluster role (#1623)
* viewer controller is now namespaced so no need for cluster role

* our default namespaced install (kubeflow namespace) can also use Role instead of ClusterRole
2019-07-16 09:35:26 -07:00
jingzhang36 b957a9872c Viewer CRD controller running under namespace (#1562)
* Viewer CRD controller running under namespace

* Change docker file and add manifest deployment yaml to support the new flag namespace

* Change docker file to support new flag namespace for viewer crd controller

* Modify kustomization.yaml and namespaced-install.yaml

* Change file name from ml-pipeline-viewer-crd-deployment to ml-pipeline-viewer-crd-deployment-patch

* Fix typo

* Remove some duplicate configs in namespaced-install
2019-07-03 11:39:40 -07:00
WeiYan 558d5b2fdb Allow users to specify namespace for Kubernetes informers (#851)
* Allow users to specify namespace for Kubernetes informers

* Change variable informerNamespace to namespace
2019-02-28 12:42:25 -08:00
Adhita Selvaraj 304f57497b adds local volume ex for using Viewer CRD, edited README for TB usage (#822) 2019-02-14 23:02:58 -08:00
Ajay Gopinathan 578e8231d0 Update all Pipelines CRD versions to v1beta1. (#681) 2019-01-17 19:35:51 -08:00
Ajay Gopinathan 8da2c9dbe9 Fix shadowing errors in Viewer reconciler (#648) 2019-01-08 15:41:01 -08:00
Ajay Gopinathan 67a7373933 Run `go vet` as part of the Travis CI. (#626)
* Run `go vet` as part of the Travis CI.

Also fix existing issues found by Go vet.

* Explicitly check for shadowing

* Fix shadowing problems throughout codebase

* Actually run all checks including shadow
2019-01-07 18:21:44 -08:00
Ajay Gopinathan 5bde521148 Update WORKSPACE and BUILD files incoporating the recent viewer CRD (#639)
change.

That change was submitted in parallel with the PR that moved everything
to Bazel and so wasn't included.

Along the way, fix conflicts in imports that was using
controller-runtime library. We can import it either through
github.com/kubernetes-sigs or sigs.k8s.io/controller-runtime, but
shouldn't be using both imports, which was causing conflicts at build
time.
2019-01-07 13:56:32 -08:00
Ajay Gopinathan eea6999b5b Add the Viewer CRD controller for managing web views such as Tensorboard instances from within the Pipelines UI. (#449)
* Add initial CRD types for Viewer resource, and generate corresponding
code.

* Use controller-runtime to scaffold out a controller main

* Start adding a deployment

* Clean up and separate reconciler logic into its own package for future testing.

* Clean up with comments

* Run dep ensure

* Update auto-generate script. Only need deepcopy funcs for viewer crd types

* Cleanup previously generated but unused viewer client code

* [WIP] Adding tests

* More tests

* Completed unit tests for reconciler with logic for max viewers

* Add CRD definition, sample instance and update README.

* Fix merge conflict

* Fix readme typo for kube and add direct port-forwarding instructions.

* Add tests for when persistent volume is used with Tensorboard viewer.

Also add a sample YAML to show how to mount and use a GCE persistent
disk in the viewer CRD.

* Remove vendor directory
2019-01-04 18:22:48 -08:00
Ajay Gopinathan 163545b370 Use Bazel to build the entire backend and perform API code generation (#609)
* Use Bazel to build the entire backend.

This also uses Bazel to generate code from the API definition in the
proto files.

The Makefile is replaced with a script that uses Bazel to first generate
the code, and then copy them back into the source tree.

Most of the BUILD files were generated automatically using Gazelle.

* Fix indentation in generate_api.sh

* Clean up WORKSPACE

* Add README for building/testing backend.

Also fix the missing licenses in the generated proto files.

* Add license to files under go_http_client
2019-01-04 17:17:20 -08:00
Ajay Gopinathan 8a13287b09 Add Gopkg dependency for kubernetes code-generator. (#371)
The code generator should not be run from HEAD, as it will generate code
that diverges from the pinned version of client-go, and also any
previously generated CRD controller clients.

This change pins both code generator and client-go to the specified
kubernetes release, and ensures the update-codegen.sh script uses the
code-generator specified in the vendor directory rather than HEAD. This
ensures the build is always reproducible.
2018-11-30 10:41:20 -08:00
Pascal Vicaire d18f37785d Updating references to the project repository to kubeflow/pipelines. 2018-11-02 15:06:54 -07:00
Pascal Vicaire 1bab424abf Fixing the GO import paths to reference the kubeflow/pipelines repository. 2018-11-02 14:53:42 -07:00
Pascal Vicaire 633e2ddcc8 Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00