Commit Graph

73 Commits

Author SHA1 Message Date
Yuan (Bob) Gong 3d7df0c522 Fix pipeline lite README (#2217)
/cc @jingzhang36
2019-09-24 10:27:29 -07:00
IronPan 9b40564dc8 fix release CB and update readme (#2204) 2019-09-23 13:05:25 -07:00
IronPan 44a08a5275 Update pipeline-lite to v0.1.31 (#2189)
* small fixes

* update version to 0.1.31

* update version to 0.1.31
2019-09-22 09:57:23 -07:00
dushyanthsc ab8f5ed043 metadata: deployment update (#2093)
Change to create mysql credential K8 object as part of deployment
2019-09-20 21:43:24 -07:00
dushyanthsc 57d9f7f1cf metadata: Deployment scripts update (#2180)
Change to parameterize database_name, host and port for metadata
deployment using config maps
2019-09-20 16:45:25 -07:00
Jiaxiao Zheng ec1ae92210 Update help info for SA. (#2179) 2019-09-20 15:49:23 -07:00
IronPan a86ee2dfbb Fix more typos in KFP marketplace application (#2158)
* small fixes

* remove trunk for db name

* Delete Makefile

* more fixes

* more fixes

* more fixes
2019-09-19 02:09:01 -07:00
IronPan 0971006bf2
Removing the unnecessary trunk when generating the DB name (#2151)
* small fixes

* remove trunk for db name

* Delete Makefile

* more fixes
2019-09-18 23:55:26 +08:00
IronPan 6e0357d0c2
Small fixes to the kfp marketplace (#2138)
* small fixes

* small fixes
2019-09-17 17:25:10 +08:00
IronPan 6b6b83c9c5
Update documentations for Kubeflow Pipelines marketplace (#2125)
* fix

* update documentations

* update documentations

* update documentations

* small fixes
2019-09-17 17:23:31 +08:00
IronPan 0efdb55a84
fix (#2129) 2019-09-17 16:38:39 +08:00
IronPan f2b1437105 Add documentation for Marketplace CLI deployment (#2128)
* fix

* fix

* fix
2019-09-16 21:36:23 -07:00
IronPan d0bf18d83b
fix (#2122) 2019-09-15 08:46:17 +08:00
Ning f21d3eda0e update kustomize (#2111) 2019-09-13 14:42:29 -07:00
dushyanthsc 22eb915b4c gcp-marketplace: Updating metadata deployment to use gRPC server (#2083)
Change to update gcp marketplace helm charts to use gRPC MLMD metadata
server.
2019-09-12 20:02:31 -07:00
IronPan 97b01b8f4a
Remove broken environment variables in namespace install (#2087)
Likely introduced by a bad merge 
https://github.com/kubeflow/pipelines/pull/1918/files#diff-4f0f86e24382decf794ec0f3d0c4c54cR672
2019-09-12 11:06:38 +08:00
dushyanthsc 635370d256 manifests/metadata: Metadata server invocation change (#2041)
Change to update invocation to use command line parameters as against
using proto text.
2019-09-10 19:28:46 -07:00
IronPan b7f37da23f fix (#2079) 2019-09-10 02:16:55 -07:00
IronPan 715471f113 Store DB password as K8s secret for marketplace deployment (#2067)
* pass in secret

* fix

* use application name by default for database prefix

* bug fixes and bump kfp version

* Update application.yaml

* fix objectstore name

* fix objectstore name

* store db pwd as secret

* fix

* fix

* fix

* fix
2019-09-09 18:06:54 -07:00
IronPan 0d81785466 Chang object store naming for marketplace deployment (#2066)
* pass in secret

* fix

* use application name by default for database prefix

* bug fixes and bump kfp version

* Update application.yaml

* fix objectstore name

* fix objectstore name
2019-09-09 03:59:18 -07:00
IronPan 3edaa38e51 fixes name inconsistency for marketplace manifest and bump kfp version (#2065)
* pass in secret

* fix

* use application name by default for database prefix

* bug fixes and bump kfp version

* Update application.yaml
2019-09-09 01:31:20 -07:00
IronPan be01314ac2 Add parameter for service account credential (#2039)
* pass in secret

* fix

* use application name by default for database prefix
2019-09-08 23:51:17 -07:00
Riley Bauer 8d196d4dec Adds Metadata Artifacts to UI (#2057)
* Working, though the request seems malformed

* Working with grpc-web. trying to push to cluster

* WIP

* With great hax come great success

* Begin moving some metadata UI pages to KFP

* Artifact list and details pages work! A lot of clean up is needed. Look for console.log and TODO

* Clean up

* Fixes filtering of artifact list

* More cleanup

* Revert ui deployment

* Updates tests

* Update envoy deployment
2019-09-06 13:19:19 -07:00
dushyanthsc 1b4919f3fb
manifest/metadata: Switching to use metadata grpc server (#1973)
This change switches pipeline deployments to use metadata-grpc server
instead of kf-mlmd server.
2019-09-03 16:15:02 -07:00
IronPan 04ddb3277f
Add readme and update application parameter (#2021)
* pass pipeline runner service account to api server

* update schema

* fix

* change image

* rename

* fix

* fix

* update readme

* update readme
2019-09-03 12:44:03 -07:00
IronPan 8a87bd3641
Change schema.yaml to v2 (#2009)
* pass pipeline runner service account to api server

* update schema

* fix

* change image

* Update schema.yaml

* Update values.yaml

* Update values.yaml
2019-09-03 11:51:44 -07:00
IronPan 4baf453342
update service account for non managed storage case (#2023) 2019-09-03 11:01:12 -07:00
IronPan 524cbb2a18 pass pipeline runner service account to api server (#1996) 2019-08-29 17:19:13 -07:00
IronPan 180f003947
Update gcp-configurations-patch.yaml
remove information checked in by accident
2019-08-29 14:02:45 -07:00
IronPan 5d9da976a4 remove service account (#1983) 2019-08-29 00:01:58 -07:00
IronPan 77c6c013e3 update application name (#1980) 2019-08-28 17:03:54 -07:00
IronPan 52d3ef5473
Update GCP marketplace deployer dockerfile (#1975)
* Update docker

* Update Dockerfile
2019-08-28 15:40:07 -07:00
IronPan 7bb4c2a013
Add CRD admin permission to deployer SA (#1977)
This is following the instruction here
https://github.com/GoogleCloudPlatform/marketplace-k8s-app-tools/blob/master/docs/schema.md#deployerserviceaccount
2019-08-28 13:48:22 -07:00
IronPan f63c301344 add GCP marketplace application manifest for kubeflow pipelines (#1621)
* move kustomize to subdirectory

* add application cr

* add label application crd can recognize

* Update README.md

* Update README.md

* Update README.md

* add schema

* update

* stage

* add deployer

* sync components

* add components

* fix issues

* add configuration

* fix

* fix

* update
2019-08-27 14:49:11 -07:00
IronPan 336760cfd8 sync namespaced install file (#1932) 2019-08-22 17:47:18 -07:00
hongye-sun 119405deaf
upgrade backend image versions (#1918) 2019-08-22 15:49:29 -07:00
dushyanthsc db6c9b4fd0 pipeline-lite: Introduce metadata component to pipeline-lite (#1840)
This change introduces the metadata component to pipeline-lite
installation. This installation:

  1. Does not include metadata-ui
  2. mysql installation is used instead of metadata-db
  3. Replica count has been reduced 1 instead of 3
2019-08-22 13:11:18 -07:00
IronPan 60de44b61d update namespaced-install.yaml (#1926) 2019-08-22 12:36:34 -07:00
IronPan 06b7ad659f
Cleanup pipeline-lite deployment (#1921)
* restructure

* working example

* working example

* move mysql

* moving minio and mysql out

* add gcp

* add files

* fix test

* extract parameters to single place

* update

* update readme

* update readme

* address pr comment
2019-08-22 10:03:28 -07:00
Kirin Patel 8c3d6fe121 Add visualization-server service to lightweight deployment (#1844)
* Add visualization-server service to lightweight deployment

* Addressed PR suggestions

* Added field to determine if visualization service is active and fixed unit tests for visualization_server.go

* Additional small fixes

* port change from 88888 -> 8888
* version change from 0.1.15 -> 0.1.26
* removed visualization-server from base/kustomization.yaml

* Fixed visualization_server_test.go to reflect new changes

* Changed implementation to be fail fast

* Changed host name to be constant provided by environment

* Added retry and extracted isVisualizationServiceAlive logic to function

* Fixed deployment.yaml file

* Fixed serviceURL configuration issuse

serviceURL is now properly obtained from the environment, the service ip address and port are used rather than service name and namespace

* Added log message to indicate when visualization service is unreachable

* Addressed PR comments

* Removed _HTTP
2019-08-21 18:30:33 -07:00
IronPan 2e7f2d4816
Add cloud sql and gcs connection for pipeline-lite deployment (#1910)
* restructure

* working example

* working example

* move mysql

* moving minio and mysql out

* add gcp

* add files

* fix test
2019-08-21 16:36:35 -07:00
IronPan 7e062cea77
Update README.md 2019-08-21 15:14:31 -07:00
Ajay Gopinathan 0369a4c382 Update manifests to point to 0.26 release. (#1870) 2019-08-16 21:02:07 -07:00
IronPan a9602fbc3f
Add API to rerun the pipeline (#1720)
* add resubmit proto

* add compiled code

* fix

* add resubmit proto

* add

* refactor

* update builder

* refactor

* refactor

* refactor

* refactor

* refactor

* refactor

* add test

* add test

* add test

* add test

* fix test

* fix test

* fix test

* fix test

* fix test

* fix test

* fix test

* address comments

* add comments

* change request body def

* recompile api

* retry instead of resubmit

* update test

* update test

* fix tests

* fix tests

* fix tests

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* robust retry

* add error handling

* reorder the call

* remove logic to update the database entry

* add mock

* add tests for rerousrce manager

* update error handling logic

* fix tests

* address comments
2019-08-07 13:59:06 -07:00
IronPan 609c7a6c0d
Move kustomize manifests a dedicate directory (#1690)
* move kustomize to subdirectory

* add application cr

* add label application crd can recognize

* Update README.md

* Update README.md

* Update README.md

* add schema

* update

* stage

* fix

* update
2019-07-30 10:21:16 -07:00
jingzhang36 a16f380637 Increase version in namespaced-install.yaml too (#1684) 2019-07-26 10:13:59 -07:00
jingzhang36 80d16406f6 Increase KFP version in (1) sdk/python/setup.py (2) component_sdk/python/setup.py (3) manifests/base/kustomization.yaml (#1674)
* Increase KFP version in sdk/python/setup.py component_sdk/python/setup.py

* Increase kfp version in manifests/base/kustomization.yaml
2019-07-25 20:03:58 -07:00
IronPan a8a162c6b9
switch third party images to gcr (#1622) 2019-07-16 12:03:21 -07:00
jingzhang36 784c4f12b7 viewer controller is now namespaced so no need for cluster role (#1623)
* viewer controller is now namespaced so no need for cluster role

* our default namespaced install (kubeflow namespace) can also use Role instead of ClusterRole
2019-07-16 09:35:26 -07:00
Ning cce52f4dfb update manifest and sdk version (#1617) 2019-07-12 14:39:04 -07:00