Commit Graph

18 Commits

Author SHA1 Message Date
Alexey Volkov cc83e1089b
Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
Yuan Gong cd55a55c62 test: fix postsubmit test is_integration_test flag 2021-02-24 14:05:11 +00:00
Yuan (Bob) Gong 1967d25c27
test: postsubmit - fix cloudbuild job filtering. Part of #4046 (#4122) 2020-07-01 19:32:18 +08:00
Renmin 3df29394c1
Integration test fix (#3357)
* try generate MKP binary for each submit

* try run

* fix format

* fix format

* fix format

* it works, gcloud builds submit --config test/cloudbuild/mkp_verify.yaml --project ml-pipeline-test

* test commit trigger

* backup codes

* test

* fix

* pass manual test before submit

* 0.3.0

* quick fix for test path

Co-authored-by: Renmin Gu <renming@google.com>
2020-03-25 01:23:02 -07:00
Renmin 32b30b896b
Post-submit test for Hosted/MKP (mpdev verify) (#3193)
* try generate MKP binary for each submit

* try run

* fix format

* fix format

* fix format

* it works, gcloud builds submit --config test/cloudbuild/mkp_verify.yaml --project ml-pipeline-test

* test commit trigger

* backup codes

* test

* fix

* pass manual test before submit

* 0.3.0

Co-authored-by: Renmin Gu <renming@google.com>
2020-03-23 17:20:47 -07:00
Yuan (Bob) Gong 5391e88fbc
[Testing] KFP standalone test infra for upgradability (#1971)
* Implement upgrade test

* mark upgrade-tests.sh as executable

* Fix comments

* Base upgrade_test_setup.yaml

* e2e integration of upgrade test

* Fix entrypoint argument

* Fix e2e workflow yaml

* Fix run_test.sh argument processing

* Fix no closing backtick

* Restrucutre upgrade_test.go to focus the test on upgrade verification

* clean up code

* Clean up after upgrade test when it is run in integration tests.

* Include pipeline tests in upgrade test

* Reorder tests

* Add upgrade test coverage for run api resources

* Add job api resource coverage in upgrade test & refactored upgrade test

* Fix add missing step in upgrade test

* Fix BUILD.bazel

* Fix upgrade_test.go

* Try to fix upgrade test failure

* Fix hard coded namespace

* Sync upgrade-tests.sh with new changes in presubmit-tests-with-pipeline-deployment.sh

* Update upgrade test

* Remove redundant code

* Fix integration test exit code

* Fix trigger interval second mismatch
2020-03-09 16:53:37 -07:00
Rui Fang 934f55a185 [Test] - Add kfp deployment method in test post submit script (#2859)
* Add mkp deployment for test

* Add mkp deployment script

This commit adds mkp deployment script including cluster deployment,
argo installation and kfp mkp deployment.

* Add sleep 60 after kfp deployment

This commits adds sleep 60 after kfp deployment to make sure kfp
resources are ready when running argo submit.

* Typo fix
This commit fixes zone variable and deletes extra comments.

* Remove cluster deployment and argo installation in mkp script

This commit removes cluster deployment and argo installation in mkp
script. Those logic are the same with before and can use existing
script.

* Revert unrelated changes

This commit reverts unrelated changes on
test/manifests/kustomization.yaml.

* Add kfp deployment options param in post submit script

This commit adds kfp deployment options in post submit script. Current
options are standalone and mkp deployment.

* Fix on naming and syntax

This commit fixes small naming and syntax problem pointed on PR review.
2020-01-21 21:54:34 -08:00
Yuan (Bob) Gong 4a8d262abb Migrate standalone deployment to workload identity on GCP (#2619)
* Script to set up workload identity for standalone deployment

* Migrate tests to run on standalone + workload identity

* Fix test script

* Switch to static GSAs for testing, because they have name length limit

* Add workload identity binding for argo

* Fix argo workload identity bindings

* Remove user-gcp-sa from tests

* Remove use_gcp_secret from xgboost sample

* Allow debugging tests locally

* Wait for policies to take effect

* Update deploy-pipeline-lite.sh

* Update deploy-pipeline-lite.sh

* [WIP] test gcloud auth list with test-runner sa

* Add namespace

* test again

* Use new image builder

* test again

* Remove debug code

* Remove usages of use_gcp_secret

* Fix unit test and tensorboard pod template

* Add debug code again to test

* Try waiting until workload identity bindings are ready

* Fix some other samples

* Fix parameterized tfx oss sample

* Add retry to image building

* Try fixing tfx oss sample

* Fix compiled tfx oss sample

* Update all google/cloud-sdk to latest

* Try fixing parameterized tfx oss sample again

* Also verify pipeline-runner ksa is working

* Fix parameterized_tfx_oss sample

* Update gcp-workload-identity-setup.sh

* Revert unneeded change

* Pin to new google/cloud-sdk

* Remove wrongly commited binaries
2019-12-16 22:05:58 -08:00
Yuan (Bob) Gong 3d008f96e9 Fix obsolete image cache when the same PR commit is tested with a new master (#2738) 2019-12-16 17:09:38 -08:00
Yuan (Bob) Gong 8e53eb43ad Move postsubmit tests to lite deployment (#1939)
* Move postsubmit tests to lite deployment

* Reduce verbose logs by wget

* Add ignored files

* add test temporary file to gitignore
2019-08-23 14:34:26 -07:00
Ning 1ab558a7cd
add argo install in postsubmit (#1333) 2019-05-14 17:43:02 -07:00
Ning f8253235c0 ml-pipeline-test has a cb job (#1322) 2019-05-14 12:59:13 -07:00
Alexey Volkov e9aa69e353 Testing - Clean up the Argo controller that was used to build images (#1311)
* Testing - Clean up the Argo controller that was used to build images

* Try to not install Argo in the first place

* Added the test-runner service account

* Cleanup

* Changing the install-argo.sh script instead
2019-05-13 14:51:09 -07:00
Ning 727c48c690 update the image in the samples to use the new component images (#1267)
* update the image in the samples to use the new component images

* replace the image tag in the yaml
2019-05-02 19:46:17 -07:00
Ning 02ecab8174 fix postsubmit bugs (#1248)
* fix postsubmit bugs

* fix bugs
2019-04-29 14:55:35 -07:00
Alexey Volkov c9d3d39377 Testing - Fixed the postsubmit tests (#1210) 2019-04-24 20:12:45 -07:00
IronPan 18878f1bed fix bunch of issues in prow test (#866)
* update tests

* explicit return successful

* fix

* move variable

* Update deploy-kubeflow.sh
2019-02-27 14:40:01 -08:00
Ning 508210d40b
Add postsubmit component test (#613)
* add postsubmit script and yaml
* remove old sample tests component file
* extract deploy-pipeline.sh, deploy-kubeflow.sh and test-prep.sh from presubmit and postsubmit scripts
2019-02-25 13:29:04 -08:00