Commit Graph

22 Commits

Author SHA1 Message Date
Chen Sun cd7e316db6
test: upgrade e2e sample tests to using sdk v2 (#9885)
* install kfp sdk 2.0 in sample test

* remove reference to GCSHelper from deprecated module

* exclude obsolete samples

* update test script

* update client usage

* revert recent changes to exit_handler.py
2023-08-17 09:33:38 +00:00
gkcalat f626629f79
chore(testing): Enable samples in e2e tests with v1 kfp SDK (#9169)
* Add pipeline_id to run and recurring run protos

* Add pipeline_id to run and recurring_run

* Set status when creating a new job. Closes #9125.

* Enable sample tests
2023-04-19 04:55:53 +00:00
Yaqi Ji b693909a08
feat(sdk)!: move v1 to deprecated folder (#7291)
* chore(sdk): move v1 to deprecated

* fix testsg

* fix testsg

* fix setup.py

* fix test

* s'

* fix tests

* fix test

* retore v2 test changes

* fix py3.6 test

* fix py3.6 test

* fix py3.6 import fallback error

* remove deprecated

* fix samples test

* sample test

* fix samples

* add readme

* restroe test

* python require

* remove path

* fix tests

* inteegration tests

* remove tfx tests for dependency with kfp v1

* fix e2e

* fix e2e

* fix integration tests

* fix sampe

* move client down

* change to kfp

* add import alias

* fix

* runid

* fix dsl

* only use kfp for function

* revert train_until_good

* tfx test

* kfp

* try import

* onprem
2022-03-04 00:52:59 +00:00
Alexey Volkov cc83e1089b
Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
Yuan (Bob) Gong 02cb6e3300
test(samples): fix sample-test argo logs command. Fixes #5283 (#5284)
* test(samples): fix sample-test argo logs command

* Update check_notebook_results.py

* Update run_sample_test.py

* Update run_resnet_cmle_test.py
2021-03-11 19:39:24 -08:00
Yuan (Bob) Gong 875137aa58
fix(samples): remove TFX iris example. Part of #5137 (#5189)
* fix(samples): remove TFX iris example

* rm all occurrences
2021-02-25 17:40:42 +08:00
Yuan (Bob) Gong 82e9731c32
test(proxy): use inverse proxy staging env for presubmit tests. Part of #4667 (#4678)
* wip

* test(proxy): use inverse proxy staging env for presubmit tests

* update

* update

* fix syntax error

* fix

* let test run faster

* keep cluster for debugging

* update

* fix tests
2020-10-30 00:44:06 -07:00
Jiaxiao Zheng 7930f83117
TFX Iris sample (#3119)
* init

* update comment

* fix module file

* clean up

* update to beam sample

* add doc of default bucket

* bump viz server tfma version

* update iris sample to keras native version

* update iris sample to keras native version

* pin TFMA

* add readme

* add to sample test corpus

* add prebuilt && update some config

* sync frontend

* update snapshot

* update snapshot

* fix gettingstarted page

* fix unit test

* fix unit test

* update description

* update some comments

* add some dependencies.
2020-03-13 17:34:34 -07:00
Jiaxiao Zheng 5c008f600c [Sample] Add back visualization in XGBoost sample (#2384)
* init.

* add delete op

* Add new transform and analyze op

* Save.

* Partial work

* partial work

* WIP

* Clean up code.

* Disable xgboost cm check for now.

* Update commit SHA

* Update kw arg

* Correct the url format.

* Switch to gcp component for create cluster.

* add secret

* fix create cluster op

* fix path problem

* Move display name

* no op

* Improve

* doc

* Solve

* add back visualization

* fix

* Fix naming

* add back check for cm

* remove todo

* Update readme

* fix naming

* fix flakiness

* Revert "fix flakiness"

This reverts commit 81ba4460
2019-10-16 21:26:38 -07:00
Jiaxiao Zheng dbac974c51
[Sample] update XGBoost sample (#2220)
* init.

* add delete op

* Add new transform and analyze op

* Save.

* Partial work

* partial work

* WIP

* Clean up code.

* Disable xgboost cm check for now.

* Update commit SHA

* Update kw arg

* Correct the url format.

* Switch to gcp component for create cluster.

* add secret

* fix create cluster op

* fix path problem

* Move display name

* no op

* Improve

* doc

* Solve

* update sample test launcher.

* Fix component test yaml
2019-10-15 08:03:09 -07:00
Alexey Volkov 7b6957ae06 SDK - Client - Added a way to set experiment name using environment variables (#2292)
* SDK - Client - Added a way to set experiment name using environment variables

This is useful for launching notebooks or pipeline files that submit
themselves for execution.

* Switched to subprocess.run which supports env

* Setting the environment variable differently
Looks like `subprocess.run` uses `PATH` to search for the program.

* Convert return code to string

* Changed the way the experiment name is being set

* Changed how the notebook installs the SDK

Notebook is overriding the SDK that's being tested.

* Not installing the KFP SDK package

* Removed the experiment_name from samples and configs.

* Changed the SDK installation lines in samples

Otherwise the sample tests do not correctly test the new SDK code.
2019-10-14 14:55:51 -07:00
Jiaxiao Zheng 19db87d650 [Sample] Improve tfx oss sample (#2360)
* Improve default value, fix flakiness.

* Improve guideline.

* Compile

* no op

* add scope

* Correct tfx nightly build tag

* switch to use RUN_ID_PLACEHOLDER
2019-10-11 13:14:05 -07:00
Jiaxiao Zheng 361fbeea77 [Sample] Add new TFX::OSS sample (#2319)
* init.

* Patched Ajay's sample

* Clean up the sample and add preload config.

* Fix default value

* Remove old file

* Add compiled tfx sample

* Add compiled pipeline and move tfx sample to contrib to prevent dependency issue.

* Add readme and remove redundant params

* Add inline comments.

* Add description

* Add sample test

* fix test name.

* fix test dir

* fix data path.

* Fix pipeline_root
2019-10-09 17:04:52 -07:00
Ning d72411cf35 add retry tests (#2141)
* add retry tests

* add arguments

* fix sample test infra error
2019-09-17 18:21:29 -07:00
Ning 646aa5ff64 feature parity between notebook sample and normal sample (#2095)
* feature parity between notebook sample and normal sample

* typo
2019-09-12 18:26:31 -07:00
Jiaxiao Zheng 7b1c720a47 Improve notebook check automation (#2040)
* Add logic to detect extension name.

* Rename notebook samples

* Change to use config yaml for papermill preprocess.

* Remove ad hoc logic

* Remove duplicated logic

* Refactor

* Add run_pipeline flag in config yaml

* Add run pipeline flag for .py sample as well.

* Fix extension name

* Fix

* Fix problems in docstring.

* refactor run_sample_test.py into two functions

* Refactor the procedure into 3 steps

* Fix bug in exit code format

* Remove two redundant functions.
2019-09-09 13:40:55 -07:00
Jiaxiao Zheng 5ac9b0449a
Add schema validation for sample test config yaml (#2000)
* Add schema for yaml files, and remove native style checks.

* Add schema check in run_sample_test.py

* fix schema
2019-08-30 11:33:56 -07:00
Jiaxiao Zheng 4918d1919a
Change sample test to read test arguments from yaml config file (#1987)
* Clean unused import

* nit

* nit: improve docstring.

* Refactor sample test into digesting params from config yaml files.

* Fix argument assignment.

* Fix path.

* Fix output params. Not every test is using it.

* Add output placeholder in yaml config.

* Fix yaml config.

* Minor fix.

* Minor fix.

* Move timeout info to config.yaml, too

* Fix import in check_notebook_results.py

* Add type hints in config.yaml

* Remove redundant close.
2019-08-29 16:29:55 -07:00
Ning 03143cf9e0
reduce taxi and xgboost test data to speed up sample test (#1917) 2019-08-27 18:32:35 -07:00
Jiaxiao Zheng 77210fba7e Refactor run_sample_test.py script into python class (#1963)
* Refactor run_sample_test.py into python class.

* Introduce PySampleChecker in sample_test_launcher
2019-08-27 16:07:11 -07:00
Ning 93e3121644
remove kubeflow training (#1902) 2019-08-21 09:20:39 -07:00
Jiaxiao Zheng b476a848d9
Refactor sample tests configuration to reduce the efforts of adding samples. (#1730)
* Remove redundant import.

* Simplify sample_test.yaml by using withItem syntax.

* Simplify sample_test.yaml by using withItem syntax.

* Change dict to str in withItems.

* remove redundant sed options.

* Fix format/style issues

* [WIP] Refactor repeated logic into two utility functions.

* [WIP] Add a utility function to validate the test results from a notebook test.

* [WIP] Refactor test cases (except for notebook sample tests) into adopting utility functions.
TODO: Need to move the functions of run_*_test.py into a unified run_sample_test.py.

* [WIP] Fix a typo in test name and incorporate tfx-cab-classification, kubeflow-training-classification, xgboost-training-cm and basic ones into one run_sample_test.py

* Fix/add some comments.

* Refactor notebook tests into using utility functions

* lint

* Unify naming in sample_test.yaml

* Remove old *_test.py files

* Fix tests by fixing test names.

* Fix string formatting, per Ark-kun's comment.

* Fix names of papermill-generated python notebook.

* Fix tests

* Fix test by fixing experiment names, and test names in yaml.

* Fix test by fixing experiment names.

* Fix dsl type checking test that does not require experiment set-up.

* Remove redundant commands and usage of ipython

* Revert "Remove redundant commands and usage of ipython"

This reverts commit 23a0e014

* Remove redundant string subs and edit an AI.

* Move image name injection to a utility function to improve readability.

* Revert lint changes of check_notebook_results.py

* Unify test case naming convention to underscore.

* Fix .py name

* Fix README.md

* Fix test

* Add TODO items.

* Add a utility function to inject kubeflow_training_classification python sample file.

* Fix redundant cd command.

* Fix indentation.

* Fix test names in component_test.yaml

* Remove redundant clean_cmle_models.py

* Fix nit problem.

* Fix comment.
2019-08-09 12:27:37 -07:00