Commit Graph

36 Commits

Author SHA1 Message Date
Alexey Volkov 4339e70962 Components - Added AutoML Tables components and tests (#2174)
* Components - Added AutoML Tables components

* Added the sample - AutoML Tables - Retail product stockout prediction

* Replaced the project ID with dummy placeholder

* Fixed the description parameter passing

* Replaced pip with pip3 and changed quotes

* Added licenses

* Updated the component links

* Revert "Replaced pip with pip3"

This reverts commit 65ed0a7fc6. (part of it)

Here, `pip` is not the name of executable. It's the module name which is
just `pip`, not `pip3`.

* Changed quotes to single quotes

* Moved the components to the gcp folder

* Switched container images to python:3.7

* Updated component versions in sample
2019-09-25 13:42:06 -07:00
Kevin Bache b52e32b1a5 Add samples for loops (#2218)
* added loop samples

* moved samples; added samples to tests

* year
2019-09-24 14:59:58 -07:00
IronPan dc5aab6687
Release 57d9f7f1cf (#2184)
* Updated component images to version 57d9f7f1cf

* Updated components to version e598176c02

* good version
2019-09-23 00:19:55 +08:00
Alexey Volkov 372efe56c5 Tests - Samples - Added the component_build sample test (#2147)
* Tests - Samples - Added the component_build sample test

* Fixed the papermill issue

* Renamed EXPERIMENT_NAME to experiment_name
2019-09-20 14:31:27 -07:00
Jiaxiao Zheng 6e95603d19 [Test/sample] Fix the model version in kubeflow_tf_serving sample to avoid potential conflict. (#2170)
* fix sample - change version number.

* fix notebook
2019-09-19 11:01:01 -07:00
Ning a855c5655b remove tfx-taxi sample in favor of the tfx oss sample (#2160) 2019-09-18 22:59:06 -07:00
Ning a71d5b0f28
add kubeflow serving sample test (#2163)
* add kubeflow serving sample test
2019-09-18 15:46:20 -07:00
Jiaxiao Zheng d6d3785506 Add a convention to make sure experiment_name is parameterized in notebook sample. (#2112)
* add a new convention

* Fix config experiment_name

* fix light weight example

* Fix experiment name

* Update guidelin.

* fix lightweight_component.config.yaml

* Remove config yaml

* Fix guideline.md

* Reword.
2019-09-17 15:37:14 -07:00
Ning 759d2f6576
add artifact location tests (#2142) 2019-09-17 13:34:28 -07:00
Ning 52fc2c824a
add dataflow sample with the new GCP component (#2096)
* add dataflow sample with tests
2019-09-16 14:19:35 -07:00
Ning 4f46720c1c Release 1449d08aee (#2099)
* Updated component images to version 1449d08aee

* Updated components to version e7a021ed1d
2019-09-13 11:14:31 -07:00
Ning bdb8598116 Add cmle tpu sample link (#2074)
* add CMLE tpu sample link

* revert the change

* typos
2019-09-09 18:56:54 -07:00
Jiaxiao Zheng 7b1c720a47 Improve notebook check automation (#2040)
* Add logic to detect extension name.

* Rename notebook samples

* Change to use config yaml for papermill preprocess.

* Remove ad hoc logic

* Remove duplicated logic

* Refactor

* Add run_pipeline flag in config yaml

* Add run pipeline flag for .py sample as well.

* Fix extension name

* Fix

* Fix problems in docstring.

* refactor run_sample_test.py into two functions

* Refactor the procedure into 3 steps

* Fix bug in exit code format

* Remove two redundant functions.
2019-09-09 13:40:55 -07:00
Ning 2a3dd327db move old gcp components to deprecated folder (#2031) 2019-09-06 16:29:20 -07:00
Ning fe0bc678a8 add more core samples in the sample test (#2030)
* add more core samples in the sample test

* remove retry test for now

* update pipeline transformer sample

* add default value to volume_ops and fix error

* remove volume snapshot and resource op sample tests, which require platform support

* remove volume_ops since it is already included in the e2e

* add timeout
2019-09-06 11:46:15 -07:00
Alexey Volkov 5360f3fcab SDK - Compiler - Stopped adding mlpipeline artifacts to every compiled template (#2046)
* Explicitly added mlpipeline outputs to the components that actually produce them

* Updated samples

* SDK - DSL - Stopped adding mlpipeline artifacts to every compiled template
Fixes https://github.com/kubeflow/pipelines/issues/1421
Fixes https://github.com/kubeflow/pipelines/issues/1422

* Updated the Lighweight sample

* Updated the compiler tests

* Fixed the lightweight sample

* Reverted the change to one contrib/samples/openvino
The sample will still work fine as it is now.
I'll add the change to that file as a separate PR.
2019-09-05 17:56:57 -07:00
Ilias Katsakioris 0cc9f69b04 Extend E2E tests: Add VolumeOp test (#2019)
* Extend E2E tests: Add VolumeOp test

* Rename: `samples/core/volume_ops/volumeop.py` ->
          `samples/core/volume_ops/volume_ops.py`
  for uniformity regarding test launching
* Change VolumeOp modes from RWM to RWO

* Add volume_ops.config.yaml
2019-09-03 21:24:58 -07:00
Ning 99edaf73bc minor fix (#1954) 2019-08-26 13:08:39 -07:00
Ning 5205339b99
versioned the 0.13.0 tfx example (#1912)
* versioned the 0.13.0 tfx example
* use the taxi_utils from 0.13.1
* update tfx oss readme
2019-08-26 11:45:46 -07:00
hongye-sun 7ec56978b6 Release 151c5349f1 (#1916)
* Updated component images to version 151c5349f1

* Updated components to version a97f1d0ad0

* Update setup.py

* Update setup.py
2019-08-21 16:06:31 -07:00
Ning 94aa0788d5 remove tfx notebook sample in favor of the TFX OSS sample (#1908) 2019-08-21 10:22:31 -07:00
Ning 93e3121644
remove kubeflow training (#1902) 2019-08-21 09:20:39 -07:00
olegchorny 101a346c0e 'core' folder included to parameters related On-Premise cluster (#1751)
* 'core' folder included to parameters related On-Premise cluster

Update is required because this sample was migrated to the samples/core folder

* Update README.md
2019-08-19 22:33:47 -07:00
Ning de538aa3e3
add compile step in the samples to generate zip files (#1866)
* add compile step in the samples to generate zip files
2019-08-16 15:53:07 -07:00
Ajay Gopinathan 0d898cb40f Release 0517114dc2 (#1859)
* Updated component images to version 0517114dc2

* Updated components to version 48dd338c8a
2019-08-16 13:16:11 -07:00
Ning 7dbca1afce
update gcloud ml-engine to ai-platform (#1863) 2019-08-16 12:06:37 -07:00
sina chavoshi a6f3f40e5e Adding a sample for serving component (#1830)
* Adding a sample for serving component

* removed typo / updated based on PR feedback

* fixing the jupyter rendering issue

* adding pip3 for tensorflow

* Fixed spelling error in VERSION

* fix indentation based on review feedback
2019-08-16 09:56:09 -07:00
Yuan (Bob) Gong ced9654cd2 Add subprocess pip install example in lightweight component example notebook (#1817) 2019-08-14 19:48:33 -07:00
Jiaxiao Zheng 750c4cd0be Move TF installation to notebooks (#1793)
* Remove redundant import.

* Simplify sample_test.yaml by using withItem syntax.

* Simplify sample_test.yaml by using withItem syntax.

* Change dict to str in withItems.

* Move tensorflow installation into notebooks.
2019-08-12 12:07:04 -07:00
Jiaxiao Zheng b476a848d9
Refactor sample tests configuration to reduce the efforts of adding samples. (#1730)
* Remove redundant import.

* Simplify sample_test.yaml by using withItem syntax.

* Simplify sample_test.yaml by using withItem syntax.

* Change dict to str in withItems.

* remove redundant sed options.

* Fix format/style issues

* [WIP] Refactor repeated logic into two utility functions.

* [WIP] Add a utility function to validate the test results from a notebook test.

* [WIP] Refactor test cases (except for notebook sample tests) into adopting utility functions.
TODO: Need to move the functions of run_*_test.py into a unified run_sample_test.py.

* [WIP] Fix a typo in test name and incorporate tfx-cab-classification, kubeflow-training-classification, xgboost-training-cm and basic ones into one run_sample_test.py

* Fix/add some comments.

* Refactor notebook tests into using utility functions

* lint

* Unify naming in sample_test.yaml

* Remove old *_test.py files

* Fix tests by fixing test names.

* Fix string formatting, per Ark-kun's comment.

* Fix names of papermill-generated python notebook.

* Fix tests

* Fix test by fixing experiment names, and test names in yaml.

* Fix test by fixing experiment names.

* Fix dsl type checking test that does not require experiment set-up.

* Remove redundant commands and usage of ipython

* Revert "Remove redundant commands and usage of ipython"

This reverts commit 23a0e014

* Remove redundant string subs and edit an AI.

* Move image name injection to a utility function to improve readability.

* Revert lint changes of check_notebook_results.py

* Unify test case naming convention to underscore.

* Fix .py name

* Fix README.md

* Fix test

* Add TODO items.

* Add a utility function to inject kubeflow_training_classification python sample file.

* Fix redundant cd command.

* Fix indentation.

* Fix test names in component_test.yaml

* Remove redundant clean_cmle_models.py

* Fix nit problem.

* Fix comment.
2019-08-09 12:27:37 -07:00
Jiaxiao Zheng 90b9ad7657 Move imagepullsecrets sample to samples/core (#1767)
* Remove redundant import.

* Simplify sample_test.yaml by using withItem syntax.

* Simplify sample_test.yaml by using withItem syntax.

* Change dict to str in withItems.

* Add image pull secret sample.

* Move imagepullsecret sample from test dir to sample dir. Waiting on corresponding unit test infra refactoring.

* Update the location of imagepullsecrets so that it can serve as an example.

* Add minimal comments documenting usage.
2019-08-08 17:35:26 -07:00
Jiaxiao Zheng 9a047fb016
Add preemtptible gpu sample (#1749)
* Remove redundant import.

* Simplify sample_test.yaml by using withItem syntax.

* Simplify sample_test.yaml by using withItem syntax.

* Change dict to str in withItems.

* Add preemptible gpu tpu sample and unittest

* Update a test utility function.

* Seperate the location of sample and gold .yaml for testing purpose.
2019-08-08 13:58:46 -07:00
sina chavoshi c07e975cf5 Basic component build sample (#1681)
* adding a basic sample for component build

* adding a basic command line based sample for component build

* remvoing use of global

* Update samples/core/component_build/component_build.py

Co-Authored-By: Jiaxiao Zheng <jxzheng@google.com>

* Switching to Notebook based sample

* Added Pip install KFP SDK
2019-08-07 20:25:17 -07:00
Ning 81db6bd77e
Move samples to the correct location (#1759)
* move ai-platform and artifact_location sample to core
* move some volume_op and volume_snapshot_op to contrib
2019-08-07 16:02:50 -07:00
sina chavoshi cd7c9e039f Moving samples to match the new folder structure (#1734) 2019-08-05 12:11:49 -07:00
Ning e8a6feb229
Restructure samples (#1710)
* restructure samples
* update apiserver and sample test for the new location
2019-08-01 17:31:37 -07:00