Commit Graph

32 Commits

Author SHA1 Message Date
Yaqi Ji b693909a08
feat(sdk)!: move v1 to deprecated folder (#7291)
* chore(sdk): move v1 to deprecated

* fix testsg

* fix testsg

* fix setup.py

* fix test

* s'

* fix tests

* fix test

* retore v2 test changes

* fix py3.6 test

* fix py3.6 test

* fix py3.6 import fallback error

* remove deprecated

* fix samples test

* sample test

* fix samples

* add readme

* restroe test

* python require

* remove path

* fix tests

* inteegration tests

* remove tfx tests for dependency with kfp v1

* fix e2e

* fix e2e

* fix integration tests

* fix sampe

* move client down

* change to kfp

* add import alias

* fix

* runid

* fix dsl

* only use kfp for function

* revert train_until_good

* tfx test

* kfp

* try import

* onprem
2022-03-04 00:52:59 +00:00
Yuan (Bob) Gong f9db81e2c8
test: fix integration-v2 test (#7122)
* Update parameterized_tfx_oss.py

* test: fix integration-v2 test

* reduce test log noise
2021-12-29 19:03:48 +00:00
Yuan (Bob) Gong 2460aaa653
test: migrate sample integration test to v2 sample test infra (#7115)
* test: migrate sample integration test to v2 sample test infra

* test: configure v2 integration test timeout
2021-12-26 04:17:44 +00:00
James Liu 3cfff3db1d
fix(samples): Use TFX library version for parameterized_tfx_oss. Fix #6974 (#6993)
* fix(samples): Use TFX library version for parameterized_tfx_oss

* change version reference
2021-12-02 10:00:04 +00:00
James Liu 91dc80d86a
feat(sample): Use TFX 1.2.0 for Taxi tips prediction sample. Partial #6138 (#6381)
* fix(sample): Use TFX1.2.0 for Taxi tips prediction sample

* also update python

* Update parameterized_tfx_oss.py

* Update taxi_pipeline_notebook.ipynb

* Update parameterized_tfx_oss.py

Co-authored-by: Yuan (Bob) Gong <4957653+Bobgy@users.noreply.github.com>
2021-08-19 09:56:40 +08:00
Jiyong Jung 053edb518d
chore: use a runtime parameter for pusher destination in the TFX example. (#6373)
{} Placeholder doesn't work well in component parameters and
it is better to have it as a runtime parameter for flexibility.

https://github.com/kubeflow/pipelines/issues/6311#issuecomment-900245391
2021-08-17 20:12:37 -07:00
Jiyong Jung 7ae0d9f935
chore: Fixes wrong Evaluator config. (#6326)
* Fixes wrong Evaluator config.

Also changes dataset to the one included in the tfx Python package.

* Rollback {{kfp-default-bucket}}.

This placeholder will be replaced if Kubeflow Pipelines is installed
from Marketplace.
2021-08-13 01:43:54 -07:00
Jiyong Jung a1f7160cf5
chore: upgrade tfx to 1.0.0 (#6316)
* test: fix sample test image build

* update to TFX 1.0.0

* update argo CLI

* Uses TFX 1.0 APIs in parameterized_tfx_oss example.

Co-authored-by: Yuan Gong <gongyuan94@gmail.com>
2021-08-12 04:02:03 -07:00
Alexey Volkov cc83e1089b
Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
Yuan Gong cd55a55c62 test: fix postsubmit test is_integration_test flag 2021-02-24 14:05:11 +00:00
Yuan (Bob) Gong a394f8cdf3
fix: upgrade tfx samples & deps to 0.27.0. Part of #5137 (#5176)
* feat: upgrade tfx to 0.27.0

* update visualization server requirements.txt

* upgrade to tensorflow:2.4.0

* fix iris sample too
2021-02-24 20:09:15 +08:00
Niklas Hansson 1fee4054a7
fix(samples): Update tfx image. Fixes #5137 (#5165)
* fixed the tfx image

* updated to versions
2021-02-22 16:53:14 -08:00
jingzhang36 ce51c591f3
fix: increase TFX version from 0.20.2 to 0.22.0. Fixes #4084, fixes #4114 (#4133)
* enable pagination when expanding experiment in both the home page and the archive page

* Revert "enable pagination when expanding experiment in both the home page and the archive page"

This reverts commit 5b672739dd.

* tfx 0.21.2 -> 0.22.2

* tfx 0.20.2 -> 0.22.0

* update requirements.txt
2020-07-02 00:40:46 -07:00
Jiaxiao Zheng 88ee54fa32
[Samples] Change the data url to point to ml-pipeline instead of ml-pipeline-playground (#3890)
* update location in tfx sample

* update xgboost

* update the rest

* update notebook sample
2020-06-01 22:30:15 -07:00
Jiaxiao Zheng 618a46b7d2
update image (#3395) 2020-04-01 17:50:24 -07:00
Jiaxiao Zheng fad7510626
Bump TFX to 0.21.2 (#3255)
* bump tfx

* bump tfma

* modernize py sample

* clean up

* update notebook sample

* Remove tmp hack in visualization server
2020-03-11 09:53:37 -07:00
Jiaxiao Zheng ee525b91cb
Bump TFX to 0.21.1 (#3220)
* bump

* pin two requirements.txt

* update sample

* try a newer k8s version
2020-03-05 17:32:50 -08:00
Jiaxiao Zheng 9a96117f94
[Sample] Disable multi-threading for TFX demo notebook (#3170)
* [Sample] Disable multi-threading for TFX demo notebook

In TFX 0.21.0 release it's not guaranteed to work well with 6 vCPU. Disable it for now.

* Update taxi_pipeline_notebook.ipynb

Co-authored-by: Yuan (Bob) Gong <gongyuan94@gmail.com>
2020-02-25 21:16:26 -08:00
Jiaxiao Zheng d91cc83602
[Sample] Update doc in taxi pipeline demo (#3149)
* update permission

* add screenshot

* local path issue
2020-02-24 11:17:35 -08:00
Jiaxiao Zheng a9bc8cfe9a
[Sample] update README (#3127)
* [Sample] typo fix

* update README
2020-02-19 16:53:02 -08:00
Jiaxiao Zheng 9fe0c7a38c
[Sample] typo fix (#3125) 2020-02-19 16:01:05 -08:00
Jiaxiao Zheng 4746bdbadd
Bump TFX dependency (#3121)
* bump py sample

* fix notebook per comments during bug bash

* clean up
2020-02-19 12:55:46 -08:00
Jiaxiao Zheng f89ce80460
[Doc] Make it explicit that hosted beta does not require GCP SA (#3066) 2020-02-13 16:19:09 +08:00
Jiaxiao Zheng b96ce127c1
update module file (#3017) 2020-02-10 16:52:08 -08:00
Jiaxiao Zheng acb2038973 [Backend] Improve parameter patching (#3016)
* update

* move patching logic

* update placeholders

* move to api converter

* refactor some tests

* fix main.go

* default remote build to false

* patch everything

* remove api converter patching

* clean up

* fix constant
2020-02-10 00:15:53 -08:00
Jiaxiao Zheng ad8c93570f
Bump TFX dependency to 0.21.0rc0 (#2949)
* bump version and modernize

* modernize

* modernize

* unpin pyarrow
2020-01-31 17:09:29 -08:00
Jiaxiao Zheng 3c6ee19393
[Backend] Patch default bucket name and project ID (#2938)
* update branch

* add env var

* update api-server

* populate default value

* lint

* bump build rule

* bump build rule

* bump travis bazel version

* fix

* Revert "bump travis bazel version"

This reverts commit 92db3842

* Revert "bump build rule"

This reverts commit be2bd7b4

* Revert "bump build rule"

This reverts commit 78926e3c

* Revert "fix"

This reverts commit 963e64b8

* fix

* patch all the samples

* unittest

* fix tests

* minor fix

* style change

* clean up
2020-01-31 15:25:21 -08:00
Jiaxiao Zheng 3c66be2dab [Sample] Update the Doc for TFX sample (#2798)
* update

* update
2020-01-15 18:08:22 -08:00
Jiaxiao Zheng cb7342c5c1 clean (#2788) 2020-01-02 21:33:40 -08:00
Jiaxiao Zheng 3fa755641e [Sample] Add a notebook sample under parameterized_tfx_oss (#2729)
* add notebook sample

* Update

* remove my kfp endpoint.

* simplify import paths.
2019-12-17 20:32:05 -08:00
Yuan (Bob) Gong 4a8d262abb Migrate standalone deployment to workload identity on GCP (#2619)
* Script to set up workload identity for standalone deployment

* Migrate tests to run on standalone + workload identity

* Fix test script

* Switch to static GSAs for testing, because they have name length limit

* Add workload identity binding for argo

* Fix argo workload identity bindings

* Remove user-gcp-sa from tests

* Remove use_gcp_secret from xgboost sample

* Allow debugging tests locally

* Wait for policies to take effect

* Update deploy-pipeline-lite.sh

* Update deploy-pipeline-lite.sh

* [WIP] test gcloud auth list with test-runner sa

* Add namespace

* test again

* Use new image builder

* test again

* Remove debug code

* Remove usages of use_gcp_secret

* Fix unit test and tensorboard pod template

* Add debug code again to test

* Try waiting until workload identity bindings are ready

* Fix some other samples

* Fix parameterized tfx oss sample

* Add retry to image building

* Try fixing tfx oss sample

* Fix compiled tfx oss sample

* Update all google/cloud-sdk to latest

* Try fixing parameterized tfx oss sample again

* Also verify pipeline-runner ksa is working

* Fix parameterized_tfx_oss sample

* Update gcp-workload-identity-setup.sh

* Revert unneeded change

* Pin to new google/cloud-sdk

* Remove wrongly commited binaries
2019-12-16 22:05:58 -08:00
Jiaxiao Zheng ef381aafcc [Sample test] Add parameterized_tfx_oss to 'normal' sample test corpus (#2695)
* Update to tfx 0.15.0 release

* update file name

* modernize naming

* move to core

* Update sample test launcher/config/file name.

* No longer need precompiled package.

* add dependency

* add pip

* no longer call dsl-compile

* fix launcher

* give additional time for init

* Try skip check in backend docker

* fix

* try fix

* revert the timeout

* fix per Alexey's suggestion

* fix typo

* print log

* fix

* remove log
2019-12-10 16:06:06 -08:00