Commit Graph

16 Commits

Author SHA1 Message Date
Junggil Lee ff2e002157
fix(samples): Update loop_parameter, loop_static samples to v2 pipelines (#9870) 2023-08-15 17:59:04 +00:00
Connor McCarthy bdff332ac6
feat(sdk): support more than one exit handler per pipeline (#8088)
* add compiler test pipeline with multiple exit handlers

* remove blocker of multiple exit handlers

* move exit handler builder logic to pipeline_spec_builder

* build all exit handlers per pipeline

* add compiler test with IR inspection

* prevent usage of cross-pipeline after

* test cross-pipeline after is prevented

* update existing task dependency logic and tests

* add v2 sample test

* remove cross-pipeline .after

* prevent cross-dag data dependency for dsl features

* add compiler test pipeline with nested exit handlers

* add support for nested exit handlers

* clean up pipeline with nested exit handlers

* remove sample with multiple exit handlers

* remove compiler test with nested exit handlers

* add compilation guard against nested exit handlers in subdag

* update release notes
2022-08-10 16:56:21 +00:00
Lingqing Gan 98a58c7a0c
Pipeline level exit handler and v2 test (#7642)
* support IR YAML format in API

* Check the error message and return false if it is not nil

* update error message

* fixed simple loop but need cleaning up

* Deleted debug logs

* remove logs and fix some format

* fix static_loop_arguments

* change the driver image 

change the driver image back to the kfp container registry.

* change variable declaration

* remove logs

* remove log

* changed argo template

* change argocompiler dependency to my own repo

* Update go.mod

* Update VERSION

* v2 pipeline level exit handler; add test case

* Update VERSION

* remove logs and change temp dependency

* remove logs

* Update argo.go

* Update argo_test.go

* Update driver.go

* Update driver.go

* change VERSION

* Update VERSION

* Modifyb PR: remove loop fix and some changes

* update dsl compile command

* revert VERSION

* Update Makefile

* Update Makefile
2022-05-05 02:37:12 +00:00
Lingqing Gan 1180e10632
fix(backend): fix simple loop bug (#7578)
* support IR YAML format in API

* Check the error message and return false if it is not nil

* update error message

* fixed simple loop but need cleaning up

* Deleted debug logs

* remove logs and fix some format

* fix static_loop_arguments

* change the driver image 

change the driver image back to the kfp container registry.

* change variable declaration

* remove logs

* remove log

* move `ok` definition

* change test file for debug purpose

* change test for debug purpose

* update sample test for static loop

* update test file, remove code for debug
2022-05-05 01:31:12 +00:00
Yaqi Ji 8bb0d0e025
feat(sdk)!: move v2 to main namespace (#7376)
* feat(sdk)!: move v2 to main namespace

* edit samples
2022-03-04 21:56:51 +00:00
Yaqi Ji b693909a08
feat(sdk)!: move v1 to deprecated folder (#7291)
* chore(sdk): move v1 to deprecated

* fix testsg

* fix testsg

* fix setup.py

* fix test

* s'

* fix tests

* fix test

* retore v2 test changes

* fix py3.6 test

* fix py3.6 test

* fix py3.6 import fallback error

* remove deprecated

* fix samples test

* sample test

* fix samples

* add readme

* restroe test

* python require

* remove path

* fix tests

* inteegration tests

* remove tfx tests for dependency with kfp v1

* fix e2e

* fix e2e

* fix integration tests

* fix sampe

* move client down

* change to kfp

* add import alias

* fix

* runid

* fix dsl

* only use kfp for function

* revert train_until_good

* tfx test

* kfp

* try import

* onprem
2022-03-04 00:52:59 +00:00
Yuan (Bob) Gong c7448c71df
test(v2): refactor sample test utils into a py package (#7105)
* test(v2): refactor sample test utils into a py package

* fix error
2021-12-23 11:10:01 +08:00
Yuan (Bob) Gong 26d33ead40
chore(v2): v2 iterator expr selector support (#7020)
* chore(v2): parameter expression selector support

* implement input parameter type validation and conversion

* fix some issues

* test: add tests for remaining loop samples

* fix

* fix2

* fix3

* address comments

* fix some tests
2021-12-10 19:01:49 +00:00
Yuan (Bob) Gong 713558cfb8
feat(v2): iterator and sub-DAG basic support (#6985)
* chore(samples): add loop_output_v2 sample

* feat(v2): iterator support

* refactor v2 backend compiler tests to golden files

* fix unit tests

* test(v2): verify loop_output_test MLMD data

* clean up

* fix

* fix2

* fix
2021-12-09 14:23:55 +00:00
Chen Sun 5bbb384cc7
test: clean up v2 compatible mode sample tests (#6943) 2021-11-23 02:08:06 +00:00
Chen Sun 2991602cfc
feat(sdk): Better error message when compiling for v2. Fixes #5688, Fixes #5727 (#5759)
* Better error message when compiling for v2

* update samples
2021-05-31 13:39:03 -07:00
Alexey Volkov cc83e1089b
Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
Yuan (Bob) Gong 02dbcfa062
test: more samples in v2 sample test (#5431)
* test: set up sample test for many samples

* test: rm loop_* tests from v1 sample test, they are already covered in v2 sample test

* fix condition pipeline for basic e2e test

* remove condition from e2e test
2021-04-09 08:34:03 -07:00
Jiaxiao Zheng ef381aafcc [Sample test] Add parameterized_tfx_oss to 'normal' sample test corpus (#2695)
* Update to tfx 0.15.0 release

* update file name

* modernize naming

* move to core

* Update sample test launcher/config/file name.

* No longer need precompiled package.

* add dependency

* add pip

* no longer call dsl-compile

* fix launcher

* give additional time for init

* Try skip check in backend docker

* fix

* try fix

* revert the timeout

* fix per Alexey's suggestion

* fix typo

* print log

* fix

* remove log
2019-12-10 16:06:06 -08:00
Jiaxiao Zheng 790fe99aca [SDK] Relax k8s sanitization (#2634)
* update

* add allow_capital

* fix

* fix volume_ops sample

* fix pipeline name sanitization

* fix unittests

* fix sanitization in _client.py

* fix component output sanitization
2019-11-26 10:28:10 -08:00
Kevin Bache b52e32b1a5 Add samples for loops (#2218)
* added loop samples

* moved samples; added samples to tests

* year
2019-09-24 14:59:58 -07:00