Commit Graph

17 Commits

Author SHA1 Message Date
Yaqi Ji b693909a08
feat(sdk)!: move v1 to deprecated folder (#7291)
* chore(sdk): move v1 to deprecated

* fix testsg

* fix testsg

* fix setup.py

* fix test

* s'

* fix tests

* fix test

* retore v2 test changes

* fix py3.6 test

* fix py3.6 test

* fix py3.6 import fallback error

* remove deprecated

* fix samples test

* sample test

* fix samples

* add readme

* restroe test

* python require

* remove path

* fix tests

* inteegration tests

* remove tfx tests for dependency with kfp v1

* fix e2e

* fix e2e

* fix integration tests

* fix sampe

* move client down

* change to kfp

* add import alias

* fix

* runid

* fix dsl

* only use kfp for function

* revert train_until_good

* tfx test

* kfp

* try import

* onprem
2022-03-04 00:52:59 +00:00
Yuan (Bob) Gong c7448c71df
test(v2): refactor sample test utils into a py package (#7105)
* test(v2): refactor sample test utils into a py package

* fix error
2021-12-23 11:10:01 +08:00
Chen Sun 5bbb384cc7
test: clean up v2 compatible mode sample tests (#6943) 2021-11-23 02:08:06 +00:00
Chen Sun 73804f8928
test(sample): reenable samples tests run with V2_ENGINE mode (#6932)
* reenable v2 engine

* fix

* fix

* fix

* log v2 engine test

* don't fill in default value at test util

* fix

* pass to job instead of spec
2021-11-20 18:18:35 +00:00
capri-xiyue 4438929259
feat(v2): added importer support (#6415)
* added importer support in compilor

* added importer launcher

* complete importer launcher draft

* added importer e2e test draft

* added importer e2e test draft and fixed build error

* added importer e2e test draft and fixed build error

* changed sample test config

* fixed mlmd publish error

* fixed format and added task verification for importer e2e test

* changed sample v2 importer test

* added non default bucket support

* fixed importer build error

* fixed e2e test

* modify importer e2e test

* fixed e2e test

* fixed e2e test

* fixed e2e test

* fixed importer e2e test

* fixed comments

* fixed unit test

* fixed importer e2e test

* added todo comment

* remove unused code

* Update importer.go

Co-authored-by: Yuan (Bob) Gong <4957653+Bobgy@users.noreply.github.com>
2021-08-31 04:06:03 -07:00
Yuan (Bob) Gong 2b78d16e03
chore(v2): artifact passing via local path (#6285)
* chore(v2): add implicit dependencies for artifacts

* chore(v2): artifact passing via local path

* clean up
2021-08-10 21:40:25 -07:00
Yuan (Bob) Gong ee663d9593
chore(v2): standardize MLMD data model. Fixes #5669 (#6054)
* chore(v2): standardize MLMD data model

* change context type to system namespace

* update sdk snapshots

* fix go v2 tests

* update

* update v2 compat snapshots

* fix all samples

* fix must specify pipeline root

* add artifact display name

* add UI rendering of new fields

* fix sample tests

* let ui read artifact and execution names consistently

* fix samples

* fix frontend tests

* fix sample test

* fix last sample

* address feedback
2021-07-19 22:26:15 -07:00
capri-xiyue 3f4bf8fc48
test(v2): added v2 compatible cache e2e test (#6004)
* added v2 compatible cache e2e test

* fixed typo

* fixed e2e test

* resued methods

* combine cache_v2 and two_step pipeline

* fixed sample v2 test

* fixed cache e2e test

* fixed e2e test

* enabled cache e2e test

* fixed typo

* fixed typo

* added enable caching info

* added debug logging

* fixed launcher bug

* removed debug logging
2021-07-15 00:25:48 -07:00
Yuan (Bob) Gong f1f99c01e6
chore(launcher): revert meadata to custom properties & artifact name -> event path (#5842)
* chore(launcher): revert meadataa to custom properties & artifact name -> event path

* fix

* fix2

* fix

* fix2

* fix test

* fix
2021-06-12 19:28:35 -07:00
Yuan (Bob) Gong a75a3c7127
chore(launcher): move artifact metadata to metadata struct field. Fixes #5788 (#5793)
* feat(launcher): move component output metadata to metadata field

* add MLMD validation for metrics_visualization_v2

* clean up

* address comment

* fix
2021-06-07 22:37:45 -07:00
capri-xiyue ef547d025a
fix(v2): added default pipeline root (#5660)
* added default pipeline root

* added default value when pipeline_root is not set

* fixed automated tests

* pin k8s to 1.18

* added testcase to verify default pipeline root

* fixed sample v2 test

* fixed typo

* changed sample v2 tests

* fixed typo

* added testcase to override pipeline root

* fixed typo

* fixed typo:
2021-05-17 19:05:40 -07:00
Alexey Volkov cc83e1089b
Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
capri-xiyue 0bd54b436d
chore(v2): add name as custom property of MLMD artifacts (#5567)
* add name as custom property of MLMD artifacts

* fixed test

* fixed test

* added custom_properties

* fixed e2e tests

* fixed tests

* fixed test
2021-04-29 21:47:30 -07:00
capri-xiyue 5718bc3cd2
chore(v2): added minio and s3 pipeline root support in v2 launcher (#5392)
* added minio and s3 pipeline root support in v2 launcher

* fixed style

* added sdk support for S3/MINIO credentials passing

* fixed add_pod_env unit tests

* added sample test for minio pipeline_root two step pipeline

* modified pipeline root

* resolved conflicts with master

* fixed the code based on comments

* added minio pipeline_root support

* added default minio path

* fixed typo and removed unused code/dependency

* refactored E2E test for minio pipeline root

* deleted duplicate e2e test

* change default minio artifacts path

* updated config yaml

* fixed typo
2021-04-20 20:09:41 -07:00
Yuan (Bob) Gong 4abbdec8c9
test(v2/samples): verify sample mlmd state (#5486)
* test(v2/samples): verify sample mlmd state

* finish artifact verification and fix v2 test integration

* fix unrecognized argument error

* fix tests

* fix test failure

* fix test
2021-04-20 03:06:38 -07:00
Yuan (Bob) Gong 1128631cd5
test: v2 sample test supports multiple test cases & internal endpoint (#5432)
* test: v2 sample test supports multiple test cases & internal endpoint

* fix

* test: reduce run details page url duplication

* fix typings
2021-04-06 21:59:01 -07:00
Yuan (Bob) Gong 14b447a07c
test: refactor v2 sample test, move test samples to samples/test folder (#5395)
* refactor: sample test util

* fix

* fix

* refactor v2 sample test

* fix
2021-04-03 05:58:21 -07:00