Commit Graph

1023 Commits

Author SHA1 Message Date
Chen Sun c03701b82a
fix(sdk): fix wrong kfp import causes wrong sdk_version being set in pipeline_spec. (#7433)
* fix wrong kfp import in compiler

* release note
2022-03-18 00:05:39 +00:00
Jonny Browning (Datatonic) 02a52a4185
fix(sdk): no longer require KFP client for kfp components build (#7430)
* fix(sdk): no longer require KFP client for kfp components build

* docs(sdk): added release note for kfp components build fix
2022-03-17 22:25:39 +00:00
Hao Xin a5a8c750b5
chore: fix ref link (#7434) 2022-03-17 16:03:11 +00:00
Chen Sun 481b108319
fix(sdk): update kfp-server-api dependencies and bump sdk version to 2.0.0-alpha.1 (#7427)
* update kfp-server-api dependencies

* release note

* bump sdk version to 2.0.0-alpha.1

* fix
2022-03-16 23:30:09 +00:00
Chen Sun 40e9610711
fix(sdk): include requirements.in in sdk manifest (#7429) 2022-03-16 15:55:14 -07:00
Connor McCarthy 4621aec146
chore(sdk): apply yapf formatting (#7414) 2022-03-16 20:34:36 +00:00
Chen Sun b741926bb4
feat(sdk): client to support KFP v2 API. (#7411)
* copy _client.py and _auth.py from deprecated folder

* Make kfp.Client support v2 API (IR).

* fix test golden

* address comments

* copyright year

* chore(backend): clean up pipelinespec.Value usage (#7407)

* chore(sdk): clean, dedup, reconcile, organize requirements (#7400)

* chore(sdk): clean, dedup, reconcile, organize requirements

* apply yapf formatting

* correct copyright

* chore(sdk): fix test missing tempdir cleanup (#7403)

* chore(sdk): fix test missing tempdir cleanup

* fix test path

* fix test path

* clean up setUp method

* change string placeholder from s to test_dir

* release note

Co-authored-by: Connor McCarthy <mccarthy.connor.james@gmail.com>
2022-03-15 21:45:37 +00:00
Connor McCarthy 5fb126a715
feat(sdk): alias v2 imports and provide DeprecationWarning (#7398)
* feat(sdk): alias v2 imports and provide DeprecationWarning

* simplify tests

* enable import of v2 namespace

* assert DeprecationWarning is raised

* update copyright

* silence pylint

* move v2 alias tests

* use assertWarnsRegex instead of assertWarns

* fix tests

* remove test for deprecation warning

* update copyright
2022-03-15 03:28:39 +00:00
Connor McCarthy 247672c75c
chore(sdk): fix test missing tempdir cleanup (#7403)
* chore(sdk): fix test missing tempdir cleanup

* fix test path

* fix test path

* clean up setUp method

* change string placeholder from s to test_dir
2022-03-14 21:25:40 +00:00
Connor McCarthy 7613cf9a1f
chore(sdk): clean, dedup, reconcile, organize requirements (#7400)
* chore(sdk): clean, dedup, reconcile, organize requirements

* apply yapf formatting

* correct copyright
2022-03-14 18:27:57 +00:00
Connor McCarthy 5dcc6d9910
chore(sdk): rename PipelineTask arguments parameter to args (#7392) 2022-03-10 21:42:54 +00:00
Connor McCarthy 5ca4cb78d3
chore(sdk): remove unused imports and variables (#7393) 2022-03-09 21:42:11 +00:00
Connor McCarthy 82d17ff616
feat(sdk)!: rename commands, arguments parameters to command, args (#7391) 2022-03-09 05:39:11 +00:00
Yaqi Ji d695ec556a
feat(sdk)!: throw error for output_component_file (#7390)
* feat(sdk)!: throw error for output_component_file

* Update readme
2022-03-09 01:05:10 +00:00
Yaqi Ji 8bb0d0e025
feat(sdk)!: move v2 to main namespace (#7376)
* feat(sdk)!: move v2 to main namespace

* edit samples
2022-03-04 21:56:51 +00:00
Chen Sun 7f67130c6e
fix(sdk): require google-api-core>=1.31.5, >=2.3.2 (#7377)
* require google-api-core>=1.31.5, >=2.3.2

* add release note
2022-03-04 19:56:59 +00:00
Yaqi Ji b693909a08
feat(sdk)!: move v1 to deprecated folder (#7291)
* chore(sdk): move v1 to deprecated

* fix testsg

* fix testsg

* fix setup.py

* fix test

* s'

* fix tests

* fix test

* retore v2 test changes

* fix py3.6 test

* fix py3.6 test

* fix py3.6 import fallback error

* remove deprecated

* fix samples test

* sample test

* fix samples

* add readme

* restroe test

* python require

* remove path

* fix tests

* inteegration tests

* remove tfx tests for dependency with kfp v1

* fix e2e

* fix e2e

* fix integration tests

* fix sampe

* move client down

* change to kfp

* add import alias

* fix

* runid

* fix dsl

* only use kfp for function

* revert train_until_good

* tfx test

* kfp

* try import

* onprem
2022-03-04 00:52:59 +00:00
Chen Sun 913539728b
chore(sdk): Fix a minor bug in task final status test sample (#7314) 2022-02-17 00:27:34 +00:00
Chen Sun de2a4a45f2
chore(sdk): bump version to 2.0.0-alpha.0 (#7313)
* chore(sdk): bump version to 2.0.0-alpha.0

* relax regex to match sdk version in tests
2022-02-15 20:07:41 +00:00
Yaqi Ji 54d5789bb4
feat(sdk)!: drop support for python 3.6 (#7303)
* chore(sdk): drop support for python 3.6

* empty

* address comments
2022-02-15 10:54:46 -08:00
Chen Sun ab805f886c
feat(sdk): Support getting pipeline status in exit handler. (#7309)
* Support PipelineTaskFinalStatus in exit handler.

* release note
2022-02-15 17:58:41 +00:00
Mehdi Drissi 9be1720f55
chore(sdk): Relax Typing Extensions Constraint (#7288)
* Relax Typing Extensions Constraint

* Update requirements.txt for typing extensions

Co-authored-by: Mehdi Drissi <mdrissi@snapchat.com>
2022-02-15 10:32:40 +00:00
Alex e07643453c
feat(sdk): Add `enable_job` method to client (#7239)
* feat(sdk): implement enable_job method

* Update RELEASE.md

Co-authored-by: Chen Sun <chensun@users.noreply.github.com>
2022-02-03 18:29:22 -08:00
vmallya-123 060588e1d9
fix(sdk): add verify_ssl to kfp client, fixes #4569 (#7174)
* adding verify_ssl

* adding code formatter changes

* retrigger checks

* updating release.md

* retrigger checks

* retrigger checks

* updating release.md
2022-02-03 18:28:16 -08:00
Alex Latchford 808ff5d8ed
fix(sdk): Add in filter to list_pipeline_versions SDK method (#7223)
* AIP-5661: Add in filter to list_pipeline_versions SDK method

* AIP-5661: Update type hints + docstrings to conform to standard. Include message in release notes
2022-02-03 16:52:45 -08:00
Chen Sun 1acb90fc94
fix(sdk.v2): Fix importer not using correct output artifact type (#7235)
* fix importer output type

* release note
2022-01-31 14:34:08 -08:00
Chen Sun 7f178900ae
chore(sdk): Bump SDK version to 1.8.11 (#7202) 2022-01-24 22:42:19 +00:00
Seb 577902ca46
fix(sdk): Support per workflow TTL (ttl_seconds_after_finished) with new format of Argo workflow manifest (#7141)
* Support per workflow TTL (ttl_seconds_after_finished) with new format of Argo workflow manifest

* Update test for TTL

* Declare fix in release note of SDK

* update syntaxe

* Update RELEASE.md

Add Braking change due to incompatibility with  KFP pre 1.7 due to Argo 2.X
2022-01-20 00:43:52 +00:00
Jiyong Jung 22a8fdfe31
fix(sdk): bumps up absl version to 1.x for compatibility with TF 2.8+. Fixes #7171 (#7172)
* Bumps up absl version to 1.x for compatibility with TF 2.8+.

* Adds a release note for absl version.
2022-01-19 22:14:52 +00:00
Chen Sun 83d54d3cb7
fix(sdk): Fix create_runtime_artifact not covering all types. (#7168)
* Fix create_runtime_artifact not covering all types.

* release note
2022-01-19 04:16:19 +00:00
Gerard Casas Saez fc2d05f90d
fix(sdk): Respect namespace if set on client (#7056)
* respect namespace if set on client

* make sure is_multi_user

* overwrite directly context_setting

* revert non-related changes

* revert overwrite_namespace

* expand text

* add release notes

* add PR link
2022-01-11 06:04:42 +00:00
Yaqi Ji 5a29d7f95b
feat(sdk): add metadata field for importer (#7112)
* feat(sdk): add metadata

* metadata

* release notes

* address comments
2022-01-06 00:41:35 +00:00
Yuan (Bob) Gong ca6e05591d
test: update README of v2 sample test (#7121)
* test: update README of v2 sample test

* address review comments by @zijianjoy

* use absolute paths, suggested by @zijianjoy

* Update README.md
2021-12-30 16:22:54 +08:00
Yuan (Bob) Gong 2460aaa653
test: migrate sample integration test to v2 sample test infra (#7115)
* test: migrate sample integration test to v2 sample test infra

* test: configure v2 integration test timeout
2021-12-26 04:17:44 +00:00
Yuan (Bob) Gong 44228c242b
test(v2): v2 sample test supports notebooks (#7109)
* test(v2): v2 sample test supports notebooks

* fix

* fix relative path problem
2021-12-24 02:37:42 +00:00
Chen Sun 6dfaeebd92
fix(sdk.v2)!: Block task dependency referencing tasks inside a sibling condition or loop group. (#7050) 2021-12-13 19:08:37 +00:00
Yaqi Ji 85d74337d6
fix(sdk): fix input/outputspec and positional arguments (#6980)
* fix(sdk): fix load_test

* concat placeholder

* release notes

* fix(sdk): fix resource spec test

* release notes

* test for ontology

* fix(sdk): fix input/outputspec

* fix reuse

* fix xgboost sample

* release

* fix tests

* address comments

* fix test

* restore tests

* address comments
2021-12-13 18:12:37 +00:00
Yaqi Ji 1a0bef7102
fix(sdk.v2): fix boolean error for inputs (#7041) 2021-12-11 17:25:35 +00:00
Chen Sun 6ca35800c7
chore: SDK release note for 1.8.10 (#7017)
* Update RELEASE.md

* Update __init__.py
2021-12-08 00:05:59 +00:00
michaelliqx a71fce0841
fix(sdk): fix bug in checking values in _param_values. Fixes #6799 (#6965) 2021-12-03 18:14:57 +00:00
Yuan (Bob) Gong bc7aad8b75
chore(sdk): fix error 'ApiResourceReference' object has no attribute 'id' (#6997)
* chore(sdk): fix error 'ApiResourceReference' object has no attribute 'id'

* fix more
2021-12-03 01:28:58 +00:00
Chen Sun c1b67154a2
fix(sdk.v2): fix regression on nested loops (#6990)
* fix regression on nested loops

* release note
2021-12-01 22:34:05 +00:00
Alex Latchford ddbfcde16f
feat(sdk): Improve CLI experience for archiving experiments, managing recurring runs and listing resources (#6934) 2021-12-01 18:07:13 +00:00
Yaqi Ji 485a07719f
fix(sdk): fix resource spec test (#6979)
* fix(sdk): fix load_test

* concat placeholder

* release notes

* fix(sdk): fix resource spec test

* release notes

* test for ontology
2021-11-30 19:25:31 +00:00
Yaqi Ji 0842934bae
fix(sdk): fix load_test (#6978)
* fix(sdk): fix load_test

* concat placeholder

* release notes
2021-11-29 23:00:30 +00:00
Chen Sun 8aee62142a
feat(sdk)!: Deprecate V2 compatible mode in v1 compiler (#6958)
* Deprecate V2 compatible mode in v1 compiler

* release note

* fix tests
2021-11-24 22:11:34 +00:00
Chen Sun 59dfffebea
fix(sdk.v2): Avoid pydantic union bug (#6957)
* avoid pydantic union bug

* release note
2021-11-24 21:48:34 +00:00
Yaqi Ji cd20373310
feat(sdk): add set_env_variable for Pipeline task (#6919)
* feat(sdk): add set_env_variable

* release notes

* enable test

* fix test

* fix test

* address comments
2021-11-23 21:46:47 +00:00
Yaqi Ji 4484ccd0b3
fix(sdk): change otherwise to else in yaml (#6952)
* fix(sdk): change otherwise to else in yaml

* release notes
2021-11-23 21:31:49 +00:00
hieuhc 6d55e262b4
fix(sdk): refresh access token only when it expires. Fixes #6883 (#6941)
* refresh access token whenerver it expires

* tight the condition when refreshing the access token
2021-11-23 19:35:07 +00:00