Commit Graph

1294 Commits

Author SHA1 Message Date
connor-mccarthy 9867653c8f chore(sdk): nest requests_toolbelt import 2023-11-17 09:14:19 -08:00
Connor McCarthy f250700e4d
chore(sdk): release KFP SDK 2.4.0 (#10167) 2023-10-27 17:04:10 +00:00
Connor McCarthy 03df9df68c
chore(sdk): fix local test failure (#10161) 2023-10-26 01:39:16 +00:00
Mathew Wicks 02e00e8439
fix(sdk): type annotation for client credentials (#10158) 2023-10-26 01:39:10 +00:00
rickyxie0929 7ab05d8a84
chore(sdk): Remove the ` (<type>)`from docstring args. (#10159)
* chore(sdk): Remove the ` (<type>)`from docstring args.

Remote the ` (<type>)` from the docstring args, which are redundant since there are type annotations.

* Trim the unnecessary leading space.
2023-10-26 00:29:09 +00:00
Connor McCarthy e3b1863791
chore(sdk): add Python 3.7 EOL notice (#10139) 2023-10-24 22:06:08 +00:00
Connor McCarthy c0adea9946
chore(sdk): add test for key error bug resolved in #10067 (#10128) 2023-10-19 23:49:03 +00:00
Connor McCarthy 8d00d0eb9a
feat(sdk): support a Pythonic artifact authoring style (#9932)
* chore(sdk): test observability, refactorings, and cleanup

* implement unified i/o syntax

* clarify container component error message

* address review feedback

* add dill to packages_to_install

* update get_uri logic for KFP and tests

* update execution tests & cleanup
2023-10-19 18:49:58 +00:00
Connor McCarthy 73d51c8a23
fix(sdk): fix bug when `dsl.importer` argument is provided by loop variable (#10116) 2023-10-18 20:37:56 +00:00
Connor McCarthy 2d3171cbfe
feat(sdk): support collecting outputs from conditional branches using `dsl.OneOf` (#10067)
* support dsl.OneOf

* address review feedback

* address review feedback
2023-10-18 02:34:55 +00:00
gkcalat ab33e2af4e
chore(sdk): Improve a message printed for users. Closes #10100 (#10101) 2023-10-15 22:58:53 +00:00
gkcalat c9032716ab
fix(sdk): Fix OOB for IPython and refactor. Closes #10075. (#10094)
* Fix OOB for IPython and refactor. Closes #10075.

* Address comments
2023-10-13 22:24:52 +00:00
Connor McCarthy 55f174e5bb
chore(sdk): clean up compiler_test.py (#10070) 2023-10-09 20:50:18 +00:00
Connor McCarthy fcdff294a6
fix(sdk): fix incorrect sub-DAG output type when using `dsl.Collected` (#10069) 2023-10-09 17:04:18 +00:00
Connor McCarthy 87005cc015
chore(sdk): wrap conditional branch groups in outer pipeline (#10034) 2023-10-05 02:45:15 +00:00
Connor McCarthy 2ef5afe0bb
chore(sdk): release KFP SDK 2.3.0 (#10024) 2023-09-22 21:32:57 +00:00
Connor McCarthy e99f2704fc
feat(sdk): support `PipelineTaskFinalStatus` in tasks that use `.ignore_upstream_failure()` (#10010)
* support taskfinalstatus in tasks that ignore upstream failure

* address review feedback
2023-09-21 01:46:37 +00:00
Connor McCarthy 20218a9c1d
chore(sdk): test observability, refactorings, and cleanup (#10005)
* chore(sdk): test observability, refactorings, and cleanup

* address review feedback

* rename classes
2023-09-18 22:51:27 +00:00
Connor McCarthy d001b8055f
chore(sdk): refactor python component executor (#9990) 2023-09-15 22:00:30 +00:00
Chen Sun a13e143038
test: fix sdk execution test (#9988)
* fix sdk execution test

* fix missing key

* fix state

* fix state

* fix capitalization
2023-09-14 20:02:30 +00:00
Connor McCarthy 659c54bbeb
chore(sdk): release KFP SDK 2.2.0 (#9984) 2023-09-14 17:37:30 +00:00
Connor McCarthy cc2cd58918
fix(sdk): fix --no-deps flag usage (#9982)
* update --no-deps flag usage

* update runtime test code
2023-09-13 15:31:02 -07:00
Connor McCarthy c6b236d1a0
feat(sdk): support dsl.If, dsl.Elif, and dsl.Else (#9894)
* support if/elif/else

* deprecate dsl.Condition

* alter rebase

* update release notes

* address review feedback

* change BinaryOperation to ConditionOperation
2023-09-11 20:19:35 +00:00
Connor McCarthy 2b05ec867f
chore(sdk): remove old file (#9959) 2023-09-05 20:57:31 +00:00
Connor McCarthy 959f54efd7
chore(sdk): release kfp sdk 2.1.3 (#9896)
* release kfp sdk 2.1.3

* update tests

* update OWNERS file
2023-09-05 18:32:31 +00:00
Connor McCarthy ef0788d986
feat(sdk): add logging at end of executor execution (#9895)
* feat(sdk): add logging at end of executor execution

* Update executor.py

* Update executor.py
2023-09-05 17:25:31 +00:00
Connor McCarthy cf0e0cf87c
feat(sdk): enable dependency-free runtime install of kfp (#9886)
* handle problematic imports

* separate runtime and compile-time symbols

* wrap kfp/__init__.py imports unavailable at runtime

* update component factory + tests

* add runtime tests

* add --no-deps flag to component factory

* update release notes

* clean up

* handle containerized python components

* update golden snapshots

* update component_factory unit tests

* respond to review feedback

* fix runtime test and compilation logic

* update tests
2023-08-24 18:31:16 +00:00
Connor McCarthy f6d0772175
chore(sdk): remove kfp-dsl source code (#9881) 2023-08-16 16:47:04 +00:00
Connor McCarthy c9e54798cd
chore(sdk): undo creation of kfp-dsl namespace package (#9874)
* revert to c8204d0

* reapply #9742

* modify #9791

* reapply #9800

* reapply #9827

* revert parts of #9738

* reapply parts of #9785

* remove duplicated dsl-test code

* reapply parts of #9791

* correct version
2023-08-15 16:24:52 -07:00
Connor McCarthy 11a5ae1dd7
chore(sdk): clean up artifact code (#9800) 2023-08-04 17:12:20 +00:00
Connor McCarthy 25f6ee6389
chore(sdk): release KFP SDK 2.1.2 (#9797) 2023-07-28 16:47:34 +00:00
Connor McCarthy 540294aedb
fix(sdk): fix GCPC break in KFP SDK (#9791) 2023-07-27 23:02:32 +00:00
Connor McCarthy 49db9effe4
chore(sdk): release KFP SDK 2.1.1 (#9787) 2023-07-27 00:26:51 +00:00
Connor McCarthy 8ad97167ff
fix(sdk): various kfp-dsl fixes (#9785)
* specify kfp-dsl version directly

* make presubmit test executable

* add yaml requirement

* assorted test and import fixes
2023-07-26 22:41:51 +00:00
Connor McCarthy 309c5b9f0a
chore(sdk): release KFP SDK 2.1.0 (#9782) 2023-07-26 17:09:02 +00:00
Connor McCarthy 525ff90684
chore(sdk): extract DSL into `kfp-dsl` package (#9738)
* move dsl dir

* make kfp-dsl a package

* make kfp-dsl a package

* additional changes

* address review feedback
2023-07-25 23:34:02 +00:00
Alex 1045c95517
chore(sdk): resolve mypy finding (#9742) 2023-07-17 19:54:37 +00:00
Connor McCarthy c8204d0285
chore(sdk): partition KFP SDK source code into runtime and non-runtime code (#9710) 2023-07-07 23:18:52 +00:00
Chen Sun a727783abd
chore: remove 'dummy_root' in test samples (#9640)
* remove 'dummy_root' in test samples

* more cleanup
2023-06-21 23:51:41 +00:00
Connor McCarthy 6dfcd533f4
chore(sdk): release KFP SDK 2.0.1 (#9669) 2023-06-21 00:22:40 +00:00
Connor McCarthy e5fe981c1a
fix(sdk): fix kfp sdk v2 readme (#9668) 2023-06-21 00:15:40 +00:00
Connor McCarthy b3bdeb286d
chore(sdk): release KFP SDK 2.0.0 (#9624)
* bump kfp-server-api version

* release 2.0.0

* add 2.0.0 release notes

* apply suggested changes
2023-06-20 20:00:40 +00:00
Connor McCarthy 92c02a6172
fix(sdk): fix click dependency bug (#9634)
* fix(sdk): fix click dependency bug

* update release notes
2023-06-20 18:33:41 +00:00
Chen Sun c33afa74f3
chore(sdk): relax name validation when upload pipeline (#9646)
* relax name validation when upload pipeline

* fix typo
2023-06-16 22:20:36 +00:00
hsteude a9ac0b95bc
fix(sdk): print docker error messages (#9595)
Without this commit, `kfp component build` doesn't print any error
messages that docker emits, e.g. if docker push fails.

Co-authored-by: Christian Geier <geier@lostpackets.de>
2023-06-13 00:47:02 +00:00
Connor McCarthy b6c660853e
chore(sdk): release KFP SDK 2.0.0-rc.2 (#9605)
* release 2.0.0-rc.2

* update comment
2023-06-09 10:59:05 -07:00
Connor McCarthy 48ecc7d879
fix(sdk): fix bug when iterating over output from upstream task in nested parallelfor loops (#9580)
* refactor for clarity

* fix iter over upstream output in nested parallelfor

* update release notes

* support empty `List` generic annotation

* fix typos

* add comment about refactoring opportunity

* fix annotation

* update comment again
2023-06-09 08:58:28 -07:00
Tommy Li 0587a3fd35
chore(sdk): loosen python kubernetes version requirement (#9545)
* loosen python kubernetes version requirement

* update sdk release note
2023-06-01 19:17:06 +00:00
Chen Sun 296120290b
fix(sdk): relax executor type checking (#9481)
* relax executor type checking

* address review comments

* add release note
2023-05-23 19:05:35 +00:00
Connor McCarthy 209df547ef
chore(sdk): release KFP SDK 2.0.0-rc.1 (#9429) 2023-05-16 18:23:00 +00:00