Commit Graph

1281 Commits

Author SHA1 Message Date
hsteude a9ac0b95bc
fix(sdk): print docker error messages (#9595)
Without this commit, `kfp component build` doesn't print any error
messages that docker emits, e.g. if docker push fails.

Co-authored-by: Christian Geier <geier@lostpackets.de>
2023-06-13 00:47:02 +00:00
Connor McCarthy b6c660853e
chore(sdk): release KFP SDK 2.0.0-rc.2 (#9605)
* release 2.0.0-rc.2

* update comment
2023-06-09 10:59:05 -07:00
Connor McCarthy 48ecc7d879
fix(sdk): fix bug when iterating over output from upstream task in nested parallelfor loops (#9580)
* refactor for clarity

* fix iter over upstream output in nested parallelfor

* update release notes

* support empty `List` generic annotation

* fix typos

* add comment about refactoring opportunity

* fix annotation

* update comment again
2023-06-09 08:58:28 -07:00
Tommy Li 0587a3fd35
chore(sdk): loosen python kubernetes version requirement (#9545)
* loosen python kubernetes version requirement

* update sdk release note
2023-06-01 19:17:06 +00:00
Chen Sun 296120290b
fix(sdk): relax executor type checking (#9481)
* relax executor type checking

* address review comments

* add release note
2023-05-23 19:05:35 +00:00
Chen Sun 02e0b33a77
chore: prefix sdk release tags with `sdk-` (#9478) 2023-05-22 22:17:35 +00:00
Connor McCarthy 209df547ef
chore(sdk): release KFP SDK 2.0.0-rc.1 (#9429) 2023-05-16 18:23:00 +00:00
Connor McCarthy 96742a648a
docs(sdk): add dsl placeholder exports (#9423) 2023-05-15 19:46:31 +00:00
Connor McCarthy 78902274f1
feat(sdk): support compiling components with `dsl.PipelineTaskFinalStatus` type (#9082) 2023-05-12 22:14:28 +00:00
Tommy Li 4d2a1cf173
fix(sdk): Optimize wait_for_run_completion sdk function to skip an extra wait (#9407) 2023-05-12 21:49:28 +00:00
Connor McCarthy 96947e6fb9
fix(sdk): fix compilation of boolean constant passed to component (#9390) 2023-05-12 17:13:39 +00:00
Connor McCarthy c01288d673
feat(sdk): support writing `TASK_FINAL_STATUS` parameter type (#9080)
* write new parameter type

* update golden snapshots

* add compiler tests
2023-05-12 17:13:32 +00:00
Chen Sun 3ad91a9bbe
chore: release KFP SDK 2.0.0-beta.17 (#9355)
* Release KFP SDK 2.0.0-beta.17

* update release note
2023-05-08 17:42:55 +00:00
Chen Sun b6b8f94da2
chore: recompile/update v2 samples to avoid possible runtime breakage (#9333)
* recompile/update v2 samples

* fix test
2023-05-05 17:28:24 +00:00
Connor McCarthy 58ebd202c4
release 2.0.0b16 (#9325) 2023-05-04 10:56:24 -07:00
Connor McCarthy c437004761
fix(sdk): fix appengine import error (#9323) 2023-05-04 17:31:45 +00:00
Jonny Browning b59b70875e
fix(sdk): allow user to choose platform for component container build. Fixes #8883 (#9212)
Co-authored-by: Jonny Browning <jonathan.browning@datatonic.com>
2023-04-25 19:41:45 +00:00
Connor McCarthy 04306dc3cb
chore(sdk): release KFP SDK 2.0.0b15 (#9218) 2023-04-24 18:32:43 +00:00
Connor McCarthy 946c51bafe
feat(sdk): support extracting input/output descriptions from component/pipeline docstrings (#9156)
* feat(sdk): support extracting input/output descriptions from component/pipeline docstrings

* remove numpydoc tests
2023-04-24 17:16:44 +00:00
Chen Sun 91277b1e91
fix(SDK): fix `client.run_pipeline` with `pipeline_id` and `version_id` gives error (#9191) 2023-04-20 21:17:40 +00:00
Connor McCarthy 41c0d78f5f
fix(sdk): fix handling of PipelineTaskFinalStatus in ir_type_ attribute hack (#9186) 2023-04-20 13:53:31 -07:00
Connor McCarthy 91abbeaf2f
feat(sdk): support `display_name` and `description` in `@dsl.pipeline` decorator (#9153)
* feat(sdk): support display_name and description in @dsl.pipeline decorator

* add release note

* test additional case
2023-04-17 14:15:39 -07:00
Mithil Poojary 3164dfb01a
fix(sdk): fixes module not found error for containerized python components. Fixes #8385 (#9157)
* Add module directory to sys.path

* Add nested module imports unit test

* Add release note to release.md
2023-04-17 11:46:02 -07:00
Connor McCarthy 30466586d0
chore(sdk): add kfp-kubernetes as kfp extras_require (#9152) 2023-04-17 10:08:22 -07:00
Connor McCarthy 80bd8f17b1
chore(sdk): bump kfp version in test data to 2.0.0-beta.14 (#9145) 2023-04-12 16:27:09 -07:00
Chen Sun a107fb1bcf
chore: release SDK 2.0.0b14 (#9144)
* release SDK 2.0.0b14

* doc ref
2023-04-12 14:29:29 -07:00
Chen Sun 952e0730a8
feat(sdk): Support submitting pipeline with platform config. (#9140)
* SDK client v2beta1 API integration.

* fix unit tests

* create alias for use of methods and fields referencing `job`.`

* fix cli

* fix pipeline list-versions

* more cli fixes

* client fix

* Support submitting pipeline with platform spec.

* unit test

* move util functions
2023-04-12 13:06:12 -07:00
Chen Sun 07d6c1816b
feat(SDK)!: SDK client v2beta1 API integration. Fixes #8706 (#9112)
* SDK client v2beta1 API integration.

* fix unit tests

* create alias for use of methods and fields referencing `job`.`

* fix cli

* fix pipeline list-versions

* more cli fixes

* client fix
2023-04-12 09:54:45 -07:00
IronPan 5e98b3b6f0
feat(sdk): Support PIPELINE_ROOT_PLACEHOLDER (#9134)
* Support PIPELINE_ROOT_PLACEHOLDER

/assign @connor-mccarthy

* Update __init__.py
2023-04-11 08:56:49 -07:00
Chen Sun a6ef77b784
feat(sdk): Support setting cpu/memory requests. (#9121)
* Support setting cpu/memory requests.

* address review comments

* address review comments
2023-04-10 23:35:16 -07:00
Connor McCarthy e907b6343e
set _ir_type attribute (#9105) 2023-04-10 12:01:36 -07:00
Connor McCarthy 5828632c2f
feat(sdk): support indexing into top-level artifact metadata in Container Components (#9131) 2023-04-10 11:46:01 -07:00
Connor McCarthy 5a769e9080
Revert "update compiler type annotations (#9090)" (#9095)
This reverts commit ad6f55e8f3.
2023-04-03 16:01:26 -07:00
Connor McCarthy ad6f55e8f3
update compiler type annotations (#9090) 2023-04-03 09:20:17 -07:00
Connor McCarthy 0cbcebcf88
fix(sdk): support accessing `.dsl` attribute on `kfp` module object (#9048) 2023-03-27 15:12:17 -07:00
Connor McCarthy 3026e452ff
fix(sdk): fix loading non-canonical type strings from v1 component YAML (#9041) 2023-03-27 10:25:23 -07:00
Alex 3e1f3c6d7a
feat(sdk): add experiment_id parameter to create run methods (#9004)
Co-authored-by: alenawang <alena.n.wang@gmail.com>
Co-authored-by: andreafehrman <andrea.k.fehrman@vanderbilt.edu>
Co-authored-by: owmasch <owenmaschal0598@gmail.com>
Co-authored-by: ryanrusson <ryan.russon@gmail.com>
2023-03-24 09:56:48 -07:00
Connor McCarthy 2bbfd5e89f
fix: support setting task dependencies via kfp.kubernetes.mount_pvc (#8999)
* enable accessing .task on pipeline channel

* set task dependencies in mount_pvc

* update tests
2023-03-16 21:10:54 -07:00
Ze Mao 0fd1e69c74
cpu and memory resource can be optional (#8992)
Co-authored-by: Ze Mao <zemao@google.com>
2023-03-16 09:23:55 -07:00
Connor McCarthy e96754cb53
feat(sdk): deprecate .add_node_selector_constraint in favor of .set_accelerator_type (#8980)
* rename method

* update docstring
2023-03-14 09:22:35 -07:00
Connor McCarthy a38d7479d7
feat(sdk): support compiling platform specific features (#8940)
* support compiling platform-specific features

* fix map size change during iteration
2023-03-10 11:18:25 -08:00
Connor McCarthy abdc08b773
chore(sdk): pin kfp-pipeline-spec to 0.2.1 (#8971) 2023-03-10 10:19:03 -08:00
JOCSTAA 6777e8f445
fix(sdk): Support python 3.11 (#8907)
* new branch

* add to release.md

* edit setup.py
2023-03-03 13:36:53 -08:00
b4sus ed66ba327f
feat(sdk): using component's pip_index_urls for Dockerfile generation. Fixes #8816 (#8871)
* feat(sdk): using component's pip_index_urls for Dockerfile generation

* Update sdk/python/kfp/cli/component.py

Co-authored-by: Connor McCarthy <mccarthy.connor.james@gmail.com>

* feat(sdk): PR changes: removed additional space from index url options string; duplicate removal not necessary

* feat(sdk): feature mentioned in RELEASE.md

* deduplication back - more components in a file can specify same pypi url - we need it only once for docker image

* feature note moved to current development section

---------

Co-authored-by: Connor McCarthy <mccarthy.connor.james@gmail.com>
2023-03-01 09:32:56 -08:00
Connor McCarthy 86554be46a
release kfp sdk 2.0.b13 (#8904) 2023-02-27 16:52:53 -08:00
Connor McCarthy 87062dbf22
fix(sdk): fix attribute error for Containerized Python Components (#8887) 2023-02-27 16:42:50 -08:00
Chen Sun 8d3e0dd805
fix(sdk): Fix environment variable set in component yaml lost during compilation. Fixes #8884 (#8885)
* Fix env set in component yaml not captured

* release note

* clean up unnecessary code in test
2023-02-23 14:28:26 -08:00
Connor McCarthy 386ff88236
fix(sdk): fix unknown artifact string in dsl.OutputPath/dsl.InputPath (#8880) 2023-02-23 08:37:04 -08:00
Connor McCarthy 31298c479b
fix(sdk): fix bug when passing data between tasks using f-strings (#8879) 2023-02-23 08:36:53 -08:00
Connor McCarthy c046879dda
support fanning-in artifacts (#8808) 2023-02-22 10:39:00 -08:00