dde2a2ee55
wip
2024-03-13 14:23:15 -07:00
c051e55dc3
test: Add ParallelFor compile test over single artifact. ( #10531 )
...
* .
* formatting
2024-02-28 06:14:59 +00:00
144761c948
fix(sdk): Prevents dsl.ParallelFor over single parameter from compiling. ( #10494 )
...
* fix(sdk): Prevents dsl.ParallelFor over single paramter from compiling.
* fix(sdk): Prevents dsl.ParallelFor over single paramter from compiling.
* update PR number in release notes
* formatting
* Add compiler_test.py test for single param compile failure
* Update some docstrings and add todo
* formatting
* Update sdk/python/kfp/compiler/compiler_test.py
Co-authored-by: Connor McCarthy <mccarthy.connor.james@gmail.com>
* Update sdk/python/kfp/compiler/compiler_test.py
Co-authored-by: Connor McCarthy <mccarthy.connor.james@gmail.com>
* Update sdk/python/kfp/dsl/for_loop.py
Co-authored-by: Connor McCarthy <mccarthy.connor.james@gmail.com>
* Use print_and_return and other small changes
* typo
* typo
---------
Co-authored-by: Connor McCarthy <mccarthy.connor.james@gmail.com>
2024-02-27 23:41:59 +00:00
ae62b1113a
chore(sdk): release KFP SDK 2.7.0 ( #10461 )
2024-02-14 11:37:53 -08:00
21c5ffebb0
fix(sdk): fix bug where `dsl.OneOf` with multiple consumers cannot be compiled ( #10452 )
2024-02-08 23:51:37 +00:00
fe04a5a842
fix(sdk): fixes type issues for ParallelFor. Fixes #9366 ( #10436 )
...
* fix type issues
* fix type issue
* fix format
* fix failed test
* fix format
* delete comments
* resolve comments
* resolve comments
* resolve format
* resolve import
* move unnecessary file
* resolve compiler_test failures
* resolve comments
* remove unnecessary imports
* fix format sort
* fix nits
* add new compiled yaml file
* solve merge conflicts
* solve conflicts
* format
* sort
* resolve comments
* resolve comments
2024-02-08 18:34:37 +00:00
b528568718
feat(sdk): Support dsl.ParallelFor over list of Artifacts ( #10441 )
...
* samples message
* update pr number
* Split LoopArgument into LoopParameterArgument and LoopArtifactArgument
* formatting
* address some comments
* resolve release notes conflict
* flatten loops in pipeline_spec_builder
* update artifact type checking logic
* simplify artifact checking logic
* re-add issubtype_of_artifact
* move name_is_loop_argument to for_loop_test.py
* simplify LoopArtifactArgument is_artifact_list=False logic
* update typeerror
* typo
* typo
* small fix
* formatting
* formatting
* remove issubtype_of_artifact()
* small changes
* assert LoopArtifactArgument channel.is_artifact_list is True
* remove whitespace
* remove newline
* Update single artifact check and error message
* formatting
* add unit test for is_artifact_list==False
* formatting
* update valueerror test.
* typo
* regex formatting
* formatting
2024-02-06 23:03:40 +00:00
1fe1c63f60
feat(sdk): support local execution of pipelines in pipelines ( #10440 )
2024-02-02 04:32:14 +00:00
7bd31d104b
support dsl.importer locally; resolve merge conflicts ( #10431 )
2024-01-29 19:17:15 -08:00
977bffce2a
feat(sdk): support f-strings in local pipeline execution ( #10435 )
2024-01-30 01:24:01 +00:00
442d457057
feat(sdk): support local pipeline execution ( #10423 )
...
* local pipeline implementation
* address review feedback
2024-01-29 07:50:37 -08:00
a990446b9c
chore(sdk): local task execution refactor + cleanup ( #10420 )
2024-01-23 15:54:03 +00:00
5b7f67acdc
fix string quotes ( #10413 )
2024-01-22 08:50:55 -08:00
75a3c48683
docs(sdk): add kfp.local to reference docs ( #10395 )
2024-01-18 18:39:58 +00:00
aac4408237
chore(sdk): release KFP SDK 2.6.0 ( #10386 )
2024-01-11 22:14:13 +00:00
db6fe05243
chore(sdk): depend on protobuf 4 in `kfp` and `kfp-kubernetes` ( #10307 )
2024-01-11 19:54:12 +00:00
55db6f5cef
chore(sdk): release KFP SDK 2.5.0 ( #10364 )
2024-01-08 17:54:28 +00:00
ca5f97dc6b
test(sdk): add test for local execution of `None` default parameter #localexecution ( #10339 )
2024-01-05 23:19:56 +00:00
2897a10f59
feat(sdk): support Concat and IfPresent placeholder in local container component execution #localexecution ( #10348 )
...
* feat(sdk): support Concat and IfPresent placeholder in local container component execution #localexecution
* address review feedback
* fix test
2024-01-05 21:53:56 +00:00
64d46dfed0
fix(sdk): permit empty local execution outputs #localexecution ( #10338 )
2024-01-05 20:52:08 +00:00
8a5a17e910
feat(sdk): remove local execution feature flag #localexecution ( #10355 )
2024-01-05 20:20:08 +00:00
dcab0511a2
test(sdk): improve KFP SDK local runner test safety #localexecution ( #10336 )
2024-01-03 18:39:15 +00:00
86b7e23985
fix(sdk): remove redundant newline character in local `DockerRunner` logs ( #10354 )
2024-01-02 23:40:14 +00:00
89d4234a5b
fix(sdk): fix presentation of strings in local execution #localexecution ( #10353 )
2024-01-02 23:00:14 +00:00
846f88770c
feat(sdk): support local Container Component execution #localexecution ( #10333 )
...
* support Container Components
* address review feedback
2023-12-20 18:34:20 +00:00
f52ba56784
chore(sdk): write local execution logs to stdout #localexecution ( #10330 )
2023-12-20 09:37:20 +00:00
654bbdebe6
feat(sdk): add special `dsl.OutputPath` read logic #localexecution ( #10334 )
2023-12-20 09:09:20 +00:00
adc5b3b160
feat(sdk): add DockerRunner #localexecution ( #10328 )
2023-12-19 23:14:19 +00:00
784927205c
feat(sdk): add local execution logging #localexecution ( #10326 )
2023-12-18 23:50:37 +00:00
d0da0ad940
chore(sdk): fix use of invalid escape sequence in tests ( #10310 )
2023-12-18 22:53:38 +00:00
76aad8b18a
feat(sdk): add local execution output collection #localexecution ( #10325 )
...
* feat(sdk): add local execution output collection #localexecution
* update ExecutorInput processing
* address review feedback
* fix exception handling test
2023-12-16 09:53:18 -05:00
21f8e9c72b
feat(sdk): add subprocess task handler #localexecution ( #10302 )
...
* add subprocess task handler
* response to review feedback
2023-12-15 19:51:55 +00:00
33bf920255
test(sdk): add placeholder_utils_test.py ( #10301 )
2023-12-13 13:59:57 -05:00
b40912cc5d
fix(sdk): use kfp.dsl.types to replace kfp.components.types Fixes #10282 ( #10283 )
...
* use kfp.dsl.types to replace kfp.components.types
Fixes : #10282
Signed-off-by: hsinhoyeh <yhh92u@gmail.com>
* fix import artifact_types
---------
Signed-off-by: hsinhoyeh <yhh92u@gmail.com>
2023-12-12 19:38:38 -05:00
d41efc3e96
update task dispatcher ( #10298 )
2023-12-12 14:23:49 -05:00
5cd708de37
feat(sdk): add local execution skeleton #localexecution ( #10292 )
2023-12-09 14:08:21 -05:00
5c60d37616
remove cleanup param in local init ( #10293 )
2023-12-09 14:07:58 -05:00
d3b3e7a5ba
chore(sdk): support Python 3.12 ( #10272 )
...
* chore(sdk): support Python 3.12
* fix kfp-kubernetes test import error
* use assertEqual instead of assertEquals
* fix kfp-kubernetes snapshot yaml
2023-11-29 23:18:03 +00:00
11f60d813a
feat(sdk): support `.after()` referencing task in `ParallelFor` group ( #10257 )
2023-11-29 10:22:14 -05:00
d3323c06f3
feat(sdk): add executor output path and executor input message placeholders ( #10240 )
...
* add support for '{{$.outputs.output_file}}' placeholder
* dedupe executor input code
2023-11-20 20:30:10 +00:00
0d7913ce4e
feat(sdk): add local execution config #localexecution ( #10234 )
2023-11-20 18:18:10 +00:00
b4d7e1857b
chore(sdk): nest requests_toolbelt import ( #10247 )
2023-11-20 18:12:10 +00:00
23fb94caa8
chore(sdk): update CONTRIBUTING.md testing instructions ( #10218 )
...
Required after #10160 , since specifying a test path will override the `pytest.ini` configuration.
2023-11-08 18:28:09 +00:00
f250700e4d
chore(sdk): release KFP SDK 2.4.0 ( #10167 )
2023-10-27 17:04:10 +00:00
03df9df68c
chore(sdk): fix local test failure ( #10161 )
2023-10-26 01:39:16 +00:00
02e00e8439
fix(sdk): type annotation for client credentials ( #10158 )
2023-10-26 01:39:10 +00:00
7ab05d8a84
chore(sdk): Remove the ` (<type>)`from docstring args. ( #10159 )
...
* chore(sdk): Remove the ` (<type>)`from docstring args.
Remote the ` (<type>)` from the docstring args, which are redundant since there are type annotations.
* Trim the unnecessary leading space.
2023-10-26 00:29:09 +00:00
e3b1863791
chore(sdk): add Python 3.7 EOL notice ( #10139 )
2023-10-24 22:06:08 +00:00
c0adea9946
chore(sdk): add test for key error bug resolved in #10067 ( #10128 )
2023-10-19 23:49:03 +00:00
8d00d0eb9a
feat(sdk): support a Pythonic artifact authoring style ( #9932 )
...
* chore(sdk): test observability, refactorings, and cleanup
* implement unified i/o syntax
* clarify container component error message
* address review feedback
* add dill to packages_to_install
* update get_uri logic for KFP and tests
* update execution tests & cleanup
2023-10-19 18:49:58 +00:00
connor-mccarthy
KevinGrantLee
rickyxie0929
hsinhoyeh
Mathew Wicks