kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,730 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

1373 Commits

Author SHA1 Message Date
KevinGrantLee d70955d2f6 formatting 2024-02-20 16:17:27 -08:00
KevinGrantLee cb6e961f59 Update some docstrings and add todo 2024-02-20 15:17:13 -08:00
KevinGrantLee 57d2697983 Add compiler_test.py test for single param compile failure 2024-02-15 16:07:34 -08:00
KevinGrantLee 175dde105d formatting 2024-02-15 15:59:14 -08:00
KevinGrantLee 50bccde729 update PR number in release notes 2024-02-15 15:45:58 -08:00
KevinGrantLee 429b5c695a fix(sdk): Prevents dsl.ParallelFor over single paramter from compiling. 2024-02-15 15:43:05 -08:00
KevinGrantLee 0d0d7ebbab fix(sdk): Prevents dsl.ParallelFor over single paramter from compiling. 2024-02-15 15:34:33 -08:00
Connor McCarthy ae62b1113a
chore(sdk): release KFP SDK 2.7.0 (#10461) 2024-02-14 11:37:53 -08:00
Connor McCarthy 21c5ffebb0
fix(sdk): fix bug where `dsl.OneOf` with multiple consumers cannot be compiled (#10452) 2024-02-08 23:51:37 +00:00
rickyxie0929 fe04a5a842
fix(sdk): fixes type issues for ParallelFor. Fixes #9366 (#10436) 
* fix type issues

* fix type issue

* fix format

* fix failed test

* fix format

* delete comments

* resolve comments

* resolve comments

* resolve format

* resolve import

* move unnecessary file

* resolve compiler_test failures

* resolve comments

* remove unnecessary imports

* fix format sort

* fix nits

* add new compiled yaml file

* solve merge conflicts

* solve conflicts

* format

* sort

* resolve comments

* resolve comments
 2024-02-08 18:34:37 +00:00
KevinGrantLee b528568718
feat(sdk): Support dsl.ParallelFor over list of Artifacts (#10441) 
* samples message

* update pr number

* Split LoopArgument into LoopParameterArgument and LoopArtifactArgument

* formatting

* address some comments

* resolve release notes conflict

* flatten loops in pipeline_spec_builder

* update artifact type checking logic

* simplify artifact checking logic

* re-add issubtype_of_artifact

* move name_is_loop_argument to for_loop_test.py

* simplify LoopArtifactArgument is_artifact_list=False logic

* update typeerror

* typo

* typo

* small fix

* formatting

* formatting

* remove issubtype_of_artifact()

* small changes

* assert LoopArtifactArgument channel.is_artifact_list is True

* remove whitespace

* remove newline

* Update single artifact check and error message

* formatting

* add unit test for is_artifact_list==False

* formatting

* update valueerror test.

* typo

* regex formatting

* formatting
 2024-02-06 23:03:40 +00:00
Connor McCarthy 1fe1c63f60
feat(sdk): support local execution of pipelines in pipelines (#10440) 2024-02-02 04:32:14 +00:00
Connor McCarthy 7bd31d104b
support dsl.importer locally; resolve merge conflicts (#10431) 2024-01-29 19:17:15 -08:00
Connor McCarthy 977bffce2a
feat(sdk): support f-strings in local pipeline execution (#10435) 2024-01-30 01:24:01 +00:00
Connor McCarthy 442d457057
feat(sdk): support local pipeline execution (#10423) 
* local pipeline implementation

* address review feedback
 2024-01-29 07:50:37 -08:00
Connor McCarthy a990446b9c
chore(sdk): local task execution refactor + cleanup (#10420) 2024-01-23 15:54:03 +00:00
Connor McCarthy 5b7f67acdc
fix string quotes (#10413) 2024-01-22 08:50:55 -08:00
Connor McCarthy 75a3c48683
docs(sdk): add kfp.local to reference docs (#10395) 2024-01-18 18:39:58 +00:00
Connor McCarthy aac4408237
chore(sdk): release KFP SDK 2.6.0 (#10386) 2024-01-11 22:14:13 +00:00
Connor McCarthy db6fe05243
chore(sdk): depend on protobuf 4 in `kfp` and `kfp-kubernetes` (#10307) 2024-01-11 19:54:12 +00:00
Connor McCarthy 55db6f5cef
chore(sdk): release KFP SDK 2.5.0 (#10364) 2024-01-08 17:54:28 +00:00
Connor McCarthy ca5f97dc6b
test(sdk): add test for local execution of `None` default parameter #localexecution (#10339) 2024-01-05 23:19:56 +00:00
Connor McCarthy 2897a10f59
feat(sdk): support Concat and IfPresent placeholder in local container component execution #localexecution (#10348) 
* feat(sdk): support Concat and IfPresent placeholder in local container component execution #localexecution

* address review feedback

* fix test
 2024-01-05 21:53:56 +00:00
Connor McCarthy 64d46dfed0
fix(sdk): permit empty local execution outputs #localexecution (#10338) 2024-01-05 20:52:08 +00:00
Connor McCarthy 8a5a17e910
feat(sdk): remove local execution feature flag #localexecution (#10355) 2024-01-05 20:20:08 +00:00
Connor McCarthy dcab0511a2
test(sdk): improve KFP SDK local runner test safety #localexecution (#10336) 2024-01-03 18:39:15 +00:00
Connor McCarthy 86b7e23985
fix(sdk): remove redundant newline character in local `DockerRunner` logs (#10354) 2024-01-02 23:40:14 +00:00
Connor McCarthy 89d4234a5b
fix(sdk): fix presentation of strings in local execution #localexecution (#10353) 2024-01-02 23:00:14 +00:00
Connor McCarthy 846f88770c
feat(sdk): support local Container Component execution #localexecution (#10333) 
* support Container Components

* address review feedback
 2023-12-20 18:34:20 +00:00
Connor McCarthy f52ba56784
chore(sdk): write local execution logs to stdout #localexecution (#10330) 2023-12-20 09:37:20 +00:00
Connor McCarthy 654bbdebe6
feat(sdk): add special `dsl.OutputPath` read logic #localexecution (#10334) 2023-12-20 09:09:20 +00:00
Connor McCarthy adc5b3b160
feat(sdk): add DockerRunner #localexecution (#10328) 2023-12-19 23:14:19 +00:00
Connor McCarthy 784927205c
feat(sdk): add local execution logging #localexecution (#10326) 2023-12-18 23:50:37 +00:00
Connor McCarthy d0da0ad940
chore(sdk): fix use of invalid escape sequence in tests (#10310) 2023-12-18 22:53:38 +00:00
Connor McCarthy 76aad8b18a
feat(sdk): add local execution output collection #localexecution (#10325) 
* feat(sdk): add local execution output collection #localexecution

* update ExecutorInput processing

* address review feedback

* fix exception handling test
 2023-12-16 09:53:18 -05:00
Connor McCarthy 21f8e9c72b
feat(sdk): add subprocess task handler #localexecution (#10302) 
* add subprocess task handler

* response to review feedback
 2023-12-15 19:51:55 +00:00
Connor McCarthy 33bf920255
test(sdk): add placeholder_utils_test.py (#10301) 2023-12-13 13:59:57 -05:00
hsinhoyeh b40912cc5d
fix(sdk): use kfp.dsl.types to replace kfp.components.types Fixes #10282 (#10283) 
* use kfp.dsl.types to replace kfp.components.types

Fixes: #10282
Signed-off-by: hsinhoyeh <yhh92u@gmail.com>

* fix import artifact_types

---------

Signed-off-by: hsinhoyeh <yhh92u@gmail.com>
 2023-12-12 19:38:38 -05:00
Connor McCarthy d41efc3e96
update task dispatcher (#10298) 2023-12-12 14:23:49 -05:00
Connor McCarthy 5cd708de37
feat(sdk): add local execution skeleton #localexecution (#10292) 2023-12-09 14:08:21 -05:00
Connor McCarthy 5c60d37616
remove cleanup param in local init (#10293) 2023-12-09 14:07:58 -05:00
Connor McCarthy d3b3e7a5ba
chore(sdk): support Python 3.12 (#10272) 
* chore(sdk): support Python 3.12

* fix kfp-kubernetes test import error

* use assertEqual instead of assertEquals

* fix kfp-kubernetes snapshot yaml
 2023-11-29 23:18:03 +00:00
Connor McCarthy 11f60d813a
feat(sdk): support `.after()` referencing task in `ParallelFor` group (#10257) 2023-11-29 10:22:14 -05:00
Connor McCarthy d3323c06f3
feat(sdk): add executor output path and executor input message placeholders (#10240) 
* add support for '{{$.outputs.output_file}}' placeholder

* dedupe executor input code
 2023-11-20 20:30:10 +00:00
Connor McCarthy 0d7913ce4e
feat(sdk): add local execution config #localexecution (#10234) 2023-11-20 18:18:10 +00:00
Connor McCarthy b4d7e1857b
chore(sdk): nest requests_toolbelt import (#10247) 2023-11-20 18:12:10 +00:00
Connor McCarthy 23fb94caa8
chore(sdk): update CONTRIBUTING.md testing instructions (#10218) 
Required after #10160, since specifying a test path will override the `pytest.ini` configuration.
 2023-11-08 18:28:09 +00:00
Connor McCarthy f250700e4d
chore(sdk): release KFP SDK 2.4.0 (#10167) 2023-10-27 17:04:10 +00:00
Connor McCarthy 03df9df68c
chore(sdk): fix local test failure (#10161) 2023-10-26 01:39:16 +00:00
Mathew Wicks 02e00e8439
fix(sdk): type annotation for client credentials (#10158) 2023-10-26 01:39:10 +00:00