kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,286 Commits 301 Branches 176 Tags 468 MiB
Commit Graph

16 Commits

Author SHA1 Message Date
Chen Sun f84b51e72d
chore(sdk): Support loading v1 yaml with {executorInput: } placeholder (#7870) 
* Support {executorInput: } placeholder

* merge

* use single quotes for consistency
 2022-06-14 13:14:31 -07:00
Connor McCarthy de0b824be1
feat(sdk): add support for IfPresentPlaceholder and ConcatPlaceholder strings (#7795) 
* move placeholders to placeholders module; implement if-present and concat placeholders

* update module name and method names throughout codebase

* rename placeholder abc

* add back compat support for CEL-style concat string

* add copyright

* add docstrings; clean up

* remove duplicate code
 2022-06-09 07:42:00 +00:00
Connor McCarthy 0cf817364c
fix(sdk): fix load v1 if present placeholder (#7765) 
* fix load v1 if present placeholder

* add test for load v1 if present placeholder
 2022-06-02 16:49:53 +00:00
Connor McCarthy a6ec449273
feat(sdk): only use IR when saving component (#7690) 
* move function into compiler module

* remove v2 readable yaml write path

* remove v2 readable yaml test data; remove duplicate tests
 2022-05-24 22:23:33 +00:00
Connor McCarthy cbc2ac5266
feat(sdk): enable read in component using IR (#7689) 
* enable read in primitive components

* enable read in via YAML component

* convert OutputValuePlaceholder to OutputParameterPlaceholder

* add docstring
 2022-05-24 18:58:57 +00:00
Connor McCarthy 6698801fc0
refactor(sdk): move placeholder logic to structures (#7687) 
* move placeholder formatting logic to structures

* add placeholder formatting logic tests

* update placeholder references throughout codebase

* remove ABC meta inheritance
 2022-05-19 07:45:56 +00:00
Connor McCarthy 62972eccf9
feat(sdk): enable compilation of primitive components (#7580) 
* clean up relevant files

* use context manager for temporary directory cleanup

* add component compilation methods

* add component compilation tests

* add more complete pipeline_func argument handling

* use context manager for handling type check mode

* improve checks on inputs for component compilation

* correct pipeline name for primitive component IR

* simplify component compilation logic

* extract compiler methods

* move compiler helpers to helpers file to avoid circular imports

* remove underscore prefix from functions in hidden module

* move helpers tests to helper_test module

* put to_pipeline_spec on ComponentSpec

* fix inputs reference

* use same naming regex for pipelines and components

* permit compilation of all BaseComponent subclasses

* clean up docstrings

* merge compiler.helpers into pipeline_spec_builder

* modify docstrings; refactor

* modify docstring
 2022-05-13 20:12:34 +00:00
Connor McCarthy 5da3826bb5
feat(sdk): use custom basemodel and remove pydantic (#7639) 
* fix discovered bug

* update tests

* implement custom BaseModel

* use basemodel for structures

* remove pydantic dependency

* assorted code cleanup
 2022-05-04 12:56:32 -06:00
Connor McCarthy fbfeadd4a4
feat(sdk): add autocomplete and version options to kfp cli (#7567) 
* add helpful options to cli

* add tests
 2022-04-25 14:01:02 -06:00
Connor McCarthy f70413ad7c
chore(sdk): stop using pydantic for serialization (#7536) 
* add ir_utils

* add ir_utils tests

* use ir_utils to write ir to file

* cast posix path to string in `kfp components build` command

* add copyright

* remove unused import

* update setup.py packages
 2022-04-12 17:03:55 +00:00
Connor McCarthy c98f14abb4
chore(sdk): make field order in compile deterministic (#7520) 
* apply docformatter

* use sort_keys=True in compiler

* update golden snapshots

* set other sort_keys=True

* update structures_test yamls
 2022-04-06 21:46:13 +00:00
Connor McCarthy 41caca8850
chore(sdk): remove python 3.6 dead code (#7440) 
* migrate modules to >= python 3.7

* update test images to greatest supported python version

* remove unused import

* update test data

* clean comment

* undo 3.7 image change

* revert 3.9 -> 3.7

* revert OrderedDict to Dict
 2022-03-21 22:15:30 +00:00
Connor McCarthy 2c0b38162f
chore(sdk): make kfp v2 hermetic (#7428) 
* move v1 files to v2

* format with yapf

* remove unused imports

* clean up

* update copyright

* move imports to module top level

* apply some pylint changes

* loosen pylintrc

* remove v2_yaml_utils.py
 2022-03-18 03:00:40 +00:00
Connor McCarthy 4621aec146
chore(sdk): apply yapf formatting (#7414) 2022-03-16 20:34:36 +00:00
Connor McCarthy 82d17ff616
feat(sdk)!: rename commands, arguments parameters to command, args (#7391) 2022-03-09 05:39:11 +00:00
Yaqi Ji 8bb0d0e025
feat(sdk)!: move v2 to main namespace (#7376) 
* feat(sdk)!: move v2 to main namespace

* edit samples
 2022-03-04 21:56:51 +00:00