kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,513 Commits 301 Branches 176 Tags 462 MiB
Commit Graph

15 Commits

Author SHA1 Message Date
Connor McCarthy e371fa3795
feat(sdk): add compilation logic for google artifact types (support custom artifact types pt. 2) (#8232) 
* remove dependency of deprecated on v2

* use new artifact identification logic

* add custom artifact type compiler test

* compile schema_version from non-kfp artifacts

* update tests

* add importer to compiler test

* update golden snapshots

* fix type checking code

* undo executor_test diff

* remove gcpc types compiler test

* add compilation test comment

* update google artifact handling

* update compiler test

* only permit system. and google. artifact types; add tests

* update compiler test

* simplify type checking logic

* use bundled artifact types in PipelineArtifactChannel

* raise error on unknown v1 input or output

* add type utils and move functions

* add type utils tests

* remove schema_version from inputspec and outputspec

* update artifact proto creation and tests

* propogate bundled artifact type string changes throughout sdk

* update golden snapshot

* remove unused v1 compat and tests

* update type checking and tests to validate schema_version using semantic versioning

* update importer sample

* update test data config

* update test_data config

* clean up sample

* clean up sample
 2022-09-12 14:00:02 -06:00
Connor McCarthy 72c1d10a33
feat(sdk): rename kfp artifact attributes (support custom artifact types pt. 1) (#8191) 2022-08-27 13:20:50 +00:00
Chen Sun 5ce4954d6b
feat(sdk)!: Implement Graph Component (#8179) 
* Implement Graph Component

* isort imports

* release note

* address review comments

* address review comments
 2022-08-26 09:28:49 +00:00
Scott_Xu 35fccb1fae
feat(sdk): expose new ContainerSpec API (#8144) 
* rename ContainerSpec to ContainerSpecImplementation for internal usage

* fix nit
 2022-08-15 20:33:34 +00:00
Scott_Xu d3c0537c8b
chore(sdk): Add test for if and concat placeholder and validate artifact channel usage (#8120) 
* test if and concat placeholder and validate artifact channel usage

* fix nit in read write test config

* resolve comments

* resolve comments and move test cases

* resolve comments and add placeholder validation

* remove unused imports

* update release file
 2022-08-10 23:35:03 +00:00
Scott_Xu 04c827fc3a
feat(sdk): supporting bring your own container for arbitrary input and outputs (#8066) 
* support container_component decorator for function with no inputs

* resolve review comments

* add sample tests for milestone 1

* modify compiler test data

* resolve reviews

* resolve reviews

* WIP

* implementation of function of no inputs

* fixed sample test

* re-fix sample test

* fix rebase merge conflict

* resolve formatting

* resolve isort error for test data

* resolve comments

* fix nit

* resolve nit

* add implementation for placeholders i/o, sample and compiler tests

* resolve comments and merge logic for constructing container component

* resolve comments

* resolve comments

* fix assertion messages

* add error handling for accessing artifact by itself

* add test for raising error for accessing artifact by itself
 2022-08-08 21:00:53 +00:00
Connor McCarthy 13736b85b6
chore(sdk): clean up kfp code style (#8027) 
* remove unused imports

* use google as isort profile

* sort imports

* format with yapf

* clean end of file new line, trailing whitespace, double quoted strings
 2022-07-15 00:06:34 +00:00
Connor McCarthy ad458d535c
fix(sdk): fix placeholder read/write logic (#7928) 
* fix ExecutorInputPlaceholder() usage

* fix OutputPath and OutputParameter placeholder task creation logic

* fix v1 component yaml deserialization logic

* fix typo in test

* ignore description when comparing ComponentSpec

* uncomment fixed test cases
 2022-06-27 15:06:38 -06:00
Chen Sun f84b51e72d
chore(sdk): Support loading v1 yaml with {executorInput: } placeholder (#7870) 
* Support {executorInput: } placeholder

* merge

* use single quotes for consistency
 2022-06-14 13:14:31 -07:00
Connor McCarthy cbc2ac5266
feat(sdk): enable read in component using IR (#7689) 
* enable read in primitive components

* enable read in via YAML component

* convert OutputValuePlaceholder to OutputParameterPlaceholder

* add docstring
 2022-05-24 18:58:57 +00:00
Connor McCarthy 6698801fc0
refactor(sdk): move placeholder logic to structures (#7687) 
* move placeholder formatting logic to structures

* add placeholder formatting logic tests

* update placeholder references throughout codebase

* remove ABC meta inheritance
 2022-05-19 07:45:56 +00:00
Connor McCarthy 9f413706df
feat(sdk): enable pip install from custom index url (#7453) 
* add pip_index_urls to component constructor

* add unit tests

* add compiler cli tests for pip_index_urls

* update golden snapshots

* add release notes

* include test file in compiler_cli_tests

* change spacing in command

* revert golden snapshots

* rename test method

* fix diff

* improve quote consistency

* extract string template from function

* fix component_op

* remove json golden

* update compiler_cli_tests
 2022-03-24 20:41:47 +00:00
Connor McCarthy 41caca8850
chore(sdk): remove python 3.6 dead code (#7440) 
* migrate modules to >= python 3.7

* update test images to greatest supported python version

* remove unused import

* update test data

* clean comment

* undo 3.7 image change

* revert 3.9 -> 3.7

* revert OrderedDict to Dict
 2022-03-21 22:15:30 +00:00
Connor McCarthy 82d17ff616
feat(sdk)!: rename commands, arguments parameters to command, args (#7391) 2022-03-09 05:39:11 +00:00
Yaqi Ji 8bb0d0e025
feat(sdk)!: move v2 to main namespace (#7376) 
* feat(sdk)!: move v2 to main namespace

* edit samples
 2022-03-04 21:56:51 +00:00