kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,751 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

19 Commits

Author SHA1 Message Date
Chen Sun ecb14f40bb
chore(sdk): Remove v2 components fork, use v1 instead. (#5042) 
* Remove v2.components fork

* fix setup.py
 2021-01-28 18:20:07 -08:00
Jiaxiao Zheng a56efb2061
feat(sdk): Merge artifact ontology from v2 to the classic KFP. (#4963) 
* move modules back to v1

* move and fix ontology tests
 2021-01-07 23:00:53 -08:00
Chen Sun a347765630
chore (sdk.v2): Error out on using InputPath placeholder for artifacts require importer. (#4929) 
* throw error on importer-inputpath combination

* address review comments
 2020-12-22 17:44:27 -08:00
Jiaxiao Zheng 2386471cdf
feat(sdk): Add artifact ontology and migrate compiler utils to onboard artifact types (#4901) 
* update

* change get_artifact_type to classmethod

* fix NoneType serialization

* fix tests

* fix compiler cli tests

* fix tests

* resolve comments

* fix tests

* drop schema and metrics classes

* fix tests

* resolve comment

* resolve comment
 2020-12-17 10:51:09 -08:00
Jiaxiao Zheng 7591805377
feat(SDK): adds Artifact base class. (#4895) 
* Add base Artifact class

* add __repr__ test

* add __repr__ test

* add serialization

* add serialization tests

* add deserialization tests

* add absl-py

* update requirements

* Resolve comments
 2020-12-15 13:18:20 -08:00
Chen Sun a4807820d5
chore(sdk): v2.components code cleanup (#4737) 
* Fix bug where we missed injecting importer node

* moved files

* address review comments

* Add InputUriPlaceholder and OutputUriPlaceholder

* support uri placholder in v2

* lint

* test

* Preserve a test case with inputPath and outputPath usage.

* fix ut

* fix import and setup

* cleanup v2.components

* address comments

* remove InputTextFile, InputBinaryFile, OutputTextFile, OutputBinaryFile

* address review comment
 2020-12-04 14:45:26 -08:00
Chen Sun 6931fe84f5
chore(sdk.v2): Allow component to be reused in a pipeline (#4784) 
* Allow component to be reused in a pipeline

* cleanup

* cleanup

* fix missing test
 2020-11-24 11:26:40 -08:00
Chen Sun 7cf620323f
chore(sdk): Use pipeline_spec proto from kfp-pipeline-spec package (#4745) 
* Use pipeline_spec proto from kfp-pipeline-spec package

* update imports

* use pre-released kfp-pipeline-spec (temporarily)

* Revert "use pre-released kfp-pipeline-spec (temporarily)"

This reverts commit 77f2e9a39c.

* test_requires

* version

* make kfp a namespace package

* move to the top

* version rc0
 2020-11-10 16:14:41 -08:00
Chen Sun a51380b065
chore(sdk): Add InputUri and, OutputUris placeholders in v2 (#4728) 
* Fix bug where we missed injecting importer node

* moved files

* address review comments

* Add InputUriPlaceholder and OutputUriPlaceholder

* support uri placholder in v2

* lint

* test

* Preserve a test case with inputPath and outputPath usage.

* fix ut

* fix import and setup

* address comments
 2020-11-09 11:37:58 -08:00
Chen Sun 00bfaf5591
chore(sdk): fix bug around assertion and test (#4718) 
* fix bug around assertion and test

* simplify test code
 2020-11-05 08:56:53 -08:00
Chen Sun 935a9b5ba5
chore(sdk): Fix a bug where we missed injecting importer node (#4712) 
* Fix bug where we missed injecting importer node

* moved files

* address review comments
 2020-11-04 16:00:55 -08:00
Chen Sun 1123489787
chore(sdk): Allow arbitrary input/output types with default to generic artifact. (#4689) 
* Allow arbitrary input/output types with default to generic artifact.

* address review comments

* address comments

* fix docstring

* fix test sample.
 2020-11-02 11:56:15 -08:00
Chen Sun 94eb582f6d
chore(sdk): Allow arbitrary input/output types in v2 compiler (#4679) 2020-10-27 11:20:01 -07:00
Jiaxiao Zheng c4dd7871a6
chore: Support resource spec in v2 compiler (#4669) 
* skeleton of code

* commit resource spec in IR proto

* add resource setter

* add accelerator setters

* fix unit conversion

* fix attribute proxy

* add and fix unittests

* add e2e test

* clean up

* clean up

* clean up

* clean up

* bypass subclass overriding

* clean up

* clean up

* clean up

* resolve comments
 2020-10-26 16:40:02 -07:00
Chen Sun 55feb218d5
chore(sdk): Raises error on unsupported features in v2 compiler (#4650) 
* Raises error on unsupported features

* use v2.dsl in tests

* update test
 2020-10-24 15:53:00 -07:00
Chen Sun 544652e1bb
chore(sdk): Support if placeholder in v2 compiler (#4648) 
* support if placeholder in v2 compiler

* fix inaccurte comments
 2020-10-24 09:23:01 -07:00
Jiaxiao Zheng 3075f9a5fb
chore: Add more semantically expressive artifact ontology to IR compiler. (#4646) 
* add ontology inline

* ontology unittests

* add test

* fix tests
 2020-10-20 14:30:22 -07:00
Alexey Volkov ccc763fb71
SDK - Restored module decoupling (#4625) 
A recent PR has added changes architecturally belonged to a different module (the component bridge). This has introduced unintended dependencies and couplings between the modules. This PR restores the module separation. It also makes the code simpler.
 2020-10-13 20:11:54 -07:00
Chen Sun 5020fd1079
compiler for IR (#4529) 
* Compile IR proto in setup.py

* compile to IR

* Fix importer node logic and lint

* cleanup and lint

* merge, undo setup.py change

* cleanup and lint

* remove currently unused code

* format _component_bridge.py

* cleanup and format

* cleanup

* upgrade protobuf in test

* restructure and test

* address review comments

* fix bug

* avoid f-strings formatting

* address review comments

* address review comments

* limit the primitive types to only int, double, and string.

* Fix test for python3.5

* use instance_schema instead of schema_title

* add v2 to setup.py

* address review comments

* move the tests closer to the code

* add more tests

* cleanup and linting

* add more tests

* fix bug on input paramter connection

* linting

* restructure tests

* fix python3.5 test failure

* support outputs.parameters placeholder

* remove pipeline decorator from v2.dsl
 2020-10-13 17:13:54 -07:00