Commit Graph

13 Commits

Author SHA1 Message Date
Chen Sun ecb14f40bb
chore(sdk): Remove v2 components fork, use v1 instead. (#5042)
* Remove v2.components fork

* fix setup.py
2021-01-28 18:20:07 -08:00
Chen Sun a347765630
chore (sdk.v2): Error out on using InputPath placeholder for artifacts require importer. (#4929)
* throw error on importer-inputpath combination

* address review comments
2020-12-22 17:44:27 -08:00
Chen Sun a4807820d5
chore(sdk): v2.components code cleanup (#4737)
* Fix bug where we missed injecting importer node

* moved files

* address review comments

* Add InputUriPlaceholder and OutputUriPlaceholder

* support uri placholder in v2

* lint

* test

* Preserve a test case with inputPath and outputPath usage.

* fix ut

* fix import and setup

* cleanup v2.components

* address comments

* remove InputTextFile, InputBinaryFile, OutputTextFile, OutputBinaryFile

* address review comment
2020-12-04 14:45:26 -08:00
Chen Sun 6931fe84f5
chore(sdk.v2): Allow component to be reused in a pipeline (#4784)
* Allow component to be reused in a pipeline

* cleanup

* cleanup

* fix missing test
2020-11-24 11:26:40 -08:00
Chen Sun 7cf620323f
chore(sdk): Use pipeline_spec proto from kfp-pipeline-spec package (#4745)
* Use pipeline_spec proto from kfp-pipeline-spec package

* update imports

* use pre-released kfp-pipeline-spec (temporarily)

* Revert "use pre-released kfp-pipeline-spec (temporarily)"

This reverts commit 77f2e9a39c.

* test_requires

* version

* make kfp a namespace package

* move to the top

* version rc0
2020-11-10 16:14:41 -08:00
Chen Sun a51380b065
chore(sdk): Add InputUri and, OutputUris placeholders in v2 (#4728)
* Fix bug where we missed injecting importer node

* moved files

* address review comments

* Add InputUriPlaceholder and OutputUriPlaceholder

* support uri placholder in v2

* lint

* test

* Preserve a test case with inputPath and outputPath usage.

* fix ut

* fix import and setup

* address comments
2020-11-09 11:37:58 -08:00
Chen Sun 935a9b5ba5
chore(sdk): Fix a bug where we missed injecting importer node (#4712)
* Fix bug where we missed injecting importer node

* moved files

* address review comments
2020-11-04 16:00:55 -08:00
Chen Sun 1123489787
chore(sdk): Allow arbitrary input/output types with default to generic artifact. (#4689)
* Allow arbitrary input/output types with default to generic artifact.

* address review comments

* address comments

* fix docstring

* fix test sample.
2020-11-02 11:56:15 -08:00
Chen Sun 94eb582f6d
chore(sdk): Allow arbitrary input/output types in v2 compiler (#4679) 2020-10-27 11:20:01 -07:00
Jiaxiao Zheng c4dd7871a6
chore: Support resource spec in v2 compiler (#4669)
* skeleton of code

* commit resource spec in IR proto

* add resource setter

* add accelerator setters

* fix unit conversion

* fix attribute proxy

* add and fix unittests

* add e2e test

* clean up

* clean up

* clean up

* clean up

* bypass subclass overriding

* clean up

* clean up

* clean up

* resolve comments
2020-10-26 16:40:02 -07:00
Chen Sun 544652e1bb
chore(sdk): Support if placeholder in v2 compiler (#4648)
* support if placeholder in v2 compiler

* fix inaccurte comments
2020-10-24 09:23:01 -07:00
Alexey Volkov ccc763fb71
SDK - Restored module decoupling (#4625)
A recent PR has added changes architecturally belonged to a different module (the component bridge). This has introduced unintended dependencies and couplings between the modules. This PR restores the module separation. It also makes the code simpler.
2020-10-13 20:11:54 -07:00
Chen Sun 5020fd1079
compiler for IR (#4529)
* Compile IR proto in setup.py

* compile to IR

* Fix importer node logic and lint

* cleanup and lint

* merge, undo setup.py change

* cleanup and lint

* remove currently unused code

* format _component_bridge.py

* cleanup and format

* cleanup

* upgrade protobuf in test

* restructure and test

* address review comments

* fix bug

* avoid f-strings formatting

* address review comments

* address review comments

* limit the primitive types to only int, double, and string.

* Fix test for python3.5

* use instance_schema instead of schema_title

* add v2 to setup.py

* address review comments

* move the tests closer to the code

* add more tests

* cleanup and linting

* add more tests

* fix bug on input paramter connection

* linting

* restructure tests

* fix python3.5 test failure

* support outputs.parameters placeholder

* remove pipeline decorator from v2.dsl
2020-10-13 17:13:54 -07:00