kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,803 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

17 Commits

Author SHA1 Message Date
Chen Sun 051a022937
feat(sdk.v2): Allow set pipeline_root via @dsl.pipeline decorator. Make pipeline_root optional. (#5107) 
* Allow set pipeline_root via @dsl.pipeline decorator.

* test covering pipeline_root not set
 2021-02-07 02:06:32 -08:00
Jiaxiao Zheng 7c50708aad
feat(sdk.v2): Update v2 compiler to support v2 component. (#5104) 
* update compiler

* lint

* fix test
 2021-02-05 17:40:37 -08:00
Chen Sun 91c5a93c8e
chore(sdk.v2): Migrate to the new IR with subdag support (#4981) 
* migrate to new ir

* address review comments

* fix bugs

* fix pipeline parameters and tests

* fix components import

* fix typo
 2021-02-03 04:11:37 -08:00
Chen Sun 9e0b9aa1f6
chore(sdk): Bring back kfp.v2.components as an alias to kfp.components (#5083) 
* Bring back kfp.v2.components with a DeprecationWarning

* fix test

* no deprecation warning
 2021-02-03 02:07:36 -08:00
Chen Sun ecb14f40bb
chore(sdk): Remove v2 components fork, use v1 instead. (#5042) 
* Remove v2.components fork

* fix setup.py
 2021-01-28 18:20:07 -08:00
Chen Sun 0c600a2cb8
fix(sdk.v2): Fix the bug where pipeline_parameters is not used. (#5002) 
* fix bug on pipeline parameters not being used.

* address review comments
 2021-01-19 07:59:45 -08:00
Chen Sun a347765630
chore (sdk.v2): Error out on using InputPath placeholder for artifacts require importer. (#4929) 
* throw error on importer-inputpath combination

* address review comments
 2020-12-22 17:44:27 -08:00
Chen Sun 03904ebacd
chore(sdk.v2): Error out on invalid pipeline name (#4851) 2020-12-01 14:36:51 -08:00
Chen Sun 6b8bd4c7ab
chore(sdk.v2): Support explicit task dependency (#4824) 2020-11-24 12:10:40 -08:00
Chen Sun 7cf620323f
chore(sdk): Use pipeline_spec proto from kfp-pipeline-spec package (#4745) 
* Use pipeline_spec proto from kfp-pipeline-spec package

* update imports

* use pre-released kfp-pipeline-spec (temporarily)

* Revert "use pre-released kfp-pipeline-spec (temporarily)"

This reverts commit 77f2e9a39c.

* test_requires

* version

* make kfp a namespace package

* move to the top

* version rc0
 2020-11-10 16:14:41 -08:00
Chen Sun a51380b065
chore(sdk): Add InputUri and, OutputUris placeholders in v2 (#4728) 
* Fix bug where we missed injecting importer node

* moved files

* address review comments

* Add InputUriPlaceholder and OutputUriPlaceholder

* support uri placholder in v2

* lint

* test

* Preserve a test case with inputPath and outputPath usage.

* fix ut

* fix import and setup

* address comments
 2020-11-09 11:37:58 -08:00
Chen Sun 82b1ed4d17
chore(sdk): v2 compiler compiles to pipeline job spec (#4729) 
* fix proto

* compile to pipeline job spec

* make pipeline_root required

* address comments
 2020-11-06 15:05:38 -08:00
Chen Sun 5d15b19b47
chore(sdk): Ensure all pipeline parameters present in runtime_parameters mapping. (#4722) 
* Fix bug that pipline parameter missing from runtime parameter list

* fix test data

* refactor and tests
 2020-11-06 01:56:42 -08:00
Chen Sun 935a9b5ba5
chore(sdk): Fix a bug where we missed injecting importer node (#4712) 
* Fix bug where we missed injecting importer node

* moved files

* address review comments
 2020-11-04 16:00:55 -08:00
Jiaxiao Zheng c4dd7871a6
chore: Support resource spec in v2 compiler (#4669) 
* skeleton of code

* commit resource spec in IR proto

* add resource setter

* add accelerator setters

* fix unit conversion

* fix attribute proxy

* add and fix unittests

* add e2e test

* clean up

* clean up

* clean up

* clean up

* bypass subclass overriding

* clean up

* clean up

* clean up

* resolve comments
 2020-10-26 16:40:02 -07:00
Chen Sun 55feb218d5
chore(sdk): Raises error on unsupported features in v2 compiler (#4650) 
* Raises error on unsupported features

* use v2.dsl in tests

* update test
 2020-10-24 15:53:00 -07:00
Chen Sun 5020fd1079
compiler for IR (#4529) 
* Compile IR proto in setup.py

* compile to IR

* Fix importer node logic and lint

* cleanup and lint

* merge, undo setup.py change

* cleanup and lint

* remove currently unused code

* format _component_bridge.py

* cleanup and format

* cleanup

* upgrade protobuf in test

* restructure and test

* address review comments

* fix bug

* avoid f-strings formatting

* address review comments

* address review comments

* limit the primitive types to only int, double, and string.

* Fix test for python3.5

* use instance_schema instead of schema_title

* add v2 to setup.py

* address review comments

* move the tests closer to the code

* add more tests

* cleanup and linting

* add more tests

* fix bug on input paramter connection

* linting

* restructure tests

* fix python3.5 test failure

* support outputs.parameters placeholder

* remove pipeline decorator from v2.dsl
 2020-10-13 17:13:54 -07:00