kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,803 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

18 Commits

Author SHA1 Message Date
Chen Sun 91c5a93c8e
chore(sdk.v2): Migrate to the new IR with subdag support (#4981) 
* migrate to new ir

* address review comments

* fix bugs

* fix pipeline parameters and tests

* fix components import

* fix typo
 2021-02-03 04:11:37 -08:00
Chen Sun ecb14f40bb
chore(sdk): Remove v2 components fork, use v1 instead. (#5042) 
* Remove v2.components fork

* fix setup.py
 2021-01-28 18:20:07 -08:00
Chen Sun 0c600a2cb8
fix(sdk.v2): Fix the bug where pipeline_parameters is not used. (#5002) 
* fix bug on pipeline parameters not being used.

* address review comments
 2021-01-19 07:59:45 -08:00
Jiaxiao Zheng 2386471cdf
feat(sdk): Add artifact ontology and migrate compiler utils to onboard artifact types (#4901) 
* update

* change get_artifact_type to classmethod

* fix NoneType serialization

* fix tests

* fix compiler cli tests

* fix tests

* resolve comments

* fix tests

* drop schema and metrics classes

* fix tests

* resolve comment

* resolve comment
 2020-12-17 10:51:09 -08:00
Chen Sun 6b8bd4c7ab
chore(sdk.v2): Support explicit task dependency (#4824) 2020-11-24 12:10:40 -08:00
Chen Sun 6931fe84f5
chore(sdk.v2): Allow component to be reused in a pipeline (#4784) 
* Allow component to be reused in a pipeline

* cleanup

* cleanup

* fix missing test
 2020-11-24 11:26:40 -08:00
Chen Sun a51380b065
chore(sdk): Add InputUri and, OutputUris placeholders in v2 (#4728) 
* Fix bug where we missed injecting importer node

* moved files

* address review comments

* Add InputUriPlaceholder and OutputUriPlaceholder

* support uri placholder in v2

* lint

* test

* Preserve a test case with inputPath and outputPath usage.

* fix ut

* fix import and setup

* address comments
 2020-11-09 11:37:58 -08:00
Chen Sun 82b1ed4d17
chore(sdk): v2 compiler compiles to pipeline job spec (#4729) 
* fix proto

* compile to pipeline job spec

* make pipeline_root required

* address comments
 2020-11-06 15:05:38 -08:00
Chen Sun 5d15b19b47
chore(sdk): Ensure all pipeline parameters present in runtime_parameters mapping. (#4722) 
* Fix bug that pipline parameter missing from runtime parameter list

* fix test data

* refactor and tests
 2020-11-06 01:56:42 -08:00
Chen Sun 935a9b5ba5
chore(sdk): Fix a bug where we missed injecting importer node (#4712) 
* Fix bug where we missed injecting importer node

* moved files

* address review comments
 2020-11-04 16:00:55 -08:00
Chen Sun 1123489787
chore(sdk): Allow arbitrary input/output types with default to generic artifact. (#4689) 
* Allow arbitrary input/output types with default to generic artifact.

* address review comments

* address comments

* fix docstring

* fix test sample.
 2020-11-02 11:56:15 -08:00
Chen Sun 94eb582f6d
chore(sdk): Allow arbitrary input/output types in v2 compiler (#4679) 2020-10-27 11:20:01 -07:00
Jiaxiao Zheng c4dd7871a6
chore: Support resource spec in v2 compiler (#4669) 
* skeleton of code

* commit resource spec in IR proto

* add resource setter

* add accelerator setters

* fix unit conversion

* fix attribute proxy

* add and fix unittests

* add e2e test

* clean up

* clean up

* clean up

* clean up

* bypass subclass overriding

* clean up

* clean up

* clean up

* resolve comments
 2020-10-26 16:40:02 -07:00
Chen Sun 55feb218d5
chore(sdk): Raises error on unsupported features in v2 compiler (#4650) 
* Raises error on unsupported features

* use v2.dsl in tests

* update test
 2020-10-24 15:53:00 -07:00
Chen Sun 544652e1bb
chore(sdk): Support if placeholder in v2 compiler (#4648) 
* support if placeholder in v2 compiler

* fix inaccurte comments
 2020-10-24 09:23:01 -07:00
Chen Sun b04bfe6b81
chore(sdk): Add test for concat placeholder (#4651) 2020-10-23 18:53:00 -07:00
Jiaxiao Zheng 3075f9a5fb
chore: Add more semantically expressive artifact ontology to IR compiler. (#4646) 
* add ontology inline

* ontology unittests

* add test

* fix tests
 2020-10-20 14:30:22 -07:00
Chen Sun 5020fd1079
compiler for IR (#4529) 
* Compile IR proto in setup.py

* compile to IR

* Fix importer node logic and lint

* cleanup and lint

* merge, undo setup.py change

* cleanup and lint

* remove currently unused code

* format _component_bridge.py

* cleanup and format

* cleanup

* upgrade protobuf in test

* restructure and test

* address review comments

* fix bug

* avoid f-strings formatting

* address review comments

* address review comments

* limit the primitive types to only int, double, and string.

* Fix test for python3.5

* use instance_schema instead of schema_title

* add v2 to setup.py

* address review comments

* move the tests closer to the code

* add more tests

* cleanup and linting

* add more tests

* fix bug on input paramter connection

* linting

* restructure tests

* fix python3.5 test failure

* support outputs.parameters placeholder

* remove pipeline decorator from v2.dsl
 2020-10-13 17:13:54 -07:00