Commit Graph

117 Commits

Author SHA1 Message Date
Tommy Li 332881895a
Add argo variable checking when compile to Tekton. (#80)
* add initial parsing

* add regex mapping for the equivalent tekton variables

* revert old changes

* fix typos

* raise error when unsupported Argo vars are used

* fix comment
2020-04-03 15:29:47 -07:00
Feng Li cf3968125d
Extend compiler to support parallelFor with loop static params (#67) 2020-04-02 19:55:46 -07:00
Tommy Li d990f2414f
Copy param output files using emptyDir volumes (#75)
* init code

* add initial workspace workaround

* added workspaces to pipelinerun

* fix typo

* only use workspace if necessary

* add extra steps for copying non configurable output file path

* update comment

* update container image

* update copy step to use busybox

* update comments

* replace workspaces with emptydir volume

* revert workspace changes

* fix volume edge case

* update comments

* update test report
2020-04-02 15:55:46 -07:00
Tommy Li 6df545ad41
add transformer test for annotations and labels (#76) 2020-03-31 17:37:27 -07:00
Tommy Li f088d2a465
Add more k8s resource support (#65)
* add more k8s resource support

* add test main functions as requested

* add description on why we need pipelinerun
2020-03-30 16:18:40 -07:00
Feng Li 0fb5ab8440
Extend compiler to support workflow level timeout (#68) 2020-03-27 14:57:53 -07:00
Tommy Li 5b52b79bd8
Add initial pipelinerun support (#62)
* add initial pipelinerun support

* update comment

* rearrange compile function
2020-03-26 14:20:23 -07:00
Feng Li 359e750b17
support retry, address the comments (#55) 2020-03-24 18:13:02 -07:00
Feng Li 10896c8036
Support timeout defining for pipeline tasks (#46) 2020-03-24 12:57:02 -07:00
Feng Li 8d6c412619
Add pipelineparams in compiler, address comments (#45) 2020-03-23 22:48:47 -07:00
Tommy Li a5992f95f7
add init_container as steps (#50) 2020-03-23 22:46:46 -07:00
Feng Li 9be5a87d69
Address review comments, remove with_param from this PR (#42) 2020-03-20 18:16:44 -07:00
Tommy Li 8e944cfc1e
Add volumemount support and fix parameter bugs (#40)
* add volumemount support and fix parameter bugs

* remove sdk/samples folder and use real kfp example

* fix formatting

* update unittest and instructions

* update license header

* update license header

* update license
2020-03-20 15:32:44 -07:00
Christian Kadner 9ff9467daf
Task output parameters as input for subsequent tasks (#27)
Closes #19
2020-03-17 17:08:14 -07:00
Tommy Li 7c843f66fe
update samples and tests to also include parallel use case (#24)
* update example and tests to also include parallel use case

* update example and tests to also include parallel use case

* add back the sequential example

* update permission

* remove sub-folders

* update readme instructions

* rename files to make it consistent

* update tests to be consistent with kfp samples
2020-03-16 14:56:30 -07:00
Christian Kadner 3167232886
Generate Tekton Pipeline with Tasks (#17)
Replace Steps with Tasks to allow parallel task execution.
Use 'runAfter' to support sequential task execution.
2020-03-11 19:46:38 -07:00
Christian Kadner faf700f222
Refactor code to extend KFP SDK compiler (#16)
This code change removes the requirement to clone and
copy the kubeflow/pipelines repository. The project
has been refactored to only contain the minimal set of
Python classes and methods that needed to be modified
to generate Tekton YAML instead of Argo YAML. The
overriden methods are dynamically linked at runtime
by monkey-patching the KFP SDK module.

Additionally adding a simple test case and setup.py
install script that creates the dsl-compile-tekton
CLI executable which works independent of the KFP
compiler executable.
2020-03-03 18:37:48 -08:00