Commit Graph

196 Commits

Author SHA1 Message Date
Prashant Sharma cb7abf1535
Support data passing pipeline. (#750) 2021-10-14 09:44:08 -07:00
Tommy Li 04ce4b08fa
Relax kfp sdk dependencies (#746)
* relax kfp sdk dependencies

* update readme version reference
2021-10-08 17:49:43 -07:00
huixa b5c907d380
[Only review]Fix #733 the pipeline parameter consumed as file (#740) 2021-09-29 15:36:10 -07:00
Michalina Kotwica a9684171c1
fix(sdk) sanitize paths in artifact_items. Fixes #738 (#739)
* sanitize paths in artifact_items

* update tests
2021-09-27 01:36:40 -07:00
Tommy Li 043d734147
Fix(sdk): chain nested conditions to work on non-dependable condition tasks. (#732)
* chain nested conditions

* add missing license

* add dependency check to remove unnecessary when expression

* minor improvement to check for the exact condition rather than just the condition task
2021-09-15 15:08:55 -07:00
Tommy Li e291986106
Update KFP SDK version to 1.7.2, create KFP-TEKTON 1.0.0 release (#718)
* update KFP SDK version to 1.7.2, create KFP-TEKTON 1.0.0 release

* update standalone deployment readme
2021-08-30 17:23:03 -07:00
kfp-tekton-bot 0708a5699b
KFP 1.7.0 Rebase (#713)
* KFP 1.7.0-rc.4 Rebase

* Resolve API and Backend conflicts

* Apply 1.7.0 changes since rc.4

* Revert unwanted SDK changes

* Revert unwanted samples changes

* Revert unwanted components changes

* Fix 1.7.0 backend conflicts

* Revert unwanted SDK changes (2)

* Fix SDK bugs in backend/Dockerfile

* Fix frontend conflicts
2021-08-30 15:02:25 -07:00
Prashant Sharma cdbb588c52
feat(sdk): Update SDK to support custom task timeout on Tekton 0.27 (#709) 2021-08-23 17:52:39 -07:00
Tommy Li 386ad234a4
Remove containerOp for pipelineparam and raw input samples (#708)
* remove containerOp for pipelineparam and raw input samples

* fix-typo
2021-08-23 14:13:39 -07:00
Tommy Li 9fbccd6276
Fix(sdk): Tekton copy result step sanitization (#711) 2021-08-23 13:51:39 -07:00
Tommy Li b5fe66cd9c
Make results to store in multi-steps if needed (#702)
* make results to store in multi-steps if needed

* add warning messages on oversized parameter

* regenerate tesrs

* fix copy-results format

* optimize the bin packing problem

* add docs and warning test cases
2021-08-20 10:55:54 -07:00
Tommy Li 1482b8e2ad
Move kfp sdk dependency to 1.7.1 (#705) 2021-08-19 11:16:54 -07:00
Tommy Li fba9ee2241
Update kfp sdk dependency to 1.7 (#699) 2021-08-13 11:53:04 -07:00
Tommy Li 87d12ce04e
Fix e2e test case (#696)
* fix e2e test case

* fix e2e test case
2021-08-12 15:10:54 -07:00
Tommy Li 8d8d2b3c6d
Migrate volume and loop unit tests to component.yaml and verify with v2 (#692)
* migrate unit tests to component.yaml and verify with v2

* update readme to remove volumesnapshot

* address comments
2021-08-10 13:21:25 -07:00
Yihong Wang 9d4643bd66
remove ContainerOp from test cases - part 3 (#693)
eliminate the usage of ContainerOp in testcases and
update the testcase accordingly, including filenames starting
with `o` to `u`

Signed-off-by: Yihong Wang <yh.wang@ibm.com>
2021-08-10 10:23:25 -07:00
Yihong Wang 6c7c5d24fe
remove ContainerOp from test cases - part 2 (#691)
eliminate the usage of ContainerOp in testcases and
update the testcase accordingly.

Signed-off-by: Yihong Wang <yh.wang@ibm.com>
2021-08-09 17:10:27 -07:00
Yihong Wang d463f16450
remove ContainerOp from test cases - part 1 (#685)
eliminate the usage of ContainerOp in testcases and
update the testcase accordingly.

Signed-off-by: Yihong Wang <yh.wang@ibm.com>
2021-08-05 11:58:42 -07:00
Michalina Kotwica 982ad5565d
fix(sdk): add test for taskRef-vs-taskSpec params (#688)
* add test for taskRef-vs-taskSpec params

* fix: taskSpec accepting params

* add license headers

* m: no spaces around "buzz"

* fix: test file custom_task_spec.yaml

* m: follow links on newlines

* fix: big_data_passing test result yamls

* fix: yamls of other tests

* factor out conditions to process params

* fix big data rewrite for regular tasks
2021-08-03 15:01:41 -07:00
Tommy Li 186a9e301f
Update code to limit loop resource group name (#686)
* update code to limit loop resource group name

* add license
2021-08-02 19:57:11 -07:00
Gang Pu 18c9cc8bcc
Change to use component to replace containerOp for any sequencer (#675)
* Change to use component to replace containerOp for any sequencer

* Remove context input and change results path

* 1: Update to use component rather than containerOp
2: Fix lint/license issue
2021-07-28 19:39:19 -07:00
Tommy Li df63b7853a
Fix merging issue from #512 (#674) 2021-07-22 12:42:06 -07:00
Tommy Li e1b2d20480
Update sdk and release tags to 0.9.0 (#667)
* update sdk and release tags to 0.9.0

* regenerate tests

* update kubeclient source version

* generate new deployment manifests
2021-07-21 16:33:25 -07:00
Tommy Li d9b8539b0d
feature(backend): Allow KFP apiserver to create recursion pipelineLoop CRs for the users (#512)
* add auto apply custom task CRs before pipelineRun creation

* fix lint

* store loop resource in ordered dict

* Update kfp-admin-guide.md

* sorted pipeline params to avoid randomness

* sorted pipeline params to avoid randomness

* regenerate tests

* convert template string from yaml to json

* regenerate tests

* clean up unnecessary helper function

* resolve merge conflicts

* resolve merge conflicts

* remove unnecessary go mod package

* only opt-in to embed the recursion loop annotations

* only opt-in to embed the recursion loop annotations

* enable opt-in only via package variable

* add example for how to inline recursive loops

* resolve conflicts

* regenerate tests

* make auto generate and apply recursive pipelineloop in annotations as default

* move parameter sorting to the end

* add parameter sorting for recursion loops

* sort recursive task parameters

* add more details on how to opt-out auto apply custom resource
2021-07-21 00:26:50 -07:00
Tommy Li 1a29e1dedd
Regenerate tests for #665 (#666) 2021-07-14 19:24:50 -07:00
Gang Pu 592b5d2205
Fix the yaml dump issue of boolean value (#665)
* Fix the yaml dump issue of boolean value

* update conditions_with_global_params.py file
2021-07-12 22:12:17 -07:00
Prashant Sharma 9d79f8438c
feat(sdk): Add pipelineloop validation for testdata yamls. (#660) 2021-07-08 10:53:49 -07:00
Jin Chi He 77963c3cea
Enhance Any Sequencer to hanle cases that some tasks skipped (#653) 2021-07-05 01:25:51 -07:00
Prashant Sharma dbd92cb7ec
feat(sdk): inline user defined custom tasks (#636) 2021-07-02 10:26:11 -07:00
Gang Pu 791fe5304a
Fix the issue when loop/graph inside a graph (#650) 2021-07-01 17:09:10 -07:00
Prashant Sharma 64d4324f2b
feat(sdk): Sdk ParallelFor task spec inline (#633)
* TODO1: PipelineLoop inlined including nested loops and added tests.

* Supported recursive and parallel tasks inlining.

    For recursive tasks, we simply skip them.
    For Parallel tasks, relevant tests were added.

* Run all tests against inlined taskSpec and normal taskRefs

* Added CLI Flag disable/enable spec inlining.
2021-06-29 19:07:36 -07:00
Tommy Li aae4671e7b
Fix nested recursion with condition custom task and parameter mapping (#625)
* fix nested recursion with condition custom task and parameter mapping

* fix alpine commands and add licenses
2021-06-18 14:56:14 -07:00
Christian Kadner 5a3ef4d6fc
Upgrade Python SDK to kfp==1.6.3 (#617)
Resolves #595

Signed-off-by: Christian Kadner <ckadner@us.ibm.com>
2021-06-14 10:03:37 -07:00
Tommy Li af9f03d000
fix(sdk): Fix nested recursion runafter and param mapping; (#609) 2021-06-03 20:07:37 -07:00
Gang Pu a033f33b30
Fix and verify nested recursive workflow (#600)
* Fix and verify nested recursive workflow

* Fix unit_test error

* Update compiler.py

* Try to fix travis error

* Refresh yaml

Co-authored-by: Tommy Li <Tommy.chaoping.li@ibm.com>
2021-06-01 00:25:04 -07:00
Gang Pu c05fc4bbeb
Support expose status for any sequencer(DSL side) (#598) 2021-05-24 03:55:32 -07:00
Tommy Li 73d5445482
Add support to generate custom task with custom task cr (#593) 2021-05-22 02:53:30 -07:00
Gang Pu 95557c6d36
Support parallelism feature on DSL side (#592) 2021-05-20 00:51:46 -07:00
Tommy Li 1bf5aa5d13
Fix custom task condition I/O behaviors on recursion and for loop (#587)
* fix custom task I/O behaviors on recursion and while loop

* Fix comment typo
2021-05-15 02:00:29 -07:00
Tommy Li 633848134d
Sanitize Tekton result parameters when passing to custom task inputs (#579) 2021-05-06 12:07:06 -07:00
Tommy Li 76e249d4d9
Enhance error messages for resource op and artifact tracking (#572)
* enchance error messages

* update logs

* update logs
2021-04-29 14:53:30 -07:00
Christian Kadner 649152cddd
Regenerate E2E test logs for release 0.8.0 (#566)
* Regenerate E2E test logs for release 0.8.0

* Regerate "golden" log files

* Regenerate "golden" logs after PR #567

* Update list of ignored tests

* Add cond_recur.yaml to list of ignored tests

* Regenerate E2E logs after updating "golden" YAML files of unit tests

* Regenerate E2E logs after enabling auto-strip EOF

* Regenerate "golden" YAML for unit tests

* Rename loop-static CRDs

* Regenerate E2E logs, enable EOF stripping only for E2E test
2021-04-29 13:00:30 -07:00
Gang Pu 98b356cbb1
Fix the issue when there's a conditional loop (#562) 2021-04-23 09:44:43 -07:00
Tommy Li e68e03e6c3
Fix recursive loop bug with no sub_group.ops (#556) 2021-04-21 06:15:41 -07:00
Tommy Li 103ae3b79b
Fix long param compile errors (#549) 2021-04-20 10:13:41 -07:00
Gang Pu 8bbcd26a53
Adjust the any sequencer example to make it more reasonable (#550) 2021-04-20 09:29:40 -07:00
Gang Pu ae56385ab2
Support the simple condition for any sequencer (#539) 2021-04-19 06:32:16 -07:00
Michalina Kotwica b370cbd1bc
fix(sdk): fix artifacts of ops with long names (#541)
* add test for artifacts of ops with long names

* add test on correct artifact_items

* fix: stepTemplate generated

* fix: artifact_items name collision

* refactor: mount_path to a separate variable

* add license to the new test file

* m: two free lines after imports in testcase

* m: other linting
2021-04-14 12:29:12 -07:00
Tommy Li 6adfcc64f3
feature(sdk): Optimize unnecessary condition task when using User definable CEL Custom task (#478)
* add cel custom task poc

* apply suggestions with minor fixes

* add initial version of plugable cel template

* fix lint

* update staging code for converting containerOp to custom task

* update staging code for converting containerOp to custom task

* remove duplicate cel conditions

* update flip-coin example to use custom task

* update flip-coin example to use custom task

* remove dsl dependencies;

* add POC comments

* fix lint

* fix self-defined CEL custom task mapping

* move custom task condition example to a separate folder

* fix tests

* make the new custom task spec and CEL condition feature as opt-in

* update instructions and generalize custom task images

* only let custom task result comparasion to skip the condition container to provide backward compatibility

* only let custom task result comparasion to skip the condition container to provide backward compatibility

* update example

* update tests

* fix comment
2021-04-13 09:43:11 -07:00
kfp-tekton-bot 4fcabb8390
KFP 1.5.0-rc.2 Rebase (#513)
* KFP 1.5.0-rc.0 Rebase

* Resolve backend and API conflicts

* Resolve UI conflicts

* Apply changes from KFP 1.5.0-rc.1

* Resolve backend and API conflicts from RC1

* Resolve UI conflicts from RC1

* Apply changes from KFP 1.5.0-rc.2

* Resolve backend conflicts from RC2

* Build SDK based on kfp RC2 from Github instead of PyPI

* Regenerate unittest's Golden YAML files
2021-04-08 16:49:03 -07:00
Tommy Li b74d4a5cbf
fix(sdk): Fix regex parsing for custom task to handle multiple pipeline params (#528)
* fix regex parsing for custom task

* fix lint
2021-04-07 18:48:02 -07:00
Tommy Li 48ac3bce5b
feature(sdk): Add custom task definition support (#526)
* add custom task template support

* fix typo

* fix lint

* update cel example to use official custom task

* add troubleshooting for example
2021-04-06 18:53:02 -07:00
Feng Li 8d5d584cb7
Fix(sdk): Fix nested loop params issue, and ensure multi nested loop works well (#525)
* fix nested loop params issue, and ensure multi nested loop works well

* address the issue of ut failed on python3.6

* Trigger CI

* address the issue of ut failed on python3.6
2021-04-06 16:10:01 -07:00
Tommy Li 991d7dcf16
fix(sdk): Fix long resource name (#521)
* fix long resource name;

* fix python 3.6 test
2021-03-31 20:21:19 -07:00
Gang Pu 504dc25c63
Support graph and recursion for tekton backend (#515)
* 1: Support graph dsl for tekton backend
2: Support recursive graph for tekton backen

* Make check license and lint pass
2021-03-30 02:13:17 -07:00
Andrew Butler 4b5230b694
Add automated labels and annotations for pipeline caching (#507)
* Add disable-cache flag and default caching for compiler

* Add updated testdata and features doc

* Update docs

* Add task level cache enabling

* Remove disable-cache flag and add warning

* Update docs

* fix typo

* Overwrite pipeline level label with task level label and add examples

* Update imports

* update format

* Update features docs
2021-03-24 11:07:45 -07:00
Tommy Li 16db79be28
Fix any sequencer typo (#503)
* fix any sequencer typo

* Update sdk/FEATURES.md

Co-authored-by: Animesh Singh <singhan@us.ibm.com>

* update any_sequencer location

* update test

* rephrase code comments

* fix lint

* fix lint

* rephrase wording

Co-authored-by: Animesh Singh <singhan@us.ibm.com>
2021-03-17 17:21:16 -07:00
Gang Pu 05e6f4aba5
Enhance AnySequencer to make it an op (#499) 2021-03-16 19:24:16 -07:00
Feng Li 19c779b378
fix(sdk): fix issue of nested dict param defined (#491) 2021-03-10 18:14:24 -08:00
Tommy Li 440cc3d042
Add unique uuid to loop resources for pipeline versioning (#485)
* add uuid to loop resources for versioning

* add back license

* add uuid comment

* stage nested loop changes

* fix dependencies mapping

* fix name matching

* add back license

* remove test files

* fix previous typo filename

* Update compiler.py

* regenerate test yaml
2021-03-08 12:44:23 -08:00
Tommy Li 6b1e02a46b
add configuration for tekton pipeline spec (#487)
* add configuration for tekton pipeline spec

* sort annotation order
2021-03-05 17:20:49 -08:00
Christian Kadner af861733e6
Update E2E tests to use kfp client (#301) (#480)
* Use kfp client to run E2E tests

* Update Tekton server and tkn client versions

* Regenerate pipelinerun logs

* Give unique names to pipelineruns resembling file names

* Delete previous pipelineruns

* Mark tests as skipped instead of not generating them

* Regenerate pipeline-loop CRDs, update copyright statements

   for f in sdk/python/tests/compiler/testdata/*_pipelineloop_cr*.yaml; do
     echo ${f/_pipelineloop_cr*.yaml/.py};
   done | sort -u | while read f; do
     echo $f; dsl-compile-tekton --py $f --output ${f/.py/.yaml};
   done;
   make unit_test GENERATE_GOLDEN_YAML=True
2021-03-05 15:02:49 -08:00
kfp-tekton-bot ede6750224
KFP 1.4.0 Rebase (#481)
* KFP 1.4.0 Rebase

Resolves #469

* Remove duplicated KFP samples

* Resolve api and backend and SDK test conflicts

* Upgrade kfp requirements to 1.4.0

* Update testdata regenerate YAML files

* Resolve CONTRIBUTING.md

* Regenerate KFP samples compile report

* Update README.md files for KFP version 1.4.0

* Resolve frontend conflicts

* Revert list-wrapped loop arguments

* Remove compiler_tests.py.rej
2021-03-01 10:21:26 -08:00
Christian Kadner f096b95d9f
Fix parallel_join_with_argo_vars pipeline (#470) (#471)
* Fix parallel_join_with_argo_vars pipeline

Resolves #470

* Fix broken doc links for IKS install
2021-02-16 14:29:06 -08:00
Christian Kadner 8170d59d48
Remove Python 3.5 support (2) (#465)
Updating a few SDK files remaining after #463

Related #463
2021-02-10 11:02:15 -08:00
Feng Li 99e506c244
feat(backend): Support loop pipelineruns of defining dictionaries params (#460) 2021-02-08 10:37:37 -08:00
Feng Li 1f943852ae
fix(backend): Fix condition with loop together issue (#456)
* enhance the when condition UI display

* Fix condition with loop together issue
2021-02-03 18:04:28 -08:00
Feng Li 6e1f367841
fix(backend): Fix condition with multi parameter issue (#455)
* enhance the when condition UI display

* Fix condition with multi parameter issue
2021-02-03 08:10:29 -08:00
Feng Li 9b89a082bc
Fix loop issue that the loop param is from task output (#452)
* enhance the when condition UI display

* Fix loop issue that the loop param is from task output
2021-02-02 00:16:28 -08:00
Feng Li 3f750f12a0
feat(backend): Support dsl to define the pipeline loops via tekton (#440)
* enhance the when condition UI display

* Support dsl to define the pipeline loops via tekton
2021-01-29 14:25:48 -08:00
kfp-tekton-bot d5e86d763e
KFP 1.3.0 Rebase (#423)
* KFP 1.3.0 Rebase

Resolves #410

* Fix license headers, markdown ToC, hyperlinks

* Fix merge conflicts in frontend and backend

* Update KFP version references in doc files

* Regenerate "Golden" YAML files any_sequencer, big_data_passing, create_component_from_func

* Regenerate compile report

* Regenerate "golden" YAML files for any_sequencer and parallel_join_with_argo_vars
2021-01-19 13:43:59 -08:00
Jin Chi He 33cde6399a
Enhance Any Sequencer by using Tekton Pipeline Variables Fature (#422) 2021-01-17 22:19:44 -08:00
Jin Chi He 6c1d68cce6
Handle Tekton pipeline level variables (#421) 2021-01-17 18:27:43 -08:00
Andrew Butler 4bec15fa5e
Add a check for parent condition status in nested conditions (#404) 2021-01-06 09:13:51 -08:00
Jin Chi He fb765134d6
Any Sequencer implements (#399) 2021-01-05 22:11:52 -08:00
Tommy Li dc6014ded8
fix(sdk): Fix nested condition bug (#400)
* fix nested condition bug

* fix lint
2021-01-04 15:29:57 -08:00
Tommy Li 51b9824382
fix(ui and sdk): Support display name annotations (#383)
* fix ui and sdk to support display name

* lint test file
2020-12-04 12:25:26 -08:00
Tommy Li 7cd39a7335
Feature branch for moving to Tekton 0.16 (#321)
* add tekton 0.16.3 go mod

* update dev setup

* update dev docs

* update readme

* support more argo variable mapping

* update feature doc on the list of supported argo variables translation

* add task-wise metadata support

* add beta whenexpression for condition, unblock runAfter for conditional task

* update condition docs

* update ui image for tekton-0.16

* Apply suggestions from code review

Co-authored-by: Andrew Butler <Andrew.Butler@ibm.com>

* address comments and fix conflicts

* update doc reference to tekton 0.16

* regenerate tests

* updated latest images with tekton 0.16

* regenerate tests

Co-authored-by: Andrew Butler <Andrew.Butler@ibm.com>
2020-11-13 11:33:04 -08:00
Feng Li cdd5625c7c
Fix #340: handle big data passing with multi dependencies (#360) 2020-11-10 17:09:56 -08:00
Tommy Li f3b315f9f3
fix(sdk): Address default pipeline timeout behavior (#354)
* address timeout bug

* update default timeout behavior

* add flag to use tekton global default
2020-11-04 13:18:54 -08:00
Tommy Li 058c6c95f7
fix(sdk): Quick fix for sanitizing conditional variables (#344) 2020-10-26 13:52:00 -07:00
Tommy Li 5f189b7ac5
Fix big data annotations and update docs/samples (#318) 2020-10-01 13:39:19 -07:00
Tommy Li 1854b92ae0
fix(sdk): Check whether the dependent component is a tekton task (#313) 2020-09-22 09:26:49 -07:00
Tommy Li b1807476d1
fix(sdk): fixes outputfile key formatting (#308)
* fix outputfile formatting

* ignore python 3.5 test with unsortable characters

* Add python 3.5 error comments

* lint tailing whitespace
2020-09-17 17:32:45 -07:00
Feng Li 8ec1d51abf
Remove persistentVolumeClaim by volumeClaimTemplate (#309)
* Remove persistentVolumeClaim by volumeClaimTemplate

* address the comments from tomcli
2020-09-16 14:13:21 -07:00
Tommy Li 7f860a9127
Refactor artifact and logging client logics to server side (#281)
* refactor artifact and logging logics to server

* remove client side logging tests

* update logging file keywords and add configurable flags

* add simple strip output logics

* update user and admin instructions

* add missing rollout command

* minor cleanup

* golang code cleanup

* clarify guide with a better UX

* add troubleshooting

* update metadata writer to also catch k8s api timeout errors

* add troubleshooting guide for redeploy

* address comments on variable names and admin guide path

* update test logs and unittest timeout interval

* Apply suggestions from code review

Co-authored-by: Animesh Singh <singhan@us.ibm.com>

* rename variables

* allow artifact image to be customizable

Co-authored-by: Animesh Singh <singhan@us.ibm.com>
2020-09-09 15:51:44 -07:00
Tommy Li 6f7eced282
fix(sdk): throw errors on deprecated volume definition (#283) 2020-08-25 16:26:02 -07:00
Tommy Li 1712b216c5
fix(sdk): Fix volumes bug on wrong dict key (#282) 2020-08-25 16:02:03 -07:00
Tommy Li ab108d4c2c
fix(sdk): Update SDK to pull artifact related information from annotations (#259)
* pull artifact related information from annotations

* update test cases

* update dict.get syntax for the merging
2020-08-10 11:02:20 -07:00
Feng Li 819e4ed7d7
An easy solution of archiving pipeline logs to S3 (#248)
* update code to address the review comments

* change the dir name

* change the dir name

* update yaml file after rebase master

* update yaml file to trigger travic

* address comments from Tommy
2020-08-06 09:39:42 -07:00
Christian Kadner c37c600486
Upgrade E2E tests for tkn CLI version 0.11 (#246)
* Now including logs for 'finally' tasks
* Add env var for SLEEP_BETWEEN_TEST_PHASES
* Add 'retry.yaml' to ignored tests
* Make node_selector more general
* Use pipelinerun status.conditions[].reason instead of .type
* Treat status "Completed" as "Succeeded"
2020-08-04 13:26:22 -07:00
kfp-tekton-bot b28c2cbca6
KFP 1.0 Rebase (#251) 2020-08-03 20:38:18 -07:00
Christian Kadner 879d783ae0
Make E2E tests more robust (#235)
* Tolerate erratic log lines in E2E tests
* Add option to re-run only tests that failed previously
* Add option to exclude/include certain test_cases only
* Add volume_op.yaml to ignored tests as the created PVC
  needs to be deleted before/after test run
* Regenerate "golden" log files after recent commits
  changed the log output regarding artifacts
* Add option to override expected Tekton Pipeline and CLI
  versions, default: 0.14 and 0.10

Closes #229
2020-07-21 11:16:05 -07:00
Christian Kadner a59f04d81a
Upgrade to Tekton version 0.14.0 (#216) 2020-07-07 16:07:08 -07:00
Christian Kadner cfdc996c16
Make unit tests run with Python 3.5 (#210) 2020-07-06 09:14:53 -07:00
Tommy Li eea0c0104e
Update samples with the new PipelineRun SDK (#206)
* fix bugs, update examples, and add tests

* Address comments

* Update readme to a shared prerequisites section

* update instructions to use python commands if possible

* add details on the yaml name produced by the SDK

* Update samples/README.md

Co-authored-by: Animesh Singh <singhan@us.ibm.com>

Co-authored-by: Animesh Singh <singhan@us.ibm.com>
2020-07-02 16:56:47 -07:00
Tommy Li fcd4308297
Enable artifacts as default (#204)
* enable artifacts as default

* Apply suggestions from code review

Co-authored-by: Animesh Singh <singhan@us.ibm.com>

* Update sdk/FEATURES.md

Co-authored-by: Animesh Singh <singhan@us.ibm.com>

* address comments

* Apply suggestions from code review

Co-authored-by: Animesh Singh <singhan@us.ibm.com>

Co-authored-by: Animesh Singh <singhan@us.ibm.com>
2020-06-26 19:34:14 -07:00
Feng Li 9267f1f8d5
Further big_data_passing fixes after PR #166 (#194)
* further big_data_passing fixes after PR #166

* further big_data_passing fixes after PR #166

* address comments from reviewers

* Address comments form Tomcli
2020-06-24 10:05:18 -07:00
Christian Kadner 196b822532
PipelineRun with embedded pipelineSpec and taskSpec (#166)
* PipelineRun with embedded pipelineSpec and taskSpec

Closes #143

* Preserve empty string default values

* Remove success_condition and failure_condition
2020-06-23 17:21:19 -07:00
Christian Kadner e509aebb0b
Update E2E tests (#187)
- Break up test cases into 2 sub-tests:
  1. Validate Tekton YAML
  2. Verify PipelineRun logs
- Delete tasks before running pipeline
- Normalize UUID before comparing logs
2020-06-15 11:13:58 -07:00