pipelines/sdk/python/tests/compiler/testdata
Vitalii Vokhmin 2f1db59798
fix(sdk): compile ParallelFor in a deterministic manner (#4926)
* fix(sdk): compile ParallelFor in a deterministic manner

During compilataion ParallelFor components end up with randomized names,
which makes it very inconvenient to compare two versions of a pipeline.
This commit fixes this issue.

* fix(sdk): fix new parallel-for test cases
2021-01-29 18:31:09 -08:00
..
test_data SDK - Compiler - Added support for volume-based data passing (3371) 2020-06-25 16:11:31 -07:00
testpackage Now pipeline function takes direct default values rather than dsp.PipelineParam. (#110) 2018-11-26 17:13:55 -08:00
README.md Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00
add_pod_env.py add_pod_env op handler (#1540) 2019-07-08 11:42:35 -07:00
add_pod_env.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
artifact_passing_using_volume.py SDK - Compiler - Added support for volume-based data passing (3371) 2020-06-25 16:11:31 -07:00
artifact_passing_using_volume.yaml test(sdk) Restored the ParallelFor compiler test data (4103) 2020-06-29 01:30:14 -07:00
basic.py fix(sdk): SDK - Avoiding deprecated ContainerOp methods (#4134) 2020-07-14 17:02:37 -07:00
basic.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
basic_no_decorator.py fix(sdk): SDK - Avoiding deprecated ContainerOp methods (#4134) 2020-07-14 17:02:37 -07:00
basic_no_decorator.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
coin.py Support replacable arguments in command as well (besides arguments) in container op. (#623) 2019-01-07 07:57:36 -08:00
coin.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
compose.py Now pipeline function takes direct default values rather than dsp.PipelineParam. (#110) 2018-11-26 17:13:55 -08:00
compose.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
default_value.py WithItems Support (#1868) 2019-08-23 21:00:28 -07:00
default_value.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
imagepullsecrets.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
input_artifact_raw_value.py SDK - Added support for raw input artifact argument values to ContainerOp (#791) 2019-08-28 21:09:57 -07:00
input_artifact_raw_value.txt SDK - Added support for raw input artifact argument values to ContainerOp (#791) 2019-08-28 21:09:57 -07:00
input_artifact_raw_value.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
kaniko.basic.yaml [SDK] Make service account configurable for build_image_from_working_dir (#3419) 2020-04-15 00:06:02 -07:00
kaniko.kubeflow.yaml [SDK] Make service account configurable for build_image_from_working_dir (#3419) 2020-04-15 00:06:02 -07:00
loop_over_lightweight_output.py fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
loop_over_lightweight_output.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
opsgroups.py fix(sdk): Fix opsgroups dependency resolution (#4370) 2020-08-27 09:03:53 -07:00
opsgroups.yaml fix(sdk): Fix opsgroups dependency resolution (#4370) 2020-08-27 09:03:53 -07:00
parallelfor_item_argument_resolving.py fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
parallelfor_item_argument_resolving.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
parallelfor_pipeline_param_in_items_resolving.py fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
parallelfor_pipeline_param_in_items_resolving.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
param_op_transform.py Samples - Cleaned up unnecessary usage of PipelineParam (#1631) 2019-07-23 14:16:15 -07:00
param_op_transform.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
param_substitutions.py Fix PipelineParam pattern bug (#1300) 2019-05-09 15:43:58 -07:00
param_substitutions.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
pipelineparams.py WithItems Support (#1868) 2019-08-23 21:00:28 -07:00
pipelineparams.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
preemptible_tpu_gpu.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
recursive_do_while.py Recursion bug fix (#1061) 2019-04-02 09:49:19 -07:00
recursive_do_while.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
recursive_while.py fix recursion bug (#1583) 2019-07-01 16:55:08 -07:00
recursive_while.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
resourceop_basic.py Extend the DSL to implement the design of #801 (#926) 2019-04-25 10:40:48 -07:00
resourceop_basic.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
sidecar.py Feature: sidecar for ContainerOp (#879) 2019-03-28 11:11:30 -07:00
sidecar.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
timeout.py Add timeout out in dsl (#1465) 2019-06-06 17:42:10 -07:00
timeout.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
tolerations.yaml SDK - Persisting all output values (#2134) 2019-09-16 19:44:24 -07:00
uri_artifacts.py feat(sdk): Artifact metadata related placeholder for components. (#5003) 2021-01-19 08:57:45 -08:00
uri_artifacts.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
volume.py return self for container op initialization methods to allow chaining the construction (#313) 2018-11-19 16:46:55 -08:00
volume.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
volume_snapshotop_rokurl.py Extend the DSL to implement the design of #801 (#926) 2019-04-25 10:40:48 -07:00
volume_snapshotop_rokurl.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
volume_snapshotop_sequential.py [Testing] Use google/cloud-sdk:279.0.0 to resolve workload identity flakiness (#3019) 2020-02-11 18:34:07 -08:00
volume_snapshotop_sequential.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
volumeop_basic.py Extend the DSL to implement the design of #801 (#926) 2019-04-25 10:40:48 -07:00
volumeop_basic.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
volumeop_dag.py Extend the DSL to implement the design of #801 (#926) 2019-04-25 10:40:48 -07:00
volumeop_dag.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
volumeop_parallel.py Extend the DSL to implement the design of #801 (#926) 2019-04-25 10:40:48 -07:00
volumeop_parallel.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
volumeop_sequential.py Extend the DSL to implement the design of #801 (#926) 2019-04-25 10:40:48 -07:00
volumeop_sequential.yaml chore: Rollback telemetry related changes (4088) 2020-06-27 15:46:14 -07:00
withitem_basic.py fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withitem_basic.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withitem_nested.py fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withitem_nested.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withparam_global.py fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withparam_global.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withparam_global_dict.py fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withparam_global_dict.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withparam_output.py fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withparam_output.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withparam_output_dict.py fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00
withparam_output_dict.yaml fix(sdk): compile ParallelFor in a deterministic manner (#4926) 2021-01-29 18:31:09 -08:00

README.md

To generate golden workflow yaml, for now please check the comments in compiler_tests.py.

Once you generate a workflow yaml, please also test it with argo to make sure it is "golden".