kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
pipelines/sdk/python/test_data
History
Connor McCarthy 8d00d0eb9a
feat(sdk): support a Pythonic artifact authoring style (#9932) 
* chore(sdk): test observability, refactorings, and cleanup

* implement unified i/o syntax

* clarify container component error message

* address review feedback

* add dill to packages_to_install

* update get_uri logic for KFP and tests

* update execution tests & cleanup
 		2023-10-19 18:49:58 +00:00
..
components fix(sdk): fix --no-deps flag usage (#9982) 2023-09-13 15:31:02 -07:00
pipelines feat(sdk): support a Pythonic artifact authoring style (#9932) 2023-10-19 18:49:58 +00:00
v1_component_yaml
…
README.md chore(sdk): update golden snapshots with pipeline interface comments (#8575) 2022-12-15 01:32:21 +00:00
test_data_config.yaml feat(sdk): support a Pythonic artifact authoring style (#9932) 2023-10-19 18:49:58 +00:00

README.md

KFP SDK Test Data

Test data in this directory is used for two separate test suites.

  1. Read/write tests

Location: sdk/python/kfp/compiler/read_write_test.py

Tests the compiler (write) and load (read) functionality of the SDK. This ensures that pipelines are written and read correctly and idempotently.

These tests require golden snapshots of pipelines and components against with compiled pipelines are compared. To update pipeline golden snapshots:

for f in sdk/python/test_data/pipelines/*.py ; do echo "$f" && python3 "$f" ; done

To update component golden snapshots:

for f in sdk/python/test_data/components/*.py ; do echo "$f" && python3 "$f" ; done
  1. Pipeline execution tests

Location: test/sdk-execution-tests.py

These tests ensure that the KFP OSS BE can execute the pipelines. execute: may be false in the test_data_config.yaml for a given test_case if the test case (a) isn't a complete example (e.g., a dependency doesn't exist in the image, etc.) or (b) the KFP OSS BE cannot execute the pipeline.