kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
pipelines/sdk/python/test_data
History
Connor McCarthy 525ff90684
chore(sdk): extract DSL into `kfp-dsl` package (#9738) 
* move dsl dir

* make kfp-dsl a package

* make kfp-dsl a package

* additional changes

* address review feedback
 		2023-07-25 23:34:02 +00:00
..
components chore(sdk): extract DSL into `kfp-dsl` package (#9738) 2023-07-25 23:34:02 +00:00
pipelines chore(sdk): extract DSL into `kfp-dsl` package (#9738) 2023-07-25 23:34:02 +00:00
v1_component_yaml test(sdk): create SDK execution test suite and restructure read/write tests (#8245) 2022-09-12 18:33:06 +00:00
README.md chore(sdk): update golden snapshots with pipeline interface comments (#8575) 2022-12-15 01:32:21 +00:00
test_data_config.yaml feat(sdk): support compiling components with `dsl.PipelineTaskFinalStatus` type (#9082) 2023-05-12 22:14:28 +00:00

README.md

KFP SDK Test Data

Test data in this directory is used for two separate test suites.

  1. Read/write tests

Location: sdk/python/kfp/compiler/read_write_test.py

Tests the compiler (write) and load (read) functionality of the SDK. This ensures that pipelines are written and read correctly and idempotently.

These tests require golden snapshots of pipelines and components against with compiled pipelines are compared. To update pipeline golden snapshots:

for f in sdk/python/test_data/pipelines/*.py ; do echo "$f" && python3 "$f" ; done

To update component golden snapshots:

for f in sdk/python/test_data/components/*.py ; do echo "$f" && python3 "$f" ; done
  1. Pipeline execution tests

Location: test/sdk-execution-tests.py

These tests ensure that the KFP OSS BE can execute the pipelines. execute: may be false in the test_data_config.yaml for a given test_case if the test case (a) isn't a complete example (e.g., a dependency doesn't exist in the image, etc.) or (b) the KFP OSS BE cannot execute the pipeline.