Commit Graph

13 Commits

Author SHA1 Message Date
Connor McCarthy 13736b85b6
chore(sdk): clean up kfp code style (#8027)
* remove unused imports

* use google as isort profile

* sort imports

* format with yapf

* clean end of file new line, trailing whitespace, double quoted strings
2022-07-15 00:06:34 +00:00
Chen Sun d6e4a34c50
feat(sdk): Add pipeline_task_name to PipelineTaskFinalStatus (#7464)
* Add pipeline_task_name to PipelineTaskFinalStatus

* release note
2022-03-25 20:48:11 +00:00
Connor McCarthy 247672c75c
chore(sdk): fix test missing tempdir cleanup (#7403)
* chore(sdk): fix test missing tempdir cleanup

* fix test path

* fix test path

* clean up setUp method

* change string placeholder from s to test_dir
2022-03-14 21:25:40 +00:00
Yaqi Ji 8bb0d0e025
feat(sdk)!: move v2 to main namespace (#7376)
* feat(sdk)!: move v2 to main namespace

* edit samples
2022-03-04 21:56:51 +00:00
Ajay Gopinathan f3f383c2ff
chore(sdk): Refactor and move all v2 related code to under the v2 namespace. (#6358)
* Refactor and move all v2 related code to under the v2 namespace.

Most of the changes are around imports and restructuring of the
codebase. While it looks like a lot of code was added, most of the code
already existed and was simply moved or copied over to v2. The only
exceptions are:
- under kfp/v2/components/component_factory.py: some helper functions
  were copied with simplification from _python_op.py
- we no longer strip the `_path` suffix in v2 components.

Note: there is still some duplication of code (particularly between
component_factory.py and _python_op.py), but it's ok for now since we
intend to replace some of this with v2 ComponentSpec + BaseComponent.

* Update setup.py.

* update tests.

* revert accidental change of gcpc

* Fix component entrypoint.

* Update goldens.

* fix tests.

* fix merge conflict.

* revert gcpc change.

* fix tests.

* fix tests.

* Add type aliases for moved files.

* merge and update goldens.
2021-08-17 19:25:37 -07:00
Yuan (Bob) Gong a95bfd66c2
feat(v2/dsl): support minio & s3 artifacts in v2 python component. Fixes #5838 (#5909)
* feat(v2/dsl): support minio & s3 artifacts in v2 python component

* fix minio output artifact key

* fix

* fix
2021-06-24 00:47:19 -07:00
Alexey Volkov cc83e1089b
Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
Ajay Gopinathan e4c6e12564
fix(sdk): Fix a bug with creating dirname for parameter files in v2 lightweight components (#5574)
* Fix a bug with creating dirname for parameter files.

* Add test as well.
2021-04-30 10:15:31 -07:00
Ajay Gopinathan b46f1b86f1
fix(sdk): Update syntax for lightweight components v2. (#5568)
* Update syntax for lightweight components v2.

Use Input[T] and Output[T] for representing input/output artifacts
of type T. This enables users to see these annotations as merely the
classes T, enabling autocompletion, reducing verbosity and simplifying
I/O types code. Users also no longer

Other changes include:
- no longer need to use .get() to obtain the artifact class
- no auto-creation of the `data` file for output artifacts. This enables
  artifacts to be either directories or files.

* fix for Py 3.6

* Remove stray file.

* Add error message if Input/Output are used with non Artifact types.

* Fix e2e test.
2021-04-29 19:27:30 -07:00
Ajay Gopinathan a6a725560c
fix(sdk): Support returning plain tuples in lightweight function components v2. (#5412) 2021-04-01 13:49:20 -07:00
dushyanthsc 0e7e543694
Adds classification metrics type to io_types (#5387)
Change to add support for Classification Metrics to io_types.

Also udpates IO types type_name from kfp. to system.
2021-03-30 20:46:18 -07:00
Ajay Gopinathan 2fc1016cd2
feat(sdk): Support return values in lightweight Python function components v2. (#5384)
* Support return values in lightweight Python function components v2.

* Update for py-39

* fix goldens.

* address PR comments.
2021-03-30 00:21:17 -07:00
Ajay Gopinathan bf8392d914
feat(sdk): Enable InputArtifact/OutputArtifact in lightweight Python-based components (#5378)
* Enable InputArtifact/OutputArtifact in lightweight Python components.

* Add copyright notice.

* Revert bad changes.

* Add executor_test.py

* Move test alongside code.

* Undo experimental change.

* Fix presubmit test script.

* presubmit fix.

* presubmit fix.

* presubmit fix.

* Add sample for v2 compiler.

* Address PR comments.
2021-03-25 14:31:46 -07:00