Commit Graph

36 Commits

Author SHA1 Message Date
Mathew Wicks 02e00e8439
fix(sdk): type annotation for client credentials (#10158) 2023-10-26 01:39:10 +00:00
gkcalat c9032716ab
fix(sdk): Fix OOB for IPython and refactor. Closes #10075. (#10094)
* Fix OOB for IPython and refactor. Closes #10075.

* Address comments
2023-10-13 22:24:52 +00:00
Connor McCarthy c8204d0285
chore(sdk): partition KFP SDK source code into runtime and non-runtime code (#9710) 2023-07-07 23:18:52 +00:00
Chen Sun c33afa74f3
chore(sdk): relax name validation when upload pipeline (#9646)
* relax name validation when upload pipeline

* fix typo
2023-06-16 22:20:36 +00:00
Tommy Li 4d2a1cf173
fix(sdk): Optimize wait_for_run_completion sdk function to skip an extra wait (#9407) 2023-05-12 21:49:28 +00:00
Chen Sun 3ad91a9bbe
chore: release KFP SDK 2.0.0-beta.17 (#9355)
* Release KFP SDK 2.0.0-beta.17

* update release note
2023-05-08 17:42:55 +00:00
Chen Sun 91277b1e91
fix(SDK): fix `client.run_pipeline` with `pipeline_id` and `version_id` gives error (#9191) 2023-04-20 21:17:40 +00:00
Chen Sun a107fb1bcf
chore: release SDK 2.0.0b14 (#9144)
* release SDK 2.0.0b14

* doc ref
2023-04-12 14:29:29 -07:00
Chen Sun 952e0730a8
feat(sdk): Support submitting pipeline with platform config. (#9140)
* SDK client v2beta1 API integration.

* fix unit tests

* create alias for use of methods and fields referencing `job`.`

* fix cli

* fix pipeline list-versions

* more cli fixes

* client fix

* Support submitting pipeline with platform spec.

* unit test

* move util functions
2023-04-12 13:06:12 -07:00
Chen Sun 07d6c1816b
feat(SDK)!: SDK client v2beta1 API integration. Fixes #8706 (#9112)
* SDK client v2beta1 API integration.

* fix unit tests

* create alias for use of methods and fields referencing `job`.`

* fix cli

* fix pipeline list-versions

* more cli fixes

* client fix
2023-04-12 09:54:45 -07:00
Alex 3e1f3c6d7a
feat(sdk): add experiment_id parameter to create run methods (#9004)
Co-authored-by: alenawang <alena.n.wang@gmail.com>
Co-authored-by: andreafehrman <andrea.k.fehrman@vanderbilt.edu>
Co-authored-by: owmasch <owenmaschal0598@gmail.com>
Co-authored-by: ryanrusson <ryan.russon@gmail.com>
2023-03-24 09:56:48 -07:00
Tara Tufano e50f40305d
fix(sdk): fix upload_pipeline when no pipeline name is provided (#8695) 2023-01-31 13:45:39 -08:00
Alex 5adc7f1b50
chore(sdk): clean up client.py (#8656) 2023-01-17 11:04:46 -08:00
Connor McCarthy f4588f3112
chore(sdk): idiomatic Python pure refactorings (#8537)
* use f-strings

* inline immediately returned variables

* simplify comprehension

* use list literals

* lift return statements into control flow blocks

* other pure refactorings

* remove passthrough function

* use a ternary when it improves readability

* use __getitem__ for regex match groups; introduced in Python 3.6

* fix changed comments

* revert one change
2022-12-06 23:44:36 +00:00
Alex 1d6a52b9ff
fix(sdk): print max_attempts instead of sleep_duration (#8523) 2022-12-02 19:32:16 +00:00
andreafehrman b26dd100e1
test(sdk): implement small tests for Client class (#8517)
Co-authored-by: droctothorpe <mythicalsunlight@gmail.com>

Co-authored-by: droctothorpe <mythicalsunlight@gmail.com>
2022-12-01 19:39:45 +00:00
Connor McCarthy 834bfbe90a
fix(sdk): revert premature client changes (#8507)
* revert _v1 client changes

* do not install kfp_server_api from source
2022-11-29 20:39:23 -08:00
Lingqing Gan 3f2e20d14f
chore(backend): regenerate v1beta1 api clients (#8403)
* add v2 experiment.proto

* regenerate v1beta1 client

* remove api version from combined swagger file

* Revert "regenerate v1beta1 client"

This reverts commit 02769d779b.

* regenerate v1beta1 clients

* regenerate python packages without api version

* remove regenerated v1 python packages&change proto

* refactor v1 exp apis and functions

* remove v2 api package and refactor v1 proto

* regenerate v1 go clients

* regenerate v1 python package

* refactor and update the human maintained swagger

* renew swagger file

* regenerate v1 packages

* regenerate v1 python package

* refactor

* regenerate v1 go clients

* regenerate v1 python package

* recover dockerfile and add s in python

* fix func name

* use commit for sdk execution test

* change sdk execution test

* update test script

* add v1 to methods

* proto update v1 method names

* regenerate v1 go packages

* regenerate python client

* update server methods

* refactor

* refactor

* refactor

* refactor python client

* fix get_healthz

* update sample-test.sh in v2 backend

* sample test script

* change v2 sample test

* change package install order

* Revert "change package install order"

This reverts commit c24fcfbed9.

* use KFP server api from commit for v2 sample tests

* small fix
2022-11-10 19:18:00 +00:00
gkcalat 65f2b644df
fix(sdk): Replace OOB authentication with loopback flow (#8262)
* Replace oob authentication with loopback flow. Fixes #7474. Closes #7526.

* Replace oob authentication with loopback flow. Fixes #7474. Closes #7526.

* Improve error messages

* Resolve comments in the PR

* Fix refresh/access token misconception

* Fix type hint annotation
2022-09-15 23:27:24 +00:00
Connor McCarthy 16c7d6658e
test(sdk): create SDK execution test suite and restructure read/write tests (#8245)
* update client for graph components

* use yaml for config

* simplify read write tests

* add test script

* restructure yaml and read/write tests

* add execution test file

* move test_data; update paths; update readme

* update kfp endpoint

* update pipeline with env

* update logging

* update config

* update kfp endpoint and timeout

* add kfp as requirement

* mock kfp_package_path for lightweight component execution

* revert pipeline name changes

* update config with name

* update read write tests to use explicit name

* update execution tests to use explicit name
2022-09-12 18:33:06 +00:00
Alex 92a1e1fe26
feature(sdk): print links outside of ipython. Fixes #8141 (#8142) 2022-09-09 00:00:27 +00:00
Connor McCarthy e14a784327
feat(sdk): migrate v1 auth to v2 (#7789)
* initial auth migration (@ji-yaqi)

* clean up files

* update imports

* add type annotations

* update docstrings

* add tests
2022-09-06 17:54:29 -06:00
Connor McCarthy c6a5e387dd
docs(sdk): refresh SDK public API docstrings (#8057)
* add module-level docstrings

* update compiler docstrings

* update registry module docstrings

* add BaseComponent and children to public api, but discourage use

* update artifact docstrings and type annotations

* update dsl docstrings

* update client docstrings

* clean up kfp.__init__

* add dsl placeholder docstrings

* many more docstring updates

* document type aliases in dsl module
2022-07-21 19:51:18 +00:00
Connor McCarthy 13736b85b6
chore(sdk): clean up kfp code style (#8027)
* remove unused imports

* use google as isort profile

* sort imports

* format with yapf

* clean end of file new line, trailing whitespace, double quoted strings
2022-07-15 00:06:34 +00:00
Scott_Xu b95c5aba85
feat(sdk/client): implements overriding caching options at submission (#7912)
* implement override caching options for client

* use absolute path in test for overriding caching

* format code and add unit tests from pipeline

* delete typo

* add two-step pipeline test and review changes

* fix formatting

* fix typo on deprecated code

* update release file

* resolve comments on docstring and testing

* update release file
2022-07-12 16:49:30 +00:00
johnmacnamararseg 9ffcb2e9db
feat(sdk): Add function to sdk client for terminating run (#7835)
* Add function to sdk client for terminating run

* RELEASE notes
2022-06-08 17:08:16 +00:00
Connor McCarthy 101d243f48
feat(sdk): validate pipeline resource name before submission (#7713)
* add pipeline resource name validation

* add pipeline name validation tests

* update downstream pipeline name logic in cli
2022-05-13 20:12:41 +00:00
Connor McCarthy 1ae6e11bab
feat(sdk): make client return values consistent (#7659)
* clean up client.py

* update client method return values

* update other types

* use preferred path to kfp_server_api classes

* fix incorrect module name

* other type annotation cleanup

* make docstrings consistent
2022-05-10 14:35:12 -06:00
Connor McCarthy ec0081372a
feat(sdk): improve cli help text (#7618)
* add docstring parsing utils

* implement docstring parsing for help text

* implement smoke test of all cli commands

* clean up use of optional in docstring

* make command descriptions more consistent

* fix disable_type_check

* update release notes
2022-04-29 17:20:57 +00:00
Alex 2636727141
feat(sdk): add archive, unarchive, and delete run methods and tidy docstrings (#7562) 2022-04-25 19:05:11 +00:00
Connor McCarthy 2494447578
feat(sdk): add .list_pipeline_versions and .unarchive_experiment methods to Client (#7563)
* add client methods

* update release notes
2022-04-14 21:28:38 +00:00
Connor McCarthy c98f14abb4
chore(sdk): make field order in compile deterministic (#7520)
* apply docformatter

* use sort_keys=True in compiler

* update golden snapshots

* set other sort_keys=True

* update structures_test yamls
2022-04-06 21:46:13 +00:00
Chen Sun 9e708b9208
fix(sdk): fix yaml support `create_run_from_pipeline_func` (#7500) 2022-04-01 19:18:25 +00:00
Chen Sun dfc85b0a0d
feat(sdk)!: Support submitting pipeline IR in yaml format via `kfp.client` (#7458)
* support yaml payload for pipeline manifest

* release note
2022-03-23 22:48:46 +00:00
Hao Xin a5a8c750b5
chore: fix ref link (#7434) 2022-03-17 16:03:11 +00:00
Chen Sun b741926bb4
feat(sdk): client to support KFP v2 API. (#7411)
* copy _client.py and _auth.py from deprecated folder

* Make kfp.Client support v2 API (IR).

* fix test golden

* address comments

* copyright year

* chore(backend): clean up pipelinespec.Value usage (#7407)

* chore(sdk): clean, dedup, reconcile, organize requirements (#7400)

* chore(sdk): clean, dedup, reconcile, organize requirements

* apply yapf formatting

* correct copyright

* chore(sdk): fix test missing tempdir cleanup (#7403)

* chore(sdk): fix test missing tempdir cleanup

* fix test path

* fix test path

* clean up setUp method

* change string placeholder from s to test_dir

* release note

Co-authored-by: Connor McCarthy <mccarthy.connor.james@gmail.com>
2022-03-15 21:45:37 +00:00