Commit Graph

32 Commits

Author SHA1 Message Date
Timur Solovev 8fce00642c SDK: fix setting pipeline-wide artifact_location for ResourceOp and VolumeOp classes and add description field for create_experiment() function (#2025)
* fix setting pipeline-wide artifact_location for ResourceOp and VolumeOp classes

* add description field for create_experiment() function
2019-09-03 21:54:59 -07:00
IronPan 8d5ec83f5e
add connection for inverse proxy (#1993)
* add connection for inverse proxy

* update code

* remove lines

* Update _client.py

* Update _client.py

* Update _client.py
2019-09-03 10:56:51 -07:00
Alexey Volkov ca93033d47 SDK/Client - Added the create_run_from_pipeline_package method (#1523)
I does not add much value over run_pipeline, buy @hongyes proposed adding it for parity.
2019-08-02 14:13:51 -07:00
Yaron Haviv 6e5171452b add support for flexible config (via env var) for the pipline service and UI, fix broken links (pointed to API vs UI service) (#1293)
* add support for flexible config (via env var) for the pipline service and UI, fix broken links (pointed to API vs UI service)

* support https prefix

* change to LF

* init _uihost

* set _uihost from host param if specified no env var

* change config.host to host
2019-07-16 14:26:05 -07:00
Kevin Bache ac833a084b List pipelines (#1588)
* added list_pipelines

* minor update
2019-07-09 18:28:24 -07:00
Fábio Franco Uechi c5cf323bf7 add optional param name to upload_pipeline (#1543) 2019-06-23 13:21:53 -07:00
Alexey Volkov 34cde15152 SDK/Client - Added support for all APIs (#1536) 2019-06-20 20:18:35 -07:00
Alexey Volkov f679f786a1 SDK/Client - Added the upload_pipeline API (#1535)
* SDK - Client Added the upload_pipeline API

* Using _get_url_prefix

Also fixing the URL.
2019-06-20 19:12:37 -07:00
Alexey Volkov 79411b7bba SDK - Fixed import (#1522) 2019-06-18 21:08:33 -07:00
Alexey Volkov 8d5d264b2f SDK - Make it easier to compile and submit a pipeline run (#1484)
* SDK - Make it easier to compile and submit a pipeline run
Adds the `Client.run_pipeline_func_on_kfp(func)` function that compiles the pipeline and submits it for execution on KFP-enabled cluster.

* Renamed run_pipeline_func_on_kfp to create_run_from_pipeline_func
2019-06-17 15:34:15 -07:00
hongye-sun f7eb0ccfaa Load auth from kube config. (#1443)
* Load auth from kube config.

* Return config
2019-06-04 16:19:52 -07:00
IronPan 7447eb3dab update DSL client documentation (#1403)
* update DSL client documentation

* Update _client.py
2019-05-30 21:40:26 -07:00
IronPan 511c10c2f3 Fix auto generated resource link for DSL (#1400)
In case of IAP endpoint, the prefix is https instead of http. without the change the link will be resolved into 
http://https://foo.endpoints.bar.cloud.goog/pipeline
/assign @Ark-kun @hongye-sun
2019-05-30 09:42:24 -07:00
Alexey Volkov 892e3082b7 SDK/Client - Supporting pipeline packages with multiple files (#1207)
* SDK/Client - Supporting pipeline packages with multiple files

* Extracted the pipeline yaml file selection function
2019-05-06 16:11:39 -07:00
Alexey Volkov 467adb5a3b SDK - Separated the generated api client package (#1214)
* SDK - Separated the generated api client package

* Splitting the package build scripts

* Pinning the API client package version

* Moved import kfp_server_api to the top of the file

* Added the Mac OS X prerequisite install instructions

* Moved the build_kfp_server_api_python_package.sh script to the backend dir

* Updated the dependency version span
2019-04-29 15:49:37 -07:00
Alexey Volkov 848d4fb99c SDK - Replaced insecure yaml.load with yaml.safe_load (#1170)
This improves security and gets rid of security warnings.
See https://github.com/yaml/pyyaml/wiki/PyYAML-yaml.load(input)-Deprecation
2019-04-23 15:26:00 -07:00
John Paton 0b40672f96 Make Python Client robust to existing IPython installations (#1186)
* Make Client robust to IPython installations

* Return false directly instead of raising

Co-Authored-By: JohnPaton <john@johnpaton.net>
2019-04-18 17:23:54 -07:00
Alexey Volkov f92024f8eb SDK/Client - Stopped extracting pipeline file to disk during submission (#1178) 2019-04-17 09:22:05 -07:00
Ning 554731e478 dsl generate zip file (#855)
* dsl generate zip file

* minor fix

* fix zip read in the unit test

* update sample tests

* dsl compiler generates pipeline based on the input name suffix

* add unit tests for different output format

* update the sdk client to support tar zip and yaml

* fix typo

* fix file write
2019-03-26 15:14:50 -07:00
hongye-sun dcdff39243 Add optional pipeline_id to run_pipeline api (#968) 2019-03-19 21:04:22 -07:00
hongye-sun f9cea6d793 Create experiment only if it's not exist. (#892)
* Create experiment only if it's not exist.

* Skip error if experiment is not found.

* Use try catch to bypass the not found error.
2019-03-02 11:42:50 -08:00
hongye-sun 69b7fd31de
Support to send default service account jwt token for pipeline client. (#779)
* Support to send default service account jwt token for pipeline client.

* Configure auth for both kfp_run and kfp_experiment APIs
2019-02-11 11:26:38 -08:00
Ning d3c4add0a9 DSL refactor (#619)
* add comments

* relocate functions in compiler to aggregate similar functions; move _build_conventional_artifact as a nested function

* reduce sanitize functions into one in the dsl.

* more comments

* move all sanitization(op name, param name) from dsl to compiler

* sanitize pipelineparam name and op_name; remove format check in pipelineparam

* remove unit test for pipelineparam op_name format checking

* fix bug: correctly replace input in the argument list

* fix bug: replace arguments with found ones

* Sanitize the file_output keys, Matches the param in the args/cmds with the whole serialized param str, Verify both param name and container name

* loosen the containerop and param name restrictions
2019-01-08 20:00:17 -08:00
qimingj 410f9b979f Update sample notebook to clean up deployed models. (#622)
* Update sample notebook to clean up deployed models.

Update SDK client to return correct links in local Jupyter with user's own proxy connection.

* Fix sample tests.
2019-01-04 13:07:30 -08:00
qimingj 6b315d4693 Change "namespace" param to "host" in kfp client so we can use Jupyter outside cluster. (#529)
* Change "namespace" param to "host" in kfp client so we can use Jupyter outside cluster.

* Fix tests.
2018-12-12 23:36:18 -08:00
Ning 886e113f78 Improve get_experiment and list_runs in the python sdk (#508)
* add get_experiment_id and list_runs_by_experiment

* offer only one get_experiment function

* return experiment body instead of id

* simply codes

* simply code 2

* remove experiment_id check in the while loop

* minor bug
2018-12-11 22:02:24 -08:00
nealgao ad1950b8e6 Add notebook sample test: tfx sample (#470)
* add notebook sample tests for tfx

* parameterize component image tag

* parameterize base and target image tags

* install tensorflow package for the notebook tfx sample test

* bug fixes

* start debug mode

* fix bugs

* add namespace arg to check_notebook_results, copy test results to gcs, fix minor bugs
add CMLE model deletion

* install the correct KFP version in the notebook; parameterize deployer model name and version

* fix CMLE model name bug

* add notebook sample test in v2

* add gcp sa in notebook tfx sample and shutdown debug mode

* import kfp.gcp
2018-12-07 10:49:30 -08:00
qimingj 1f8846cf20 Sanitize inputs from SDK when submitting run. (#466) 2018-12-04 16:25:21 -08:00
Alexey Volkov 4f74ae3c0c SDK/Client - Removed import six (#425) 2018-11-30 15:03:59 -08:00
nealgao b39435765d configurable namespaces in sample test and python SDK (#306)
* configurable namespaces in sample test and python SDK

* update run_test.sh

* fix a typo
2018-11-17 00:31:05 -08:00
Yasser Elsayed 0f2e9a3ca8 Job link -> run link (#268) 2018-11-16 22:25:32 -08:00
Pascal Vicaire 633e2ddcc8 Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00