Commit Graph

101 Commits

Author SHA1 Message Date
Yuan Gong 1c66f93f51 chore(release): bumped version to 1.6.0 2021-05-24 13:36:51 +08:00
Yuan Gong bc329aa816 chore(release): bumped version to 1.6.0-rc.0 2021-05-13 07:17:55 +00:00
Alexey Volkov cc83e1089b
Assigned copyright to the project authors (#5587) 2021-05-05 13:53:22 +08:00
Yuan (Bob) Gong 3d72a2d9d5
chore(release): bump version to 1.5.0 on master branch (#5508) 2021-04-20 01:51:38 -07:00
Yuan Gong 3b5030aefa chore(release): bumped version to 1.5.0-rc.3 2021-04-09 13:28:26 +00:00
Yuan Gong f870570a79 chore(release): bumped version to 1.5.0-rc.2 2021-04-02 10:06:48 +00:00
Yuan Gong 1cd189567d chore(release): bumped version to 1.5.0-rc.1 2021-04-01 11:59:53 +08:00
Yuan Gong d2c66deb93 chore(release): bumped version to 1.5.0-rc.0 2021-03-22 21:25:52 +08:00
Yuan (Bob) Gong 8b3d741c6e
chore(release): after release, also bump master to 1.4.1 (#5196)
* update release instructions

* chore(release): bump version to 1.4.1

* Update setup.py
2021-03-01 12:10:16 -08:00
Luis Magana 5df2801603
feat(backend): Added multi-user pipelines (UI + API); Fixes #4197 (#4835)
* Added multi-user pipelines backend


corrected typo


updating code based on review


fixes for pipelines server


reverting this back

* removing unnecessary info logging
2021-02-26 06:10:15 -08:00
Yuan (Bob) Gong 706c105c8c
chore(api): build api clients using a prebuilt image (#5150)
* chore(api): build api clients using a prebuilt image

* Update Makefile
2021-02-19 10:27:44 -08:00
Niklas Hansson e669b22954
fix(backend): remove Bazel from building the API. Part of #3250 (#4906)
* updated to remove bazel

* rename@

* script to run in container

* update the generation

* updated docker image

* changed name

* updated the code

* regenerated API

* fix env variables

* updated version of go swagger

* rerun generate with updated package

* added healthz

* typo with folders fixed

* changed version

* set version of protoc compiler

* test if version is correct

* test version

* changed version

* updated version agian

* test version

* the latest test

* updated docker image

* fixed some stuff

* new test

* tested other version

* new tests

* changed swagger

* new test

* updated versions

* missed docker file

* updated files@

* change back

* updated after feedback@

* clean up

* remove license and install binary

* update and check differences

* completed rebase

* go mod tidy

* updated based upon work of boby

* remove code commited by misstake

* added by misstake

* updated after feedback

* futher updates after feedback

* final updates from feedback

* switch to Makefile

* update

* fix non-root execution

* clean up, fix release script

* fix swagger

* fix healthz endpoint & regenerate python client

* Delete sample.py.tar.gz

Co-authored-by: Yuan Gong <gongyuan94@gmail.com>
Co-authored-by: Yuan (Bob) Gong <4957653+Bobgy@users.noreply.github.com>
2021-02-16 16:58:30 -08:00
Rui Fang 2b95c002b7 chore(release): bumped version to 1.4.0 2021-02-12 09:31:46 +00:00
Yuan (Bob) Gong 3d40bba9a3
chore(backend): clean up backend code generation (#5116)
* chore(backend): tidy go.mod and update tools.go

* go install, instead of go get

* fix problems reported by go vet

* simplify some ide reported redundant syntax

* license is not required for generated code

* remove licenses for generated code

* cleanup

* remove license more

* rm unused BUILD.bazel files

* fixed generate_api.sh

* reimport error.proto
2021-02-09 07:10:57 -08:00
Yuan (Bob) Gong 5725bb85ed
chore(backend): tidy go.mod & update tools.go & fix go vet (#5110)
* chore(backend): tidy go.mod and update tools.go

* go install, instead of go get

* fix problems reported by go vet

* simplify some ide reported redundant syntax
2021-02-08 11:06:56 -08:00
Chen Sun 26de102f82 chore(release): bumped version to 1.4.0-rc.1 2021-02-01 00:18:50 -08:00
Yang Pan c484cfa46c chore(release): bumped version to 1.3.0 2021-01-07 00:39:26 -08:00
Chen Sun 5445ce82c7 chore(release): bumped version to 1.2.0 2020-12-17 23:24:32 -08:00
numerology 1449cfe0a5 chore(release): bumped version to 1.1.2 2020-12-14 09:43:07 -08:00
Yuan (Bob) Gong 6895f1977b
chore(backend): delete outdated backend/api/Makefile. Fixes #4717 (#4893) 2020-12-13 18:05:28 -08:00
Rui Fang a0a1a5d0cf chore(release): bumped version to 1.1.2-rc.1 2020-12-04 07:09:17 +00:00
hilcj c1aebb5d22 chore(release): bumped version to 1.1.1-beta.1 2020-11-26 17:58:04 +00:00
hilcj 4fe4a30545 Revert "chore(release): bumped version to 1.1.1-beta.1"
This reverts commit 9af3e79c10.
2020-11-26 16:10:10 +00:00
hilcj 9af3e79c10 chore(release): bumped version to 1.1.1-beta.1 2020-11-26 04:32:09 +00:00
hilcj bd86072a8c Revert "chore(release): bumped version to 1.1.1.beta.1"
This reverts commit 5928a2659b.
2020-11-26 04:20:10 +00:00
hilcj 5928a2659b chore(release): bumped version to 1.1.1.beta.1 2020-11-26 03:07:26 +00:00
DavidSpek 0df9473bba
feat: Set current namespace for in-cluster SDK in multi-user mode and add healthz endpoint to API backends (#4638)
* Set current namespace in local KFP context if running from notebook

* Create "~/.config/kfp/" instead of ".config/kfp/"

At first it was assumed the `get_user_namespace` command would be executed from the home directory.

* Create local context file if it doesn't exist during set_user_namespace

* Grab path from LOCAL_KFP_CONTEXT when creating folder

Instead of harcoding the os.mkdirs path to `~/.config/kfp` it now grabs it from the LOCAL_KFP_CONTEXT. Also, removed path creation in `get_user_namespace` as that is now handled in `set_user_namespace`. Also, it now checks if the path exists rather than the local_context_file to remove the situation where it tries to create ~/.config/kfp/ because the context.json doesn't exist when the path does.

* add multi-user setting to healthz api

* Add http prefix to health api url

* move healtz api call to own function and fix multi_user boolean

* Fix HEALTH_PATH declaration

* Move check to Client __init__ and change get_kfp_healthz to avoid breaking in case of old apiserver image

* Add multi_user to frontend healthz

* Expose multi_user in frontend and add integration test

* Fix integration test

* Fix host hardcoding and error handling

* Handle empty API response, check if API up to date

* Fix response return

* remove API check due to empty response

* retry API call if first response empty

* retry getting healthz api if no response

* change health_api to https

The healthz_api has been returning empty responses which might be caused by sending an http request to an https endpoint. Although requests handles redirects, this commit is to test if this solves the issue.

* Add some debug info to healthz exception

* add url to debug and lower retries to 1

* Use api_client to get healthz data

* Debug info for API response

* Follow API redirect history

* Fix indentation

* Add healthz proto

* Try getting healthz api with new python backend

* Add installation of kfp_server_api in tests

* Fix incorrect setup location

* Replace old .get with new http backend .multi_user

* Code clean up

* Small fixes and TimeOutError for retries healthz api

* Remove changes to go dependencies

* Send empty proto request and fix exception client

* Remove unused commit_sha and tag_name
2020-11-24 15:36:39 -08:00
Yuan Gong 7d36f48482 chore(release): bumped version to 1.1.0-alpha.1 2020-11-02 03:01:27 +00:00
Niklas Hansson 5742991c1a
feat(API): exposing api for setting the default version of pipeline. Fixes #4049 (#4406)
* initial work on exposing the default version of pipeline

* update description

* added missing files

* updated api build, unsure if this is correct ...

* updated after feedback

* clean up

* remove empty line

* started to make the integration test

* added integreation test

* fixed build and feedback

* updated the tests

* Updated the test

* new test

* typo

* updated the pipeline default

* updated the pipeline version

* formatting

* error in comparison
2020-10-15 16:19:25 -07:00
Yihong Wang 06bf42998e
chore(backend): remove unused import in .proto (#4448)
nit: Clean up unused `import`s in proto files.
Since no actually code change, code gen is skipped.
2020-09-22 00:28:47 -07:00
Yuan (Bob) Gong d91a0c9da1
chore(release): bump version to 1.0.1 on master branch (#4492)
* chore(release): bump version to 1.0.1 on master branch

* remove rc changelog
2020-09-14 01:28:58 -07:00
jingzhang36 b6c2c2aee6
doc: readme for how to auto-generate api reference from the backend api definitions (#4348)
* enable pagination when expanding experiment in both the home page and the archive page

* Revert "enable pagination when expanding experiment in both the home page and the archive page"

This reverts commit 5b672739dd.

* add a quick guide on how to generate api reference from kfp api definition

* remove trailing lines
2020-08-10 21:12:16 -07:00
Yuan (Bob) Gong 988f5b02e4
chore(release): bump version to 1.0.0 on master branch (#4249) 2020-07-20 02:04:51 -07:00
Yuan (Bob) Gong f456ee9768
doc(sdk/client): fix kfp-server-api py client's docstring format (#4047)
* Pull templates from upstream 4.3.1

* update templates according to OpenAPITools/openapi-generator/pull/6391

* regenerate python client
2020-06-23 06:21:45 -07:00
Yuan (Bob) Gong c6ac5e0b1f
[Python Client] Clean up generated python client template to facilitate version bump (#3937)
* Remove version from generated python client header comment

* Regenerate client

* Bump to 1.0.0-dev.2 to showcase version bump diff
2020-06-09 18:20:04 -07:00
Yuan (Bob) Gong 04e23d2a05
[Release] Regenerate api clients on release (#3910)
* [Release] Regenerate api clients on release

* Fix hack/release.sh

* Add a script to check required tools

* update

* Update

* Update clean up
2020-06-04 13:24:16 +08:00
Yuan (Bob) Gong 4f34be6f01
[API] Add license header to python api client files (#3897)
* Regenerate clients after proto description fix

* Add LICENSE to api python client

* Add license header to python files

* Revert unintended changes
2020-06-04 10:23:24 +08:00
Yuan (Bob) Gong 7dfb34edc8
Regenerate clients after proto description fix (#3895) 2020-06-03 01:52:17 -07:00
Yuan (Bob) Gong 36eba13efb
[Python Client] Use openapi generator instead of swagger (#3872)
* Generate python client package into repo using kfp_api_single_file.swagger.json

* Commit python client generated by swagger

* Use openapi-generator instead

* Regenerate using openapi-generator

* Add extra info into swagger single file

* Update more info

* update

* Move python http client to upper folder

* Clean up build script

* Update kfp_server_api from new swagger.json
2020-06-02 21:18:17 -07:00
Amy 5d302b6edb
fix typo on sort order: 'des' --> 'desc' (#3893) 2020-06-02 18:00:17 -07:00
jingzhang36 286492591b
More documentation on backend API methods (#3758)
* list experiment desc

* changes should be made in proto

* add comments and descriptions

* comments/descriptions in run.proto

* comments in job.proto and pipeline.proto

* try starting a new line

* newline doesnt help

* add swagger gen'ed file

* address comments

* regenerate json and client via swagger

* address comments

* regenerate go_http_client and swagger from proto

* two periods

* re-generate
2020-06-01 12:26:25 +08:00
Yuan (Bob) Gong c38f36cdc1
[Backend] Add service account field to run and job api objects (#3649)
* Add service account field to run and job api objects

* Update description

* Fix field casing

* Add comment about the next field number
2020-04-29 22:58:17 -07:00
Yuan (Bob) Gong b61944458a
[Backend] Authorization service (#3627)
* Authorization service proto

* implement auth service

* Add unit tests
2020-04-27 16:42:04 -07:00
Chen Sun c4fb79447c
[API] Include namespace in visualization.swagger.json (#3588)
* include namespace in CreateVisualization

* include namespace in post body

* put namespace in the path and in front of visualization

* post /apis/v1beta1/visualizations/{namespace}
2020-04-23 13:44:06 -07:00
Chen Sun c3a0230747
[Backend][Multi-user] Support creating visualization in user namespace (#3495)
* Add namespace field to CreateVisualizationRequest

* Support getting visualization service URL with namespace

* fix typo

* Add auth checking & allow empty namespace
2020-04-17 19:11:37 -07:00
jingzhang36 60f896bacc
Upload pipeline/pipeline version with a description (#3511)
* add desscription to client interface

* autogen

* version doesn't have description field

* swagger autogen

* remove two accidentally committed local python package
2020-04-17 15:36:04 +08:00
jingzhang36 56d519e9f7
Add archive experiment feature in backend (#3359)
* add new field in db schema and api schema

* auto genereted types for experiment storage state

* add archive and unarchive methods to backend for experiments.

* auto generated archive/unarchive methods for epxeriments

* add archive and unarchive to client

* set proper storage state when creating experiment

* retrieve storage state when we get/list epxeriment(s)

* change expection in test to have storage state

* add storage state in resource manager test

* revise experiemnt server test

* revise api converter test

* integration test of experiment archive

* archive/unarchive experiment affect the storage state of runs in it

* test all the runs in archive/unarchive experiment

* test all runs are archived/unarchived with their experiment in experiment server

* integration test

* integration test: value type mismatch in assertion

* unused import; default value for storage state

* autogen code for frontend

* reorder the fields in api experiment schema

* switch the position of the two enum to verify a hypothesis

* Put a place hodler to prevent any valid item to take the value 0

* Get rid of the place holder since the cause of issue related to value 0 is found and fixed.

* The returned api experiment now has storage state field

* create experiment return doesn't contain storege state

* Cleanup needs to clean runs and pipeliens now

* a missing client

* use resource reference as fileter instead of experiment uuid

* use same namespace in archive unit test

* Leave archive/unarchive experiment integration test to a separate PR

* also need to update jobs when experiments are archived

* Change of unarchiving logic. When experiment is unarchived, jobs/runs in
it stay archived

* add unit test for the job status in archived/unarchived experiment

* change archive state to 3 value enum; add experiment integration test

* make archive state 3 value enum to avoid 0 value mapped to available; add integration test

* run swagger autogen

* fix an expected value

* fix experiment server test

* add job check in experiment server test

* update job crds

* fix a typo

* remove accidentally included irrelevant changes
2020-04-16 07:31:09 +08:00
Chen Sun 2f1dbbedd2
Experiment API change (#3198) 2020-03-06 09:17:23 -08:00
Yuan (Bob) Gong 688aa08d42
Release 0.2.5 - e66dcb1860 (#3179)
* Updated component images to version e66dcb1860

* Updated components to version 3f4b80127f

* Update setup.py

* Fix swagger codegen download url

* Update versions
2020-02-26 23:59:19 -08:00
jingzhang36 80fc767eb8
Fix a missing query parameter in swagger json file for version upload api (#3160)
* add pipelineid to api parameter

* Backend swagger autogent

* Reverse a local change

* Reverse another local change
2020-02-24 19:44:15 +08:00