Commit Graph

172 Commits

Author SHA1 Message Date
Chen Sun c5658f09ec chore(release): bumped version to 2.0.5 2023-12-08 18:00:49 +00:00
Chen Sun a226de2197 chore(release): bumped version to 2.0.4 2023-12-01 00:04:16 +00:00
Chen Sun 58ce09e07d chore(release): bumped version to 2.0.3 2023-10-27 04:08:53 +00:00
Chen Sun efe630cf80 chore(release): bumped version to 2.0.2 2023-10-11 20:27:27 +00:00
Chen Sun 40c759f431
chore(release): bump version to 2.0.1 on master branch (#9899) 2023-08-17 14:49:40 -07:00
Chen Sun e03e312193 chore(release): bumped version to 2.0.0 2023-06-20 16:54:58 +00:00
Linchin 923b67e38f chore(release): bumped version to 2.0.0-rc.2 2023-06-13 18:43:09 +00:00
gkcalat 79d8d83ce4
fix(backend): Add creation of pipeline and pipeline version atomically (#9416)
* Add create pipeline and version

* Add CreatePipelineAndVersion

* Add unit tests

* Address comments and add counters

* Add comments to pipeline.proto

* Add e2e test case for CreatePipelineAndVersion
2023-05-18 23:38:46 +00:00
Joe Li cb93fcc5ca chore(release): bumped version to 2.0.0-rc.1 2023-05-12 21:36:20 +00:00
Chen Sun 270257512a chore(release): bumped version to 2.0.0-beta.2 2023-05-08 09:21:48 +00:00
Chen Sun 8645cac9a6
fix(release): Update release image with the latest api-generator (#9198)
* Update release image with the latest api-generator

* Add note to keep api-generator image in sync between dev and release
2023-04-21 16:34:41 +00:00
Chen Sun 7b70cb5e37
fix(api): Regenerate v2beta1 API (#9197) 2023-04-21 14:21:41 +00:00
Linchin e0529fe26b chore(release): bumped version to 2.0.0-beta.1 2023-04-11 19:14:29 +00:00
Chen Sun 4a9bc2b1ca
fix(api): Fix pipeline.upload.swagger.json (#9104)
* fix pipeline.upload.swagger.json

* remove `namespace` from upload_pipeline_version parameters
2023-04-05 18:05:02 +00:00
gkcalat e7fdb7f387
fix(backend): Add pipeline_id to pipeline_source in Run and RecurringRun (#9097)
* Add pipeline_id to run and recurring run protos

* Add pipeline_id to run and recurring_run

* Remove unused commented code

* Add pipeline id verification
2023-04-04 03:55:00 +00:00
Chen Sun 7d3a6e6ebd
fix(backend): Fix CreatePipelineVersion API (#9075)
* fix pipeline_version API

* address review comments
2023-03-31 23:57:04 +00:00
gkcalat caf842de3d
fix(backend): Add pipeline version to the request body (#9056) 2023-03-28 20:15:43 +00:00
gkcalat a4ab066d0e
chore(backend): Remove API dependdency from filter and list packages. Closes #8934 (#8939)
* Stage progress

* Fix comments in the filter.proto.

* Remove api dep from filter and list. Fixes #8934.
2023-03-09 11:37:06 -08:00
gkcalat 06f154250b
fix(backend): Deprecate experiment_id in Run API v2 (#8921) 2023-03-03 20:29:00 +00:00
gkcalat e568148264
fix(backend): Revert the url changes in run API v 2 (#8920) 2023-03-03 18:19:00 +00:00
gkcalat e8f10b1ff9
fix(backend): Add ListAllRuns endpoint (#8901) 2023-02-28 01:49:41 +00:00
gkcalat 1bed63a31e
feature(backed): Status-IR.part-1: Add updating tasks and run statuses to api server (#8850)
* Add children to PipelineTaskDetail

* Add state and state history to task

* Add state and state history to run

* Add pod_name to PipelineTaskDetail

* Add PodName and Payload to tasks table

* Add upsert to task store

* Add create or update task report wf

* Wire the report server

* Remove v1 and v2 specific functions

* Revert Run proto order

* Stage progress

* Add run id to exec spec

* Disable unit test due to #8851

* Address comments

* Address some comment

* Remove empty lines

* Refactor toModelTasks

* Address comments

* Address comments
2023-02-23 00:26:23 +00:00
Chen Sun 8552226c41
chore(test): revert api changes to deprecated client (#8841)
* revert api changes to deprecated client

* list experiments

* fix

* fix sample v2 test
2023-02-14 11:01:58 -08:00
gkcalat c8165859bd
Update API references and readme. Closes #8723 (#8828)
* Update API references and readme. Closes #8723

* Add a note about html headers

* Remove folders, update readme
2023-02-09 23:41:01 +00:00
Chen Sun fd3f694d9a
test: install compatible `kfp-server-api` and `kfp` packages (#8829)
* don't install kfp-server-api and kfp both from HEAD

* install compatible kfp-server-api and kfp
2023-02-09 20:30:01 +00:00
Ablai Akhazhanov 438b16597d chore(release): bumped version to 2.0.0-beta.0 2023-02-07 23:41:29 +00:00
Lingqing Gan 6522e6c48a
fix(backend): add retry run in v2 api. Fixes #8735 (#8804)
* add retry run

* fix typo in comments

* fix proto typo and regenerate

* add logic to verify experiment id

* fix typo
2023-02-07 01:24:32 +00:00
gkcalat 135dc64854
feat(backend): Refactor apiserver, add Pipeline and other v2beta services (#8633)
* Staging WIP

* Fix recurring run, switch to pipeline_version_id

* Regenerate python client

* Refactor packages for pipeline service v2

* Stage progress

* Add support for pipeline service v2beta1

* Go mod tidy

* Update licenses

* Set default namespace to be empty

* Separate deletion of pipeline versions

* Change report ReportRunMetrics to obey AIP

* Use pipeline version id in run proto

* Update run.proto

* Upgrade storage

* Remove dependencies on api

* Stage refactoring progress

* Refactor apiserver

* Update v1beta1 unit test

* Update dependencies

* Fix integration test

* Revert visualization server changes (workaround)

* Address comments

* Basic lint the api server

* Update licenses file

* Adjust intergtaion tests

* Fix typos in the tests

* Update tests

* Update test

* Add support v1 delepe pipeline

* Remove gorm.Model to split into a different PR

* Lint api server

* Fix default experiment in upgrade test

* Update storage states

* Testing upgrade test run

* Add copying pod logs to the GCS bucket

* Fix upgrade test

* Adjust backend test for list

* Fix the tests

* Fix workflow manifest discrepancy at create

* Add a few unit-tests

* Add misc service and fix persistence agent

* Remove default values from TEXT columns

* Address comments. Fixes #8702.

* Address comment, reorder resource, server, storage

* Fix front end integration test

* Fix FE integration test

* Fix tabs, add pauses, make more explicit FE test

* Revert FE test changes

* Enable default experiment and disable its deletion

* Replace empty namespace with POD_NAMESPACE

* Default experiment is now the oldest

* Emplace empty with POD_NAMESPACE for argo only

* Fix api integration test

* Revert changes to default experiment's description

* Improve FE test flakiness

* Force refresh in the FE test

* Fix FE integration test

* Add delay in FE test

* Add local debug to FE test

* Update tests

* Fix typo

* Address comments

* Enforce template version verification

* Fix workflow manifest discrepancy with v1

* Fix FE test

* Revert changes in persistence agent

* Limit to one resource owner

* Change default run state to unknown

* Revert changes to FE integration test

* Make states consistent

* Remove links from error messages

* Address comments

* Address comments

* Change the order for teardown

---------

Co-authored-by: Chen Sun <chensun@users.noreply.github.com>
2023-02-03 20:17:01 +00:00
Lingqing Gan d5244644ba
feat(backend): add run support for v2 api (#8647)
* remove template dependency on api

* add create run

* update run metrics proto

* add run methods

* small changes

* pass asserted types in model converter
2023-01-05 00:37:10 +00:00
Lingqing Gan d0f0ab309a
feat(backend): Add support for recurring run v2 api (#8634)
* add wiring

* added create recur run and wirings

* added get recurring run and test

* added enable disable delete rec run and tests

* revert namespace change

* fix typo

* use v1 counters for recurring runs

* fix bug

* change recurring run package name and regen

* merge recurring run and job server
2022-12-29 01:26:19 +00:00
Lingqing Gan 7e7e1afcb0
feat(backend): Add support for converting v2 recurring run to scheduled workflow in template (#8521)
* add template support for v2 api

* copyright

* add v2 tests

* add proto files and generate clients

* update dockerfile

* update script

* refactor rec_run_id

* copyright info

* move string definition

* small fix to proto

* small refactor

* template takes model instead of api

* template changes

* convert to model in resource manager

* resolve conflicts

* fix integration test typos

* test

* test

* test

* testing

* temp change for debug

* temp change for debug 2

* temp change for debug 3

* temp change for debug 4

* temp change for debug 5

* temp change for debug 6

* revert resource manager change

* add print

* bring back integration tests

* folder name

* delete a file

* remove package debug

* fix bug

* print more variables

* add log

* add log

* small fix

* add log

* more logs

* add test

* add  logs

* test

* add another test

* use old function for Trigger convertion

* change modeltoCRDTrigger function

* removed V1 at the end of function name

* add comments

* removed unnecessary variable

* typo

* small change

* test

* remove logs for debugging

* small bug

* remove logs for debug

* nit and removed unused functions

* remove unused functions  and move var declararion
2022-12-21 19:43:13 +00:00
gkcalat 8e02cc5c5a
chore(backend): Add pipeline and runtime protos (#8533)
* Adjust generator.sh

* Format the existing protos

* Add pipeline protos

* Add runtime protos

* Generate client libs

* Fix typos, adjust readme

* Add python client

* Update package name

* Replace error.proto with google.rps.Status
2022-12-09 01:46:11 +00:00
Ilias Katsakioris 931c14a742
feat(backend): Upload namespaced pipeline definitions. Part of #4197 (#8511)
* feat(backend) Fix authentication in upload requests

Fix the way KFP API server authenticates pipeline upload requests.
We leverage 'isAuthenticated()` function which requires proper
initialization of the context object to include user identity.

* feat(backend): Add namespace field in pipeline upload swagger definition

Extend swagger defintion of the pipeline upload API with a namespace
parameter in order to support uploading namespaced pipelines.

* chore(backend): Generate Go & Python clients

Autogenerate the Go and Python clients after extending the swagger
definitions of upload pipeline APIs with a namespace field.
2022-12-01 19:22:44 +00:00
Lingqing Gan 6e364d35b1
feat(backend): Add v2 api for experiments (#8480)
* v2 exp proto and generate clients

* server changes

* move v1 and v2 protos into api folder

* regenerate v1 packages

* generate v2 package

* add v2 funcs.

* added v2 create experiment

* integration and initialization tests

* createexperiment works and rest can be pinged

* add create exp tests

* add get experiment

* add get experiment tests

* add list experiment and one test

* add list exp tests

* add TestValidateCreateExperimentRequest_Multiuser

* add delete exp tests

* add archive/unarchive exp and tests

* refactor storage and resource layers

* change api converter

* small fix

* small fixes

* move proto files outside and name v1 package api

* refactor

* refactor
2022-11-29 01:21:43 +00:00
Lingqing Gan 3f2e20d14f
chore(backend): regenerate v1beta1 api clients (#8403)
* add v2 experiment.proto

* regenerate v1beta1 client

* remove api version from combined swagger file

* Revert "regenerate v1beta1 client"

This reverts commit 02769d779b.

* regenerate v1beta1 clients

* regenerate python packages without api version

* remove regenerated v1 python packages&change proto

* refactor v1 exp apis and functions

* remove v2 api package and refactor v1 proto

* regenerate v1 go clients

* regenerate v1 python package

* refactor and update the human maintained swagger

* renew swagger file

* regenerate v1 packages

* regenerate v1 python package

* refactor

* regenerate v1 go clients

* regenerate v1 python package

* recover dockerfile and add s in python

* fix func name

* use commit for sdk execution test

* change sdk execution test

* update test script

* add v1 to methods

* proto update v1 method names

* regenerate v1 go packages

* regenerate python client

* update server methods

* refactor

* refactor

* refactor

* refactor python client

* fix get_healthz

* update sample-test.sh in v2 backend

* sample test script

* change v2 sample test

* change package install order

* Revert "change package install order"

This reverts commit c24fcfbed9.

* use KFP server api from commit for v2 sample tests

* small fix
2022-11-10 19:18:00 +00:00
Lingqing Gan 6c6b1e3a94
chore(backend): move v1 api to v1beta1 package and folder (#8376)
* move v1 api to v1beta1 package and folder

* fix test

* update README.md

* update README.md

* update readme
2022-10-26 07:11:30 +00:00
Ablai Akhazhanov 850a5a5e27 chore(release): bumped version to 2.0.0-alpha.6 2022-10-14 23:22:02 +00:00
Chen Sun 73caa1a66c chore(release): bumped version to 2.0.0-alpha.5 2022-09-26 11:08:27 -07:00
Ablai Akhazhanov 58052eafc1 chore(release): bumped version to 2.0.0-alpha.4 2022-08-31 21:55:27 +00:00
Ablai Akhazhanov f604406238 chore(release): bumped version to 2.0.0-alpha.3 2022-07-13 18:17:33 +00:00
James Liu cf1b873a9a
fix(backend): Upgrade grpc-gateway patch version to enable correct swagger config (#7788)
* fix(backend): Upgrade grpc-gateway patch version to enable correct swagger config.

* Tag PR commit info

* Generate api based on reverted change
2022-06-01 19:09:49 +00:00
Chen Sun 9cfbc6695f
Revert "feat(api): add runtime_config.parameter_values with string typed values" (#7805)
This reverts commit 5b64733ef6.
2022-05-27 09:35:12 +00:00
Chen Sun 5b64733ef6
feat(api): add runtime_config.parameter_values with string typed values (#7734) 2022-05-16 20:38:17 +00:00
Lingqing Gan 38bd93d6fc chore(release): bumped version to 2.0.0-alpha.2 2022-05-05 16:10:59 -07:00
Lingqing Gan 471c7d3425 chore(release): bumped version to 2.0.0-alpha.1 2022-04-04 16:38:48 -07:00
Chen Sun 3fb1a9f8c8 chore(release): bumped version to 2.0.0-alpha.0 2022-03-16 10:08:02 -07:00
Chen Sun 2a4b60ee2f
chore(release): bump version to 1.8.1 on master branch (#7353)
* chore(release): bump version to 1.8.1 on master branch

* update marketplace manifest snapshot

* update formatting
2022-02-26 09:23:35 +00:00
Chen Sun 21c3e30130
chore(release): bump version to 1.8.0 on master branch (#7318)
* chore(release): bump version to 1.8.0 on master branch

* update marketplace snapshot
2022-02-16 10:31:07 +00:00
Diana Atanasova 81438f3c03
feat(backend): add new endpoint that get pipeline by name (#7004)
* feat(backend): add new endpoint that get pipelines by name

Add new endpoint getPipelineByName that take in consideration the current namespace,
because the name is unique within a namespace only.

Fix: https://github.com/kubeflow/pipelines/issues/7003

Signed-off-by: Diana Atanasova <dianaa@vmware.com>

* Remove extra identation in pipeline.proto file

Signed-off-by: Diana Atanasova <dianaa@vmware.com>

* feat(backend): add new endpoint GetPipelineByName

Use explicit URL. Namespace isn't passed through `resource_references`, but
is part of the URL path.
In cases when only the pipeline name is required(standalone installation, shared pipelines)
, a hyphen "-" is used. Example:
/apis/v1beta1/namespaces/-/pipelines/{name}

Signed-off-by: Diana Atanasova <dianaa@vmware.com>

* Check for authorization in MultiUserMode

Signed-off-by: Diana Atanasova <dianaa@vmware.com>
2022-02-15 17:38:41 +00:00
Chen Sun 5ce3d57244
chore(release): bump version to 1.8.0-rc.3 on master branch (#7293)
* chore(release): bump version to 1.8.0-rc.3 on master branch

* update gcp marketplace snapshot
2022-02-11 09:40:40 +00:00