Commit Graph

14 Commits

Author SHA1 Message Date
gkcalat 9ec4dc7f30
fix(backend): Add pipeline spec name validation and relax display name validation (#9374)
* Add pipeline name check at creation time

* Revert changes for pipeline version

* Validate pipeline spec name and relax display name

* Fix e2e test
2023-05-11 23:57:30 +00:00
Chen Sun 8b2fba3f39
test: Add v2 API integration tests (#9185)
* Add v2 API integration tests

* move v1 client
2023-04-27 20:20:39 +00:00
gkcalat 135dc64854
feat(backend): Refactor apiserver, add Pipeline and other v2beta services (#8633)
* Staging WIP

* Fix recurring run, switch to pipeline_version_id

* Regenerate python client

* Refactor packages for pipeline service v2

* Stage progress

* Add support for pipeline service v2beta1

* Go mod tidy

* Update licenses

* Set default namespace to be empty

* Separate deletion of pipeline versions

* Change report ReportRunMetrics to obey AIP

* Use pipeline version id in run proto

* Update run.proto

* Upgrade storage

* Remove dependencies on api

* Stage refactoring progress

* Refactor apiserver

* Update v1beta1 unit test

* Update dependencies

* Fix integration test

* Revert visualization server changes (workaround)

* Address comments

* Basic lint the api server

* Update licenses file

* Adjust intergtaion tests

* Fix typos in the tests

* Update tests

* Update test

* Add support v1 delepe pipeline

* Remove gorm.Model to split into a different PR

* Lint api server

* Fix default experiment in upgrade test

* Update storage states

* Testing upgrade test run

* Add copying pod logs to the GCS bucket

* Fix upgrade test

* Adjust backend test for list

* Fix the tests

* Fix workflow manifest discrepancy at create

* Add a few unit-tests

* Add misc service and fix persistence agent

* Remove default values from TEXT columns

* Address comments. Fixes #8702.

* Address comment, reorder resource, server, storage

* Fix front end integration test

* Fix FE integration test

* Fix tabs, add pauses, make more explicit FE test

* Revert FE test changes

* Enable default experiment and disable its deletion

* Replace empty namespace with POD_NAMESPACE

* Default experiment is now the oldest

* Emplace empty with POD_NAMESPACE for argo only

* Fix api integration test

* Revert changes to default experiment's description

* Improve FE test flakiness

* Force refresh in the FE test

* Fix FE integration test

* Add delay in FE test

* Add local debug to FE test

* Update tests

* Fix typo

* Address comments

* Enforce template version verification

* Fix workflow manifest discrepancy with v1

* Fix FE test

* Revert changes in persistence agent

* Limit to one resource owner

* Change default run state to unknown

* Revert changes to FE integration test

* Make states consistent

* Remove links from error messages

* Address comments

* Address comments

* Change the order for teardown

---------

Co-authored-by: Chen Sun <chensun@users.noreply.github.com>
2023-02-03 20:17:01 +00:00
Lingqing Gan 3f2e20d14f
chore(backend): regenerate v1beta1 api clients (#8403)
* add v2 experiment.proto

* regenerate v1beta1 client

* remove api version from combined swagger file

* Revert "regenerate v1beta1 client"

This reverts commit 02769d779b.

* regenerate v1beta1 clients

* regenerate python packages without api version

* remove regenerated v1 python packages&change proto

* refactor v1 exp apis and functions

* remove v2 api package and refactor v1 proto

* regenerate v1 go clients

* regenerate v1 python package

* refactor and update the human maintained swagger

* renew swagger file

* regenerate v1 packages

* regenerate v1 python package

* refactor

* regenerate v1 go clients

* regenerate v1 python package

* recover dockerfile and add s in python

* fix func name

* use commit for sdk execution test

* change sdk execution test

* update test script

* add v1 to methods

* proto update v1 method names

* regenerate v1 go packages

* regenerate python client

* update server methods

* refactor

* refactor

* refactor

* refactor python client

* fix get_healthz

* update sample-test.sh in v2 backend

* sample test script

* change v2 sample test

* change package install order

* Revert "change package install order"

This reverts commit c24fcfbed9.

* use KFP server api from commit for v2 sample tests

* small fix
2022-11-10 19:18:00 +00:00
Lingqing Gan 6c6b1e3a94
chore(backend): move v1 api to v1beta1 package and folder (#8376)
* move v1 api to v1beta1 package and folder

* fix test

* update README.md

* update README.md

* update readme
2022-10-26 07:11:30 +00:00
Lingqing Gan c7b56d6ca6
fix(backend): change downloaded IR from JSON to YAML. Fixes #7673 (#7768)
* change downloaded IR from JSON to YAML

* correct error message

* update error message

* change template.Bytes() to return yaml

* remove json to yaml conversion

* add TODO

* remove yaml package

* mod tidy

* change go mod

* Update test data for evaluation classification feature attribution pipeline.

PiperOrigin-RevId: 446739064

* feat(conformance): adapt run api tests to KF env (#7658)

- Undid earlier refactoring in test_util.go. I think having the util
  function to take a parameter structure is much more readable than
  constructing api parameters in the util function.

* feat(conformance): adapt remaining tests to KF env (#7670)

- Adapted job, rn, upgrade and visualization tests
- Undid earlier change where I had to pass in empty string to indicate
  that resource reference should not be overridden because experiment id
  is specified
- Updated visualization client to support SA token projection auth

* Revert "feat(conformance): adapt remaining tests to KF env (#7670)"

This reverts commit 3cf7c19be9.

* Revert "feat(conformance): adapt run api tests to KF env (#7658)"

This reverts commit e644d7a18b.

* Revert "Update test data for evaluation classification feature attribution pipeline."

This reverts commit 86a2fb2c02.

* block usage of json IR in backend. change test

* update tests

* update tests

* update tests

* fix test

* change commnets

* remove json test

Co-authored-by: Googler <nobody@google.com>
Co-authored-by: James Wu <54086668+james-jwu@users.noreply.github.com>
2022-06-22 01:13:25 +00:00
James Wu 913277a3aa
feat(conformance): adapt pipeline version API tests to run in KF (#7653) 2022-05-04 17:47:32 +00:00
capri-xiyue 2e945750cb
feat(v2): V2 create run api (#6689)
* added draft of create v2 pipeline run

* fixed broken UT and added UT for parsing template

* modified run apis to support v2 IR spec

* remove temporary patch

* fixed dependency

* fixed build failure

* finished draft

* finished create job and run

* refactor template and fixed broken UT

* updated go license

* fixed build failure

* fixed build

* added UT

* modified UT

* fixed build failure

* fixed license
2021-10-28 21:53:51 -07:00
Yuan (Bob) Gong 4360652e66
test(backend/integration): pipeline API integration tests for v2 spec (#6798)
* test(backend/integration): pipeline API integration tests for v2 spec

* test: update PipelineClientInterface
2021-10-26 17:48:27 -07:00
Niklas Hansson 129f46a943
chore: add missing assert in pipeline_version_api_test.go, run_api_test.go and upgrade_test.go (#6605) 2021-09-28 16:02:54 -07:00
Niklas Hansson 00a0ffbdb7
feat(backend): upgrade argo go module to V3. Part of #5718 (#5792)
* updating argo

* updated fix deps and code

* clean up
2021-06-08 05:04:45 -07:00
Luis Magana 5df2801603
feat(backend): Added multi-user pipelines (UI + API); Fixes #4197 (#4835)
* Added multi-user pipelines backend


corrected typo


updating code based on review


fixes for pipelines server


reverting this back

* removing unnecessary info logging
2021-02-26 06:10:15 -08:00
Niklas Hansson 5742991c1a
feat(API): exposing api for setting the default version of pipeline. Fixes #4049 (#4406)
* initial work on exposing the default version of pipeline

* update description

* added missing files

* updated api build, unsure if this is correct ...

* updated after feedback

* clean up

* remove empty line

* started to make the integration test

* added integreation test

* fixed build and feedback

* updated the tests

* Updated the test

* new test

* typo

* updated the pipeline default

* updated the pipeline version

* formatting

* error in comparison
2020-10-15 16:19:25 -07:00
jingzhang36 ee587101d3
Add integration tests for version related methods (#3174)
* create a new version upload integration test file

* checkpoint

* checkpoint

* test

* checkpoint

* checkpoint

* version api integration test

* Fix a typo

* typo in comment

* error message
2020-02-26 21:29:52 +08:00