Commit Graph

9 Commits

Author SHA1 Message Date
gkcalat e7fdb7f387
fix(backend): Add pipeline_id to pipeline_source in Run and RecurringRun (#9097)
* Add pipeline_id to run and recurring run protos

* Add pipeline_id to run and recurring_run

* Remove unused commented code

* Add pipeline id verification
2023-04-04 03:55:00 +00:00
gkcalat 06f154250b
fix(backend): Deprecate experiment_id in Run API v2 (#8921) 2023-03-03 20:29:00 +00:00
gkcalat e568148264
fix(backend): Revert the url changes in run API v 2 (#8920) 2023-03-03 18:19:00 +00:00
gkcalat e8f10b1ff9
fix(backend): Add ListAllRuns endpoint (#8901) 2023-02-28 01:49:41 +00:00
gkcalat 1bed63a31e
feature(backed): Status-IR.part-1: Add updating tasks and run statuses to api server (#8850)
* Add children to PipelineTaskDetail

* Add state and state history to task

* Add state and state history to run

* Add pod_name to PipelineTaskDetail

* Add PodName and Payload to tasks table

* Add upsert to task store

* Add create or update task report wf

* Wire the report server

* Remove v1 and v2 specific functions

* Revert Run proto order

* Stage progress

* Add run id to exec spec

* Disable unit test due to #8851

* Address comments

* Address some comment

* Remove empty lines

* Refactor toModelTasks

* Address comments

* Address comments
2023-02-23 00:26:23 +00:00
Lingqing Gan 6522e6c48a
fix(backend): add retry run in v2 api. Fixes #8735 (#8804)
* add retry run

* fix typo in comments

* fix proto typo and regenerate

* add logic to verify experiment id

* fix typo
2023-02-07 01:24:32 +00:00
gkcalat 135dc64854
feat(backend): Refactor apiserver, add Pipeline and other v2beta services (#8633)
* Staging WIP

* Fix recurring run, switch to pipeline_version_id

* Regenerate python client

* Refactor packages for pipeline service v2

* Stage progress

* Add support for pipeline service v2beta1

* Go mod tidy

* Update licenses

* Set default namespace to be empty

* Separate deletion of pipeline versions

* Change report ReportRunMetrics to obey AIP

* Use pipeline version id in run proto

* Update run.proto

* Upgrade storage

* Remove dependencies on api

* Stage refactoring progress

* Refactor apiserver

* Update v1beta1 unit test

* Update dependencies

* Fix integration test

* Revert visualization server changes (workaround)

* Address comments

* Basic lint the api server

* Update licenses file

* Adjust intergtaion tests

* Fix typos in the tests

* Update tests

* Update test

* Add support v1 delepe pipeline

* Remove gorm.Model to split into a different PR

* Lint api server

* Fix default experiment in upgrade test

* Update storage states

* Testing upgrade test run

* Add copying pod logs to the GCS bucket

* Fix upgrade test

* Adjust backend test for list

* Fix the tests

* Fix workflow manifest discrepancy at create

* Add a few unit-tests

* Add misc service and fix persistence agent

* Remove default values from TEXT columns

* Address comments. Fixes #8702.

* Address comment, reorder resource, server, storage

* Fix front end integration test

* Fix FE integration test

* Fix tabs, add pauses, make more explicit FE test

* Revert FE test changes

* Enable default experiment and disable its deletion

* Replace empty namespace with POD_NAMESPACE

* Default experiment is now the oldest

* Emplace empty with POD_NAMESPACE for argo only

* Fix api integration test

* Revert changes to default experiment's description

* Improve FE test flakiness

* Force refresh in the FE test

* Fix FE integration test

* Add delay in FE test

* Add local debug to FE test

* Update tests

* Fix typo

* Address comments

* Enforce template version verification

* Fix workflow manifest discrepancy with v1

* Fix FE test

* Revert changes in persistence agent

* Limit to one resource owner

* Change default run state to unknown

* Revert changes to FE integration test

* Make states consistent

* Remove links from error messages

* Address comments

* Address comments

* Change the order for teardown

---------

Co-authored-by: Chen Sun <chensun@users.noreply.github.com>
2023-02-03 20:17:01 +00:00
Lingqing Gan d5244644ba
feat(backend): add run support for v2 api (#8647)
* remove template dependency on api

* add create run

* update run metrics proto

* add run methods

* small changes

* pass asserted types in model converter
2023-01-05 00:37:10 +00:00
gkcalat 8e02cc5c5a
chore(backend): Add pipeline and runtime protos (#8533)
* Adjust generator.sh

* Format the existing protos

* Add pipeline protos

* Add runtime protos

* Generate client libs

* Fix typos, adjust readme

* Add python client

* Update package name

* Replace error.proto with google.rps.Status
2022-12-09 01:46:11 +00:00