* test: access specific field via "id".
* test: access specific field via "id".
* update snapshots.
* Add test to validata description changes.
* Change id def for input tag.
* Skip unit tests
* Add unit tests back and change id
* Add a helper for clear default value in input field.
Remove unnecessary 'tab' command
* Add comment to explain the parameter name for tests
Remove default value for runName before typing new value
* Redirect to v2 new run after selecting v2 pipeline when creating run
* Add a tab in FE-integration test
* Add tab to the failed tests
* Add query keys back to NewRunSwitcher
* Separate pipelineServiceApiV1 and pipelineServiceApiV2.
Add uploadPipelineVersionV2 helper.
* Ingegrate new pipeline functionality with v2 API.
Create a new pipeline dialog for v2 pipeline because the error is
not string type.
* Integrate getPipelineVersion() in run/recurring run details router
with v2 API.
* Integrate listPipelines() / listPipelineVersions() in PipelineList and
PipelineVersionList with v2 API.
* Update private and shared pipelines unit tests.
* Separate v1 and v2 logics (based on API return value) in pipeline
details (router).
Noted: add additional listPipelines() to get latest version because v2
don't default version field.
* Change pipeline props in PipelineDetailsV2 and PipelineVersionCard
Remove default version in PipelineVersionCard test.
Append version id to URL for unspecified versionId scenario.
* Create new ResourceSelectorV2 and make corresponding changes (back to
v2beta1Pipeline) in PipelineDialogV2 and NewPipelineVersion
* Create resource converter to make various API returned objects fit in
base resource.
Change the behavior of "selectionChanged" to achive more general usage.
* Integrate getPipeline() / getPipelineVersion() in "create / clone run"
with v2 API.
* Integrate get started page with v2 pipeline API.
* Integrate getPipelineVersion() in run list with v2 API.
* Integrate delete pipeline / pipeline version with v2 API.
* Remove unused imports. Change relative path to absolute path.
* Add unit test for PipelineDialogV2 and ResourceSelectorV2.
* Fix incorrect Version Description in PipelineVersionCard and rename the
constant in unit test.
Add size limitation in the listPipelineVersions() called by
getSelectedVersion.
Add missing props in NewRunV2 test.
Fix FE-integration test (trial)
* Simplify the logic of deletePipelineVersion. Remove
dialoghandlerMultiId.
* Staging WIP
* Fix recurring run, switch to pipeline_version_id
* Regenerate python client
* Refactor packages for pipeline service v2
* Stage progress
* Add support for pipeline service v2beta1
* Go mod tidy
* Update licenses
* Set default namespace to be empty
* Separate deletion of pipeline versions
* Change report ReportRunMetrics to obey AIP
* Use pipeline version id in run proto
* Update run.proto
* Upgrade storage
* Remove dependencies on api
* Stage refactoring progress
* Refactor apiserver
* Update v1beta1 unit test
* Update dependencies
* Fix integration test
* Revert visualization server changes (workaround)
* Address comments
* Basic lint the api server
* Update licenses file
* Adjust intergtaion tests
* Fix typos in the tests
* Update tests
* Update test
* Add support v1 delepe pipeline
* Remove gorm.Model to split into a different PR
* Lint api server
* Fix default experiment in upgrade test
* Update storage states
* Testing upgrade test run
* Add copying pod logs to the GCS bucket
* Fix upgrade test
* Adjust backend test for list
* Fix the tests
* Fix workflow manifest discrepancy at create
* Add a few unit-tests
* Add misc service and fix persistence agent
* Remove default values from TEXT columns
* Address comments. Fixes#8702.
* Address comment, reorder resource, server, storage
* Fix front end integration test
* Fix FE integration test
* Fix tabs, add pauses, make more explicit FE test
* Revert FE test changes
* Enable default experiment and disable its deletion
* Replace empty namespace with POD_NAMESPACE
* Default experiment is now the oldest
* Emplace empty with POD_NAMESPACE for argo only
* Fix api integration test
* Revert changes to default experiment's description
* Improve FE test flakiness
* Force refresh in the FE test
* Fix FE integration test
* Add delay in FE test
* Add local debug to FE test
* Update tests
* Fix typo
* Address comments
* Enforce template version verification
* Fix workflow manifest discrepancy with v1
* Fix FE test
* Revert changes in persistence agent
* Limit to one resource owner
* Change default run state to unknown
* Revert changes to FE integration test
* Make states consistent
* Remove links from error messages
* Address comments
* Address comments
* Change the order for teardown
---------
Co-authored-by: Chen Sun <chensun@users.noreply.github.com>
* Enable choose pipeline and pipeline version for creating a run without pipeline ID and run ID.
* Wrap pipeline selector dialog as a function component (need to fix).
* Added a callback in NewRun component to handle the situation (choosing v1 pipeline first, and then change to v2 pipeline).
* Format.
* Set NewRunV1 as default page.
Added existingPipelineId into props of NewRunV1 to show pipeline and pipeline version details at the very first fetch.
* Wrap pipeline version selection as a function component
added exisingVersionId and callback in NewRun component to change the versionId in parent component(NewRunSwitcher)
* Replace url if users choose other pipeline version and pipeline version.
* Added additional check in if condition for callback in order to avoid breaking current v1 design.
* Fixed field in test components.
* Pre-fill experiment name for NewRunV2.
* Added comments and unit tests
* Added comments in NewRun to specify the timing of call back behavior.
* Update URL when experiment is changed.
Remove unused props
* Change behavior of updating url for changed experiment in NewRunV2
* Revert to 7966ae8.
* Remove updating URL for changed experiment.
* Added updating URL for changed experiment back.
* Hold for all changes related to URL.
* remove cache time setting.
* Add all changes related to URL update back
Modified the FE-integration-test to match current behavior
Enabling pre-filling run name of v1 new run page.
Fixing the errors in NewRunSwitcher.
* Modified the frontend-integration-test to match current v1 behavior (pre-filling the run name).
* Remove obsolete snapshot.
* Remove the old test (rely on snapshot) and add new test for selecting pipeline with params
Added tiny test for prefilling the run name when pipeline is selected.
* Format
* Replace useEffect() with callback for changed experiment.
* Replace useEffect() with callback fn() for changed pipeline and pipeline version.
* Remove unused parameters
Directly use existingPipeline and existingPipelineVersion without declaring another parameters
Added a test to validate the run name for selected pipeline
Wraped NewRun props into an interface.
Added "experiment" constant in useQuery for getting experiment details.
* remove compile warning.
* Rename the variable name in NewRunParameterV2 to get rid of the compile warning and avoid infinite loop.
* format
* Change unit test for NewRunV1 to match new behavior (callback).
* Remove unused parameters.
* Remove the unnecessary useEffect() for setApiExperiment
add runId condition for selected experiment.
* Add service account field to run and job api objects
* Update description
* Fix field casing
* Use service account from api object
* Fix bug and add unit test
* [UI] Allow choosing Kubernetes service account
* fix unit tests
* fix format
* Also clone service account
* service account UI features
* Add unit test for cloning service account
* Fix frontend integration tests
* [Testing] Use gke 1.15.8 to mitigate workload identity flakiness
* Upgrade gcloud version
* Update image builder image too
* Turn on workload identity
* Update deploy-cluster.sh
* secret sample uses python3 instead
* Increase xgboost time limit
* Revert files with bad format
* Update component and pipelines to use gcloud 279.0.0
* Fix secret sample using python3
* Upgrade frontend integration test image
* Rebuild frontend integration test image
* FE changes for version ui
* sort methods; remove console
* format
* remove obsolete snapshots
* cosmetic change: simplify href link construction
* fix the clone run behavior when version present
* format
* run-integration-test
* frontend-integration-test: try to simulate uploading file
* fix frontend-integration-test
* address comments
* address comments and add one more unit test
* Tests - Use base image for frontend tests
* Moved the base image to ml-pipeline-test bucket.
The ml-pipeline-staging bucker is inaccessible by the image-builder container.
* Moved the gcloud installation to the base image
* Setting correct user for /src
* Trying to chown the directory using a different technique.
* GCP SDK is now in /tools/
* Using the official gcloud install method
See https://github.com/GoogleCloudPlatform/cloud-sdk-docker/blob/master/debian_slim/Dockerfile
* Running gcloud only under the seluser user
* COPY --chown=seluser
For some reason the root, not the active user owns the data copied using COPY
* No need to run apt-get update again.
Cleaning files before committing the layer.
Installing pip using apt-get (it's no longer in python-setuptools)
* Allows toggling between one-off and recurring runs in the new run page
* Clean up and adds tests
* Fix integration test - account for extra field in form
* Cleanup and PR comments
* Clear default exp table on delete and create default exp on run create
if no default exists
With this change, if the delete experiment API is called on the default
experiment, then the ID will also be removed from the default_experiments
table.
Additionally, if the default experiment doesn't exist and a new run is
created without an experiment, a new default experiment will be created,
and the run will be placed within this experiment.
* Adds integration test for creating a run without an experiment
* Fixes failure to close database connection and adds tests for recreating and deleting default experiment
* Rename function
* Revert some row.Close() calls
* Adds 'Create run' button to experiment list / all runs page
* Add run without experiment and filtering to FE integration test
* Update snapshots
* Add refresh and wait to integration test
* Adjust
* Adjust
* Don't exit integration test early if npm test fails
* PR comments
* TEMP - take screenshots to debug integration test
* Store screenshots
* Remove create run without experiment integration test for now as it fails due to the default experiment being deleted at the end of the API initialization and integration test suites
* WIP - Create default experiment upon API server initialization
* Default experiment initialization caused crashes if API server pod was restarted without clearing DB
* Adding new table to store default experiment ID
* Add default experiment type model definition
* Minor fixes, everything seems to work now
* Clean up. Renamed to default_experiment_store
* Adds tests for the default_experiment_store
* Add integration test for verifying initial cluster state. Currently only covers existence of default experiment
* Don't run initialization tests except as integration tests
* Fixes comments
* PR comments and cleanup
* Extract code in resource_manager to helper func
* Update swagger definitions
* WIP - Adds ability to terminate runs to frontend
* Update snapshots
* Adds tests. Also changes warning message color to orange rather than red
* Remove refresh button from run details page
* Elaborate terminate confirmation message
* Minor fixes
* Remove references to refresh button from integration tests
* Uses 'Create' for all actions that lead to creation flow, or result in a static object (experiment). 'Start' is used solely for initiating runs
* Update integration test
* Adds an experiment selector to the new run page. Needs tests
* Adds an experiment selector to the new run page. Needs tests
* Adds tests for the new experiment selector in NewRun
* Rename PipelineSelector -> ResourceSelector since it handles experiments as well
* Makes ResourceSelector more abstract. No longer coupled to experiments and pipelines
* PR comments, NewRun clean-up
* Moves resourceToRow function into ResourceSelector
* Fix e2e test
* Tests - Getting rid of git clone in */run_test.sh
run_test.sh scripts no longer pull the repo code, because the code is now correctly baked in during the image build. This saves ~11 pulls per commit
Backend unit test image is now build as part of the test suite
* Added target-image-prefix parameter to simplify test configuration
* Build all images from source code prepared by Prow. Got rid of git pulls
All images are now built from archived version of code the source code prepared by Prow.
This saves 25 more pulls and improves test reliability.
The archived source code location is passed through image-build-context-gcs-uri parameter.
* Addressed the PR feedback.
* Adds tests for the NewRun page
* Add more tests
* Adds many more tests, cleans-up PipelineSelector a bit, and fixes bug in Utils.ts
* Update create run button ID in e2e test
* Test clean-up and PR comments
Joe Li
Chen Sun
gkcalat
dependabot[bot]
Yuan (Bob) Gong
Alexey Volkov
StefanoFioravanzo
Yuan (Bob) Gong
jingzhang36
Alexey Volkov
hongye-sun
Yasser Elsayed
Riley Bauer
IronPan
nealgao
Alexey Volkov
Pascal Vicaire
Pascal Vicaire