63c7450ea2
chore: update test/OWNERS ( #8412 )
2022-11-01 21:32:46 +00:00
100b1f301c
fix(test): unable to create test cluster ( #8410 )
2022-11-01 13:23:08 -07:00
c6094cb2ed
chore(test): check single quote in formatting presubmit ( #8407 )
2022-11-01 12:04:08 -07:00
6c6b1e3a94
chore(backend): move v1 api to v1beta1 package and folder ( #8376 )
...
* move v1 api to v1beta1 package and folder
* fix test
* update README.md
* update README.md
* update readme
2022-10-26 07:11:30 +00:00
65ee01a436
fix(backend): Upgrade mysql to 8.0.26 ( #8351 )
...
* Upgrade mysql to 8.0-debian
* Downgrade to mysql-8.0.26 to fix mlmd authentication issue
* Fix cloudbuilds
* Fix gcp marketplace manifests
* Cleaning up mysql password from yaml
* Improve comments
2022-10-14 07:34:04 +00:00
16c7d6658e
test(sdk): create SDK execution test suite and restructure read/write tests ( #8245 )
...
* update client for graph components
* use yaml for config
* simplify read write tests
* add test script
* restructure yaml and read/write tests
* add execution test file
* move test_data; update paths; update readme
* update kfp endpoint
* update pipeline with env
* update logging
* update config
* update kfp endpoint and timeout
* add kfp as requirement
* mock kfp_package_path for lightweight component execution
* revert pipeline name changes
* update config with name
* update read write tests to use explicit name
* update execution tests to use explicit name
2022-09-12 18:33:06 +00:00
25cd45d772
chore(sdk): add script to check for unused imports ( #8221 )
...
* add dev requirement
* add unused import check to isort script
2022-08-31 22:53:51 -07:00
7d5985b4d4
feat(frontend): Creating run from various entry points ( #8190 )
...
* Enable choose pipeline and pipeline version for creating a run without pipeline ID and run ID.
* Wrap pipeline selector dialog as a function component (need to fix).
* Added a callback in NewRun component to handle the situation (choosing v1 pipeline first, and then change to v2 pipeline).
* Format.
* Set NewRunV1 as default page.
Added existingPipelineId into props of NewRunV1 to show pipeline and pipeline version details at the very first fetch.
* Wrap pipeline version selection as a function component
added exisingVersionId and callback in NewRun component to change the versionId in parent component(NewRunSwitcher)
* Replace url if users choose other pipeline version and pipeline version.
* Added additional check in if condition for callback in order to avoid breaking current v1 design.
* Fixed field in test components.
* Pre-fill experiment name for NewRunV2.
* Added comments and unit tests
* Added comments in NewRun to specify the timing of call back behavior.
* Update URL when experiment is changed.
Remove unused props
* Change behavior of updating url for changed experiment in NewRunV2
* Revert to 7966ae8
2022-08-31 19:34:54 +00:00
13736b85b6
chore(sdk): clean up kfp code style ( #8027 )
...
* remove unused imports
* use google as isort profile
* sort imports
* format with yapf
* clean end of file new line, trailing whitespace, double quoted strings
2022-07-15 00:06:34 +00:00
8cc822f87a
test: update Argo cli version in sample test ( #8022 )
2022-07-13 07:34:03 +00:00
be5ff7215f
chore(sdk): update contributing guidelines/tests ( #7802 )
...
* add presubmit checks, contributing guidelines, and pre-commit file
* delete old unused formatting script
* modify scripts
2022-07-12 20:35:29 -06:00
3bbc1d9afb
fix: Update mysql image to fix CVE-2022-1292 ( #8017 )
2022-07-12 21:18:02 +00:00
8bee2922c2
feat: Upgrade argo-workflow to v3.3.8 ( #8009 )
...
* Upgrade argo-workflow to v3.3.8
* update go liencenses files
* use golang 1.17 in build and test
* temporarily disable v2 image cloudbuild
2022-07-12 19:22:31 +00:00
2a99dbfcef
chore(test): add test infra mysql run cleanup script ( #7979 )
2022-07-11 23:07:30 +00:00
12d5cc3284
chore(sdk): use pytest instead of unittest for test execution ( #7869 )
...
* fix compiler test data path
* condense and add development requirements
* use pytest instead of unittest
* update contributing guidelines
2022-06-10 05:49:19 +00:00
e077d01cf9
feat(sdk): add noun aliasing to cli ( #7569 )
...
* allow both singular and plural versions of nouns
* use command table for client creation
* cleanup
* simplify docker mock
* add docker to test requirements; clean up existing requirements
2022-04-25 12:24:57 -06:00
42115e3bc2
chore: create presubmit-formatting-sdk.sh script ( #7415 )
2022-03-17 17:16:10 +00:00
7c2f520fe3
chore: use the upstream go-licenses tool ( #7408 )
2022-03-16 02:10:34 +00:00
b693909a08
feat(sdk)!: move v1 to deprecated folder ( #7291 )
...
* chore(sdk): move v1 to deprecated
* fix testsg
* fix testsg
* fix setup.py
* fix test
* s'
* fix tests
* fix test
* retore v2 test changes
* fix py3.6 test
* fix py3.6 test
* fix py3.6 import fallback error
* remove deprecated
* fix samples test
* sample test
* fix samples
* add readme
* restroe test
* python require
* remove path
* fix tests
* inteegration tests
* remove tfx tests for dependency with kfp v1
* fix e2e
* fix e2e
* fix integration tests
* fix sampe
* move client down
* change to kfp
* add import alias
* fix
* runid
* fix dsl
* only use kfp for function
* revert train_until_good
* tfx test
* kfp
* try import
* onprem
2022-03-04 00:52:59 +00:00
d22728b814
chore: Update bump-version-in-place.sh ( #7277 )
2022-02-08 17:30:43 +00:00
fe70363ec7
chore(backend): Check for forbidden license during image build and in presubmit ( #7210 )
...
* Check for forbidden license during image build
* Add forbidden license check in backend presubmit
* update backend presubmit to use golang image
2022-01-26 00:30:43 +00:00
15fac0b538
chore: remove Bobgy from OWNERS ( #7195 )
2022-01-25 08:11:28 +08:00
568a11865d
test: fix tfx presubmit test. ( #7143 )
2022-01-05 16:11:26 -08:00
2460aaa653
test: migrate sample integration test to v2 sample test infra ( #7115 )
...
* test: migrate sample integration test to v2 sample test infra
* test: configure v2 integration test timeout
2021-12-26 04:17:44 +00:00
ac14a3b610
test: migrate all sample tests to v2 sample test infra ( #7114 )
...
* test: migrate all sample tests to v2 sample test infra
* fix
2021-12-24 08:15:43 +00:00
073539a50a
chore: change owner ( #7113 )
2021-12-24 01:26:42 +00:00
c470a21c51
chore: Revert permission changes to Dockerfile ( #7111 )
2021-12-24 00:06:42 +00:00
af9d058e85
fix(manifests): Remove redundant secret value in profile controller ( #7087 )
...
* fix(manifests): Remove redundant secret value in profile controller
* attempt to fix sample test
2021-12-23 16:41:42 +00:00
9bf30b8eb6
test: fix test failing to find kfp ( #7108 )
...
* tests: Try to figure out what causes test failing to find kfp
* mistune not ready for upgrade
2021-12-23 12:37:43 +00:00
76b03cd2d8
chore: Remove AI Platform sample ( #7026 )
2021-12-09 19:31:56 +00:00
39af924cb2
chore: Remove Container Build sample ( #7027 )
2021-12-09 18:44:55 +00:00
7157764f21
feat(backend): Upgrade MLMD to 1.5.0 ( #6996 )
2021-12-09 11:35:55 +00:00
20f9ec4c19
test: Disable ai_platform and container_build during post-submit test ( #7022 )
2021-12-08 23:36:54 +00:00
25dfe6065d
chore(backend): bump argo-workflows to latest. ( #6920 )
...
* Bump argo-workflows to latest.
* Bump presubmit golang version.
* Pull latest image tags.
* Update cloud.build and manifests to argo v3.2.3
Co-authored-by: James Liu <jamxl@google.com>
2021-12-01 06:19:13 +00:00
b3d15cd066
feat(backend): Upgrade MLMD to 1.4.0 ( #6910 )
...
* feat(backend): Upgrade MLMD to 1.4.0
* set kfp~1.8
* add tensorflow_model_analysis
* update requirements
* Resolving tfx dependencies
* update Frontend MLMD
* chore: remove v2 compatible sample from builtin samples
Co-authored-by: Yuan Gong <gongyuan94@gmail.com>
2021-11-26 20:42:07 +08:00
3bdf8c0ced
feat(manifests): Add liveness Probe for cloud sql proxy. Fix #4973 ( #6904 )
...
* fix(manifests): Add liveness Probe for cloud sql proxy.
* update mysql.yaml file too
* install rsync
* container install rsync
* install rsync everywhere
* apt install -y rsync
* -y
2021-11-18 19:09:43 +00:00
f317c6156f
test: default to emissary executor ( #6856 )
2021-11-16 19:11:12 +00:00
ce5c100e8e
test: temporarily test tfx against a release branch ( #6907 )
2021-11-13 09:19:40 +00:00
6a730f9618
revert: "test: fix kubeflow-pipelines-tfx-python37 test" ( #6878 )
...
This reverts commit fe0865e9b7
2021-11-08 10:35:09 -08:00
fe0865e9b7
test: fix kubeflow-pipelines-tfx-python37 test ( #6862 )
2021-11-03 15:51:21 -07:00
aedbd60104
test: skip archiving experiments because of perf problem ( #6843 )
2021-11-01 13:30:30 +08:00
4cf34e2d08
feat: upgrade argo to v3.1.14 ( #6809 )
...
* feat: upgrade argo to v3.1.14
* go mod tidy
* fix license versions
2021-10-28 15:17:51 -07:00
ea205cfa32
test: remove pin for cluster version ( #6692 )
...
* remove pin for cluster version
* pin image type to cos
2021-10-06 16:41:19 -07:00
efb6fc655f
test: Revert "fix: Add workaround init container to fix test infra" ( #6652 )
...
This reverts commit f87057486a
2021-09-30 12:28:31 -07:00
f87057486a
fix: Add workaround init container to fix test infra ( #6618 )
...
* debug to see e2e test
* debug
* updated gcloud version
* added networking issue workaround
2021-09-28 13:43:19 -07:00
e035a88149
feat: upgrade MLMD to 1.2.0. Fix #6436 ( #6437 )
...
* chore(frontend): upgrade MLMD to 1.2.0
* update version for backend
* update dependencies
* makefile
* tfx compatiblity update
2021-08-28 16:59:22 -07:00
ed33258ef0
test(tfx): fix parameterized tfx oss sample config
2021-08-19 01:04:43 +00:00
ccb637979d
test: configure tfx sample push_destination arg ( #6379 )
2021-08-18 22:12:35 +08:00
366b70eaa7
feat: upgrade argo to v3.1.6-patch ( #6376 )
...
* feat: upgrade argo to v3.1.6-patch
* Update Dockerfile
* Update install-argo-cli.sh
2021-08-18 03:17:38 -07:00
59a0c9d1de
feat: upgrade TFX to 1.2.0 ( #6375 )
...
* feat: upgrade TFX to 1.2.0
* fix
* update
* fix visualization server
* fix2
2021-08-18 01:50:37 -07:00
78200c8e03
test: fix apt update "changed its 'Suite' value from 'stable' to 'oldstable'" ( #6351 )
...
* test: fix build proxy image
* chore: upgrade sample test image
* update cloud image
* fix 2
2021-08-16 02:18:06 -07:00
ee8cbfa31c
feat: upgrade argo to v3.1.6 ( #6333 )
...
* feat: upgrade argo to v3.1.6
* feat: use argo v3.1.6 image
* update licenses
2021-08-13 02:32:54 -07:00
a1f7160cf5
chore: upgrade tfx to 1.0.0 ( #6316 )
...
* test: fix sample test image build
* update to TFX 1.0.0
* update argo CLI
* Uses TFX 1.0 APIs in parameterized_tfx_oss example.
Co-authored-by: Yuan Gong <gongyuan94@gmail.com>
2021-08-12 04:02:03 -07:00
36b815bedf
feat: upgrade to argo v3.1.5-patch ( #6228 )
...
* feat: upgrade to argo v3.1.5-patch
* update go.mod
* fix license
* update license
2021-08-04 06:55:41 -07:00
17a9bd7cca
test: Remove upgrade command in project_cleaner ( #6227 )
...
* fix(test): Remove upgrade command in project_cleaner
* Use shell
* remove
2021-08-04 02:30:41 -07:00
14667758c6
chore(test): Automatic clean up periodic persistent disk. Fix #2523 ( #6136 )
...
* chore(test): Clean up periodic persistent disk
* delete disk
* address comment
* filter flag
* update licenses
* package
* tidy go mod
* chop elf license
* revert root directory change
2021-08-03 01:56:11 -07:00
5eedc99341
test: restore penguin_pipeline_kubeflow_test ( #6131 )
2021-07-25 00:55:41 -07:00
04342436a9
feat: use argo v3.1.2-patch.2. Part of #5718 ( #6082 )
...
* feat: use argo v3.1.2-patch
* upgrade to argo v3.1.2-patch.2
* update versions to v3.1.2
2021-07-22 03:51:25 -07:00
bd281a55fa
test: prepare samples to be emissary executor compatible. Part of #5718 ( #6109 )
...
* test: prepare samples to be emissary executor compatible
* fix sample test
2021-07-22 18:00:01 +08:00
697c041c36
test: temporarily skip verify workload identity binding
2021-07-15 05:14:07 +00:00
2557f40c5a
revert: feat: change release tags to vX.Y.Z. Part of #5954 ( #6034 )
...
This reverts commit b57bbeeb98
2021-07-14 14:43:56 +08:00
cb75b4483a
feat: use argo v3.1.1-patch. Part of #5930 ( #6027 )
...
* feat: use argo v3.1.1-patch
* chore: also upgrade argo go modules to patch
* add comment
* fix download
* fix licenses
* go mod tidy
2021-07-14 10:41:43 +08:00
a43af4112b
test: Address TFX presubmit test failure ( #6031 )
...
* Update presubmit-tests-tfx.sh
* Update presubmit-tests-tfx.sh
2021-07-13 16:20:02 -07:00
b653ea244c
feat: pipeline spec as a separate go module ( #6000 )
...
* feat: pipeline spec as a separate go module
* use api-generator image & update release image
* clean up & update licenses
* go mod tidy
2021-07-12 20:51:16 -07:00
b57bbeeb98
feat: change release tags to vX.Y.Z. Fixes #5954 ( #5974 )
...
* Add runtime resource request for GPUs
* clean up
* Updated docks and add check
* clean up
* update after feedback
* Clean up after feedback
2021-07-08 00:42:49 -07:00
ade34542e0
chore: Updates argoproj/argo URLs to argoproj/argo-workflows ( #5969 )
...
* Updt argoproj/argo URLs to argoproj/argo-workflows
* Update link to workflows.ts
* Update license.txt to reduce # of changed lines
* Revert changes to backend Dockerfile & license.txt
* Update license.txt, keep line endings
2021-07-06 21:52:20 -07:00
4451c7d453
feat: upgrade argo to v3.1.1. Part of #5718 ( #5971 )
...
* feat: upgrade argo to v3.1.1
* go mod tidy
2021-07-03 05:52:49 -07:00
2b65d51bdf
test: use new argo CLI URL ( #5966 )
...
* Update test-sample Dockerfile to use new argo URL
* Update argo URL
* Update Dockerfile
Co-authored-by: Yuan (Bob) Gong <4957653+Bobgy@users.noreply.github.com>
2021-07-02 23:38:49 -07:00
3973407310
feat: upgrade argo-workflows to v3.1.0. Part of #5718 ( #5922 )
2021-06-28 04:37:14 -07:00
28431fc3fd
feat: update MLMD to 1.0.0 ( #5786 )
...
* feat: update MLMD to 1.0.0
* update MLMD frontend client
2021-06-03 10:34:36 -07:00
1db9db5be8
chore: restore KFP SDK version to 1.6.2, decouple SDK release from KFP main release. ( #5739 )
...
* Update __init__.py
* Update bump-version-in-place.sh
2021-05-27 01:21:17 -07:00
bf8681b7e3
feat(sdk.v2): Add Google AIPlatformClient ( #5677 )
...
* ai platform client
* fix test
* update URL
2021-05-18 13:33:34 -07:00
f59f695e2c
test: pin google-cloud-bigquery to make TFX presubmit work ( #5662 )
2021-05-17 20:01:40 -07:00
2203206191
test: pin GKE cluster to 1.18 to use docker runtime
2021-05-18 08:35:18 +08:00
8b9d4d2ed5
chore(release): support using gh CLI
2021-05-13 08:03:56 +00:00
39f3d4ef60
test: Update presubmit-tests-tfx.sh to run tests from src root. ( #5639 )
2021-05-12 01:06:26 -07:00
98440d932c
test: Update test cases in presubmit-tests-tfx.sh ( #5628 )
...
replace taxi_pipeline_kubeflow_gcp_test with penguin_pipeline_kubeflow_gcp_test
2021-05-10 23:10:42 -07:00
76f8b3e9ac
chore(deps): bump lodash from 4.17.19 to 4.17.21 in /test/frontend-integration-test ( #5612 )
...
Bumps [lodash](https://github.com/lodash/lodash ) from 4.17.19 to 4.17.21.
- [Release notes](https://github.com/lodash/lodash/releases )
- [Commits](https://github.com/lodash/lodash/compare/4.17.19...4.17.21 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-08 04:39:07 -07:00
1cc378d15a
test: pin google-cloud-bigquery to fix TFX presubmit ( #5616 )
2021-05-08 03:57:07 -07:00
31939086d6
feat: update MLMD to 0.30.0 ( #5592 )
2021-05-05 17:03:05 -07:00
cc83e1089b
Assigned copyright to the project authors ( #5587 )
2021-05-05 13:53:22 +08:00
ab63956f3a
test: fix presubmit kubeflow-pipelines-tfx-python36 ( #5477 )
...
* Update presubmit-tests-tfx.sh
* --use-deprecated=legacy-resolver
* Update presubmit-tests-tfx.sh
2021-04-14 14:44:12 -07:00
02dbcfa062
test: more samples in v2 sample test ( #5431 )
...
* test: set up sample test for many samples
* test: rm loop_* tests from v1 sample test, they are already covered in v2 sample test
* fix condition pipeline for basic e2e test
* remove condition from e2e test
2021-04-09 08:34:03 -07:00
5d0f3a3d32
fix(deployment): fix default resource requests. Fixes #5148 ( #5409 )
...
* fix(deployment): fix default resource requests
* fix mkp presubmit for rc version
2021-04-01 11:52:14 +08:00
29da88b2be
chore(release): fix metadata release script and add presubmit ( #5410 )
...
* chore: fix metadata release script
* add presubmit test to verify release script
* fix
* show release script diff
2021-04-01 11:04:37 +08:00
bf8392d914
feat(sdk): Enable InputArtifact/OutputArtifact in lightweight Python-based components ( #5378 )
...
* Enable InputArtifact/OutputArtifact in lightweight Python components.
* Add copyright notice.
* Revert bad changes.
* Add executor_test.py
* Move test alongside code.
* Undo experimental change.
* Fix presubmit test script.
* presubmit fix.
* presubmit fix.
* presubmit fix.
* Add sample for v2 compiler.
* Address PR comments.
2021-03-25 14:31:46 -07:00
3d441b04c8
fix(test): Update reference link in test README.md ( #5354 )
...
Links are out-of-date in the README file.
2021-03-22 17:52:50 -07:00
f21a5abc3a
test: Update bazel version in presubmit-tests-tfx.sh ( #5356 )
2021-03-22 16:43:43 -07:00
139bf0b717
chore(test): add chensun to test/OWNERS, remove numerology ( #5357 )
2021-03-22 15:28:43 -07:00
a9288861b4
chore(release): fix release script 2
2021-03-22 21:43:11 +08:00
1e240885a1
chore: add missing places we need to upgrade mysql to 5.7 ( #5301 )
...
* fix(deployment): [gcp marketplace] fix mysql deployment after upgrade to 5.7
* tag_for_hosted should fail on error
* upgrade mysql to 5.7
2021-03-15 11:12:48 -07:00
3cdb1d9954
feat(deployment): update mysql to 5.7 and support running as nonroot ( #5278 )
...
* Create mysql-serviceaccount.yaml
* Update kustomization.yaml
* Update mysql-deployment.yaml
* Update mysql-deployment.yaml
* Update mysql-deployment.yaml
* Update tag_for_hosted.sh
* Update mysql-deployment.yaml
2021-03-14 06:46:47 -07:00
02cb6e3300
test(samples): fix sample-test argo logs command. Fixes #5283 ( #5284 )
...
* test(samples): fix sample-test argo logs command
* Update check_notebook_results.py
* Update run_sample_test.py
* Update run_resnet_cmle_test.py
2021-03-11 19:39:24 -08:00
be64b32798
feat: update argo image to v2.12.9 and automate update process. Fixes #5232 ( #5266 )
...
* add notices and licenses for argo 2.12
* feat: upgrade argo images to v2.12.9
* update all refs to argo image version
* add NOTICES generation script
* upgrade argo cli to latest
* fix
* fix
* add license_info.csv back
* make release process safer
* add back third_party/license.txt
* refactor(deployment): move argo manifests to third-party, updates for 2.12.9
* update marketplace snapshots
* set up marketplace presubmit test
* add comment
2021-03-10 12:52:42 +08:00
8b3d741c6e
chore(release): after release, also bump master to 1.4.1 ( #5196 )
...
* update release instructions
* chore(release): bump version to 1.4.1
* Update setup.py
2021-03-01 12:10:16 -08:00
03147b0dba
chore(release): fix release script
2021-02-26 14:45:56 +08:00
7d017f3b12
chore(release): change all release scripts to run in docker ( #5195 )
...
* wip
* wip
* wip
* wip
* fix non-root
* fix all
* update doc
* update implementation details readme
2021-02-26 13:11:00 +08:00
875137aa58
fix(samples): remove TFX iris example. Part of #5137 ( #5189 )
...
* fix(samples): remove TFX iris example
* rm all occurrences
2021-02-25 17:40:42 +08:00
cd55a55c62
test: fix postsubmit test is_integration_test flag
2021-02-24 14:05:11 +00:00
d3f77b292b
test: fix tfx version consistently. Part of #5137 ( #5179 )
2021-02-24 21:50:29 +08:00
Chen Sun
Connor McCarthy
Lingqing Gan
gkcalat
Joe Li
Yuan (Bob) Gong
Yaqi Ji
capri-xiyue
James Liu
Hao Xin
Joshua Carp
Yuan Gong
Jiyong Jung
Niklas Hansson
Joe Liedtke
dependabot[bot]
Alexey Volkov
Ajay Gopinathan
juliusvonkohout