cd4aa7d71f
refactor(components): De-hardcoded local output paths. ( #4495 )
...
* Components - De-hardcoded local output paths.
* pip install pathlib2
* Added component.yaml changes
2021-06-08 01:13:45 -07:00
73780697c1
test(v2): presubmit unit tests of v2 ( #5802 )
...
* presubmit unit tests of v2
* added mlmd port forward
* deleted mlmd port forward
* rename
* added kubectl port forward
* renamed test
2021-06-07 22:37:52 -07:00
a75a3c7127
chore(launcher): move artifact metadata to metadata struct field. Fixes #5788 ( #5793 )
...
* feat(launcher): move component output metadata to metadata field
* add MLMD validation for metrics_visualization_v2
* clean up
* address comment
* fix
2021-06-07 22:37:45 -07:00
941879dd5c
feat(components): Adding Visualization component for PyTorch - KFP ( #5810 )
...
* Adding visualization component
Signed-off-by: ankan94 <ankan@ideas2it.com>
* Switch to Apache2 License
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-07 21:57:53 -07:00
f843121e91
feat(components): Adding Minio component for PyTorch - KFP ( #5808 )
...
* Adding minio component and tests
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Minio executor fix
Signed-off-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: ankan94 <ankan@ideas2it.com>
2021-06-07 21:57:45 -07:00
c5325db7d2
feat(components): Adding Trainer component for PyTorch - KFP ( #5767 )
...
* Create README.md
Initial Readme
* Create README.md
Initial commit for the PyTorch pipeline examples
* Update README.md
* Adding PyTorch training component
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding PyTorch - trainer unit tests
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing UT and adding setup.py
Signed-off-by: ankan94 <ankan@ideas2it.com>
* update setup.py, trainer compopents pyfiles,applied pylyintrc
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* adressed the review comments,applied pylint, black
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* added copyright headers in tests files
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* updated base component
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* Changing to Apache2 License
Reviewed license change with Legal team
* Switch to Apache2 License
* Add tox for test automation with presubmit script
* Add model archiver to dependencies
* Cleanup setup.py
* Cleanup
* Cleanup
* Cleanup
* Using common fixture for unit tests and adding gpu fix for saving the model
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Changing to Apache2 License
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* resolve typo
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* Added OWNERS
* OWENRS will be added as separate PR
* fix detect_version function in setup.py
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* Cleanup for setup description field warnings
Co-authored-by: Geeta Chauhan <4461127+chauhang@users.noreply.github.com>
Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
Co-authored-by: Geeta Chauhan <gchauhan@fb.com>
2021-06-08 12:12:56 +08:00
b08b29f46e
feat(components): PyTorch - Added the Create PyTorch Model Archive component ( #5630 )
...
* Components - PyTorch - Added the Create PyTorch Model Archive component
* Added component to the sample pipeline
2021-06-07 18:07:54 -07:00
e20a1b8bda
feat(components): Adding Mar component for PyTorch - KFP ( #5780 )
...
* adding mar component
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* removed extra files
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* removed exta file __init__py
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* Switch to Apache2 License
* Move tests folder
* Adding spec for mar component
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
Co-authored-by: Geeta Chauhan <gchauhan@fb.com>
Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-07 08:30:51 -07:00
f61048b5d2
fix(scheduledworkflow): Set location to make CRON timezone work, Fixes #2653 ( #5800 )
...
* set location
* update log
* fix log
* install tzdata
2021-06-07 05:19:51 -07:00
6a1b841db9
chore(launcher): put pipeline context as parent of run context. Part of #5669 ( #5785 )
2021-06-04 20:54:48 -07:00
5dcbd35b71
chore: add link and Python 3.8/3.9 classifiers to setup.py ( #5715 )
...
* Add link and Python 3.8/3.9 classifiers to setup.py
The link should appear on PyPI: https://pypi.org/project/kfp/#description
* use "The Kubeflow Authors" in setup.py
* Include more links in Python package description
2021-06-04 12:47:48 -07:00
14cb98b662
chore: update python version for build.sh ( #5799 )
2021-06-03 23:07:36 -07:00
85013375f0
Update pipeline_spec.proto ( #5787 )
...
The single quote is no longer supported.
2021-06-03 16:00:36 -07:00
63093d29e5
release: KFP SDK and v2 launcher 1.6.3 ( #5796 )
...
* Update __init__.py to 1.6.3
* Update v2_compat.py
2021-06-03 14:26:36 -07:00
6b87155a33
feat(sdk.v2): Support Exit handler in v2 compiler. ( #5784 )
2021-06-03 12:58:36 -07:00
ef33b9e77d
feat(frontend): Support v2 confusion matrix visualization. Issue #5668 ( #5781 )
...
* feat(frontend): Shows ConfusionMatrix in Metrics Tab
* adjust uI
* remove comment
* definition description
* moving wrapper
* runtype check
2021-06-03 11:36:36 -07:00
28431fc3fd
feat: update MLMD to 1.0.0 ( #5786 )
...
* feat: update MLMD to 1.0.0
* update MLMD frontend client
2021-06-03 10:34:36 -07:00
0d84877c98
fix(sdk): Add http status code check for token requests. Fixes #4312 ( #5782 )
...
Signed-off-by: Anna Jung (VMware) <antheaj@vmware.com>
2021-06-02 23:55:36 -07:00
f3c0c464bf
chore(deps): bump lodash from 4.17.19 to 4.17.21 in /frontend ( #5624 )
...
Bumps [lodash](https://github.com/lodash/lodash ) from 4.17.19 to 4.17.21.
- [Release notes](https://github.com/lodash/lodash/releases )
- [Commits](https://github.com/lodash/lodash/compare/4.17.19...4.17.21 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-06-02 18:05:35 -07:00
4eb722e93f
fix(sdk): resolve pipeline_root and run_uid placeholders in container env ( #5772 )
2021-06-02 16:26:35 -07:00
ee77fd86ec
fix(sdk.v2): fix metrics outputs populating to unblock pipeline run ( #5770 )
2021-06-02 13:18:35 -07:00
84387a8083
release(api): Bump kfp-pipeline-spec version to 0.1.8 ( #5778 )
2021-06-02 11:44:35 -07:00
adc1951518
feat(deployment): configurable v2 compatible mode default pipeline root. Part of #5680 . Fixes #5704 ( #5750 )
...
* feat(deployment): configurable v2 compatible mode default pipeline root
* clarify documentation
2021-06-02 08:52:02 -07:00
cf2807c558
fix(deployment): GCP AI Platform Pipelines -- correct default values when some fields left empty. Fixes #5717 ( #5777 )
...
* fix(deployment): GCP AI Platform Pipelines -- correct default values when some fields left empty
* backward compatible databaseNamePrefix behavior
2021-06-02 05:25:02 -07:00
1b780d6b9d
test(samples): fix ai_platform.ipynb. Fixes #5775 ( #5776 )
2021-06-02 04:27:02 -07:00
6d5675cc60
chore(deps): bump ws from 6.2.1 to 6.2.2 in /frontend/server ( #5771 )
...
Bumps [ws](https://github.com/websockets/ws ) from 6.2.1 to 6.2.2.
- [Release notes](https://github.com/websockets/ws/releases )
- [Commits](https://github.com/websockets/ws/commits )
---
updated-dependencies:
- dependency-name: ws
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-06-02 03:16:02 -07:00
831c15ca98
chore(deps): bump urllib3 from 1.26.3 to 1.26.5 in /sdk/python ( #5769 )
...
Bumps [urllib3](https://github.com/urllib3/urllib3 ) from 1.26.3 to 1.26.5.
- [Release notes](https://github.com/urllib3/urllib3/releases )
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst )
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.3...1.26.5 )
---
updated-dependencies:
- dependency-name: urllib3
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-06-01 21:59:01 -07:00
43994abb7e
feat(v2): enable v2 compatible mode in full Kubeflow with zero config. Fixes #5680 ( #5697 )
...
* feat(v2): enable v2 compatible mode in full Kubeflow
* fix
* fix
* move objectstore reelated code to separate package
* fix style
2021-06-01 18:27:01 -07:00
601b104c0b
feat(frontend): MetricsTab for NodeDetail, ROC Curve from MLMD custom property. Issue #5668 ( #5731 )
...
* feat(frontend): MetricsTab for NodeDetail, ROC Curve from MLMD custom property
* add back test renderer
* remove debug tool
* address nit comments
* more comment address
* merge metrics to visualization
* error boundary, revert banner change, more testing, data validation
* attempt to use actual function
* clear queryclient
* address comments
* address comments
* address comments
2021-06-01 09:16:04 -07:00
0a373d02d9
chore: set up AUTHORS file. Fixes #5470 ( #5766 )
2021-06-01 02:49:05 -07:00
5f34603e60
fix(sdk, v2): Fix error when replica_count isn't set ( #5761 )
2021-06-01 01:48:04 -07:00
2991602cfc
feat(sdk): Better error message when compiling for v2. Fixes #5688 , Fixes #5727 ( #5759 )
...
* Better error message when compiling for v2
* update samples
2021-05-31 13:39:03 -07:00
421211087c
fix(cli): handle when pipeline.paramters is None ( #5725 )
...
Signed-off-by: ByungchanKim <kbc8894@gmail.com>
2021-05-29 17:16:01 -07:00
4e5d724fef
feat(sdk): Dropped support for Python 3.5. Fixes #4584 ( #4611 )
...
Fixes https://github.com/kubeflow/pipelines/issues/4584
2021-05-28 17:20:00 -07:00
fa5ac25678
fix(sdk): Avoid inserting duplicate input parameters in v2 compatible mode. ( #5740 )
2021-05-28 15:06:00 -07:00
f9f455ed96
fix(sdk.v2): Fix the bug where string concat inside a loop may break compilation. ( #5752 )
2021-05-28 13:54:01 -07:00
bd03eab678
chore(deps): bump dns-packet from 1.3.1 to 1.3.4 in /frontend ( #5749 )
...
Bumps [dns-packet](https://github.com/mafintosh/dns-packet ) from 1.3.1 to 1.3.4.
- [Release notes](https://github.com/mafintosh/dns-packet/releases )
- [Changelog](https://github.com/mafintosh/dns-packet/blob/master/CHANGELOG.md )
- [Commits](https://github.com/mafintosh/dns-packet/compare/v1.3.1...v1.3.4 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-28 03:58:59 -07:00
6732b0d2cd
chore: Adding chensun in KFP root OWNERS ( #5747 )
2021-05-27 15:46:59 -07:00
d7b927feeb
fix(components/google-cloud): update version to include google-cloud-aiplatform fix ( #5721 )
...
* fix: update version to include google-cloud-aiplatform fix
* fix: update dockerfile to build from PR, will update once google-cloud-aiplatform releases fix
* fix: upgrade dependency to latest google-cloud-aiplatform release
2021-05-27 11:16:59 -07:00
efe916c075
Fix the cache-deployer to run as non root ( #5742 )
2021-05-27 08:39:17 -07:00
1db9db5be8
chore: restore KFP SDK version to 1.6.2, decouple SDK release from KFP main release. ( #5739 )
...
* Update __init__.py
* Update bump-version-in-place.sh
2021-05-27 01:21:17 -07:00
ebf5310764
fix(frontend): Remove alphabetical sorting of the metrics column. Fixes #5215 ( #5701 )
...
* Remove alphabetical sorting of the metrics column
Signed-off-by: Anna Jung (VMware) <antheaj@vmware.com>
* Fix code format
Signed-off-by: Anna Jung (VMware) <antheaj@vmware.com>
* Refactor test to use data-testid
Signed-off-by: Anna Jung (VMware) <antheaj@vmware.com>
* Remove snapshot in favor of text comparison
Signed-off-by: Anna Jung (VMware) <antheaj@vmware.com>
2021-05-26 19:38:16 -07:00
fba546e0f4
chore(components/google-cloud): update readme with link to samples & api docs ( #5734 )
...
* update readme with link to samples & api docs
* correct links
* link to main page of read the docs
* spell correction
2021-05-26 10:42:16 -07:00
435f6b1abe
fix(backend): Fixed workflow cannot be retried with node xxx in Omitted ( #5738 )
...
Fixes #5537
2021-05-26 09:01:41 -07:00
0cf76a46ed
chore(deps-dev): bump browserslist from 4.8.7 to 4.16.5 in /frontend ( #5736 )
...
Bumps [browserslist](https://github.com/browserslist/browserslist ) from 4.8.7 to 4.16.5.
- [Release notes](https://github.com/browserslist/browserslist/releases )
- [Changelog](https://github.com/browserslist/browserslist/blob/main/CHANGELOG.md )
- [Commits](https://github.com/browserslist/browserslist/compare/4.8.7...4.16.5 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-25 21:13:41 -07:00
b50a5cfc4e
chore(components): AWS SageMaker update eks cluster version for tests ( #5735 )
2021-05-25 19:53:40 -07:00
cbea3f087e
chore: Adding ji-yaqi to API & SDK OWNERS files, remove inactive members. ( #5733 )
...
* Update OWNERS
* Update OWNERS
2021-05-25 16:06:40 -07:00
58f74d3347
feat(sdk): special handling for type annotation using `typing.Optional` ( #5716 )
...
* handle type annotation with Optional
* remove typing._GenericAlias, which is available only after Py 3.7
* fix
* fix py3.6 test
* address review comments
2021-05-25 06:57:09 -07:00
226079338b
fix(frontend): Truncate large Markdown file to prevent UI crashing. Fix #5513 ( #5585 )
...
* (frontend): Truncate large Markdown file to prevent UI crashing
* limit 50KB as the markdown render size
* address comment
* memorization
* address comments
2021-05-24 21:10:09 -07:00
b1bf6c63a6
chore(deps): bump hosted-git-info from 2.7.1 to 2.8.9 in /frontend ( #5631 )
...
Bumps [hosted-git-info](https://github.com/npm/hosted-git-info ) from 2.7.1 to 2.8.9.
- [Release notes](https://github.com/npm/hosted-git-info/releases )
- [Changelog](https://github.com/npm/hosted-git-info/blob/v2.8.9/CHANGELOG.md )
- [Commits](https://github.com/npm/hosted-git-info/compare/v2.7.1...v2.8.9 )
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-05-24 06:12:32 -07:00
Alexey Volkov
capri-xiyue
Yuan (Bob) Gong
ankan94
shrinath-suresh
Arvind Gautam
Windfarer
john li
Yaqi Ji
hilcj
Chen Sun
James Liu
Anna
dependabot[bot]
Wakana Nogami
ByungchanKim
sasha-gitg
juliusvonkohout
sina chavoshi
guanhuichen
Suraj Kota