Commit Graph

3558 Commits

Author SHA1 Message Date
Chen Sun d1f90b34d6
chore: Release KFP SDK and v2 launcher 1.8.0 (#6505) 2021-09-03 16:29:10 -07:00
Chen Sun 236f67ec8d
fix(samples): Add `kfp_package_path` to importer sample test. (#6507) 2021-09-03 15:49:10 -07:00
shrinath-suresh a54aa33f51
chore(components/pytorch): bert samples - confusion matrix (#6458)
* Fixing confusion matrix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Enabling confusion matrix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Passing attention masks to compute_bert_outputs

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-09-03 12:05:10 -07:00
Chen Sun 2f19a26ffd
chore(sdk): Format all Python files under SDK folder. (#6501)
* Reformat sdk only using the new yapf config.

* Reformat docstrings using docformatter.

* update golden files to resolve diff caused by whitespaces

* fix some tests

* format .py files under sdk/python/tests using yapf

* additional docformatter

* fix some tests
2021-09-03 11:25:11 -07:00
James Liu a35812429c
feat(frontend): Create an Expand button to open SubDAG. Partial #6301 (#6490)
* feat(frontend): Create an Expand button to open SubDAG

* address comment
2021-09-02 15:08:18 -07:00
chongyouquan 14fbfb6a75
chore(components/google-cloud): Post release 0.1.6 (#6498)
* Update version.py

* Update RELEASE.md

* Add long_description_content_type to setup.py
2021-09-02 13:27:18 -07:00
Yaqi Ji 8100c5e02c
feat(sdk): load v1 and v2 component spec (#6497)
* feat(sdk): load v1 and v2 component spec

* Update RELEASE.md
2021-09-02 12:40:18 -07:00
IronPan 166c71cb79
feat(components/google-cloud): add dataflow wait component (#6484)
* add gcp resources proto

* move

* add wait component implementation

* format the python files in GCPC

* format the python files in GCPC

* format the python files in GCPC

* format the python files in GCPC
2021-09-02 09:03:31 -07:00
IronPan 66a1840fe3
feat(components): Add static YAML for batch predict, create endpoint, upload and deploy model (#6466)
* deprecate     'CustomPythonPackageTrainingJobRunOp',

* add yaml

* add components

* revert unecessary changes

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bugs

* fix bugs
2021-09-02 08:49:31 -07:00
IronPan 9f9830fef2
chore(components/google-cloud): format the python files in GCPC (#6485) 2021-09-01 19:01:30 -07:00
Yaqi Ji 5a8298ec2e
chore(sdk): fix typing issues. (#6480) 2021-09-01 16:17:37 -07:00
Chen Sun a537a9c4a2
chore: Update yapf config and move it to sdk folder. (#6467)
* Update yapf config

* move style config to sdk folder

* link to style config file
2021-09-01 16:17:30 -07:00
sina chavoshi 4572848cb6
chore(components/google-cloud): Update tox test env to Python 3.9 (#6491)
* upgrade nox env to python 3.9

* move flake config under [flake8]

* fix dependancies
2021-09-01 15:44:30 -07:00
sina chavoshi 4b12235f53
chore(components/google-cloud): Remove W504 from flake8 rules to match auto format (#6488) 2021-09-01 14:50:31 -07:00
Chen Sun c3d982f69f
chore: Release kfp-pipeline-spec 0.1.10 and update golang generated code (#6489) 2021-09-01 14:38:30 -07:00
IronPan 572643f831
feat(components/google-cloud): add gcp resources proto (#6478)
* add gcp resources proto

* move
2021-09-01 11:41:30 -07:00
IronPan 226d97bed5
chore(components/google-cloud): update custom job component yaml to match the latest code (#6475)
/assign @SinaChavoshi
2021-09-01 11:38:30 -07:00
sina chavoshi 56cf094fd3
chore(components/google-cloud): Update google-cloud-aiplatform min version to 1.4.0 (#6482) 2021-08-31 16:52:44 -07:00
sina chavoshi fa1f1a45fb
chore(components/google-cloud): Add model forecast documentation to Sphinx docs (#6483)
* add model forcast documentation to sphinx docs

* reorder links
2021-08-31 16:49:44 -07:00
Joshua Carp f43ecc223d
chore(sdk): Import mock from stdlib and drop dependency. (#6456)
* Import mock from stdlib and drop dependency.

* Drop mock from requirements.

h/t @chensun
2021-08-31 16:38:44 -07:00
yzhaozh 3a8842966e
fix(components/google-cloud): Fix the default value of preprocessing_bigquery_dataset (#6481) 2021-08-31 16:01:43 -07:00
James Liu 964a62e970
feat(frontend): Add styling for Artifact Node. Partial #6280 (#6418)
* feat(frontend): Add styling for Artifact Node

* comment

* use database
2021-08-31 13:43:44 -07:00
capri-xiyue 4403b52a22
chore(v2): support v2 makefile in mac (#6441)
* support v2 makefile in mac

* fixed make file

* added default value if go env is not set

* fixed makefile

* fixed makefile

* fixed makefile

* fixed makefile

* added readme
2021-08-31 12:41:44 -07:00
James Liu d03277fe4e
feat(frontend): SubDag Node and mock samples. Partial #6419. Fix #6302. Fix #6398 (#6420)
* feat(frontend): SubDag Node and mock samples

* fix import

* comment address

* from aside to div

* address comments
2021-08-31 10:04:03 -07:00
capri-xiyue 4438929259
feat(v2): added importer support (#6415)
* added importer support in compilor

* added importer launcher

* complete importer launcher draft

* added importer e2e test draft

* added importer e2e test draft and fixed build error

* added importer e2e test draft and fixed build error

* changed sample test config

* fixed mlmd publish error

* fixed format and added task verification for importer e2e test

* changed sample v2 importer test

* added non default bucket support

* fixed importer build error

* fixed e2e test

* modify importer e2e test

* fixed e2e test

* fixed e2e test

* fixed e2e test

* fixed importer e2e test

* fixed comments

* fixed unit test

* fixed importer e2e test

* added todo comment

* remove unused code

* Update importer.go

Co-authored-by: Yuan (Bob) Gong <4957653+Bobgy@users.noreply.github.com>
2021-08-31 04:06:03 -07:00
sina chavoshi 610a1f257c
feat(components/google-cloud): Support Proto Plus serialization (#6464)
* support proto serialization

* clean up comments
2021-08-30 12:39:25 -07:00
Chen Sun cfefc6d397
feat(sdk.v2): Support `set_display_name` in v2. (#6471)
* Support `set_display_name` in v2.

* update comment in proto

* fix test
2021-08-30 12:07:25 -07:00
Chen Sun 63913bec25
chore(sdk): Add Alpha feature notice for local client (#6462)
* alpha notice for local client

* expose `pipeline_root` parameter from the wrapper function.
2021-08-30 10:55:25 -07:00
sasha-gitg aebe8d757e
fix: Rename 'python_module' to 'python_module_name' and fix type to str (#6473) 2021-08-30 10:26:25 -07:00
Jaeyeon Kim 728915f4e4
feat(sdk): detail option to kfp run get. Fixes #6315 (#6404)
* [CLI]: add detail option to kfp run get command

- to get more detailed information

Signed-off-by: Jaeyeon Kim <anencore94@gmail.com>

* merge print_run_in_detail with _display_run

Signed-off-by: Jaeyeon Kim <anencore94@gmail.com>
2021-08-30 04:21:24 -07:00
Yuan (Bob) Gong 9afe125a75
revert: "feat(sdk): Add description to upload_pipeline_version in kfp. Part of #6256" (#6468)
This reverts commit 8b51cc4f22.
2021-08-30 00:42:24 -07:00
Joe Liedtke b8c450f9ac
feat(api): Updates pipeline_spec.proto to use google.protobuf.Value (#6402) 2021-08-30 00:00:24 -07:00
James Liu e035a88149
feat: upgrade MLMD to 1.2.0. Fix #6436 (#6437)
* chore(frontend): upgrade MLMD to 1.2.0

* update version for backend

* update dependencies

* makefile

* tfx compatiblity update
2021-08-28 16:59:22 -07:00
yzhaozh e45782e971
fix(components/google-cloud): Fix the keyword argument 'project_id' to 'project' after the yaml upd… (#6463) 2021-08-27 17:18:22 -07:00
James Liu 36ac7defcb
chore(third_party): Add a script to update MLMD. (#6454)
* chore(third_party): Add a script to update MLMD

* address comments
2021-08-27 16:49:22 -07:00
yzhaozh c12799675a
feat(components/google-cloud): add preprocessing_bigquery_dataset to the inputs of preprocessing component (#6461) 2021-08-27 16:32:22 -07:00
Chen Sun d2a1e633ff
chore(sdk): Update SDK 1.7.2 release note with list of breaking changes. (#6460) 2021-08-27 15:13:21 -07:00
yzhaozh c41e4a194b
fix(components/google-cloud): Move the input param details out of the pipeline definition. (#6459)
* Move the input param details out of the pipeline definition.

* Add input_tables to pipeline method args.
2021-08-27 15:00:21 -07:00
IronPan 7d6133b564
fix(components): move components to contrib/ folder (#6438) 2021-08-27 14:35:22 -07:00
IronPan 163cfa92fe
fix(components): Update all GCPC components naming to be consistent (#6449)
* rename to keep all GCPC component name consistent

* revert
2021-08-27 14:16:21 -07:00
yzhaozh a72c8b7901
feat(components/google-cloud): add README.md file for forecasting components. (#6452) 2021-08-27 12:11:06 -07:00
sina chavoshi 27b3511ad5
fix(components/google-cloud): Switch to v2 types_util (#6453)
* swtich to v2 types_util

* use v1 load_component_from_text
2021-08-26 14:42:05 -07:00
James Liu aec5792cb2
fix(frontend): Fix the styling for custom icons on sideNav (#6440)
* fix(frontend): Fix the styling for custom icons on sideNav

* fix test
2021-08-26 05:23:05 -07:00
Yaqi Ji 8f10bcdf16
chore: Release KFP SDK and v2 launcher 1.7.2 (#6442)
* Update RELEASE.md

* Update __init__.py

* Update v2_compat.py

* Update RELEASE.md
2021-08-25 19:58:04 -07:00
Chen Sun 96bb17531f
test(sdk): ignore kfp version in v2_compatible tests (#6444) 2021-08-25 17:06:05 -07:00
sina chavoshi a165cc6ea8
fix(components/google-cloud): Remove experimental modules from init (#6443) 2021-08-25 16:31:51 -07:00
Chen Sun 06044dd89e
fix(sdk.v2): fix importer not taking output from upstream (#6439) 2021-08-25 15:23:50 -07:00
Yaqi Ji 65174cdd93
feat(sdk): Add BaseModel to component_spec data classes (#6372)
* pydantic setup

* switch to union types

* Fix base_component tests

* switch to pydantic for python3.6 compat and fix tests

* Fix tests

* use str for type

* fix tests

* Consistent quote sign

* Address comments

* Update type
2021-08-25 14:00:02 -07:00
IronPan c783705c0e
feat(components): Copy the GCP components to contrib folder (#6421)
* move a few components to contrib

* move a few components to contrib

* move a few components to contrib

* move a few components to contrib

* move a few components to contrib
2021-08-25 07:59:45 -07:00
IronPan d864db16f7
feat(components): move dataflow/bq component to google-cloud (#6422)
* move dataflow/bq to google-cloud

* move dataflow/bq to google-cloud
2021-08-25 07:26:45 -07:00