Commit Graph

2751 Commits

Author SHA1 Message Date
Rhys Arkins 0e69a904b5
chore: set npm rangeStrategy in separate rule (#5075) 2021-02-01 22:35:35 -08:00
Yuan (Bob) Gong 5bc4c71cf4
chore: change renovate config to rangeStrategy=update-lock file for npm (#5074) 2021-02-02 13:11:41 +08:00
Yuan (Bob) Gong affb7b88ee
Update renovate.json5 (#5072) 2021-02-02 12:06:14 +08:00
WhiteSource Renovate 23f5726062
Configure Renovate (#5056)
* Add renovate.json

* Update renovate.json

* Update renovate.json

* Apply suggestions from code review

Co-authored-by: Rhys Arkins <rhys@arkins.net>

* Update renovate.json

* Update renovate.json

* Update renovate.json

* Update renovate.json

* Update renovate.json

* Update renovate.json

Co-authored-by: Rhys Arkins <rhys@arkins.net>

* Update and rename renovate.json to .github/renovate.json5

* Update renovate.json5

* Apply suggestions from code review

Co-authored-by: Rhys Arkins <rhys@arkins.net>

* Update renovate.json5

* Update renovate.json5

* Apply suggestions from code review

Co-authored-by: Rhys Arkins <rhys@arkins.net>

* Update renovate.json5

* Update renovate.json5

Co-authored-by: Yuan (Bob) Gong <4957653+Bobgy@users.noreply.github.com>
Co-authored-by: Rhys Arkins <rhys@arkins.net>
2021-02-01 18:53:36 -08:00
Yuan (Bob) Gong c5c8d715ed
fix: upgrade some images to reduce vulnerabilities (#5065)
* fix: upgrade some images to reduce vulnerabilities

* upgrade openssl
2021-02-01 10:23:02 -08:00
StefanoFioravanzo b5c10d2a21
feat(swf): Add a [[RunUUID]] macro (#4995)
* [SWF] Add [[RunUUID]] macro

Signed-off-by: Stefano Fioravanzo <stefano@arrikto.com>

* [SWF] Fix typo in function name

Signed-off-by: Stefano Fioravanzo <stefano@arrikto.com>
2021-02-01 03:35:02 -08:00
Chen Sun f00dad820c
chore(doc): update release doc with caveats on `release-on-tag` retry (#4917) 2021-02-01 02:22:02 -08:00
Chen Sun 26de102f82 chore(release): bumped version to 1.4.0-rc.1 2021-02-01 00:18:50 -08:00
Chen Sun 2e7eb9d356
fix(SDK): require PyYAML>=5.3 (#5063) 2021-01-30 23:36:02 -08:00
Vitalii Vokhmin 2f1db59798
fix(sdk): compile ParallelFor in a deterministic manner (#4926)
* fix(sdk): compile ParallelFor in a deterministic manner

During compilataion ParallelFor components end up with randomized names,
which makes it very inconvenient to compare two versions of a pipeline.
This commit fixes this issue.

* fix(sdk): fix new parallel-for test cases
2021-01-29 18:31:09 -08:00
Michalina Kotwica ce985bc287
fix(sdk): Allow keyword-only arguments in pipeline function signature (#4544)
* add test for keyword-only arguments in pipeline func

* fix: kwargs-only argument for pipeline func

* test: kwargs generate same yaml as args

* remove whole metadata

* assert -> self.assertEqual

* programmatic example --> fixed example

* same name for both

Co-authored-by: Alexey Volkov <alexey.volkov@ark-kun.com>
2021-01-29 18:31:02 -08:00
Chen Sun cad02dc283
fix(test): Pin pip version in presubmit-tests-tfx.sh Fixes #5049 (#5050)
* Update presubmit-tests-tfx.sh

* Update presubmit-tests-tfx.sh

* Update presubmit-tests-tfx.sh
2021-01-29 15:16:01 -08:00
Chen Sun 56476cc3a1
fix(samples): Bump dataproc image version to 1.5 in xgboost_training_cm.py (#5062)
* Update xgboost_training_cm.py

* Update xgboost_training_cm.py
2021-01-29 14:05:01 -08:00
Chen Sun 48a34e677d
disable discovery cache (#5058) 2021-01-29 11:08:03 -08:00
dependabot[bot] 24100c45e1
chore(deps): bump immer from 1.10.0 to 8.0.1 in /frontend (#5018)
Bumps [immer](https://github.com/immerjs/immer) from 1.10.0 to 8.0.1.
- [Release notes](https://github.com/immerjs/immer/releases)
- [Commits](https://github.com/immerjs/immer/compare/v1.10.0...v8.0.1)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-01-29 01:14:10 -08:00
dependabot[bot] 3fcd5e784e
chore(deps): bump axios from 0.19.2 to 0.21.1 in /frontend/server (#4949)
Bumps [axios](https://github.com/axios/axios) from 0.19.2 to 0.21.1.
- [Release notes](https://github.com/axios/axios/releases)
- [Changelog](https://github.com/axios/axios/blob/v0.21.1/CHANGELOG.md)
- [Commits](https://github.com/axios/axios/compare/v0.19.2...v0.21.1)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-01-29 01:14:01 -08:00
Yuku Takahashi c653c30050
fix(components): cast return value of gcp/automl/create_dataset_for_tables. Fixes #5053 (#5054) 2021-01-28 23:33:01 -08:00
Chen Sun ecb14f40bb
chore(sdk): Remove v2 components fork, use v1 instead. (#5042)
* Remove v2.components fork

* fix setup.py
2021-01-28 18:20:07 -08:00
James Liu 35bc50e8e7
Upgrade tfx version to 0.26.0 in backend (#5052) 2021-01-28 17:49:01 -08:00
Chen Sun d14f64e4fe
fix(components): Update components/local/base/Dockerfile to use Python3 (#5047) 2021-01-28 14:12:01 -08:00
Chen Sun 76246f4758
chore(components): Delete deprecated dataproc components (#5045)
* Stop building deprecated dataproc components, and delete the code

* fix cloudbuild.yaml

* more cleanup
2021-01-28 00:16:01 -08:00
Suraj Kota 2dd8de3f6f
chore(components): SageMaker fix flaky groundtruth test (#5044) 2021-01-27 20:52:01 -08:00
Chen Sun e6aeb9cc39
fix(component): Use Python3.6 to build KFP launcher component (#5039) 2021-01-27 11:06:01 -08:00
Jiaxiao Zheng 32ce8d8f90
feat(api): Add AI Platform Custom Job spec to IR (#5035) 2021-01-26 04:18:00 -08:00
Niklas Hansson 2f04bc6697
fix(backend): fix periodic schedule to begin at start time. Fixes #3935 (#5027)
* Fixed periodic schedule to start at starttime

* clean up

* clean up
2021-01-26 03:37:08 -08:00
James Liu bf655186a3
feat(frontend): Add Task Details tab when clicking a node: Info includes ID, Name, Time, Status. Fixes #4699 (#5023)
* Add Task Details tab when clicking a node: Info includes ID, Name, Time, Status

* fix test and add comment

* Address comments

* address comment, move tab to right order

* small update on the optional chaining

* test the python upgrade for presubmit failure

* Try with python 3.8 for latest stable version

* Change python 3.7 because 3.8 is not supported by current ml-metadata version

* Update Dockerfile

Co-authored-by: Yuan (Bob) Gong <4957653+Bobgy@users.noreply.github.com>
2021-01-26 03:37:01 -08:00
Chen Sun 0fd6580e24
fix(sample): Fix missing `--region` in dataflow sample notebook. Fixes #5007 (#5036)
* Update dataflow.ipynb

* Update dataflow.ipynb

* Update dataflow.config.yaml

* Update dataflow.config.yaml
2021-01-26 02:34:00 -08:00
James Liu a8b7fc97b1
fix(test): Fix presubmit with python version upgrade (#5033)
* Fix presubmit with python version upgrade

* Update Dockerfile

Co-authored-by: Yuan (Bob) Gong <4957653+Bobgy@users.noreply.github.com>
2021-01-26 01:47:00 -08:00
Niklas Hansson f653913096
fix(frontend): updated the docs to point to the correct cron expression descriptions. Fixes #2654 (#5028)
* updated the docs to point to the correct cron expression descriptions

* fix test
2021-01-22 16:09:40 -08:00
Chen Sun f906dee88f
chore(sdk): Rename test_source.py to pipeline_source.py to make it compatible with pytest (#5024) 2021-01-22 01:01:27 -08:00
Jiaxiao Zheng 3ee0ae01eb
chore: Resolve comments in #5003 (#5009)
* use pathlib

* fix tests
2021-01-21 09:29:02 -08:00
Ben Wallace 9a30e973d9
fix(backend): allow multiple values per key/op in filter. Fixes #4975 (#4990)
* modify filter fields to map strings to slices of structs

* fix broken json tests

* add unit tests for new functionality
2021-01-20 15:57:00 -08:00
Alexey Volkov 7ed110e984
fix(mkp): Added default values for parameters (#5010)
Fixes https://b.corp.google.com/issues/177083468
2021-01-19 14:29:58 -08:00
Yuan (Bob) Gong 82e2f819f5
chore(proxy): use production inverse proxy (#5004) 2021-01-19 12:11:59 -08:00
Jiaxiao Zheng a36a62a700
feat(sdk): Artifact metadata related placeholder for components. (#5003)
* resolve comments.

* fix tests

* wip: add structures and skeleton for component resolution logic

* add generator

* fix the problem

* cleanup

* add a test

* fix tests
2021-01-19 08:57:45 -08:00
Chen Sun 0c600a2cb8
fix(sdk.v2): Fix the bug where pipeline_parameters is not used. (#5002)
* fix bug on pipeline parameters not being used.

* address review comments
2021-01-19 07:59:45 -08:00
Alexey Volkov 3b9fdff26b
fix(mkp): Added service account description to prevent validation errors (#4992) 2021-01-15 15:53:43 -08:00
Jiaxiao Zheng e0c814451d
chore(sdk): Add annotations for new-styled KFP component (#4989)
* undeprecate and add annotation

* fix the case for missing metadata

* resolve comments

* apply suggestion
2021-01-15 11:17:51 -08:00
shikajiro 3660a63508
feat(components): Add json format for BigQuery output to GCS (#4994)
* Support for json output

* update to_gcs component.yaml

* add output json format test.

* add command-line param.
2021-01-14 21:25:51 -08:00
Alexey Volkov 691eefc599
fix(sdk): Components - Fixed python components that use \n. Fixes #4939 (#4993)
* SDK - Components - Fixed python components that use \n

The escape sequence was being replaced by the `echo` command.

Apparently, unlike in the `bash` shell, the `echo` command of the `sh` shell expands the escape sequences by default and does not support an option to turn it off. (For some reason the -n option works properly even though it should not).

Fixes https://github.com/kubeflow/pipelines/issues/4939

* Fixed the test data

* Fixed the deprecated container component builder

* Fixed the new compiler test case

* Added test
2021-01-14 18:21:51 -08:00
Jiaxiao Zheng 279694ec6d
feat(sdk): Container entrypoint used for new styled KFP component authoring (#4978)
* skeleton

* add entrypoint utils to parse param

* wip: artifact parsing

* add input param artifacts passing and clean unused code

* wip

* add output artifact inspection

* add parameter output

* finish entrypoint implementation

* add entrypoint_utils_test.py

* add entrypoint test

* add entrypoint test

* get rid of tf

* fix test

* fix file location

* fix tests

* fix tests

* resolving comments

* Partially rollback

* resolve comments in entrypoint.py

* resolve comments
2021-01-14 16:01:21 -08:00
Alexey Volkov d629397654
feat(sdk): Components - Support annotations when creating components from python (#4996)
The component specification has always supported component annotations, but there was no way to specify them for the components generated from python. This PR fixes that.
2021-01-14 13:59:31 -08:00
Niklas Hansson ca09c7a026
fix(backend): add default value for CRON_SCHEDULE_TIMEZONE (#4977)
* fixed config so the paramter is avilabel for gcp market place as well

* wrong value
2021-01-14 12:33:31 -08:00
capri-xiyue 4ab5d63f71
fix(backend):Change enqueue base delay in non-error mode to 1 second for persistent agent (#4957)
* Change enqueue base delay in non-error mode to 1 second

* added Terminating constants

* used terminating constants in store layer

* modified comments
2021-01-14 11:18:55 -08:00
Chen Sun 273890ad0b
Bump kfp-pipeline-spec version to 0.1.4 (#4982) 2021-01-14 10:05:05 -08:00
Mansoor Baba Shaik 0a7da2d2db
feat(sdk): Replace logging and print statements with click echo statements for cli (#4622) 2021-01-14 08:41:04 -08:00
Andrey Velichkevich 34d23aa924
feat(components): Change Katib component output to JsonObject (#4974) 2021-01-14 00:57:02 -08:00
radcheb 5633b9abda
fix(sdk): fixes unresolved PipelineParam when static list passed to dsl.ParallelFor. Fixes #4890 (#4891)
* fix parallelfor compiling items + add tests

* remove debug print

* fix tests

* fix parallelfor_pipeline_param_in_items_resolving test

* debug test

* fix tests

* Revert "debug test"

This reverts commit 57451143bd.

* fix tests
2021-01-14 00:09:03 -08:00
Shu 23c12a9fb4
chore: add instruction detail in _auth.py print statement. Fixes #4987 (#4988)
* Update _auth.py with more instructions

* Update sdk/python/kfp/_auth.py

Co-authored-by: Jiaxiao Zheng <jxzheng@google.com>

Co-authored-by: Jiaxiao Zheng <jxzheng@google.com>
2021-01-13 10:30:36 -08:00
Niklas Hansson eeb7f8f04a
fix(backend): make the scheduleworkflowontroller timezone aware. Fixes #2653 (#4641)
* intial work'

* small fixes

* updated tests and how parameter are set

* try to fix test

* check with out adding missing test

* fixed small typo

* test changes

* updated config

* typo

* updated after feedback

* fixed pointer error

* test to add paramter

* moved to init so removed not needed code

* updated further

* updated tests to also check endtime

* clean up test

* fixed failing test

* fixed the expected test results

* added timezone examples

* further clean up

* fixed time format

* Update params.env

* moved location to cronjobscheduler

* clean up

* set env variable to empty

* reverted back

* updated to make magic nbr to constant

* updated the tests with comment

* added comments on cron expressions

* update naming and return types

* updated to UTC as default

* updated with an alpha notice
2021-01-10 00:59:05 -08:00