kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,506 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

536 Commits

Author SHA1 Message Date
Matts966 702e48b9ec
fix(backend): recognize "sidecar.istio.io/inject" annotation to use Istio service mesh optionally. Fixes #6200 (#6391) 
* Recognize "sidecar.istio.io/inject" annotation to use istio service mesh optionally

* Fix return to continue

Co-authored-by: Matts966 <Matts966@users.noreply.github.com>
 2021-08-19 06:23:53 -07:00
Yuan Gong 78491d12b8 chore(release): bumped version to 1.7.0-rc.4 2021-08-19 05:04:29 +00:00
Joshua Carp 0511983a5f
chore: fix broken links (#6386) 2021-08-18 21:50:53 -07:00
Gerard Casas Saez 943dc128e1
feat(backend): Add pipeline version description to backend. Part of #6256 (#6261) 
* start adding description to version

* add description to resource manager

* remove description from pipeline default version

* update pipeline_store

* add some tests to ensure its being passed around

* update frontend generated api

* run auto formatter

* add comment to frontend readme about running npm run format

* add missing api converter step
 2021-08-18 20:59:53 -07:00
Yuan (Bob) Gong 366b70eaa7
feat: upgrade argo to v3.1.6-patch (#6376) 
* feat: upgrade argo to v3.1.6-patch

* Update Dockerfile

* Update install-argo-cli.sh
 2021-08-18 03:17:38 -07:00
Yuan (Bob) Gong 59a0c9d1de
feat: upgrade TFX to 1.2.0 (#6375) 
* feat: upgrade TFX to 1.2.0

* fix

* update

* fix visualization server

* fix2
 2021-08-18 01:50:37 -07:00
capri-xiyue 2639ba060b
feat: added namespace as cache scope (#6342) 
* added namespace as cache scope

* fixed comments

* change namespace to optional
 2021-08-17 05:35:42 -07:00
Yuan (Bob) Gong ee8cbfa31c
feat: upgrade argo to v3.1.6 (#6333) 
* feat: upgrade argo to v3.1.6

* feat: use argo v3.1.6 image

* update licenses
 2021-08-13 02:32:54 -07:00
Chen Sun 7559e27cfb
feat(backend/sdk): Rename `pipeline-output-directory` to `pipeline-root`. Fixes #6307 (#6329) 2021-08-13 00:41:54 -07:00
Jiyong Jung a1f7160cf5
chore: upgrade tfx to 1.0.0 (#6316) 
* test: fix sample test image build

* update to TFX 1.0.0

* update argo CLI

* Uses TFX 1.0 APIs in parameterized_tfx_oss example.

Co-authored-by: Yuan Gong <gongyuan94@gmail.com>
 2021-08-12 04:02:03 -07:00
Yuan (Bob) Gong a6ab4e4411
chore(swf): fix recurring run + v2 compatible (#6297) 2021-08-11 03:22:25 -07:00
Yaqi Ji 9989d37021
chore: update Dockerfile for SDK 1.7.0 (#6262) 2021-08-06 18:13:27 -07:00
Yuan Gong 3c6d1285a0 chore(release): bumped version to 1.7.0-rc.3 2021-08-06 07:13:16 +00:00
Joshua Carp 2f843f95aa
fix: fix a spelling error (#6236) 2021-08-05 17:17:46 -07:00
Yuan (Bob) Gong ef37236d00
fix(backend): argo workflow not found in KFP DB should be GCed. Part of #6189 (#6190) 
* fix(backend): argo workflow not found in KFP DB should be GCed

* Update backend/src/apiserver/resource/resource_manager.go

Co-authored-by: Niklas Hansson <niklas.sven.hansson@gmail.com>

* address feedback

* tidy

* Update backend/src/apiserver/resource/resource_manager.go

Co-authored-by: Niklas Hansson <niklas.sven.hansson@gmail.com>

Co-authored-by: Niklas Hansson <niklas.sven.hansson@gmail.com>
 2021-08-05 07:22:19 -07:00
Yuan (Bob) Gong 9c6250fe12
chore(backend): pin sdk version to released version. Fixes #5689 (#6229) 2021-08-04 18:53:18 -07:00
Yuan (Bob) Gong 36b815bedf
feat: upgrade to argo v3.1.5-patch (#6228) 
* feat: upgrade to argo v3.1.5-patch

* update go.mod

* fix license

* update license
 2021-08-04 06:55:41 -07:00
Yuan Gong cc920c761c chore(release): bumped version to 1.7.0-rc.2 2021-07-22 12:23:43 +00:00
Yuan (Bob) Gong 04342436a9
feat: use argo v3.1.2-patch.2. Part of #5718 (#6082) 
* feat: use argo v3.1.2-patch

* upgrade to argo v3.1.2-patch.2

* update versions to v3.1.2
 2021-07-22 03:51:25 -07:00
James Liu ce40a2e9a4
chore(visualization): Revert to tensorflow image because tfx image is too big. Fix #6053 (#6061) 
* quit using tfx library for visualization

* revert to tensorflow

* fix read file issue on FE
 2021-07-15 20:16:38 -07:00
Yuan Gong f8ce345863 chore(release): bumped version to 1.7.0-rc.1 2021-07-15 11:23:40 +00:00
Yuan Gong 27c558e4ea chore(release): bumped version to 1.7.0-rc.0 2021-07-15 09:29:15 +00:00
Yuan (Bob) Gong fff62e1521
chore(v2): unify pipeline name between MLMD and KFP DB. Fixes #5978 (#6038) 
* chore(sdk): unify pipeline name between MLMD and KFP DB

* backend changes pipeline-name during upload

* update sdk snapshots

* add backend tests

* fix launcher

* fix tests

* address feedback
 2021-07-14 20:53:51 -07:00
capri-xiyue a1a98772b7
chore(v2): fixed task api comment (#6043) 2021-07-14 12:59:49 -07:00
Yuan (Bob) Gong a30e093f67
fix(tfx): fix missing mlmd data when sdk label is overridden. Fixes #5303 (#6035) 2021-07-13 22:24:58 -07:00
Yuan (Bob) Gong cb75b4483a
feat: use argo v3.1.1-patch. Part of #5930 (#6027) 
* feat: use argo v3.1.1-patch

* chore: also upgrade argo go modules to patch

* add comment

* fix download

* fix licenses

* go mod tidy
 2021-07-14 10:41:43 +08:00
James Liu 290d201cdf
fix(frontend): TFX artifact visualization update. Fix tensorflow/tfx#3933 (#5999) 
* fix(frontend): TFX artifact visualization update

* revert requirements change

* docker image change

* outputartifact adjust

* comment unused

* statisticGen fix

* sync config

* fix teest
 2021-07-13 12:47:58 -07:00
Yuan (Bob) Gong b653ea244c
feat: pipeline spec as a separate go module (#6000) 
* feat: pipeline spec as a separate go module

* use api-generator image & update release image

* clean up & update licenses

* go mod tidy
 2021-07-12 20:51:16 -07:00
XiyueYu e6f498d4b5 chore(release): bumped version to v1.7.0-alpha.3 2021-07-12 16:57:12 -07:00
Yuan (Bob) Gong a0fd14b276
chore: clean up backend/src/v2 KFP v2 POC code (#6017) 2021-07-12 16:55:30 +08:00
James Wu 27415fde4b
feat(backend): add V2 lightweight Python pipeline sample. Fixes #5689 (#5998) 2021-07-11 01:42:25 -07:00
capri-xiyue 724e5b4c7d
chore(v2): Fetch cache result from MLMD and put cache result into argo output artifacts/parameters (#5957) 
* added model and storage layer for task

* added create task api

* added api to list tasks

* modified task proto and fixed nits

* renamed variable

* fixed ut

* fixed UT

* added UT for api_converter and resource manager

* added UT for api_converter and resource manager

* fixed BE UT

* added task storage layer UT

* changed UT

* fixed foreign key typo

* added some draft code for replay argo result

* added kfp client in v2

* deleted unused code

* run go mode

* upgraded go version in go v2 test

* run go mod tidy

* added cache client

* fixed nits

* fetched MLMD output parameter

* store output artifacts metadata from cache

* added mlmd pipeline context, exuection and output event

* fixed grpc endpoint of mlpipeline

* fixed task backend bug and fixed launcher connect bug

* fixed cache bug

* added cache info

* fixed unused test

* fixed backend test

* fixed v2 build

* refactored launcher

* removed unused code

* fixed typo
 2021-07-08 23:38:23 -07:00
capri-xiyue fd973f714a
chore(v2): updated protoc version, fixed task BE (#5983) 
* updated protoc version, fixed task BE

* fixed be test

* updated api generator image and readme
 2021-07-06 20:54:21 -07:00
Yuan Gong bd6350dc27 chore(release): bumped version to 1.7.0-alpha.2 2021-07-03 13:29:11 +00:00
Yuan (Bob) Gong 4451c7d453
feat: upgrade argo to v3.1.1. Part of #5718 (#5971) 
* feat: upgrade argo to v3.1.1

* go mod tidy
 2021-07-03 05:52:49 -07:00
Joe Liedtke 2b65d51bdf
test: use new argo CLI URL (#5966) 
* Update test-sample Dockerfile to use new argo URL

* Update argo URL

* Update Dockerfile

Co-authored-by: Yuan (Bob) Gong <4957653+Bobgy@users.noreply.github.com>
 2021-07-02 23:38:49 -07:00
capri-xiyue b7d4b1ba7c
chore(v2): DB and API for creating/querying cache entries (#5857) 
* added model and storage layer for task

* added create task api

* added api to list tasks

* modified task proto and fixed nits

* renamed variable

* fixed ut

* fixed UT

* added UT for api_converter and resource manager

* added UT for api_converter and resource manager

* fixed BE UT

* added task storage layer UT

* changed UT

* fixed foreign key typo

* fixed typo and added comments
 2021-06-30 11:30:22 -07:00
Yuan Gong a1d513eb41 chore(release): bumped version to 1.7.0-alpha.1 2021-06-28 13:19:50 +00:00
Yuan (Bob) Gong 3973407310
feat: upgrade argo-workflows to v3.1.0. Part of #5718 (#5922) 2021-06-28 04:37:14 -07:00
Yuan (Bob) Gong c9d72e2f12
chore: check and comply with go mod licenses when building images. Fixes #4715 (#5908) 
* chore: add licenses for persistence agent

* chore: update licenses for cache server, swf, viewer

* update

* check licenses when building images

* fix

* fix

* fix more

* add build image commands to makefile

* wip

* update argo license workflow to use the new go-licenses tool

* clean up

* clean up

* upgrade tool

* update
 2021-06-25 05:48:53 -07:00
Yuan (Bob) Gong db8c467048
chore: add capri-xiyue to backend OWNERS (#5874) 2021-06-20 21:10:16 -07:00
Yuan (Bob) Gong ecb81d7132
chore(backend): update apiserver licenses (#5889) 
* wip

* save licenses files

* chore: update apiserver licenses
 2021-06-20 19:39:16 -07:00
Niklas Hansson a44a22559b
feat(backend): workflow validation. Fixes #3526. (#3965) 
* Added validation to the workflow

* check if template is empty

* remove if and add test that fails

* rework the code a bit

* fix backend test

* renamed to clean up

* fix tests

* clean up the tests

* clean up and fix tests

* clean up

* clean up tests

* update after feedback

* back to addRuntimeMetadata

* rebase with master

* move addRuntimeMetadata to seperate file to be exported

* Add the add metadata function
 2021-06-13 18:16:36 -07:00
Niklas Hansson 00a0ffbdb7
feat(backend): upgrade argo go module to V3. Part of #5718 (#5792) 
* updating argo

* updated fix deps and code

* clean up
 2021-06-08 05:04:45 -07:00
Windfarer f61048b5d2
fix(scheduledworkflow): Set location to make CRON timezone work, Fixes #2653 (#5800) 
* set location

* update log

* fix log

* install tzdata
 2021-06-07 05:19:51 -07:00
Yuan (Bob) Gong 28431fc3fd
feat: update MLMD to 1.0.0 (#5786) 
* feat: update MLMD to 1.0.0

* update MLMD frontend client
 2021-06-03 10:34:36 -07:00
juliusvonkohout efe916c075
Fix the cache-deployer to run as non root (#5742) 2021-05-27 08:39:17 -07:00
guanhuichen 435f6b1abe
fix(backend): Fixed workflow cannot be retried with node xxx in Omitted (#5738) 
Fixes #5537
 2021-05-26 09:01:41 -07:00
Yuan Gong 1c66f93f51 chore(release): bumped version to 1.6.0 2021-05-24 13:36:51 +08:00
Alexey Volkov 584d5e5742
Backend - Added modern time formatters (#5464) 
* Backend - Added modern time formatters

Placeholder format: `{{$.scheduledTime.strftime('%Y-%m-%d')}}`

* Update go.mod

* Update go.sum

* Update parameter_formatter_test.go

* Update parameter_formatter.go

* Update parameter_formatter.go

* Update parameter_formatter.go

* Fixed regexp escaping

* Fixed typo

* Fixed formatting

* Fixed the current time placeholder

* Fixed the test

* Added error logging
 2021-05-19 17:24:45 -07:00