kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,753 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

149 Commits

Author SHA1 Message Date
Kelli Belcher 271d4ebfaf
Intel oneAPI XGBoost daal4py example pipeline (#10044) 
* Intel oneAPI XGBoost daal4py sample pipeline

* Intel oneAPI XGBoost daal4py sample pipeline

* Intel oneAPI XGBoost daal4py sample pipeline
 2023-10-05 22:35:15 +00:00
Chen Sun 4a57ab69dd
chore(components): Move openvino components and samples to the right locations. (#9498) 2023-07-05 16:55:42 +00:00
rd-pong d50d178936
chore(components): Add sample for Sagemaker Model Monitor component (#9405) 
* Add sample pipeline for hosting and model monitor

* Update sample pipeline doc

* Address comments
 2023-05-15 23:22:59 +00:00
ananth102 09d5151542
chore(components): Update Sagemaker sample to use v2 Hosting components (#9398) 
* Update mnist sample with Hosting

* updated sample with new directory

* Updating sample to use output rather than after

* Address comments
 2023-05-12 22:27:28 +00:00
ryansteakley 7be9693959
chore(components): Update aws owners files to reflect current owners (#8622) 
* update aws owners files to reflect current owners

* fix list
 2022-12-22 22:29:14 +00:00
ryansteakley 4c097171c1
chore(components): Add sample for blended pipeline using v1 and v2 AWS Sagemaker components (#8284) 
* blended pipeline

* add sample to samples folder

* update pinned version of TrainingJob

* update samples instructions

* update bucket and sagemaker role sections

* update broken link and fix indentation:
 2022-11-01 23:55:45 +00:00
James Liu 91fe29f099
feat(samples): Full Kubeflow E2E sample using KFPv2. (#8303) 
* feat(samples): Full Kubeflow E2E sample using KFPv2.

* fix output

* fix import json

* use dict

* clear output
 2022-10-18 21:47:58 +00:00
Jagadeesh J 72aab0b5b8
chore(components/pytorch) - fix url paths (#8293) 2022-10-05 05:53:22 +00:00
Jagadeesh J 58d22d4ba9
chore(components/pytorch) - Samples fix for PT and PTL Upgrade (#8148) 
* WIP: chore(components/pytorch) - Samples fix for PT and PTL Upgrade

* fix: bert example

 - fix minio secret
 - remove pth file upload to minio
 - add captum to pip packages

* fix: bert-dist training args

* fix: cifar10 example

* fix: cifar10 example notebook

* fix: captum example

* fix: gpu fixes for bert and cifar10 example

* fix: bert dist ptl upgrade
 2022-09-22 05:29:38 +00:00
Jagadeesh J 49c3587591
chore(components/pytorch):kserve migration (#7615) 
* chore(components/pytorch):kserve migration

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: pytorch dist training

 - enable env vars in config.properties
 - upgrade pip in dockerfile

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Bert - KServe v2 handler changes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fix: bert notebook for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: add protocol verion to bert gpu yaml

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Adding utility to convert image to bytes - Cifar

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Cifar10 - captum update

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fix: cifar10 example

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: predictor component for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: pytorch dist training for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: cifar10 hpo example

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Bumping pytorch-kfp-components version

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
 2022-07-08 08:55:52 +00:00
WhiteSource Renovate 624f197d52
fix(deps): update dependency npm to v8 [security] (#7885) 2022-07-08 05:52:51 +00:00
ryansteakley 086f0c960d
chore: Update oidc commands to include region and add brackets for trust policy (#7899) 2022-07-07 23:15:50 +00:00
ryansteakley cc8e3fdec1
chore: add missing imports for aws samples data scripts (#7877) 
* update source for input data

* add imports for samples

* use aws legal approved s3 buckets

* change bucket in pipeline input
 2022-07-07 22:33:51 +00:00
ryansteakley 77ab758a4e
chore: update source for aws samples input data (#7772) 2022-06-07 17:04:30 +00:00
ryansteakley a8a3b93ade
chore: fix link for installing kubeflow on AWS (#7762) 2022-05-19 18:40:56 +00:00
Vedant Padwal d93b390e62
feat(doc): Update kubeflow-e2e-mnist notebook to use KServe (#7355) 
* Update kubeflow-e2e-mnist notebook to use KServe

* Add outputs

* Add old KFServing code

* Made changes as paul suggested

* Update multi user mode guide

* Made changes as Paul suggested

* Remove service account as The service_account issue is fixed if you use KFP 1.8.1
 2022-03-07 06:54:53 +00:00
Jagadeesh J 131b116fb9
chore(components/pytorch): Upgrade PTL (#6902) 
* chore(components/pytorch): Upgrade PTL

* Bump PTL version

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>
 2022-01-12 07:09:11 +00:00
Andrey Velichkevich 7fdba90659
chore(sample): Update Katib examples for 0.12 release (#6820) 
* chore(sample): Update Katib examples for 0.12 release

* Run Early Stopping example
 2021-10-29 06:24:51 -07:00
James Liu 991473d3e4
chore(sample): upgrade katib and kfp sdk versions in e2e mnist tutorial (#6712) 2021-10-11 13:50:43 -07:00
shrinath-suresh 9ed77f5631
chore(components/pytorch): Samples - Cifar10 webdataset fix (#6516) 
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-09-08 12:07:01 -07:00
shrinath-suresh a54aa33f51
chore(components/pytorch): bert samples - confusion matrix (#6458) 
* Fixing confusion matrix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Enabling confusion matrix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Passing attention masks to compute_bert_outputs

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-09-03 12:05:10 -07:00
shrinath-suresh 2a4ffe1bed
chore(components/pytorch): PyTorch samples README.md update (#6423) 
* pytorch sample readme update

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing image name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating local build readme

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-08-24 22:33:44 -07:00
shrinath-suresh 7634adbe77
chore(components/pytorch): Update ax-hpo pytorch samples notebook (#6414) 
* Updating hpo notebook with additional instructions and screenshots

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding images

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-08-23 22:35:39 -07:00
shrinath-suresh 5e597b13c8
chore(components/pytorch): pytorch samples build fixes (#6338) 
* build dependency fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Pinning PTL to 1.4.2

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Revert "Pinning PTL to 1.4.2"

This reverts commit 8e207f0d3b.

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Pinning PTL to 1.4.2

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-08-15 22:06:05 -07:00
shrinath-suresh b4ad3d1488
chore(components/pytorch): Samples Unit tests and lint fixes (#6288) 
* Applying yapf on all the python files in samples

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Test compile yaml fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Remove unused file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes: generate_templates.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes:  gen_image_timestamp.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Cifar10 handler lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes for the remaining files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-08-11 22:59:02 -07:00
shrinath-suresh f9d47d0ef9
fix(components/pytorch): PyTorch Samples - Generating component.yaml using templates (#6231) 
* Adding code to generate component.yaml files from templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding templates for train and pre process

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating the build script to generate component.yaml from templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating the jupyter notebook to use templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing all component.yaml files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Revert "Removing all component.yaml files"

This reverts commit db75951949.

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing bert notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing cifar10 pipeline

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing cifar10 template mapping

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing the cifar10 preprocess input

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fixing ciar10 notebook arguments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding examples in component.yaml templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating README.md files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 captum insights notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding templates for hpo

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating distributed training notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing yaml path in dist training

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing all component.yaml files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Moving component.yaml templates into pytorch-kfp-components

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing template path

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 script argument variable

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing argument or bert dist

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding image name to templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding template for ax train

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Creating template mapping for ax

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing hpo script arguments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Ax Template mapping fix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-08-08 23:34:25 -07:00
Yuan Gong 3c6d1285a0 chore(release): bumped version to 1.7.0-rc.3 2021-08-06 07:13:16 +00:00
Jagadeesh J 105e10090e
fix(components/pytorch): Update Readme docs (#6186) 
* Fix: Update readme docs

* fix: Update Dockerfile with PTL latest

 - fix typo in readme

* Fix: Add contributing.md

 - cleanup
 - add description

* Fix: Typo
 2021-07-30 22:36:35 -07:00
Jagadeesh J 8319eac3fc
fix(components/pytorch): readme update (#6174) 2021-07-27 15:53:44 -07:00
Andrey Velichkevich 89c36d37a2
fix(components): Refactor Kubeflow E2E mnist example (#5433) 
* Modify notebook

* Changes in Notebook

* Generate output

* Add owners file

* Add Prediction output

* Update e2e example

* Remove Print
 2021-07-27 11:22:44 -07:00
shrinath-suresh 4d42624d5b
fix(components/pytorch): Pytorch Cifar10 Captum Insights (#6105) 
* Fix Captum Insights cifar10

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing handler for GPU scenario

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing comments and updating pytorch job operator variable in Bert distributed pipeline notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-07-23 12:18:40 -07:00
Yuan Gong cc920c761c chore(release): bumped version to 1.7.0-rc.2 2021-07-22 12:23:43 +00:00
shrinath-suresh 74d27e7e7e
fix(components/pytorch): custom handler for cifar10, saves explain output as bytes image (#6050) 
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-07-20 03:10:15 -07:00
shrinath-suresh 71317711be
fix(components/pytorch): Custom package installation - torchserve (#6055) 
* Swiching on custom installation

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding sklearn and captum

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-07-19 23:22:15 -07:00
Jagadeesh J 01acf5a0bb
fix(components/pytorch): readme update (#6081) 2021-07-19 10:13:16 -07:00
Jagadeesh J 01ec07b467
fix(components/pytorch): Clean up notebook and yaml files (#6070) 
* Fix: Clean up notebook and yaml files

* Fix: Dockerfile
 2021-07-16 10:33:38 -07:00
Jagadeesh J b1d0eb799b
feat(components/pytorch): Pytorch Distributed Training (#6021) 
* Feature: Bert distributed training

* Feat: Adds staging volume for pytorch job

* Feat: Add PVC storage URI for KFserving

 - Update copy component

* Fix: gpu explain handler

* fix: notebook cleanup

* Fix: Update Dockerfile, requirement.txt

* Fix: Dockerfile
 2021-07-16 05:29:38 -07:00
Jagadeesh J aef50375f7
feat(components/pytorch): Example to estimate best parameters using AX (#6041) 
* Feature: Example to estimate best parameters using AX

* fix: Change notebook path

 - fix voulme creation component

* Fix: check if args has model params

* fix: check model params in cifar10 script

* Fix: Updated script for adam optimizer

 - Updated Readme and notebook with ax description

* Fix: remove token from notebook

* Fix: component yaml for trainer
 2021-07-16 04:43:38 -07:00
Jagadeesh J a4b915b373
fix(components/pytorch): Add sleep to cifar10 pipeline (#6042) 
* Fix: Add sleep to cifar10 pipeline

* Fix: Add comment for sleep and infernece tasks
 2021-07-16 03:54:38 -07:00
Yuan Gong f8ce345863 chore(release): bumped version to 1.7.0-rc.1 2021-07-15 11:23:40 +00:00
Yuan Gong 27c558e4ea chore(release): bumped version to 1.7.0-rc.0 2021-07-15 09:29:15 +00:00
XiyueYu e6f498d4b5 chore(release): bumped version to v1.7.0-alpha.3 2021-07-12 16:57:12 -07:00
shrinath-suresh d88394ba4a
fix(components/pytorch): pytorch kfp components and Sample - GPU updates (#5939) 
* Updating trainer test wiht model parameter to support multi gpu multi node scenario

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing get_model to lightning_module in bert example as PTL is used from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing ptl 1.3.x from dependency as Pytorch operator needs ptl to be installed from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating trainer args with gpu parameters

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Installing PTL from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating get_model to lightning_module

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-07-11 22:06:26 -07:00
Yuan Gong bd6350dc27 chore(release): bumped version to 1.7.0-alpha.2 2021-07-03 13:29:11 +00:00
shrinath-suresh 5b78b01410
chore(samples/pytorch) - Build script fix - Updating Dockerfile name (#5928) 
* Fixing build script

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Setting custom package installation to false for bert

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-06-29 12:09:35 -07:00
Yuan Gong a1d513eb41 chore(release): bumped version to 1.7.0-alpha.1 2021-06-28 13:19:50 +00:00
shrinath-suresh 551756ee39
chore(components/pytorch) Updating pytorch lightning version to 1.3.7 (#5905) 
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-06-27 23:49:14 -07:00
Jagadeesh J 0f222f11fc
Fix(Components/pytorch): Add single docker file for cpu and gpu (#5863) 
* Fix: Add single docker file for cpu and gpu

* Feat: Add dockerfile for tensorboard with torch profiler plugin
 2021-06-26 10:09:12 -07:00
shrinath-suresh 694cae410f
chore(components/pytorch) Cifar 10 example - Confusion matrix Fix (#5918) 
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-06-26 02:24:12 -07:00
shrinath-suresh a437b92c24
chore(components/pytorch) [WIP] Updating docker image location - pytorch kfp samples (#5911) 
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-06-24 00:03:19 -07:00