kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,649 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

9 Commits

Author SHA1 Message Date
Jagadeesh J 58d22d4ba9
chore(components/pytorch) - Samples fix for PT and PTL Upgrade (#8148) 
* WIP: chore(components/pytorch) - Samples fix for PT and PTL Upgrade

* fix: bert example

 - fix minio secret
 - remove pth file upload to minio
 - add captum to pip packages

* fix: bert-dist training args

* fix: cifar10 example

* fix: cifar10 example notebook

* fix: captum example

* fix: gpu fixes for bert and cifar10 example

* fix: bert dist ptl upgrade
 2022-09-22 05:29:38 +00:00
shrinath-suresh b4ad3d1488
chore(components/pytorch): Samples Unit tests and lint fixes (#6288) 
* Applying yapf on all the python files in samples

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Test compile yaml fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Remove unused file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes: generate_templates.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes:  gen_image_timestamp.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Cifar10 handler lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes for the remaining files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-08-11 22:59:02 -07:00
Jagadeesh J aef50375f7
feat(components/pytorch): Example to estimate best parameters using AX (#6041) 
* Feature: Example to estimate best parameters using AX

* fix: Change notebook path

 - fix voulme creation component

* Fix: check if args has model params

* fix: check model params in cifar10 script

* Fix: Updated script for adam optimizer

 - Updated Readme and notebook with ax description

* Fix: remove token from notebook

* Fix: component yaml for trainer
 2021-07-16 04:43:38 -07:00
shrinath-suresh d88394ba4a
fix(components/pytorch): pytorch kfp components and Sample - GPU updates (#5939) 
* Updating trainer test wiht model parameter to support multi gpu multi node scenario

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing get_model to lightning_module in bert example as PTL is used from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing ptl 1.3.x from dependency as Pytorch operator needs ptl to be installed from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating trainer args with gpu parameters

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Installing PTL from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating get_model to lightning_module

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-07-11 22:06:26 -07:00
shrinath-suresh 694cae410f
chore(components/pytorch) Cifar 10 example - Confusion matrix Fix (#5918) 
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-06-26 02:24:12 -07:00
shrinath-suresh 192b8e8756
fix(components/pytorch) Pytorch Lightning Arguments string pass through (#5870) 
* Updating bert script to use input arguments as string

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding utility to parse input arguments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing tensorboard root and checkpoint dirs

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding string pass through in component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing pipeline.py file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing pipeline keys

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing args in component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing extra comma

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing unused code

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 example

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Uncommenting confusion matrix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating jupyter notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing cifar10 train component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing lint issues

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-06-23 23:10:19 -07:00
Arvind Gautam 1983037de7
feat(component/pytorch) Custom handler for cifar10 example ,saves multiple explain attributions methods (#5871) 
* added custom handler for cifar10 and update captum notebook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* update config.properties

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* updated explanation output file path

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* resolve conflicts and update cifar10 notbook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* update custom handler and other deps for cifar10

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* updated config file

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* updated config file

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* fix pylint formatting

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Enabling custom package installation and pinning ptl version to 1.3.2

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Setting custom package installation to false in cofig.properties

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Applying yapf

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
 2021-06-21 22:58:54 -07:00
Jagadeesh J 2d7f3a21f2
feat(components/pytorch): Add requirement for mar generation (#5850) 
* Feat: Add requirement for mar generation

 - Notebook clean to skip root access
 - Adds package.json

* Fix: Update config.properties for cifar10 and bert examples

* Fix: Update s3 urls with git urls

 - readme fixes
 - add config.properties

* Fix: Docker files copy command permission
 2021-06-17 03:10:28 -07:00
shrinath-suresh 703822c420
feat(components): Adding samples for PyTorch - KFP (#5812) 
* Adding Cifar10, Bert examples, component.yamls and Dockerfile

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding cifar10 and bert notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing component yaml paths

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing docker image name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* updating notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating image name in component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding --no-cache option to pip install

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating readme file with cluster steps

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing links in README.md

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing README.md indendation

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing local pipelines files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating docker image name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding Docstrings, yapf, pylint

Signed-off-by: ankan94 <ankan@ideas2it.com>

* fix test images paths in the notebook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Adding docker file for gpu

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding pipeline.py file to run the example from local environment

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding build script for local testing

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding license header and description in component.yaml files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixin docker file license

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Renaming docker file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding docker file name to build script

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* updating readme.md with local steps

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Installing pytorch-components from pypi

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing cpu docker file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding --no-cache-dir for pip

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing headers

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
 2021-06-09 06:44:16 -07:00