Commit Graph

37 Commits

Author SHA1 Message Date
Jagadeesh J 72aab0b5b8
chore(components/pytorch) - fix url paths (#8293) 2022-10-05 05:53:22 +00:00
Jagadeesh J 58d22d4ba9
chore(components/pytorch) - Samples fix for PT and PTL Upgrade (#8148)
* WIP: chore(components/pytorch) - Samples fix for PT and PTL Upgrade

* fix: bert example

 - fix minio secret
 - remove pth file upload to minio
 - add captum to pip packages

* fix: bert-dist training args

* fix: cifar10 example

* fix: cifar10 example notebook

* fix: captum example

* fix: gpu fixes for bert and cifar10 example

* fix: bert dist ptl upgrade
2022-09-22 05:29:38 +00:00
Jagadeesh J 49c3587591
chore(components/pytorch):kserve migration (#7615)
* chore(components/pytorch):kserve migration

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: pytorch dist training

 - enable env vars in config.properties
 - upgrade pip in dockerfile

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Bert - KServe v2 handler changes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fix: bert notebook for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: add protocol verion to bert gpu yaml

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Adding utility to convert image to bytes - Cifar

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Cifar10 - captum update

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fix: cifar10 example

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: predictor component for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: pytorch dist training for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: cifar10 hpo example

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Bumping pytorch-kfp-components version

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
2022-07-08 08:55:52 +00:00
WhiteSource Renovate 624f197d52
fix(deps): update dependency npm to v8 [security] (#7885) 2022-07-08 05:52:51 +00:00
Jagadeesh J 131b116fb9
chore(components/pytorch): Upgrade PTL (#6902)
* chore(components/pytorch): Upgrade PTL

* Bump PTL version

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>
2022-01-12 07:09:11 +00:00
shrinath-suresh 9ed77f5631
chore(components/pytorch): Samples - Cifar10 webdataset fix (#6516)
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-09-08 12:07:01 -07:00
shrinath-suresh a54aa33f51
chore(components/pytorch): bert samples - confusion matrix (#6458)
* Fixing confusion matrix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Enabling confusion matrix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Passing attention masks to compute_bert_outputs

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-09-03 12:05:10 -07:00
shrinath-suresh 2a4ffe1bed
chore(components/pytorch): PyTorch samples README.md update (#6423)
* pytorch sample readme update

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing image name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating local build readme

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-24 22:33:44 -07:00
shrinath-suresh 7634adbe77
chore(components/pytorch): Update ax-hpo pytorch samples notebook (#6414)
* Updating hpo notebook with additional instructions and screenshots

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding images

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-23 22:35:39 -07:00
shrinath-suresh 5e597b13c8
chore(components/pytorch): pytorch samples build fixes (#6338)
* build dependency fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Pinning PTL to 1.4.2

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Revert "Pinning PTL to 1.4.2"

This reverts commit 8e207f0d3b.

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Pinning PTL to 1.4.2

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-15 22:06:05 -07:00
shrinath-suresh b4ad3d1488
chore(components/pytorch): Samples Unit tests and lint fixes (#6288)
* Applying yapf on all the python files in samples

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Test compile yaml fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Remove unused file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes: generate_templates.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes:  gen_image_timestamp.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Cifar10 handler lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes for the remaining files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-11 22:59:02 -07:00
shrinath-suresh f9d47d0ef9
fix(components/pytorch): PyTorch Samples - Generating component.yaml using templates (#6231)
* Adding code to generate component.yaml files from templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding templates for train and pre process

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating the build script to generate component.yaml from templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating the jupyter notebook to use templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing all component.yaml files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Revert "Removing all component.yaml files"

This reverts commit db75951949.

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing bert notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing cifar10 pipeline

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing cifar10 template mapping

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing the cifar10 preprocess input

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fixing ciar10 notebook arguments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding examples in component.yaml templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating README.md files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 captum insights notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding templates for hpo

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating distributed training notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing yaml path in dist training

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing all component.yaml files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Moving component.yaml templates into pytorch-kfp-components

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing template path

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 script argument variable

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing argument or bert dist

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding image name to templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding template for ax train

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Creating template mapping for ax

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing hpo script arguments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Ax Template mapping fix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-08 23:34:25 -07:00
Jagadeesh J 105e10090e
fix(components/pytorch): Update Readme docs (#6186)
* Fix: Update readme docs

* fix: Update Dockerfile with PTL latest

 - fix typo in readme

* Fix: Add contributing.md

 - cleanup
 - add description

* Fix: Typo
2021-07-30 22:36:35 -07:00
Jagadeesh J 8319eac3fc
fix(components/pytorch): readme update (#6174) 2021-07-27 15:53:44 -07:00
shrinath-suresh 4d42624d5b
fix(components/pytorch): Pytorch Cifar10 Captum Insights (#6105)
* Fix Captum Insights cifar10

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing handler for GPU scenario

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing comments and updating pytorch job operator variable in Bert distributed pipeline notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-07-23 12:18:40 -07:00
shrinath-suresh 74d27e7e7e
fix(components/pytorch): custom handler for cifar10, saves explain output as bytes image (#6050)
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-07-20 03:10:15 -07:00
shrinath-suresh 71317711be
fix(components/pytorch): Custom package installation - torchserve (#6055)
* Swiching on custom installation

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding sklearn and captum

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-07-19 23:22:15 -07:00
Jagadeesh J 01acf5a0bb
fix(components/pytorch): readme update (#6081) 2021-07-19 10:13:16 -07:00
Jagadeesh J 01ec07b467
fix(components/pytorch): Clean up notebook and yaml files (#6070)
* Fix: Clean up notebook and yaml files

* Fix: Dockerfile
2021-07-16 10:33:38 -07:00
Jagadeesh J b1d0eb799b
feat(components/pytorch): Pytorch Distributed Training (#6021)
* Feature: Bert distributed training

* Feat: Adds staging volume for pytorch job

* Feat: Add PVC storage URI for KFserving

 - Update copy component

* Fix: gpu explain handler

* fix: notebook cleanup

* Fix: Update Dockerfile, requirement.txt

* Fix: Dockerfile
2021-07-16 05:29:38 -07:00
Jagadeesh J aef50375f7
feat(components/pytorch): Example to estimate best parameters using AX (#6041)
* Feature: Example to estimate best parameters using AX

* fix: Change notebook path

 - fix voulme creation component

* Fix: check if args has model params

* fix: check model params in cifar10 script

* Fix: Updated script for adam optimizer

 - Updated Readme and notebook with ax description

* Fix: remove token from notebook

* Fix: component yaml for trainer
2021-07-16 04:43:38 -07:00
Jagadeesh J a4b915b373
fix(components/pytorch): Add sleep to cifar10 pipeline (#6042)
* Fix: Add sleep to cifar10 pipeline

* Fix: Add comment for sleep and infernece tasks
2021-07-16 03:54:38 -07:00
shrinath-suresh d88394ba4a
fix(components/pytorch): pytorch kfp components and Sample - GPU updates (#5939)
* Updating trainer test wiht model parameter to support multi gpu multi node scenario

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing get_model to lightning_module in bert example as PTL is used from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing ptl 1.3.x from dependency as Pytorch operator needs ptl to be installed from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating trainer args with gpu parameters

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Installing PTL from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating get_model to lightning_module

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-07-11 22:06:26 -07:00
shrinath-suresh 5b78b01410
chore(samples/pytorch) - Build script fix - Updating Dockerfile name (#5928)
* Fixing build script

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Setting custom package installation to false for bert

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-29 12:09:35 -07:00
shrinath-suresh 551756ee39
chore(components/pytorch) Updating pytorch lightning version to 1.3.7 (#5905)
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-27 23:49:14 -07:00
Jagadeesh J 0f222f11fc
Fix(Components/pytorch): Add single docker file for cpu and gpu (#5863)
* Fix: Add single docker file for cpu and gpu

* Feat: Add dockerfile for tensorboard with torch profiler plugin
2021-06-26 10:09:12 -07:00
shrinath-suresh 694cae410f
chore(components/pytorch) Cifar 10 example - Confusion matrix Fix (#5918)
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-26 02:24:12 -07:00
shrinath-suresh a437b92c24
chore(components/pytorch) [WIP] Updating docker image location - pytorch kfp samples (#5911)
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-24 00:03:19 -07:00
shrinath-suresh 192b8e8756
fix(components/pytorch) Pytorch Lightning Arguments string pass through (#5870)
* Updating bert script to use input arguments as string

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding utility to parse input arguments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing tensorboard root and checkpoint dirs

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding string pass through in component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing pipeline.py file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing pipeline keys

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing args in component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing extra comma

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing unused code

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 example

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Uncommenting confusion matrix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating jupyter notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing cifar10 train component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing lint issues

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-23 23:10:19 -07:00
Arvind Gautam 1983037de7
feat(component/pytorch) Custom handler for cifar10 example ,saves multiple explain attributions methods (#5871)
* added custom handler for cifar10 and update captum notebook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* update config.properties

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* updated explanation output file path

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* resolve conflicts and update cifar10 notbook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* update custom handler and other deps for cifar10

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* updated config file

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* updated config file

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* fix pylint formatting

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Enabling custom package installation and pinning ptl version to 1.3.2

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Setting custom package installation to false in cofig.properties

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Applying yapf

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-21 22:58:54 -07:00
ankan94 a41a72f614
feat(samples/pytorch): Adding compilation test for PyTorch samples KFP (#5856)
* Create README.md

Initial Readme

* Create README.md

Initial commit for the PyTorch pipeline examples

* Update README.md

* Delete components/PyTorch/pytorch_kfp_components directory

* Add OWNERS

* Adding test for yaml compilation

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Adding tests to config

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Adding test for compilation

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Removing lint issues and apply yapf

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Addressing Review comments

Signed-off-by: ankan94 <ankan@ideas2it.com>

Co-authored-by: Geeta Chauhan <4461127+chauhang@users.noreply.github.com>
Co-authored-by: shrinath-suresh <63862647+shrinath-suresh@users.noreply.github.com>
Co-authored-by: Geeta Chauhan <gchauhan@fb.com>
2021-06-17 12:08:14 -07:00
Jagadeesh J 2d7f3a21f2
feat(components/pytorch): Add requirement for mar generation (#5850)
* Feat: Add requirement for mar generation

 - Notebook clean to skip root access
 - Adds package.json

* Fix: Update config.properties for cifar10 and bert examples

* Fix: Update s3 urls with git urls

 - readme fixes
 - add config.properties

* Fix: Docker files copy command permission
2021-06-17 03:10:28 -07:00
shrinath-suresh 9cfa4dfc0a
fix(components/pytorch) Pytorch - Tensorboard Profiler fix (#5860)
* Fix: module_file_args overriding the trainer_args variable. Updating module_file_args as the superset

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Setting PTL to 1.3.5 in requirements.txt

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing typo

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding print statements for profiler debugging

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing cpuonly tag

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-16 16:06:27 -07:00
shrinath-suresh ea5c6977bf
chore: PyTorch Samples - README.md update and notebook cleanup (#5833)
* Cleaning up the notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Clean up Bert Notebook

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Fix: Readme changes

 - adding prerequisites readme

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* clean up cifar10 notebook and new notebook for captum insights

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Adding desc to BERT notebook

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Adding desc to BERT notebook

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Fix: Add install dependencies script

* Updating README files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating google vertex example link

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding link to kfp python sdk

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* update dependencies for captum insights in cifar10 notebook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: jagadeesh <jagadeeshj@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
2021-06-10 08:52:52 -07:00
Geeta Chauhan cc85ca55c6
chore: Add OWNERS for PyTorch KFP Components (#5827)
* Create README.md

Initial Readme

* Create README.md

Initial commit for the PyTorch pipeline examples

* Update README.md

* Delete components/PyTorch/pytorch_kfp_components directory

* Add OWNERS

Co-authored-by: shrinath-suresh <63862647+shrinath-suresh@users.noreply.github.com>
2021-06-09 20:54:51 -07:00
shrinath-suresh 703822c420
feat(components): Adding samples for PyTorch - KFP (#5812)
* Adding Cifar10, Bert examples, component.yamls and Dockerfile

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding cifar10 and bert notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing component yaml paths

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing docker image name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* updating notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating image name in component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding --no-cache option to pip install

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating readme file with cluster steps

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing links in README.md

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing README.md indendation

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing local pipelines files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating docker image name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding Docstrings, yapf, pylint

Signed-off-by: ankan94 <ankan@ideas2it.com>

* fix test images paths in the notebook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Adding docker file for gpu

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding pipeline.py file to run the example from local environment

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding build script for local testing

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding license header and description in component.yaml files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixin docker file license

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Renaming docker file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding docker file name to build script

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* updating readme.md with local steps

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Installing pytorch-components from pypi

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing cpu docker file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding --no-cache-dir for pip

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing headers

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
2021-06-09 06:44:16 -07:00
shrinath-suresh c5325db7d2
feat(components): Adding Trainer component for PyTorch - KFP (#5767)
* Create README.md

Initial Readme

* Create README.md

Initial commit for the PyTorch pipeline examples

* Update README.md

* Adding PyTorch training component

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding PyTorch - trainer unit tests

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing UT and adding setup.py

Signed-off-by: ankan94 <ankan@ideas2it.com>

* update setup.py, trainer compopents pyfiles,applied pylyintrc

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* adressed the review comments,applied pylint, black

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* added copyright headers in tests files

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* updated base component

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Changing to Apache2 License

Reviewed license change with Legal team

* Switch to Apache2 License

* Add tox for test automation with presubmit script

* Add model archiver to dependencies

* Cleanup setup.py

* Cleanup

* Cleanup

* Cleanup

* Using common fixture for unit tests and adding gpu fix for saving the model

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing to Apache2 License

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* resolve typo

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Added OWNERS

* OWENRS will be added as separate PR

* fix detect_version function in setup.py

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Cleanup for setup description field warnings

Co-authored-by: Geeta Chauhan <4461127+chauhang@users.noreply.github.com>
Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
Co-authored-by: Geeta Chauhan <gchauhan@fb.com>
2021-06-08 12:12:56 +08:00