Commit Graph

8 Commits

Author SHA1 Message Date
Jagadeesh J 49c3587591
chore(components/pytorch):kserve migration (#7615)
* chore(components/pytorch):kserve migration

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: pytorch dist training

 - enable env vars in config.properties
 - upgrade pip in dockerfile

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Bert - KServe v2 handler changes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fix: bert notebook for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: add protocol verion to bert gpu yaml

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Adding utility to convert image to bytes - Cifar

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Cifar10 - captum update

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fix: cifar10 example

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: predictor component for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: pytorch dist training for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: cifar10 hpo example

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Bumping pytorch-kfp-components version

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
2022-07-08 08:55:52 +00:00
Jagadeesh J 105e10090e
fix(components/pytorch): Update Readme docs (#6186)
* Fix: Update readme docs

* fix: Update Dockerfile with PTL latest

 - fix typo in readme

* Fix: Add contributing.md

 - cleanup
 - add description

* Fix: Typo
2021-07-30 22:36:35 -07:00
Jagadeesh J aef50375f7
feat(components/pytorch): Example to estimate best parameters using AX (#6041)
* Feature: Example to estimate best parameters using AX

* fix: Change notebook path

 - fix voulme creation component

* Fix: check if args has model params

* fix: check model params in cifar10 script

* Fix: Updated script for adam optimizer

 - Updated Readme and notebook with ax description

* Fix: remove token from notebook

* Fix: component yaml for trainer
2021-07-16 04:43:38 -07:00
Jagadeesh J 0f222f11fc
Fix(Components/pytorch): Add single docker file for cpu and gpu (#5863)
* Fix: Add single docker file for cpu and gpu

* Feat: Add dockerfile for tensorboard with torch profiler plugin
2021-06-26 10:09:12 -07:00
Jagadeesh J 2d7f3a21f2
feat(components/pytorch): Add requirement for mar generation (#5850)
* Feat: Add requirement for mar generation

 - Notebook clean to skip root access
 - Adds package.json

* Fix: Update config.properties for cifar10 and bert examples

* Fix: Update s3 urls with git urls

 - readme fixes
 - add config.properties

* Fix: Docker files copy command permission
2021-06-17 03:10:28 -07:00
shrinath-suresh ea5c6977bf
chore: PyTorch Samples - README.md update and notebook cleanup (#5833)
* Cleaning up the notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Clean up Bert Notebook

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Fix: Readme changes

 - adding prerequisites readme

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* clean up cifar10 notebook and new notebook for captum insights

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Adding desc to BERT notebook

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Adding desc to BERT notebook

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Fix: Add install dependencies script

* Updating README files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating google vertex example link

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding link to kfp python sdk

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* update dependencies for captum insights in cifar10 notebook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: jagadeesh <jagadeeshj@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
2021-06-10 08:52:52 -07:00
shrinath-suresh 703822c420
feat(components): Adding samples for PyTorch - KFP (#5812)
* Adding Cifar10, Bert examples, component.yamls and Dockerfile

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding cifar10 and bert notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing component yaml paths

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing docker image name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* updating notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating image name in component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding --no-cache option to pip install

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating readme file with cluster steps

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing links in README.md

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing README.md indendation

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing local pipelines files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating docker image name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding Docstrings, yapf, pylint

Signed-off-by: ankan94 <ankan@ideas2it.com>

* fix test images paths in the notebook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Adding docker file for gpu

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding pipeline.py file to run the example from local environment

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding build script for local testing

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing name

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding license header and description in component.yaml files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixin docker file license

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Renaming docker file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding docker file name to build script

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* updating readme.md with local steps

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Installing pytorch-components from pypi

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing cpu docker file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding --no-cache-dir for pip

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing headers

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
2021-06-09 06:44:16 -07:00
shrinath-suresh c5325db7d2
feat(components): Adding Trainer component for PyTorch - KFP (#5767)
* Create README.md

Initial Readme

* Create README.md

Initial commit for the PyTorch pipeline examples

* Update README.md

* Adding PyTorch training component

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding PyTorch - trainer unit tests

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing UT and adding setup.py

Signed-off-by: ankan94 <ankan@ideas2it.com>

* update setup.py, trainer compopents pyfiles,applied pylyintrc

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* adressed the review comments,applied pylint, black

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* added copyright headers in tests files

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* updated base component

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Changing to Apache2 License

Reviewed license change with Legal team

* Switch to Apache2 License

* Add tox for test automation with presubmit script

* Add model archiver to dependencies

* Cleanup setup.py

* Cleanup

* Cleanup

* Cleanup

* Using common fixture for unit tests and adding gpu fix for saving the model

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing to Apache2 License

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* resolve typo

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Added OWNERS

* OWENRS will be added as separate PR

* fix detect_version function in setup.py

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Cleanup for setup description field warnings

Co-authored-by: Geeta Chauhan <4461127+chauhang@users.noreply.github.com>
Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
Co-authored-by: Geeta Chauhan <gchauhan@fb.com>
2021-06-08 12:12:56 +08:00