shrinath-suresh
b4ad3d1488
chore(components/pytorch): Samples Unit tests and lint fixes ( #6288 )
...
* Applying yapf on all the python files in samples
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Test compile yaml fixes
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Remove unused file
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Lint fixes: generate_templates.py
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Lint fixes: gen_image_timestamp.py
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Lint fixes
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Cifar10 handler lint fixes
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Lint fixes for the remaining files
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-11 22:59:02 -07:00
shrinath-suresh
f9d47d0ef9
fix(components/pytorch): PyTorch Samples - Generating component.yaml using templates ( #6231 )
...
* Adding code to generate component.yaml files from templates
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding templates for train and pre process
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating the build script to generate component.yaml from templates
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating the jupyter notebook to use templates
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Removing all component.yaml files
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Revert "Removing all component.yaml files"
This reverts commit db75951949 .
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing bert notebook
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Changing cifar10 pipeline
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating cifar10 notebook
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing cifar10 template mapping
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing the cifar10 preprocess input
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* fixing ciar10 notebook arguments
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding examples in component.yaml templates
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating README.md files
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating cifar10 captum insights notebook
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding templates for hpo
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating distributed training notebook
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing yaml path in dist training
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Removing all component.yaml files
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Moving component.yaml templates into pytorch-kfp-components
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing template path
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating cifar10 script argument variable
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing argument or bert dist
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding image name to templates
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding template for ax train
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Creating template mapping for ax
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing hpo script arguments
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Ax Template mapping fix
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Addressing review comments
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-08 23:34:25 -07:00
Jagadeesh J
01ec07b467
fix(components/pytorch): Clean up notebook and yaml files ( #6070 )
...
* Fix: Clean up notebook and yaml files
* Fix: Dockerfile
2021-07-16 10:33:38 -07:00
Jagadeesh J
b1d0eb799b
feat(components/pytorch): Pytorch Distributed Training ( #6021 )
...
* Feature: Bert distributed training
* Feat: Adds staging volume for pytorch job
* Feat: Add PVC storage URI for KFserving
- Update copy component
* Fix: gpu explain handler
* fix: notebook cleanup
* Fix: Update Dockerfile, requirement.txt
* Fix: Dockerfile
2021-07-16 05:29:38 -07:00
Jagadeesh J
aef50375f7
feat(components/pytorch): Example to estimate best parameters using AX ( #6041 )
...
* Feature: Example to estimate best parameters using AX
* fix: Change notebook path
- fix voulme creation component
* Fix: check if args has model params
* fix: check model params in cifar10 script
* Fix: Updated script for adam optimizer
- Updated Readme and notebook with ax description
* Fix: remove token from notebook
* Fix: component yaml for trainer
2021-07-16 04:43:38 -07:00
Jagadeesh J
0f222f11fc
Fix(Components/pytorch): Add single docker file for cpu and gpu ( #5863 )
...
* Fix: Add single docker file for cpu and gpu
* Feat: Add dockerfile for tensorboard with torch profiler plugin
2021-06-26 10:09:12 -07:00
shrinath-suresh
a437b92c24
chore(components/pytorch) [WIP] Updating docker image location - pytorch kfp samples ( #5911 )
...
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-24 00:03:19 -07:00
shrinath-suresh
703822c420
feat(components): Adding samples for PyTorch - KFP ( #5812 )
...
* Adding Cifar10, Bert examples, component.yamls and Dockerfile
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding cifar10 and bert notebooks
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing component yaml paths
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Changing docker image name
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* updating notebooks
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating image name in component.yaml
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding --no-cache option to pip install
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating readme file with cluster steps
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing links in README.md
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing README.md indendation
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Removing local pipelines files
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Updating docker image name
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding Docstrings, yapf, pylint
Signed-off-by: ankan94 <ankan@ideas2it.com>
* fix test images paths in the notebook
Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
* Adding docker file for gpu
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding pipeline.py file to run the example from local environment
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding build script for local testing
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing name
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding license header and description in component.yaml files
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixin docker file license
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Renaming docker file
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding docker file name to build script
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* updating readme.md with local steps
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Installing pytorch-components from pypi
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Fixing cpu docker file
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Adding --no-cache-dir for pip
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
* Removing headers
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
2021-06-09 06:44:16 -07:00