Commit Graph

31 Commits

Author SHA1 Message Date
Humair Khan 24782d178d
chore: update all owners files (#11886)
Various owners' files reviewers/approvers are no longer involved with
the community. Additionaly, we have various other folks that are
involved and have shown an active interest in reviewing various portions
of the code base. This change updates all owners files to reflect this
current state of the community.

Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com>
2025-05-02 14:47:04 +00:00
Jagadeesh J 49c3587591
chore(components/pytorch):kserve migration (#7615)
* chore(components/pytorch):kserve migration

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: pytorch dist training

 - enable env vars in config.properties
 - upgrade pip in dockerfile

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Bert - KServe v2 handler changes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fix: bert notebook for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: add protocol verion to bert gpu yaml

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Adding utility to convert image to bytes - Cifar

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Cifar10 - captum update

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fix: cifar10 example

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: predictor component for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: pytorch dist training for kserve v2

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* fix: cifar10 hpo example

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>

* Bumping pytorch-kfp-components version

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
2022-07-08 08:55:52 +00:00
Jagadeesh J 131b116fb9
chore(components/pytorch): Upgrade PTL (#6902)
* chore(components/pytorch): Upgrade PTL

* Bump PTL version

Signed-off-by: Jagadeesh J <jagadeeshj@ideas2it.com>
2022-01-12 07:09:11 +00:00
shrinath-suresh 6219a16901
chore(components/pytorch): pytorch-kfp-components setup.py update (#6360)
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-16 21:55:41 -07:00
shrinath-suresh 361ae529f0
chore(components/pytorch): Pytorch kfp components setup (#6355)
* Updating development status from alpha to stable

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating development status to production/stable

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Setting development status to Beta

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-16 13:44:42 -07:00
shrinath-suresh 5e597b13c8
chore(components/pytorch): pytorch samples build fixes (#6338)
* build dependency fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Pinning PTL to 1.4.2

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Revert "Pinning PTL to 1.4.2"

This reverts commit 8e207f0d3b.

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Pinning PTL to 1.4.2

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-15 22:06:05 -07:00
Jagadeesh J 9bec83f098
chore(components/pytorch): Add sqlalchemy pacakge to ax (#6340) 2021-08-15 21:44:05 -07:00
shrinath-suresh b4ad3d1488
chore(components/pytorch): Samples Unit tests and lint fixes (#6288)
* Applying yapf on all the python files in samples

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Test compile yaml fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Remove unused file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes: generate_templates.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes:  gen_image_timestamp.py

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Cifar10 handler lint fixes

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Lint fixes for the remaining files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-11 22:59:02 -07:00
shrinath-suresh f9d47d0ef9
fix(components/pytorch): PyTorch Samples - Generating component.yaml using templates (#6231)
* Adding code to generate component.yaml files from templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding templates for train and pre process

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating the build script to generate component.yaml from templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating the jupyter notebook to use templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing all component.yaml files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Revert "Removing all component.yaml files"

This reverts commit db75951949.

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing bert notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing cifar10 pipeline

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing cifar10 template mapping

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing the cifar10 preprocess input

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* fixing ciar10 notebook arguments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding examples in component.yaml templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating README.md files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 captum insights notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding templates for hpo

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating distributed training notebook

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing yaml path in dist training

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing all component.yaml files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Moving component.yaml templates into pytorch-kfp-components

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing template path

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 script argument variable

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing argument or bert dist

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding image name to templates

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding template for ax train

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Creating template mapping for ax

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing hpo script arguments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Ax Template mapping fix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-08 23:34:25 -07:00
shrinath-suresh 271783e58e
chore(components/pytorch): Updating pytorch-kfp-component dependency list (#6219)
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-08-08 22:41:25 -07:00
shrinath-suresh 48805efc83
chore(components/pytorch): pytorch-kfp-components version update (#6175)
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-07-27 20:54:44 -07:00
shrinath-suresh e567b0d50f
chore(components/pytorch): pytorch-kfp-components unit test fixes (#6064)
* Adding Pytorch-lightning, mock and torchmetrics to tox.ini

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing lint issues

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Bumping version to rc2

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating readme with the command to use tox

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-07-16 01:38:38 -07:00
Alexey Volkov 561622c9f8
chore(components): Added canonical location for some components (#6060)
* Components - Added canonical location for some components

* Fixed the component.py files
2021-07-15 21:28:12 -07:00
shrinath-suresh d88394ba4a
fix(components/pytorch): pytorch kfp components and Sample - GPU updates (#5939)
* Updating trainer test wiht model parameter to support multi gpu multi node scenario

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing get_model to lightning_module in bert example as PTL is used from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* removing ptl 1.3.x from dependency as Pytorch operator needs ptl to be installed from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating trainer args with gpu parameters

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Installing PTL from source

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating get_model to lightning_module

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-07-11 22:06:26 -07:00
Alexey Volkov d15d0fe9fa
chore(components): Added missing annotations to my components (#5992) 2021-07-08 15:30:23 -07:00
shrinath-suresh 551756ee39
chore(components/pytorch) Updating pytorch lightning version to 1.3.7 (#5905)
Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-27 23:49:14 -07:00
shrinath-suresh 192b8e8756
fix(components/pytorch) Pytorch Lightning Arguments string pass through (#5870)
* Updating bert script to use input arguments as string

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding utility to parse input arguments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing tensorboard root and checkpoint dirs

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding string pass through in component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing pipeline.py file

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing pipeline keys

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing args in component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing extra comma

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing unused code

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating cifar10 example

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Uncommenting confusion matrix

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating jupyter notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing cifar10 train component.yaml

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Addressing review comments

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing lint issues

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-23 23:10:19 -07:00
ankan94 72f7464d01
feat(components): Addressing Review comments on Trainer component for PyTorch - KFP (#5814)
* fix url and keywords in setup.py

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Minio UT fix

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Base component metaclass modification

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Adding fast failing for trainer component.

Signed-off-by: ankan94 <ankan@ideas2it.com>

* fixing minio test

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Fixing lint issues

Signed-off-by: ankan94 <ankan@ideas2it.com>

Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
2021-06-17 09:42:28 -07:00
shrinath-suresh 9cfa4dfc0a
fix(components/pytorch) Pytorch - Tensorboard Profiler fix (#5860)
* Fix: module_file_args overriding the trainer_args variable. Updating module_file_args as the superset

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Setting PTL to 1.3.5 in requirements.txt

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing typo

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding print statements for profiler debugging

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Removing cpuonly tag

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-16 16:06:27 -07:00
shrinath-suresh ea5c6977bf
chore: PyTorch Samples - README.md update and notebook cleanup (#5833)
* Cleaning up the notebooks

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Clean up Bert Notebook

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Fix: Readme changes

 - adding prerequisites readme

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Clean up Bert Notebooks

Signed-off-by: ankan94 <ankan@ideas2it.com>

* clean up cifar10 notebook and new notebook for captum insights

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Adding desc to BERT notebook

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Adding desc to BERT notebook

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Fix: Add install dependencies script

* Updating README files

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Updating google vertex example link

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding link to kfp python sdk

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* update dependencies for captum insights in cifar10 notebook

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: jagadeesh <jagadeeshj@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
2021-06-10 08:52:52 -07:00
Geeta Chauhan cc85ca55c6
chore: Add OWNERS for PyTorch KFP Components (#5827)
* Create README.md

Initial Readme

* Create README.md

Initial commit for the PyTorch pipeline examples

* Update README.md

* Delete components/PyTorch/pytorch_kfp_components directory

* Add OWNERS

Co-authored-by: shrinath-suresh <63862647+shrinath-suresh@users.noreply.github.com>
2021-06-09 20:54:51 -07:00
Geeta Chauhan b418a74aab
chore: Update version for PyTorch KFP components 0.1.0.rc-1 release (#5823)
* Create README.md

Initial Readme

* Create README.md

Initial commit for the PyTorch pipeline examples

* Update README.md

* Delete components/PyTorch/pytorch_kfp_components directory

* Update version for 0.1.0.rc-1 release

Co-authored-by: shrinath-suresh <63862647+shrinath-suresh@users.noreply.github.com>
2021-06-09 01:25:16 -07:00
ankan94 941879dd5c
feat(components): Adding Visualization component for PyTorch - KFP (#5810)
* Adding visualization component

Signed-off-by: ankan94 <ankan@ideas2it.com>

* Switch to Apache2 License

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-07 21:57:53 -07:00
shrinath-suresh f843121e91
feat(components): Adding Minio component for PyTorch - KFP (#5808)
* Adding minio component and tests

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Minio executor fix

Signed-off-by: ankan94 <ankan@ideas2it.com>

Co-authored-by: ankan94 <ankan@ideas2it.com>
2021-06-07 21:57:45 -07:00
shrinath-suresh c5325db7d2
feat(components): Adding Trainer component for PyTorch - KFP (#5767)
* Create README.md

Initial Readme

* Create README.md

Initial commit for the PyTorch pipeline examples

* Update README.md

* Adding PyTorch training component

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Adding PyTorch - trainer unit tests

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Fixing UT and adding setup.py

Signed-off-by: ankan94 <ankan@ideas2it.com>

* update setup.py, trainer compopents pyfiles,applied pylyintrc

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* adressed the review comments,applied pylint, black

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* added copyright headers in tests files

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* updated base component

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Changing to Apache2 License

Reviewed license change with Legal team

* Switch to Apache2 License

* Add tox for test automation with presubmit script

* Add model archiver to dependencies

* Cleanup setup.py

* Cleanup

* Cleanup

* Cleanup

* Using common fixture for unit tests and adding gpu fix for saving the model

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

* Changing to Apache2 License

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* resolve typo

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Added OWNERS

* OWENRS will be added as separate PR

* fix detect_version function in setup.py

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Cleanup for setup description field warnings

Co-authored-by: Geeta Chauhan <4461127+chauhang@users.noreply.github.com>
Co-authored-by: ankan94 <ankan@ideas2it.com>
Co-authored-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>
Co-authored-by: Geeta Chauhan <gchauhan@fb.com>
2021-06-08 12:12:56 +08:00
Alexey Volkov b08b29f46e
feat(components): PyTorch - Added the Create PyTorch Model Archive component (#5630)
* Components - PyTorch - Added the Create PyTorch Model Archive component

* Added component to the sample pipeline
2021-06-07 18:07:54 -07:00
Arvind Gautam e20a1b8bda
feat(components): Adding Mar component for PyTorch - KFP (#5780)
* adding mar component

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* removed extra files

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* removed exta file __init__py

Signed-off-by: Arvind-Ideas2IT <arvindkumarsingh.gautam@ideas2it.com>

* Switch to Apache2 License

* Move tests folder

* Adding spec for mar component

Signed-off-by: Shrinath Suresh <shrinath@ideas2it.com>

Co-authored-by: Geeta Chauhan <gchauhan@fb.com>
Co-authored-by: Shrinath Suresh <shrinath@ideas2it.com>
2021-06-07 08:30:51 -07:00
Alexey Volkov b12d63665f
feat(components): PyTorch - Train fully-connected network pipeline (#5208) 2021-03-12 16:58:46 -08:00
Alexey Volkov 37da6257a3
feat(components): PyTorch - Create fully connected network in PyTorch network (#5205) 2021-03-08 12:25:23 -08:00
Alexey Volkov fc7afdd0a0
feat(components): PyTorch - Convert to ONNX from PyTorch ScriptModule (#5207) 2021-03-08 11:38:30 -08:00
Alexey Volkov dfa756317e
feat(components): PyTorch - Train PyTorch model from CSV (#5206) 2021-03-08 11:38:23 -08:00