* Initiate a new k8s client when calling _get_resource
* Remove k8s_client for methods that use _get_resource
* Initiate a new k8s client when calling _delete_resource
* Add test that check component outputs
* Remove sagemaker check
* Extract get_output_ack_resource_metadata to a function
Extract "Scheduled" to constant FINAL_STATUS
* Extract to function: verify_monitoring_schedule_component_outputs
* Add model monitor component and integration tests
* Generate model monitor using updated generator
* Add sleep for monitoring schedule
* Update requirements v2
* Change model monitor image url
* minor fix
* minor fix
* minor fix
* Add unit testing for MonitoringSchedule
* Delete assume-role.json
* Add doc and sample pipeline for Monitoring Schedule
* Regenerate using the latest code generator.
Make parameter description 1 sentence long.
* Revert "Add doc and sample pipeline for Monitoring Schedule"
This reverts commit 6b3b7cc6f5.
* Delete print statements
* Update component with new generator
* address comments
* Add retry for _delete_resource
* Add try catch protection for _get_resource and _delete_resource
* Add integration tests for monitoring job definition components
* Update is_endpoint_deleted for new _get_resource
* Add integration test for updating monitoring schedule
* Remove update from canary
* Add doc and sample pipeline for Monitoring Schedule
* Add doc for monitoring job definition
Update doc for monitoring schedule
* Remove sample for monitoring schedule
* Address comments
* Address comments
* Address comment for unit test
* Address doc comments
* Address test comments
* Hosting Components and test
* update dependency
* Regenerating with spec trimming
* handle None case
* adress pr comments
* another way of handling update not supported
* test changes
* removing unused logic
* Staging pr
* Added READMEs
* Main doc changes
* minor edit
* Upgrade package version and change default instance type
Upgrade sagemaker version
Upgrade boto3 version
Upgrade pyyaml version
Change training and endpoint instance type
* Remove dependency on "sagemaker-sample-data-<region>"
* change from conda to pip in DockerFile
* missing a equal sign
* missing a slash in eksctl path
* use ECR instead of docker
* revert ecr changes
* use ubuntu:18.04 as base image
* add copy requirement file
* replace docker image with ecr image to avoid rate limiting issue
* login to public ecr to use image
* unit tests
* feature: generated new sagemaker features
* update unit test
* remove unit tests
* Release: Staging component for release
* reformatted files
* fix(components): make inputs.model_artifact_url optional in sagemaker model component
* chore: run black
* Fixed Stop bug
commit f2092382ee941c2f33935db3e886093a15f103f7
Author: ananth102 <abashyam@amazon.com>
Date: Fri Oct 7 19:51:55 2022 +0000
replaced image
commit 2f0e2daa54fe80a3dfc471d393be62d612217b84
Merge: bf2389a667ce165432
Author: ananth102 <abashyam@amazon.com>
Date: Fri Oct 7 19:50:28 2022 +0000
Merge remote-tracking branch 'stopfix/handle_stopped' into kfpv1fixes2
commit 7ce165432e
Author: Kartik Kalamadi <kalamadi@amazon.com>
Date: Thu Mar 3 09:58:16 2022 -0800
Run black
commit 32d6e1388a
Author: Kartik Kalamadi <kalamadi@amazon.com>
Date: Tue Mar 1 15:25:32 2022 -0800
Change image for testing
commit 7875d9aa27
Author: Kartik Kalamadi <kalamadi@amazon.com>
Date: Mon Jan 31 09:29:50 2022 -0800
Handle Stopped state for all components and fix bug in robomaker simulation function
* chore(docs): Update model README.md
Update README
* updated image and liscense
* chore: pop ModelDataUrl if not exist
* fix: make field as option in aws batch_transform component
chore: run black
chore: revert docker version pump up
chore(docs): update valid instance types
Remove key if not use
Pop KmsKeyId
* update changelog
* chore: pop DataProcessing if no value supplied
* test(components): Update test
* fix(batch_transform): only pop input and output
* fixed log bug
Co-authored-by: ananth102 <abashyam@amazon.com>
* Update scripts to use public ecr instead of docker
* other codebuild specs
* run black on non-formatted files
* login to general ecr
* change default image for generate_components
* use public ecr amazon linux
* use :2 tag
* add arg for kfp v1 or v2 build version
* change whitespace and add docker login back for integration tests
* enable buildkit
* use v2 license file if in v2 build-mode
* make build_version mandatory
* Updt argoproj/argo URLs to argoproj/argo-workflows
* Update link to workflows.ts
* Update license.txt to reduce # of changed lines
* Revert changes to backend Dockerfile & license.txt
* Update license.txt, keep line endings
* Print logs for Processing and Batch Transform
* Change image in yamls
* Add unit tests for cw calls
* update version in license file to 1.1.1
* generate yaml for the new version
* update changelog
* Adds RoboMaker and SageMaker RLEstimator components
* Genericise samples
* Genericise samples
* Adds better logging and updates shim component in samples
* Adds fixes for PR comments. Updates tests accordingly
* Adds docker image reference for integration tests. Allows for setting job_name for RLEstimator training jobs
* Separate RM and SM execution roles
* Remove README reference to VPC config items
* Adds more reliable integration test for RoboMaker Simulation Job
* Simplifies integration tests
* Reverted test container entrypoints
* Update black formatting
* Update components for redbackthomson repo
* Prefix RLEstimator job name
* Add RoboMakerFullAccess to generated roles
* Update version to official 1.1.0
* Formatting int test file
* Add PassRole IAM permission to OIDC
* Adds ROBOMAKER_EXECUTION_ROLE_ARN to build vars
Co-authored-by: Nicholas Thomson <nithomso@amazon.com>
* Temporary rebase commit
* Add yaml compiler
* Add compiler CLI
* Update Dockerfile to copy all files
* Add validate input list vs dict
* Add unit test for new train
* Add minor bug fixes
* Override tag when generating specs
* Update pydocs with formatter
* Add contributing doc
* Add formatters to CONTRIBUTING
* Add working generic logic applied to train
* Update component input and output to inherit
* Downgrade to Python 3.7
* Update add outputValue to arg list
* Updated outputValue to outputPath
* Add empty string default to not-required inputs
* Update path to component relative to root
* Update faulty False-y condition
* Update outputs to write to file
* Update doc formatting
* Update docstrings to match structure
* Add unit tests for component and compiler
* Add unit tests for component
* Add spec unit tests
* Add training unit tests
* Update unit test automation
* Add sample formatting checks
* Remove extra flake8 check in integ tests
* Add unit test black check
* Update black formatting for all files
* Update include black formatting
* Add batch component
* Remove old transform components
* Update region input description
* Add all component specs
* Add deploy component
* Add ground truth component
* Add HPO component
* Add create model component
* Add processing component
* Add workteam component
* Add spec unit tests
* Add deploy unit tests
* Add ground truth unit tests
* Add tuning component unit tests
* Add create model component unit test
* Add process component unit tests
* Add workteam component unit tests
* Remove output_path from required_args
* Remove old component implementations
* Update black formatting
* Add assume role feature
* Compiled all components
* Update doc formatting
* Fix process terminate syntax error
* Update compiler to use kfp structures
* Update nits
* Update unified requirements
* Rebase on debugging commit
* Add debugger unit tests
* Update formatting
* Update component YAML
* Fix unit test Dockerfile relative directory
* Update unit test context to root
* Update Batch to auto-generate name
* Update minor docs and formatting changes
* Update deploy name to common autogenerated
* Add f-strings to logs
* Add update support
* Add Amazon license header
* Update autogen and autoformat
* Rename SpecValidator to SpecInputParser
* Split requirements by dev and prod
* Support for checking generated specs
* Update minor changes
* Update deploy component output description
* Update components to beta repository
* Update fix unit test requirements
* Update unit test build spec for new results path
* Update deploy wait for endpoint complete
* Update component configure AWS clients in new method
* Update boto3 retry method
* Update license version
* Update component YAML versions
* Add new version to Changelog
* Update component spec types
* Update deploy config ignore overwrite
* Update component for debugging
* Update images back to 1.0.0
* Remove coverage from components
* Changes for updating existing endpoint
* Review comments addressed
* Review comments addressed
* Review comments addressed
* Changed awscli and boto3 version. Ran black to format integration tests
* Removing temporarily to debug integration failures
* Adding back integration tests
* Control the number of parallel integration tests to 10
* Third Party License updated
* Version changed to 0.9.0
* Fixed a typo in Changelog
* Implemented debugger for training component with sample pipeline, unit tests, and integration test
* Implemented changes from PR, refactored utils.py, made sample pipeline more succinct, removed hardcoding from integration tests
* Added default parameter for sample pipeline and fixed grammar for sample README, refactored _utils.py for fstrings and fixed offset for errors
* Removed aws secret lines
* Terminate debug rules when terminating training job, Terminate debug rules if terminate is pressed after training job has completed, added integration tests for stop_debug_rules, updated READMEs for train and sample, renamed sample pipeline, removed tensorboard, updated sagemaker version to sagemaker 2.1.0.
* Terminate debug rules when terminating training job, Terminate debug rules if terminate is pressed after training job has completed, added integration tests for stop_debug_rules, updated READMEs for train and sample, renamed sample pipeline, removed tensorboard, updated sagemaker version to sagemaker 2.1.0.
* Removed extra files, cleaned integration test
* Changed integration test to use sample debugger pipeline
* Processing jobs created from debug rules will not terminate, fixing other small issues
* Removed debug from pipeline definition, removed extra line, removed unused function
* Changelog and image tag updates
* Add client assume role functionality
* Add assume_role to component.yaml files
* Update image to personal
* Update input to force NoneType on empty
* Update integration test setup with assumed role
* Add assume role integration test
* Update boto session to use refreshing credentials
* Update assume role relax trust relationship
* Add check for defined assumed role name
* Add processing assume integ test
* Add assume role unit test for main methods
* Add assume_role to all READMEs
* Update session to use AssumeRoleProvider
* Remove region from child calls to session
* Fix extra region_name in test
* Update assume role processing integ test name
* Add processing integ test to list
* Update assumed role to remain if not generated
* Update license version
* Update image tag to new version
* Add new version to Changelog
* Add functionality to stop SM jobs
- Unit and Integration tests for the functionality
* unit test update and customer message update
* Changelog and image tag updates
* update version for deploy component and merge conflicts
* Update version in License file
* fix conflicting paths for download, add test for batch
ananth102
rd-pong
jsitu777
Suraj Kota
Thang Minh Vu
ryansteakley
ananth102
Meghna Baijal
Mauricio Scheffer
Joe Liedtke
Kartik Kalamadi
Leonard O' Sullivan
Nicholas Thomson
jkuruba
Dustin Luong