* change from conda to pip in DockerFile
* missing a equal sign
* missing a slash in eksctl path
* use ECR instead of docker
* revert ecr changes
* use ubuntu:18.04 as base image
* add copy requirement file
* replace docker image with ecr image to avoid rate limiting issue
* login to public ecr to use image
* Update scripts to use public ecr instead of docker
* other codebuild specs
* run black on non-formatted files
* login to general ecr
* change default image for generate_components
* use public ecr amazon linux
* use :2 tag
* add arg for kfp v1 or v2 build version
* change whitespace and add docker login back for integration tests
* enable buildkit
* use v2 license file if in v2 build-mode
* make build_version mandatory
* Adds RoboMaker and SageMaker RLEstimator components
* Genericise samples
* Genericise samples
* Adds better logging and updates shim component in samples
* Adds fixes for PR comments. Updates tests accordingly
* Adds docker image reference for integration tests. Allows for setting job_name for RLEstimator training jobs
* Separate RM and SM execution roles
* Remove README reference to VPC config items
* Adds more reliable integration test for RoboMaker Simulation Job
* Simplifies integration tests
* Reverted test container entrypoints
* Update black formatting
* Update components for redbackthomson repo
* Prefix RLEstimator job name
* Add RoboMakerFullAccess to generated roles
* Update version to official 1.1.0
* Formatting int test file
* Add PassRole IAM permission to OIDC
* Adds ROBOMAKER_EXECUTION_ROLE_ARN to build vars
Co-authored-by: Nicholas Thomson <nithomso@amazon.com>
* Temporary rebase commit
* Add yaml compiler
* Add compiler CLI
* Update Dockerfile to copy all files
* Add validate input list vs dict
* Add unit test for new train
* Add minor bug fixes
* Override tag when generating specs
* Update pydocs with formatter
* Add contributing doc
* Add formatters to CONTRIBUTING
* Add working generic logic applied to train
* Update component input and output to inherit
* Downgrade to Python 3.7
* Update add outputValue to arg list
* Updated outputValue to outputPath
* Add empty string default to not-required inputs
* Update path to component relative to root
* Update faulty False-y condition
* Update outputs to write to file
* Update doc formatting
* Update docstrings to match structure
* Add unit tests for component and compiler
* Add unit tests for component
* Add spec unit tests
* Add training unit tests
* Update unit test automation
* Add sample formatting checks
* Remove extra flake8 check in integ tests
* Add unit test black check
* Update black formatting for all files
* Update include black formatting
* Add batch component
* Remove old transform components
* Update region input description
* Add all component specs
* Add deploy component
* Add ground truth component
* Add HPO component
* Add create model component
* Add processing component
* Add workteam component
* Add spec unit tests
* Add deploy unit tests
* Add ground truth unit tests
* Add tuning component unit tests
* Add create model component unit test
* Add process component unit tests
* Add workteam component unit tests
* Remove output_path from required_args
* Remove old component implementations
* Update black formatting
* Add assume role feature
* Compiled all components
* Update doc formatting
* Fix process terminate syntax error
* Update compiler to use kfp structures
* Update nits
* Update unified requirements
* Rebase on debugging commit
* Add debugger unit tests
* Update formatting
* Update component YAML
* Fix unit test Dockerfile relative directory
* Update unit test context to root
* Update Batch to auto-generate name
* Update minor docs and formatting changes
* Update deploy name to common autogenerated
* Add f-strings to logs
* Add update support
* Add Amazon license header
* Update autogen and autoformat
* Rename SpecValidator to SpecInputParser
* Split requirements by dev and prod
* Support for checking generated specs
* Update minor changes
* Update deploy component output description
* Update components to beta repository
* Update fix unit test requirements
* Update unit test build spec for new results path
* Update deploy wait for endpoint complete
* Update component configure AWS clients in new method
* Update boto3 retry method
* Update license version
* Update component YAML versions
* Add new version to Changelog
* Update component spec types
* Update deploy config ignore overwrite
* Update component for debugging
* Update images back to 1.0.0
* Remove coverage from components
* add integ test for sample pipeline train
* change docker build context integ test
* add spot test and use train ccomponent test for sample train pipeline
* small changes and ran flake8 and black
* address comments
* Add working FSx setup and test
* Removed duplicate test function
* Replaced failure return with exit
* Update parallel methods to export
* Update EKS cluster name outside parallel task
* Add SKIP_FSX_TEST in buildspec
* Add revoke security group ingress
* Add default pytest FSx values
* # This is a combination of 5 commits.
# This is the 1st commit message:
Add initial scripts
# This is the commit message #2:
Add working pytest script
# This is the commit message #3:
Add initial scripts
# This is the commit message #4:
Add environment variable files
# This is the commit message #5:
Remove old cluster script
* Add initial scripts
Add working pytest script
Add initial scripts
Add environment variable files
Remove old cluster script
Update pipeline credentials to OIDC
Add initial scripts
Add working pytest script
Add initial scripts
Add working pytest script
* Remove debugging mark
* Update example EKS cluster name
* Remove quiet from Docker build
* Manually pass env
* Update env list vars as string
* Update use array directly
* Update variable array to export
* Update to using read for splitting
* Move to helper script
* Update export from CodeBuild
* Add wait for minio
* Update kubectl wait timeout
* Update minor changes for PR
* Update integration test buildspec to quiet build
* Add region to delete EKS
* Add wait for pods
* Updated README
* Add fixed interval wait
* Fix CodeBuild step order
* Add file lock for experiment ID
* Fix missing pytest parameter
* Update run create only once
* Add filelock to conda env
* Update experiment name ensuring creation each time
* Add try/catch with create experiment
* Remove caching from KFP deployment
* Remove disable KFP caching
* Move .gitignore changes to inside component
* Add blank line to default .gitignore
* Add initial unit test buildspec
* Add docker log output
* Add force no pytest color
* Update docker build to be quiet
* Add pass all environment variables
* Update unit test container env file
* Update env to use different syntax
* Remove daemon mode
* Remove TTY from docker run
* Add dryrun and dockercfg setup
* Update dryrun into CodeBuild logic
* Add mkdir for Docker config
* Update app version temporarily
* Revert app version temporarily
* Update unit test log file
* Add tag minor and major versions
* Update version temporarily
* Add print for major and minor tags
* Revert version back down
* Add deploy version override
* Update path to testing directories
* Fix tab formatting
* Fix pytest log directory
jsitu777
Suraj Kota
ryansteakley
Leonard O' Sullivan
Kartik Kalamadi
Nicholas Thomson