079eea369a
* Print logs for Processing and Batch Transform * Change image in yamls * Add unit tests for cw calls * update version in license file to 1.1.1 * generate yaml for the new version * update changelog |
||
|---|---|---|
| .. | ||
| batch_transform | ||
| codebuild | ||
| common | ||
| create_simulation_app | ||
| delete_simulation_app | ||
| deploy | ||
| ground_truth | ||
| hyperparameter_tuning | ||
| model | ||
| process | ||
| rlestimator | ||
| simulation_job | ||
| simulation_job_batch | ||
| tests | ||
| train | ||
| workteam | ||
| .dockerignore | ||
| .gitignore | ||
| CONTRIBUTING.md | ||
| Changelog.md | ||
| Dockerfile | ||
| LICENSE.txt | ||
| NOTICE.txt | ||
| OWNERS | ||
| README.md | ||
| THIRD-PARTY-LICENSES.txt | ||
| dev_requirements.txt | ||
| requirements.txt | ||
README.md
Amazon SageMaker Components for Kubeflow Pipelines
Summary
With Amazon SageMaker Components for Kubeflow Pipelines (KFP), you can create and monitor training, tuning, endpoint deployment, and batch transform jobs in Amazon SageMaker. By running Kubeflow Pipeline jobs on Amazon SageMaker, you move data processing and training jobs from the Kubernetes cluster to Amazon SageMaker’s machine learning-optimized managed service. The job parameters, status, logs, and outputs from Amazon SageMaker are still accessible from the Kubeflow Pipelines UI.
Components
Amazon SageMaker Components for Kubeflow Pipelines offer an alternative to launching compute-intensive jobs in Kubernetes and integrate the orchestration benefits of Kubeflow Pipelines. The following Amazon SageMaker components have been created to integrate 6 key Amazon SageMaker features into your ML workflows. You can create a Kubeflow Pipeline built entirely using these components, or integrate individual components into your workflow as needed.
For an end-to-end tutorial using these components, see Using Amazon SageMaker Components.
For more example pipelines, see Sample AWS SageMaker Kubeflow Pipelines.
There is no additional charge for using Amazon SageMaker Components for Kubeflow Pipelines. You incur charges for any Amazon SageMaker resources you use through these components.
Training components
Training
The Training component allows you to submit Amazon SageMaker Training jobs directly from a Kubeflow Pipelines workflow. For more information, see SageMaker Training Kubeflow Pipelines component.
RLEstimator
The RLEstimator component allows you to submit RLEstimator (Reinforcement Learning) SageMaker Training jobs directly from a Kubeflow Pipelines workflow. For more information, see SageMaker RLEstimator Kubeflow Pipelines component.
Hyperparameter Optimization
The Hyperparameter Optimization component enables you to submit hyperparameter tuning jobs to Amazon SageMaker directly from a Kubeflow Pipelines workflow. For more information, see SageMaker Hyperparameter Optimization Kubeflow Pipeline component.
Processing
The Processing component enables you to submit processing jobs to Amazon SageMaker directly from a Kubeflow Pipelines workflow. For more information, see SageMaker Processing Kubeflow Pipeline component.
Inference components
Hosting Deploy
The Deploy component enables you to deploy a model in Amazon SageMaker Hosting from a Kubeflow Pipelines workflow. For more information, see SageMaker Hosting Services - Create Endpoint Kubeflow Pipeline component.
Batch Transform component
The Batch Transform component enables you to run inference jobs for an entire dataset in Amazon SageMaker from a Kubeflow Pipelines workflow. For more information, see SageMaker Batch Transform Kubeflow Pipeline component.
Ground Truth components
Ground Truth
The Ground Truth component enables you to to submit Amazon SageMaker Ground Truth labeling jobs directly from a Kubeflow Pipelines workflow. For more information, see SageMaker Ground Truth Kubeflow Pipelines component.
Workteam
The Workteam component enables you to create Amazon SageMaker private workteam jobs directly from a Kubeflow Pipelines workflow. For more information, see SageMaker create private workteam Kubeflow Pipelines component.
RoboMaker components
Create Simulation Application
The Create Simulation Application component allows you to create a RoboMaker Simulation Application directly from a Kubeflow Pipelines workflow. For more information, see RoboMaker Create Simulation app Kubeflow Pipelines component.
Simulation Job
The Simulation Job component allows you to run a RoboMaker Simulation Job directly from a Kubeflow Pipelines workflow. For more information, see RoboMaker Simulation Job Kubeflow Pipelines component.
Simulation Job Batch
The Simulation Job Batch component allows you to run a RoboMaker Simulation Job Batch directly from a Kubeflow Pipelines workflow. For more information, see RoboMaker Simulation Job Batch Kubeflow Pipelines component.
Delete Simulation Application
The Delete Simulation Application component allows you to delete a RoboMaker Simulation Application directly from a Kubeflow Pipelines workflow. For more information, see RoboMaker Delete Simulation app Kubeflow Pipelines component.