pipelines/components/aws/sagemaker/simulation_job_batch
Thang Minh Vu 328edd8117
fix(components): make inputs.model_artifact_url optional in sagemaker model component (#8336)
* fix(components): make inputs.model_artifact_url optional in sagemaker model component

* chore: run black

* Fixed Stop bug

commit f2092382ee941c2f33935db3e886093a15f103f7
Author: ananth102 <abashyam@amazon.com>
Date:   Fri Oct 7 19:51:55 2022 +0000

    replaced image

commit 2f0e2daa54fe80a3dfc471d393be62d612217b84
Merge: bf2389a66 7ce165432
Author: ananth102 <abashyam@amazon.com>
Date:   Fri Oct 7 19:50:28 2022 +0000

    Merge remote-tracking branch 'stopfix/handle_stopped' into kfpv1fixes2

commit 7ce165432e
Author: Kartik Kalamadi <kalamadi@amazon.com>
Date:   Thu Mar 3 09:58:16 2022 -0800

    Run black

commit 32d6e1388a
Author: Kartik Kalamadi <kalamadi@amazon.com>
Date:   Tue Mar 1 15:25:32 2022 -0800

    Change image for testing

commit 7875d9aa27
Author: Kartik Kalamadi <kalamadi@amazon.com>
Date:   Mon Jan 31 09:29:50 2022 -0800

    Handle Stopped state for all components and fix bug in robomaker simulation function

* chore(docs): Update model README.md

Update README

* updated image and liscense

* chore: pop ModelDataUrl if not exist

* fix: make field as option in aws batch_transform component

chore: run black

chore: revert docker version pump up

chore(docs): update valid instance types

Remove key if not use

Pop KmsKeyId

* update changelog

* chore: pop DataProcessing if no value supplied

* test(components): Update test

* fix(batch_transform): only pop input and output

* fixed log bug

Co-authored-by: ananth102 <abashyam@amazon.com>
2022-10-14 22:12:49 +00:00
..
src feat(components) Adds RoboMaker and SageMaker RLEstimator components (#4813) 2020-12-11 13:27:27 -08:00
README.md feat(components) Adds RoboMaker and SageMaker RLEstimator components (#4813) 2020-12-11 13:27:27 -08:00
component.yaml fix(components): make inputs.model_artifact_url optional in sagemaker model component (#8336) 2022-10-14 22:12:49 +00:00

README.md

RoboMaker Simulation Job Batch Kubeflow Pipelines component

Summary

Component to run a RoboMaker Simulation Job Batch from a Kubeflow Pipelines workflow. https://docs.aws.amazon.com/robomaker/latest/dg/API_StartSimulationJobBatch.html

Intended Use

For running your simulation workloads using AWS RoboMaker.

max_concurrency: Input
simulation_job_requests: Input
sim_app_arn: Input

Runtime Arguments

Argument Description Optional Data type Accepted values Default
region The region where the cluster launches No String
endpoint_url The endpoint URL for the private link VPC endpoint Yes String
assume_role The ARN of an IAM role to assume when connecting to SageMaker Yes String
app_name The name of the simulation application. Must be unique within the same AWS account and AWS region Yes String SimulationApplication-[datetime]-[random id]
role The Amazon Resource Name (ARN) that Amazon RoboMaker assumes to perform tasks on your behalf No String
timeout_in_secs The amount of time, in seconds, to wait for the batch to complete Yes String
max_concurrency The number of active simulation jobs create as part of the batch that can be in an active state at the same time Yes Int
simulation_job_requests A list of simulation job requests to create in the batch No List of Dicts []
sim_app_arn The application ARN for the simulation application Yes String
tags Key-value pairs to categorize AWS resources Yes Dict {}

Notes:

  • This component can be ran in a pipeline with the Create Simulation App and Delete Simulation App components or as a standalone.
  • One of sim_app_arn can be provided as an input, or can be embedded as the 'application' value for any of the simulation_job_requests.
  • The format for the simulation_job_requests field is:
[
    {
        "outputLocation": {
            "s3Bucket": "string",
            "s3Prefix": "string",
        },
        "loggingConfig": {"recordAllRosTopics": "bool"},
        "maxJobDurationInSeconds": "int",
        "iamRole": "string",
        "failureBehavior": "string",
        "simulationApplications": [
            {
                "application": "string",
                "launchConfig": {
                    "packageName": "string",
                    "launchFile": "string",
                    "environmentVariables": {
                        "string": "string",
                    },
                    "streamUI": "bool",
                },
            }
        ],
        "vpcConfig": {
            "subnets": "list",
            "securityGroups": "list",
            "assignPublicIp": "bool",
        },
    }
]

Output

The ARN and ID of the batch job.

Example code

Example of creating a Sim app, then a Sim job batch and finally deleting the Sim app : robomaker_simulation_job_batch_app

Resources