diff --git a/components/google-cloud/google_cloud_pipeline_components/proto/README.md b/components/google-cloud/google_cloud_pipeline_components/proto/README.md index 132c869b43..6b1dce053a 100644 --- a/components/google-cloud/google_cloud_pipeline_components/proto/README.md +++ b/components/google-cloud/google_cloud_pipeline_components/proto/README.md @@ -43,5 +43,7 @@ This list will be expanded to support more types in the future. * BigQueryJob * CustomJob * DataflowJob +* DataprocBatch +* DataprocLro * HyperparameterTuningJob * VertexLro diff --git a/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_pyspark_batch/component.yaml b/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_pyspark_batch/component.yaml index acb9adecf5..67d012a478 100644 --- a/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_pyspark_batch/component.yaml +++ b/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_pyspark_batch/component.yaml @@ -21,7 +21,7 @@ description: | Required: Project to run the Dataproc batch workload. location (Optional[str]): Location of the Dataproc batch workload. If not set, default to `us-central1`. - batch_id (str): + batch_id (Optional[str]): The ID to use for the batch, which will become the final component of the batch's resource name. If none is specified, a default name will be generated by the component. diff --git a/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_batch/component.yaml b/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_batch/component.yaml index 5278114e15..4e4bd7afa9 100644 --- a/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_batch/component.yaml +++ b/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_batch/component.yaml @@ -21,7 +21,7 @@ description: | Required: Project to run the Dataproc batch workload. location (Optional[str]): Location of the Dataproc batch workload. If not set, default to `us-central1`. - batch_id (str): + batch_id (Optional[str]): The ID to use for the batch, which will become the final component of the batch's resource name. If none is specified, a default name will be generated by the component. diff --git a/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_r_batch/component.yaml b/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_r_batch/component.yaml index 02c0647bd0..c0754c8dae 100644 --- a/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_r_batch/component.yaml +++ b/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_r_batch/component.yaml @@ -21,7 +21,7 @@ description: | Required: Project to run the Dataproc batch workload. location (Optional[str]): Location of the Dataproc batch workload. If not set, default to `us-central1`. - batch_id (str): + batch_id (Optional[str]): The ID to use for the batch, which will become the final component of the batch's resource name. If none is specified, a default name will be generated by the component. diff --git a/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_sql_batch/component.yaml b/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_sql_batch/component.yaml index 2f191fb7b8..40add1aa92 100644 --- a/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_sql_batch/component.yaml +++ b/components/google-cloud/google_cloud_pipeline_components/v1/dataproc/create_spark_sql_batch/component.yaml @@ -21,7 +21,7 @@ description: | Required: Project to run the Dataproc batch workload. location (Optional[str]): Location of the Dataproc batch workload. If not set, default to `us-central1`. - batch_id (str): + batch_id (Optional[str]): The ID to use for the batch, which will become the final component of the batch's resource name. If none is specified, a default name will be generated by the component.