Commit Graph

46 Commits

Author SHA1 Message Date
hilcj de8d800c8e
Fix display_name and description fields. (#9085) 2023-03-31 20:47:58 +00:00
Chen Sun d2db64bebb
feat: Add cpu_request and memory_request in pipeline_spec. (#9063) 2023-03-30 16:02:06 +00:00
Connor McCarthy 902e2a999f
feat: add TASK_FINAL_STATUS to PipelineSpec ParameterTypeEnum (#9061) 2023-03-30 08:28:05 +00:00
hilcj 60f2a1fe7a
Add pipeline metadata fields in the IR. (#9038) 2023-03-27 21:32:40 +00:00
hilcj 250db6e289
Fix typo in IR field description (#9023) 2023-03-22 16:58:43 +00:00
Connor McCarthy 643f421fcd
feat: add platform-specific configuration protos to `kfp-pipeline-spec` package (#8896)
* feat: add platform-specific configuration protos

* update comment
2023-03-03 00:12:59 +00:00
Connor McCarthy 998f52dd94
feat(IR): add is_optional field for input artifacts (#8571) 2022-12-13 23:46:29 +00:00
Connor McCarthy 041f4462b3
feat(IR): change is_list_of_artifacts proto field to is_artifact_list (#8522) 2022-12-02 09:28:16 +00:00
Connor McCarthy 6cd7cbcbc4
feat(sdk): add is_list_of_artifacts field to PipelineSpec [lists of artifacts support pt. 2] (#8466)
* add field

* bump kfp-pipeline-spec version
2022-11-30 18:42:16 +00:00
Bo a86ae9b89b
feat(IR): adds IteratorPolicy to PipelineTaskSpec proto for support of parallelism setting on ParallelFor (#7804) 2022-05-27 18:21:12 +00:00
Connor McCarthy 436d7afe83
fix(ir): fix kfp-pipeline-spec proto imports (#7754)
* remove unused import

* add google.protobuf.Duration import
2022-05-18 17:19:26 +00:00
Connor McCarthy f960a52c82
feat(IR): add is_optional to ParameterSpec proto (#7704) 2022-05-12 16:40:05 +00:00
hilcj 27d5404cda
feat(api): Update IR with RetryPolicy (#7581) 2022-04-20 20:47:54 +00:00
Joe Liedtke 541f2ac8de
feat(api): adds task name to PipelineTaskFinalStatus message (#7452)
* Adds task name to PipelineTaskFinalStatus.

* Fixes comment error.
2022-03-23 22:51:46 +00:00
Chen Sun a03b41e129
chore(api): Add parameter_values in RuntimeConfig (#6790) 2021-10-21 12:27:02 -07:00
hilcj 8133c37c7d
chore(api): Fix proto description. (#6659) 2021-10-08 15:25:43 -07:00
Chen Sun 2b1530ba02
chore(api): Add default_value in ComponentInputsSpec.ParameterSpec and default_pipeline_root in PipelineSpec. (#6662)
default_pipeline_root in PipelineSpec.
2021-10-03 15:54:49 -07:00
hilcj 87739ea523
chore(api): Add pipeline_job_resource_name (#6646)
Add PipelineTaskFinalStatus.pipeline_job_resource_name field.
2021-09-29 13:56:09 -07:00
hilcj 6252b09cba
feat(api): Update pipeline_spec.proto to add `pipeline_job_uuid` and `pipeline_job_name` in `PipelineTaskFinalStatus` (#6557)
Add pipeline job id to the task final status proto.
2021-09-13 17:34:31 -07:00
Chen Sun cfefc6d397
feat(sdk.v2): Support `set_display_name` in v2. (#6471)
* Support `set_display_name` in v2.

* update comment in proto

* fix test
2021-08-30 12:07:25 -07:00
Joe Liedtke b8c450f9ac
feat(api): Updates pipeline_spec.proto to use google.protobuf.Value (#6402) 2021-08-30 00:00:24 -07:00
Chen Sun 5b5568c112
feat(api): Add env variable in ContainerSpec (#6251) 2021-08-09 10:52:27 -07:00
Yaqi Ji 58fefe9e21
chore: update pipeline_spec.proto comments for `schema_title` format and sync the deprecation warning for `schema_uri`. (#6234)
* Update pipeline_spec.proto

* Update pipeline_spec.proto
2021-08-04 22:11:18 -07:00
Chen Sun bb22118588
feat(api): Add PipelineTaskFinalStatus to pipeline_spec.proto (#6221)
* Add PipelineTaskFinalStatus

* fork https://github.com/googleapis/googleapis/blob/master/google/rpc/status.proto
2021-08-03 22:12:41 -07:00
Yaqi Ji 6b48154d1c
feat(sdk): update pipeline_spec.proto to add artifact schema version field (#6220) 2021-08-03 16:54:41 -07:00
Yuan (Bob) Gong b653ea244c
feat: pipeline spec as a separate go module (#6000)
* feat: pipeline spec as a separate go module

* use api-generator image & update release image

* clean up & update licenses

* go mod tidy
2021-07-12 20:51:16 -07:00
hilcj 635f1ba7c0
Update pipeline_spec.proto (#5813) 2021-06-08 11:06:16 -07:00
hilcj 85013375f0
Update pipeline_spec.proto (#5787)
The single quote is no longer supported.
2021-06-03 16:00:36 -07:00
IronPan 0c6b99563a
Update IR documentations (#5647)
* Update IR documentations

* Update pipeline_spec.proto

* Update pipeline_spec.proto
2021-05-18 19:31:41 -07:00
Chen Sun d3ddfadf2d
chore(api): deprecate AIPlatformCustomJobSpec (#5361) 2021-03-22 19:50:43 -07:00
hilcj 1e8d4991c8
Update pipeline_spec.proto (#5342) 2021-03-22 13:42:43 -07:00
Chen Sun 265a0274e7
release(api): Update pipeline_spec.proto and bump kfp-pipeline-spec version to 0.1.7. (#5262)
* Update pipeline_spec.proto

* Update setup.py
2021-03-08 17:46:23 -08:00
Chen Sun 33a7d4d336
feat(api): Update pipeline_spec.proto - Add metadata to ArtifactSpec (#5143) 2021-02-17 12:20:30 -08:00
Yuan (Bob) Gong d024935339
WIP: KFP v2 POC (#5092)
* Changes:
* add kfp v2 hello world sample
* generate go proto code
* code to unmarshal via jsonpb
* generate container spec
* add root DAG task and Makefile to run in argo
* env setup to quickly build driver container
* generate mlmd grpc golang client
* mlmd grpc client usage example
* driver-dag: put execution and context
* driver dag: put context only when execution is a DAG
* driver task: resolve parameter from parent execution
* chain dag driver with task driver
* driver: output argo parameters
* driver: build driver docker image
* driver: push image to dev registry
* compiler: root dag driver compiler
* mlmd doc
* driver: use task spec and executor spec as driver input instead
* driver: pod spec patch output for type EXECUTOR
* compiler: passing - parameter placeholder with hello world example
* include generated argo workflow in source control
* driver no longer outputs parameters
* publisher: publish parameters to execution custom properties
* driver, publisher: execution state
* publisher: remove built binary from repo
* sample: add producer consumer sample
* sample: producer consumer sample with only parameters
* e2e output parameter support
* e2e: driver resolves input parameter from tasks in the same DAG
* compiler: convert KFP task dependency to argo task dependency
* feat: refactor publisher so it can run as an entrypoint
* build: entrypoint image
* feat: executor and publisher in one container via entrypoint rewriting

* fixed compile error (#1)

* add licenses

* update readme

Co-authored-by: capri-xiyue <52932582+capri-xiyue@users.noreply.github.com>
2021-02-08 10:18:33 -08:00
hilcj 7dbb5d327b
Update pipeline_spec.proto (#5088) 2021-02-03 12:29:36 -08:00
Chen Sun 628e970990
feat(API): Add TriggerPolicy to pipeline_spec (#5080)
* Add TriggerPolicy to pipeline_spec

* fix comments
2021-02-02 16:32:36 -08:00
Jiaxiao Zheng 32ce8d8f90
feat(api): Add AI Platform Custom Job spec to IR (#5035) 2021-01-26 04:18:00 -08:00
hilcj bb0f33054c
feat(backend): sync pipeline_spec.proto (#4927)
Add control flow features to the pipeline_spec.proto.
2020-12-21 13:52:26 -08:00
Jiaxiao Zheng ee85ed563c
[IR] Add deployment spec to IR spec. (#4881)
* add deployment spec

* update version string
2020-12-09 11:46:54 -08:00
Jiaxiao Zheng f140ddb679
chore: Add resolver spec in IR (#4759)
* add resolver spec

* update version

* update version again
2020-11-11 18:07:41 -08:00
Chen Sun 82b1ed4d17
chore(sdk): v2 compiler compiles to pipeline job spec (#4729)
* fix proto

* compile to pipeline job spec

* make pipeline_root required

* address comments
2020-11-06 15:05:38 -08:00
Jiaxiao Zheng 655c42d423
chore: Add pipelineJob to IR spec (#4720)
* add job to IR

* add generated proto_py

* make comments concise
2020-11-05 16:20:50 -08:00
Jiaxiao Zheng c4dd7871a6
chore: Support resource spec in v2 compiler (#4669)
* skeleton of code

* commit resource spec in IR proto

* add resource setter

* add accelerator setters

* fix unit conversion

* fix attribute proxy

* add and fix unittests

* add e2e test

* clean up

* clean up

* clean up

* clean up

* bypass subclass overriding

* clean up

* clean up

* clean up

* resolve comments
2020-10-26 16:40:02 -07:00
Chen Sun 72ce138253
Update IR ExecutorOutput message to use ArtifactList for artifacts field. (#4619)
* Update IR ExecutorOutput message

* fix a typo
2020-10-12 23:10:27 -07:00
Chen Sun 629a980cfd
Update ImporterSpec artifact_uri type (#4548) 2020-09-28 17:07:25 -07:00
hongye-sun d8e82602b0
Pipeline IR (#4371)
* add pipeline spec api proto

* Update pipeline_spec.proto

Add the schema of the pipeline spec.

* Update pipeline_spec.proto

Update the component I/O interfaces and renamed several places.

* Update pipeline_spec.proto

Minor comment and name changes.

* Move the IR into v2alpha1 folder
2020-09-23 14:33:08 -07:00