Commit Graph

82 Commits

Author SHA1 Message Date
Chen Sun b92e4786b2
chore: release kfp-pipeline-spec 0.2.2 (#9120) 2023-04-07 21:24:51 +00:00
Chen Sun 758c91f767
chore: Batch update pipeline spec go generated code (#9083)
* Batch update IR go generated code

* regenerate
2023-03-31 21:53:58 +00:00
hilcj de8d800c8e
Fix display_name and description fields. (#9085) 2023-03-31 20:47:58 +00:00
Chen Sun d2db64bebb
feat: Add cpu_request and memory_request in pipeline_spec. (#9063) 2023-03-30 16:02:06 +00:00
Connor McCarthy 902e2a999f
feat: add TASK_FINAL_STATUS to PipelineSpec ParameterTypeEnum (#9061) 2023-03-30 08:28:05 +00:00
hilcj 60f2a1fe7a
Add pipeline metadata fields in the IR. (#9038) 2023-03-27 21:32:40 +00:00
hilcj 250db6e289
Fix typo in IR field description (#9023) 2023-03-22 16:58:43 +00:00
Connor McCarthy a38d7479d7
feat(sdk): support compiling platform specific features (#8940)
* support compiling platform-specific features

* fix map size change during iteration
2023-03-10 11:18:25 -08:00
Connor McCarthy f31ef32a73
chore: release kfp-pipeline-spec 0.2.1 (#8970) 2023-03-10 17:59:21 +00:00
Connor McCarthy 643f421fcd
feat: add platform-specific configuration protos to `kfp-pipeline-spec` package (#8896)
* feat: add platform-specific configuration protos

* update comment
2023-03-03 00:12:59 +00:00
Connor McCarthy 14905e9169
chore(sdk): bump kfp-pipeline-spec (#8744)
* bump kfp-pipeline-spec to 0.2.0

* clean up setup.py
2023-01-20 12:41:16 -08:00
Chen Sun c30648a390
feat(API): Update IR go package (#8614) 2022-12-21 20:18:13 +00:00
Connor McCarthy 998f52dd94
feat(IR): add is_optional field for input artifacts (#8571) 2022-12-13 23:46:29 +00:00
Connor McCarthy 041f4462b3
feat(IR): change is_list_of_artifacts proto field to is_artifact_list (#8522) 2022-12-02 09:28:16 +00:00
Connor McCarthy 6cd7cbcbc4
feat(sdk): add is_list_of_artifacts field to PipelineSpec [lists of artifacts support pt. 2] (#8466)
* add field

* bump kfp-pipeline-spec version
2022-11-30 18:42:16 +00:00
Bo 288d597a44
chore: bump kfp-pipeline-spec minor version to 0.1.16 (#7807) 2022-05-27 18:43:12 +00:00
Yaqi Ji 30ab968500
chore(api): Update OWNERS (#7806) 2022-05-27 18:22:12 +00:00
Bo a86ae9b89b
feat(IR): adds IteratorPolicy to PipelineTaskSpec proto for support of parallelism setting on ParallelFor (#7804) 2022-05-27 18:21:12 +00:00
Connor McCarthy 436d7afe83
fix(ir): fix kfp-pipeline-spec proto imports (#7754)
* remove unused import

* add google.protobuf.Duration import
2022-05-18 17:19:26 +00:00
Connor McCarthy 356d9cb521
chore: bump kfp-pipeline-spec to 0.1.15 (#7736) 2022-05-18 07:00:26 +00:00
Connor McCarthy f960a52c82
feat(IR): add is_optional to ParameterSpec proto (#7704) 2022-05-12 16:40:05 +00:00
hilcj 27d5404cda
feat(api): Update IR with RetryPolicy (#7581) 2022-04-20 20:47:54 +00:00
Chen Sun 5c168e6449
chore: bump kfp-pipeline-spec version to 0.1.14 (#7463) 2022-03-24 22:16:10 +00:00
Chen Sun b2db4d5601
chore: remove building sdist for `kfp-pipeline-spec` (#7459) 2022-03-24 17:31:47 +00:00
Joe Liedtke 541f2ac8de
feat(api): adds task name to PipelineTaskFinalStatus message (#7452)
* Adds task name to PipelineTaskFinalStatus.

* Fixes comment error.
2022-03-23 22:51:46 +00:00
Chen Sun 5fe4f50a4f
chore(backend): clean up pipelinespec.Value usage (#7407) 2022-03-14 17:32:57 +00:00
Alan Chin 4d9e9bedd3
chore(build): Add source dist to kfp-pipeline-spec python package (#7165) 2022-01-21 17:49:20 +00:00
Ajay Gopinathan 0be57c3880
feat(sdk): Use google.protobuf.Value in v2 for passing parameters. (#6804)
* Use google.protobuf.Value in v2 for passing parameters.

* retest samples.

* Fix tests.

* Update release, more cleanup.

* Use github.com/kubeflow/pipelines/api from same repo.

* Run go mod tidy

* chore: go mod tidy

* fix v2 compile error and clean up unused code

* pr comments.

* update goldens

* Fix metadata recording.

* Update kfp mlmd client.

* fix test again

* another try.

* chore: migrate v2 DAG driver input parameters to protobuf.Value + small refactorings

* fix v2 launcher + clean up

* fix a compile error

* fix a few more tests

* fix number parsing

* clean up

* disable cache_v2 test.

Co-authored-by: Yuan Gong <gongyuan94@gmail.com>
2021-10-28 14:25:51 -07:00
Chen Sun a03b41e129
chore(api): Add parameter_values in RuntimeConfig (#6790) 2021-10-21 12:27:02 -07:00
hilcj 8133c37c7d
chore(api): Fix proto description. (#6659) 2021-10-08 15:25:43 -07:00
Chen Sun 3dd9e2a9b5
chore(api): release kfp-pipeline spec 0.1.12 and update golang generated code (#6684) 2021-10-05 00:53:18 -07:00
Chen Sun 2b1530ba02
chore(api): Add default_value in ComponentInputsSpec.ParameterSpec and default_pipeline_root in PipelineSpec. (#6662)
default_pipeline_root in PipelineSpec.
2021-10-03 15:54:49 -07:00
hilcj 87739ea523
chore(api): Add pipeline_job_resource_name (#6646)
Add PipelineTaskFinalStatus.pipeline_job_resource_name field.
2021-09-29 13:56:09 -07:00
Chen Sun e23f89852d
chore: release kfp-pipeline spec 0.1.11 and update golang generated code (#6570) 2021-09-14 19:24:33 -07:00
hilcj 6252b09cba
feat(api): Update pipeline_spec.proto to add `pipeline_job_uuid` and `pipeline_job_name` in `PipelineTaskFinalStatus` (#6557)
Add pipeline job id to the task final status proto.
2021-09-13 17:34:31 -07:00
Chen Sun c3d982f69f
chore: Release kfp-pipeline-spec 0.1.10 and update golang generated code (#6489) 2021-09-01 14:38:30 -07:00
Chen Sun cfefc6d397
feat(sdk.v2): Support `set_display_name` in v2. (#6471)
* Support `set_display_name` in v2.

* update comment in proto

* fix test
2021-08-30 12:07:25 -07:00
Joe Liedtke b8c450f9ac
feat(api): Updates pipeline_spec.proto to use google.protobuf.Value (#6402) 2021-08-30 00:00:24 -07:00
Yaqi Ji 703ac8723e
chore: sync pipeline_spec to current version. (#6401) 2021-08-20 16:20:55 -07:00
James Liu 1feb9a0c41
chore(frontend): Use protoc to compile IR to typescript definition. Fix #6272 (#6273) 2021-08-10 02:38:24 -07:00
Chen Sun 5b5568c112
feat(api): Add env variable in ContainerSpec (#6251) 2021-08-09 10:52:27 -07:00
Chen Sun ef4518623e
chore: make directories before downloading api dependency proto (#6245) 2021-08-05 14:28:42 -07:00
Yaqi Ji 4c838f7001
chore: Update package version for pipeline-spec release (#6242) 2021-08-05 13:17:42 -07:00
Yaqi Ji 58fefe9e21
chore: update pipeline_spec.proto comments for `schema_title` format and sync the deprecation warning for `schema_uri`. (#6234)
* Update pipeline_spec.proto

* Update pipeline_spec.proto
2021-08-04 22:11:18 -07:00
Chen Sun 0b82ef939b
chore(api): Using Makefile to pull dependency proto (#6223)
* update api/makefile

* add back "make clean all"
2021-08-04 07:40:42 -07:00
Chen Sun bb22118588
feat(api): Add PipelineTaskFinalStatus to pipeline_spec.proto (#6221)
* Add PipelineTaskFinalStatus

* fork https://github.com/googleapis/googleapis/blob/master/google/rpc/status.proto
2021-08-03 22:12:41 -07:00
Yaqi Ji 6b48154d1c
feat(sdk): update pipeline_spec.proto to add artifact schema version field (#6220) 2021-08-03 16:54:41 -07:00
Yuan (Bob) Gong b653ea244c
feat: pipeline spec as a separate go module (#6000)
* feat: pipeline spec as a separate go module

* use api-generator image & update release image

* clean up & update licenses

* go mod tidy
2021-07-12 20:51:16 -07:00
capri-xiyue 724e5b4c7d
chore(v2): Fetch cache result from MLMD and put cache result into argo output artifacts/parameters (#5957)
* added model and storage layer for task

* added create task api

* added api to list tasks

* modified task proto and fixed nits

* renamed variable

* fixed ut

* fixed UT

* added UT for api_converter and resource manager

* added UT for api_converter and resource manager

* fixed BE UT

* added task storage layer UT

* changed UT

* fixed foreign key typo

* added some draft code for replay argo result

* added kfp client in v2

* deleted unused code

* run go mode

* upgraded go version in go v2 test

* run go mod tidy

* added cache client

* fixed nits

* fetched MLMD output parameter

* store output artifacts metadata from cache

* added mlmd pipeline context, exuection and output event

* fixed grpc endpoint of mlpipeline

* fixed task backend bug and fixed launcher connect bug

* fixed cache bug

* added cache info

* fixed unused test

* fixed backend test

* fixed v2 build

* refactored launcher

* removed unused code

* fixed typo
2021-07-08 23:38:23 -07:00
hilcj 635f1ba7c0
Update pipeline_spec.proto (#5813) 2021-06-08 11:06:16 -07:00