cad6929326
feat(Backend + SDK): Update kfp backend and kubernetes sdk to support tolerations
...
Co-authored-by: edmondop <edmondo.porcu@gmail.com>
Co-authored-by: tarat44 <32471142+tarat44@users.noreply.github.com>
2024-02-13 12:59:13 -05:00
1fcc68121c
feat(kubernetes_platform): Add ActiveDeadlineSeconds(timeout) to the kubernetes platform spec ( #10464 )
2024-02-13 00:19:04 +00:00
0b75afdd8a
chore(components): Update AutoSxS and RLHF image tags
...
PiperOrigin-RevId: 606330905
2024-02-12 12:30:46 -08:00
b3978c1e98
feat(Backend + SDK): Update kfp backend and kubernetes sdk to support pod labels and annotations ( #10393 )
...
* update kfp kubernetes sdk to include pod labels and annotations
* fix unit test output order
* add podmetadata changes
* update argo compiler to support pod metadata
* update tests
* update go mod to use the latest kubernetes_platform package
* update licenses
* address comments
* update kubernetes_platform package to include the latest spec
---------
Co-authored-by: Chen Sun <chensun@users.noreply.github.com>
2024-02-09 21:15:01 +00:00
6cc234b3f1
feat(kubernetes_platform): Update kubernetes_platform go package to include ConfigMaps as volumes and as env variables. ( #10400 )
...
* Update kubernetes_platform go package to include ConfigMaps as volumes and as env variables
Signed-off-by: Alexey Roytman <roytman@il.ibm.com>
* add ConfigMapKeyToEnvMap
* change config_map_key string
* add list of map
* rename "CmAsVolume" to "ConfigMapAsVolume" and "CmAsEnv" to "ConfigMapAsEnv"
---------
Signed-off-by: Alexey Roytman <roytman@il.ibm.com>
2024-02-09 20:12:44 +00:00
e6ddb0c012
fix(backend): get pipeline by name is broken due to version typo, Fixes #9940 ( #10268 )
...
function getPipelineByName have a version typo:
V1beta1 -> v1beta1
2024-02-09 20:12:38 +00:00
25f4478307
Fix(backend): fix timeout for internal server error. Fixes #10267 ( #10439 )
...
* Fix(backend): fix timeout for internal server error
* Fix(backend): fix timeout for internal server error (variable rename)
2024-02-09 19:06:44 +00:00
1582e0a9bd
feat(Backend + SDK): Update kfp backend and kubernetes sdk to support ImagePullSecrets ( #10427 )
...
* Update kfp backend and kubernetes sdk to support ImagePullSecrets
* update go.mod go.sum and csv files
* update image_pull_secret method name
* update unit tests
* update apiserver.csv file
* update set_image_pull_secrets name
2024-02-09 19:06:38 +00:00
1280753eb4
chore(components): Use new module for looking up ReFINED and AutoSxS image tags
...
PiperOrigin-RevId: 605457014
2024-02-08 16:14:35 -08:00
21c5ffebb0
fix(sdk): fix bug where `dsl.OneOf` with multiple consumers cannot be compiled ( #10452 )
2024-02-08 23:51:37 +00:00
d4c3f35797
feat(components): Add RLAIF pipeline to preview
...
PiperOrigin-RevId: 605396378
2024-02-08 12:36:38 -08:00
fe04a5a842
fix(sdk): fixes type issues for ParallelFor. Fixes #9366 ( #10436 )
...
* fix type issues
* fix type issue
* fix format
* fix failed test
* fix format
* delete comments
* resolve comments
* resolve comments
* resolve format
* resolve import
* move unnecessary file
* resolve compiler_test failures
* resolve comments
* remove unnecessary imports
* fix format sort
* fix nits
* add new compiled yaml file
* solve merge conflicts
* solve conflicts
* format
* sort
* resolve comments
* resolve comments
2024-02-08 18:34:37 +00:00
87db18e3a1
No public description
...
PiperOrigin-RevId: 605012378
2024-02-07 09:41:59 -08:00
f51dc39614
feat(kubernetes_platform): Update kubernetes_platform go package to include imagePullPolicy. ( #10416 )
...
Signed-off-by: Revital Sur <eres@il.ibm.com>
2024-02-07 17:12:36 +00:00
1c9ac5c8e2
feat(kubernetes_platform): Update kubernetes_platform go package to include ImagePullSecrets ( #10410 )
2024-02-07 08:46:35 +00:00
b528568718
feat(sdk): Support dsl.ParallelFor over list of Artifacts ( #10441 )
...
* samples message
* update pr number
* Split LoopArgument into LoopParameterArgument and LoopArtifactArgument
* formatting
* address some comments
* resolve release notes conflict
* flatten loops in pipeline_spec_builder
* update artifact type checking logic
* simplify artifact checking logic
* re-add issubtype_of_artifact
* move name_is_loop_argument to for_loop_test.py
* simplify LoopArtifactArgument is_artifact_list=False logic
* update typeerror
* typo
* typo
* small fix
* formatting
* formatting
* remove issubtype_of_artifact()
* small changes
* assert LoopArtifactArgument channel.is_artifact_list is True
* remove whitespace
* remove newline
* Update single artifact check and error message
* formatting
* add unit test for is_artifact_list==False
* formatting
* update valueerror test.
* typo
* regex formatting
* formatting
2024-02-06 23:03:40 +00:00
b6247fb8e4
chore(components): Update component naming in AutoSxS implementation
...
PiperOrigin-RevId: 604678269
2024-02-06 09:49:04 -08:00
269fc3e9a9
No public description
...
PiperOrigin-RevId: 604419526
2024-02-05 13:41:12 -08:00
14193def65
chore(components): Create module containing AutoSxS and RLHF image tag
...
PiperOrigin-RevId: 603765313
2024-02-02 12:58:35 -08:00
421d65a684
fix(backend): correct run field map col names ( #10430 )
...
* fix(backend): correct field map col names
Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com>
* chore(backend): add tests for api field map
Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com>
---------
Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com>
2024-02-02 16:54:15 +00:00
1fe1c63f60
feat(sdk): support local execution of pipelines in pipelines ( #10440 )
2024-02-02 04:32:14 +00:00
05f69b2333
fix(components): Update text generation pipeline input description
...
PiperOrigin-RevId: 602860006
2024-01-30 15:35:02 -08:00
7bd31d104b
support dsl.importer locally; resolve merge conflicts ( #10431 )
2024-01-29 19:17:15 -08:00
977bffce2a
feat(sdk): support f-strings in local pipeline execution ( #10435 )
2024-01-30 01:24:01 +00:00
0f3f68c05f
fix(components): Write model resource_name to the output of training pipeline remote runner
...
PiperOrigin-RevId: 602426716
2024-01-29 10:21:12 -08:00
442d457057
feat(sdk): support local pipeline execution ( #10423 )
...
* local pipeline implementation
* address review feedback
2024-01-29 07:50:37 -08:00
8c7b5b2bf5
feat(components): Use a single inference component for AutoSxS
...
PiperOrigin-RevId: 601877680
2024-01-26 15:06:46 -08:00
c803a69d85
chore(components): fix GCPC documentation dependencies issue
...
PiperOrigin-RevId: 601574718
2024-01-25 14:54:51 -08:00
cdd91f25d1
chore(components): GCPC 2.9.0 Release
...
PiperOrigin-RevId: 601525956
2024-01-25 12:18:17 -08:00
83cb88f9b5
feat(components): Update LLM Evaluation Pipelines to use `text-bison@002` model by default
...
PiperOrigin-RevId: 601509035
2024-01-25 11:25:23 -08:00
b9e08ded48
fix(components): Only run `preview.llm.bulk_inference` after tuning third-party models with RLHF
...
PiperOrigin-RevId: 601226133
2024-01-24 13:59:24 -08:00
f65bb0f532
fix(backend): MLMD pagination on getting executions of DAG ( #10396 )
2024-01-24 19:06:53 +00:00
a990446b9c
chore(sdk): local task execution refactor + cleanup ( #10420 )
2024-01-23 15:54:03 +00:00
ddb2f9a8b6
fix(components): Update base image for KFP lightweight component for VPC SC compliance
...
PiperOrigin-RevId: 600622671
2024-01-22 17:55:51 -08:00
60b66dca0f
docs(components): Update AutoSxS pipeline to use "question_answering" as task name instead of "question_answer", where "question_answer" is still supported, but deprecated
...
chore(components): Update RLHF and AutoSxS image tags
PiperOrigin-RevId: 600532640
2024-01-22 12:17:59 -08:00
5b7f67acdc
fix string quotes ( #10413 )
2024-01-22 08:50:55 -08:00
bce8487061
feat(components): support aliases arg in ModelUploadOp
...
PiperOrigin-RevId: 600096017
2024-01-20 08:37:24 -08:00
bd0dd7782e
chore(components): Sync AutoML components
...
PiperOrigin-RevId: 600091779
2024-01-20 08:02:08 -08:00
4bb3423889
feat(components): Support scheduling and labels in utils.build_payload
...
PiperOrigin-RevId: 599904659
2024-01-19 12:20:10 -08:00
45595189fa
chore(components): migrate GCPC to protobuf 4; require KFP>=2.6.0
...
PiperOrigin-RevId: 599639627
2024-01-18 15:16:09 -08:00
75a3c48683
docs(sdk): add kfp.local to reference docs ( #10395 )
2024-01-18 18:39:58 +00:00
6275177e6e
Fix metrics visualization v2 sample ( #10399 )
2024-01-17 16:54:30 -08:00
80c9b04bd6
fix(components): Update base image for KFP lightweight component for VPC SC compliance
...
PiperOrigin-RevId: 598888543
2024-01-16 10:46:58 -08:00
1cc31bb917
chore(components): Sync AutoML components
...
PiperOrigin-RevId: 597743182
2024-01-11 22:22:41 -08:00
a79b36c804
docs(sdk): fix `kfp-kubernetes` docs build error ( #10389 )
2024-01-12 01:11:13 +00:00
10ad823542
chore(sdk): update `kfp-kubernetes` docs versions and release scripts ( #10388 )
2024-01-12 01:00:13 +00:00
0907a1155b
chore(sdk): release kfp-kubernetes 1.1.0 ( #10387 )
2024-01-11 23:56:13 +00:00
74c92d73ed
chore(components): Add v1.model.ModelGetOp components
...
PiperOrigin-RevId: 597653399
2024-01-11 14:22:08 -08:00
aac4408237
chore(sdk): release KFP SDK 2.6.0 ( #10386 )
2024-01-11 22:14:13 +00:00
4276aae31b
chore(components): rollback GCPC 2.8.1 release
...
PiperOrigin-RevId: 597636452
2024-01-11 13:16:48 -08:00
droctothorpe