kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,649 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

5649 Commits

Author SHA1 Message Date
connor-mccarthy 7ec10c63d9 improve DockerRunner tests 2024-01-05 14:00:20 -08:00
Connor McCarthy 2897a10f59
feat(sdk): support Concat and IfPresent placeholder in local container component execution #localexecution (#10348) 
* feat(sdk): support Concat and IfPresent placeholder in local container component execution #localexecution

* address review feedback

* fix test
 2024-01-05 21:53:56 +00:00
Connor McCarthy 64d46dfed0
fix(sdk): permit empty local execution outputs #localexecution (#10338) 2024-01-05 20:52:08 +00:00
Connor McCarthy 8a5a17e910
feat(sdk): remove local execution feature flag #localexecution (#10355) 2024-01-05 20:20:08 +00:00
Dharmit Dalvi 5399585b6a
feat(backend): Enable logging for KFP components (#10288) 2024-01-05 01:47:08 +00:00
Connor McCarthy dcab0511a2
test(sdk): improve KFP SDK local runner test safety #localexecution (#10336) 2024-01-03 18:39:15 +00:00
Connor McCarthy 86b7e23985
fix(sdk): remove redundant newline character in local `DockerRunner` logs (#10354) 2024-01-02 23:40:14 +00:00
Connor McCarthy 89d4234a5b
fix(sdk): fix presentation of strings in local execution #localexecution (#10353) 2024-01-02 23:00:14 +00:00
Connor McCarthy 973610b918 chore(components): add `json_escape` placeholder util 
PiperOrigin-RevId: 595174285
 2024-01-02 11:54:02 -08:00
Michael Hu 216d3f8036 docs(components): Fix AutoSxS docstring formatting 
PiperOrigin-RevId: 594058915
 2023-12-27 10:25:15 -08:00
Googler a66c5990e4 feat(components): Output errors as a separate table from Arbiter 
PiperOrigin-RevId: 592769441
 2023-12-21 00:03:12 -08:00
Michael Hu 14de087e74 No public description 
PiperOrigin-RevId: 592702825
 2023-12-20 17:53:15 -08:00
Connor McCarthy 846f88770c
feat(sdk): support local Container Component execution #localexecution (#10333) 
* support Container Components

* address review feedback
 2023-12-20 18:34:20 +00:00
Connor McCarthy f52ba56784
chore(sdk): write local execution logs to stdout #localexecution (#10330) 2023-12-20 09:37:20 +00:00
Connor McCarthy 654bbdebe6
feat(sdk): add special `dsl.OutputPath` read logic #localexecution (#10334) 2023-12-20 09:09:20 +00:00
Connor McCarthy adc5b3b160
feat(sdk): add DockerRunner #localexecution (#10328) 2023-12-19 23:14:19 +00:00
James Liu c6acac9bf6
fix(frontend): Add disableParsingRawHTML option for markdown-to-jsx component (#10315) 2023-12-19 20:02:38 +00:00
Googler 44f9992d0c feat(components): change output format to allow possible post eval 
PiperOrigin-RevId: 592257929
 2023-12-19 09:25:57 -08:00
Tobias Goerke 9a306129f8
feat(backend): preserve querystring in pipeline root (fixes #10318) (#10319) 
* feat: preserve querystring in pipeline root

* refactor: create AppendToPipelineRoot
Also apply to client.go

* feat: remove query string from URIs (#1)

* feat: remove query string from URIs

* refactor(GenerateOutputURI): move and preserve comments
 2023-12-19 00:55:37 +00:00
Googler 8eddc27bc9 chore(components): Fix argument description 
PiperOrigin-RevId: 592033936
 2023-12-18 15:56:52 -08:00
Connor McCarthy 784927205c
feat(sdk): add local execution logging #localexecution (#10326) 2023-12-18 23:50:37 +00:00
Connor McCarthy d0da0ad940
chore(sdk): fix use of invalid escape sequence in tests (#10310) 2023-12-18 22:53:38 +00:00
Connor McCarthy 76aad8b18a
feat(sdk): add local execution output collection #localexecution (#10325) 
* feat(sdk): add local execution output collection #localexecution

* update ExecutorInput processing

* address review feedback

* fix exception handling test
 2023-12-16 09:53:18 -05:00
Googler 2e2ba9e5ea fix(components): Upload the tuned adapter to Model Registry instead of model checkpoint from `preview.llm.rlhf_pipeline` 
PiperOrigin-RevId: 591393116
 2023-12-15 16:47:51 -08:00
Googler 075d58f89f fix(components): Resolve unique model display name on each `preview.llm.rlhf_pipeline` run instead of reusing cached result 
PiperOrigin-RevId: 591365087
 2023-12-15 14:48:17 -08:00
Connor McCarthy 2009dfb2f1
test(sdk): add `kfp-kubernetes` execution tests (#10304) 2023-12-15 22:31:54 +00:00
Googler f51a930120 fix(components): Use `large_model_reference` as `model_reference_name` when uploading models from `preview.llm.rlhf_pipeline` instead of hardcoding value as `text-bison@001` 
PiperOrigin-RevId: 591346782
 2023-12-15 13:36:40 -08:00
Connor McCarthy 21f8e9c72b
feat(sdk): add subprocess task handler #localexecution (#10302) 
* add subprocess task handler

* response to review feedback
 2023-12-15 19:51:55 +00:00
Googler 75ffbf94dd test(components): INTERNAL 
PiperOrigin-RevId: 591075392
 2023-12-14 15:54:17 -08:00
Michael Hu 9f8495d376 feat(components): Add better docstrings for AutoSxS 
PiperOrigin-RevId: 591051675
 2023-12-14 14:25:29 -08:00
Connor McCarthy c76a2c0a0d chore(components): release GCPC 2.8.0 
PiperOrigin-RevId: 590758371
 2023-12-13 17:12:52 -08:00
Googler 9f165b6f14 fix(components): Add autosxs_pipeline to the __all__ variable for the preview/model_evaluation directory 
PiperOrigin-RevId: 590757280
 2023-12-13 17:04:12 -08:00
Connor McCarthy 99da2df9fe chore(components): release GCPC 2.7.0 
PiperOrigin-RevId: 590711365
 2023-12-13 14:22:35 -08:00
Jason Dai 8c59816bf2 feat(components): Release new LLM Eval image version 0.5 
PiperOrigin-RevId: 590702775
 2023-12-13 13:53:17 -08:00
Googler 3d62d26727 feat(component): Migrate AutoSxS pipeline to preview and move related files to _implementation/llm directory to help Model Eval team use side by side metrics as part of their pipeline 
PiperOrigin-RevId: 590677273
 2023-12-13 12:20:20 -08:00
Connor McCarthy 33bf920255
test(sdk): add placeholder_utils_test.py (#10301) 2023-12-13 13:59:57 -05:00
Googler efeed83406 feat(components): Enable text generation pipeline to generate row based metrics 
docs: update description of ModelEvaluation's metadata field accordingly

PiperOrigin-RevId: 590486026
 2023-12-13 00:43:57 -08:00
hsinhoyeh b40912cc5d
fix(sdk): use kfp.dsl.types to replace kfp.components.types Fixes #10282 (#10283) 
* use kfp.dsl.types to replace kfp.components.types

Fixes: #10282
Signed-off-by: hsinhoyeh <yhh92u@gmail.com>

* fix import artifact_types

---------

Signed-off-by: hsinhoyeh <yhh92u@gmail.com>
 2023-12-12 19:38:38 -05:00
Connor McCarthy 2edfb8965d
install kfp-pipeline-spec from source for kfp tests (#10300) 2023-12-12 18:05:48 -05:00
Connor McCarthy d41efc3e96
update task dispatcher (#10298) 2023-12-12 14:23:49 -05:00
Googler 227eab1c68 fix(components): Use `llama-2-7b` for the base reward model when tuning `llama-2-13` with the `preview.llm.rlhf_pipeline` 
PiperOrigin-RevId: 589490121
 2023-12-09 18:23:01 -08:00
Connor McCarthy 5cd708de37
feat(sdk): add local execution skeleton #localexecution (#10292) 2023-12-09 14:08:21 -05:00
Connor McCarthy 5c60d37616
remove cleanup param in local init (#10293) 2023-12-09 14:07:58 -05:00
Googler 685634d4a3 feat(components): Add `num_microbatches` to `_implementation.llm` training components 
PiperOrigin-RevId: 589267101
 2023-12-08 16:07:09 -08:00
Googler 9007fb0007 feat(components): Bump image tag used by `preview.llm` pipelines 
PiperOrigin-RevId: 589253163
 2023-12-08 15:10:38 -08:00
Chen Sun c5658f09ec chore(release): bumped version to 2.0.5 2023-12-08 18:00:49 +00:00
dependabot[bot] 69d2d35002
chore(deps): bump axios from 0.21.1 to 1.6.0 in /frontend/server (#10228) 
Bumps [axios](https://github.com/axios/axios) from 0.21.1 to 1.6.0.
- [Release notes](https://github.com/axios/axios/releases)
- [Changelog](https://github.com/axios/axios/blob/v1.x/CHANGELOG.md)
- [Commits](https://github.com/axios/axios/compare/v0.21.1...v1.6.0)

---
updated-dependencies:
- dependency-name: axios
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-07 19:54:55 +00:00
Tommy Li fc0e472974
chore(backend): Propose Tomcli to be the backend reviewer (#10291) 2023-12-06 23:36:54 +00:00
Googler 708b8bd623 fix(components): Append `tune-type` label when uploading models tuned by `preview.llm.rlhf_pipeline` 
PiperOrigin-RevId: 588172611
 2023-12-05 13:30:22 -08:00
Dharmit Dalvi 23a2bc3ba3
feat(backend): Parameterizing v2 Launcher and Driver Images (#10269) 
* Parameterize v2 launcher image

* Parameterize v2 driver image
 2023-12-05 21:02:06 +00:00