Commit Graph

64 Commits

Author SHA1 Message Date
Michael Hu 216d3f8036 docs(components): Fix AutoSxS docstring formatting
PiperOrigin-RevId: 594058915
2023-12-27 10:25:15 -08:00
Googler 2e2ba9e5ea fix(components): Upload the tuned adapter to Model Registry instead of model checkpoint from `preview.llm.rlhf_pipeline`
PiperOrigin-RevId: 591393116
2023-12-15 16:47:51 -08:00
Michael Hu 9f8495d376 feat(components): Add better docstrings for AutoSxS
PiperOrigin-RevId: 591051675
2023-12-14 14:25:29 -08:00
Googler 9f165b6f14 fix(components): Add autosxs_pipeline to the __all__ variable for the preview/model_evaluation directory
PiperOrigin-RevId: 590757280
2023-12-13 17:04:12 -08:00
Googler 3d62d26727 feat(component): Migrate AutoSxS pipeline to preview and move related files to _implementation/llm directory to help Model Eval team use side by side metrics as part of their pipeline
PiperOrigin-RevId: 590677273
2023-12-13 12:20:20 -08:00
Googler efeed83406 feat(components): Enable text generation pipeline to generate row based metrics
docs: update description of ModelEvaluation's metadata field accordingly

PiperOrigin-RevId: 590486026
2023-12-13 00:43:57 -08:00
Googler c23b720f10 feat(components): Group `preview.llm.rlhf_pipeline` components for more readability
PiperOrigin-RevId: 582733817
2023-11-15 10:56:39 -08:00
Jason Dai b55ed6e4b4 feat(components): Add tuning dataset support to LLM Eval Text Generation and Text Classification Pipelines. Include new LLM Eval Preprocessor component to both pipelines
PiperOrigin-RevId: 582732167
2023-11-15 10:56:23 -08:00
Connor McCarthy 91f50da235 feat(components): add environment variable support to GCPC's `create_custom_training_job_from_component`
PiperOrigin-RevId: 582423917
2023-11-14 13:32:12 -08:00
Googler bcd59220f4 feat(components): Group `preview.llm.rlhf_pipeline` components for more readability
PiperOrigin-RevId: 582394326
2023-11-14 11:52:02 -08:00
Googler a927984394 feat(components): Group `preview.llm.rlhf_pipeline` components for more readability
PiperOrigin-RevId: 581354060
2023-11-10 13:32:31 -08:00
Changyu Zhu bfa40697ae chore(components): Remove DataConverterJobOp from docs
PiperOrigin-RevId: 580358293
2023-11-07 17:58:23 -08:00
Changyu Zhu 79a916d067 chore(components): Change #AutoML #Vision data converter output artifact type
PiperOrigin-RevId: 580344061
2023-11-07 16:57:14 -08:00
Googler 033bfa264d chore(components): Update image
PiperOrigin-RevId: 580254777
2023-11-07 11:56:41 -08:00
Jason Dai f6aad5e4e0 feat(components): add LLM Eval pipeline parameter for customizing eval dataset reference ground truth field
PiperOrigin-RevId: 580233829
2023-11-07 10:54:21 -08:00
Changyu Zhu 4c4ca6b092 chore(components): Add JSON payload concatenation utility for AutoML Vision data converter
PiperOrigin-RevId: 578295648
2023-10-31 14:02:47 -07:00
Googler f67cbfa81f feat(components): Add ability to tune chat model with `preview.llm.rlhf_pipeline`
PiperOrigin-RevId: 578262705
2023-10-31 12:15:30 -07:00
Googler d8f2c140ce feat(components): Add chat dataset preprocessor to `preview.llm.infer_pipeline`
PiperOrigin-RevId: 577988605
2023-10-30 16:20:21 -07:00
Changyu Zhu c383eb64cd chore(components): Update AutoML Vision data converter component
PiperOrigin-RevId: 576269528
2023-10-24 13:58:21 -07:00
Connor McCarthy c0ef67cb86 chore(components): update GCPC docstrings
PiperOrigin-RevId: 576164819
2023-10-24 09:26:32 -07:00
Jason Dai d53dddab1c feat(components): add support for customizing model_parameters in LLM eval text generation and LLM eval text classification pipelines
PiperOrigin-RevId: 575302065
2023-10-20 13:20:33 -07:00
Googler e8fb6990df feat(components): Make `model_checkpoint` optional for `preview.llm.infer_pipeline`
PiperOrigin-RevId: 574876480
2023-10-19 08:14:58 -07:00
Connor McCarthy faba9223ee feat(components): migrate `DataflowFlexTemplateJobOp` to GA namespace (now `v1.dataflow.DataflowFlexTemplateJobOp`)
PiperOrigin-RevId: 574498920
2023-10-18 09:25:37 -07:00
Googler 1386a826ba feat(components): Set display names for SFT, RLHF and LLM inference pipelines
PiperOrigin-RevId: 572897105
2023-10-12 07:17:39 -07:00
Changyu Zhu 8f07661ae9 feat(components): Add vision data converter component to preview
PiperOrigin-RevId: 572660064
2023-10-11 12:55:38 -07:00
Googler 2bb57ece35 feat(components): Upload tensorboard metrics from RLHF pipeline if a tensorboard resource id is provided
PiperOrigin-RevId: 572040791
2023-10-09 14:26:17 -07:00
Connor McCarthy b83b9a4644 docs(components): fix preview.custom_job.create_custom_training_job_from_component reference docs
PiperOrigin-RevId: 570738849
2023-10-04 10:42:48 -07:00
Googler 42df5e1301 fix(components): Fix the feature transform engine arguments
PiperOrigin-RevId: 570221353
2023-10-02 17:03:40 -07:00
Googler 4fd1c02fc0 fix(components): Disable caching for LLM pipeline components that store temporary artifacts
PiperOrigin-RevId: 570070284
2023-10-02 08:14:00 -07:00
Jason Dai e8b8450e0a feat(components): Add support for customizing evaluation_display_name in model evaluation pipelines
PiperOrigin-RevId: 567648855
2023-09-22 09:56:24 -07:00
Googler adb86777a0 No public description
PiperOrigin-RevId: 566742090
2023-09-19 14:21:22 -07:00
Connor McCarthy fc1f12b7bd feat(components): add `persistent_resource_id` to preview GCPC custom job components/utils
PiperOrigin-RevId: 565423232
2023-09-14 11:14:20 -07:00
Connor McCarthy 1fbdeb2abf chore(components): fix GCPC markdown docstrings rendering
PiperOrigin-RevId: 565397565
2023-09-14 09:51:07 -07:00
Yifan Xiao cfe671c485 chore(components): Update the pipelines for the Tabular Workflow
feat(components): Expose feature selection pipeline

PiperOrigin-RevId: 565182978
2023-09-13 15:44:24 -07:00
Connor McCarthy 510f23a052 chore(components): remove error __init__.py file
PiperOrigin-RevId: 565177719
2023-09-13 15:24:39 -07:00
Connor McCarthy abf05f4819 feat(components): fork a subset of `v1` `custom_job` and `gcp_launcher` container code to `preview`
PiperOrigin-RevId: 564809626
2023-09-12 13:21:26 -07:00
Googler e21174f94a feat(components): Add sampling_strategy parameter to bulk inferrer to support different strategy. By default, we use greedy
PiperOrigin-RevId: 562860317
2023-09-05 12:43:17 -07:00
Connor McCarthy 3fb199658f chore(components): convert GCPC docstrings to markdown
PiperOrigin-RevId: 562015575
2023-09-01 12:12:27 -07:00
Googler 9ce2866527 feat(components): Update supported large model reference names that can be resolved by function based component in _implementation/llm
PiperOrigin-RevId: 559493244
2023-08-23 11:36:15 -07:00
Connor McCarthy 59aa41d78a chore(components): fix infer_pipeline invocation
PiperOrigin-RevId: 558586379
2023-08-20 10:03:56 -07:00
Connor McCarthy 7d282b91f4 chore(components): reorganize gcpc llm components
PiperOrigin-RevId: 558581292
2023-08-20 09:13:49 -07:00
Googler 611298a8ee feat(components): Add rlhf and infer pipelines to preview/llm. Add llm related components to _implementation/llm
PiperOrigin-RevId: 558430903
2023-08-19 11:38:14 -07:00
Googler beb66abcf6 chore(components): INTERNAL
PiperOrigin-RevId: 558309338
2023-08-18 19:58:02 -07:00
Googler c3b9550bf5 chore(components): INTERNAL
PiperOrigin-RevId: 558295863
2023-08-18 18:11:10 -07:00
Kevin Naughton f323acf4eb fix(components): Fix proto reference from range to _range in model evaluation preview utils function
PiperOrigin-RevId: 558256414
2023-08-18 15:02:23 -07:00
Googler db3f867cc2 chore(components): Update the pipelines for the Tabular Workflow for Forecasting
PiperOrigin-RevId: 558241332
2023-08-18 14:05:17 -07:00
Jason Dai f454a86177 feat(components): Add Feature Attribution components to _implementation/model_evaluation. Add LLM Eval text generation and text classification pipelines to preview namespace init file
PiperOrigin-RevId: 557226606
2023-08-15 13:12:06 -07:00
Connor McCarthy 88e1045c11 feat(components): use GCPC project id placeholder as project parameter default
PiperOrigin-RevId: 556844000
2023-08-14 10:50:12 -07:00
Jason Dai b630d5c8ae feat(components): add Vertex RAI safety bias evaluation pipeline
PiperOrigin-RevId: 556075708
2023-08-11 13:53:46 -07:00
Kevin Naughton b350ac4ddc feat(components): Upgrade LLM evaluation classification and text generation pipelines to preview
PiperOrigin-RevId: 555540517
2023-08-10 10:08:00 -07:00