4c4ca6b092
chore(components): Add JSON payload concatenation utility for AutoML Vision data converter
...
PiperOrigin-RevId: 578295648
2023-10-31 14:02:47 -07:00
9b7a5dc532
chore(components): [endpoint_batch_predict] update parameters' default value
...
PiperOrigin-RevId: 578266253
2023-10-31 12:28:06 -07:00
f67cbfa81f
feat(components): Add ability to tune chat model with `preview.llm.rlhf_pipeline`
...
PiperOrigin-RevId: 578262705
2023-10-31 12:15:30 -07:00
d8f2c140ce
feat(components): Add chat dataset preprocessor to `preview.llm.infer_pipeline`
...
PiperOrigin-RevId: 577988605
2023-10-30 16:20:21 -07:00
429eb0dc59
chore(components): bump latest supported KFP SDK version
...
PiperOrigin-RevId: 577965944
2023-10-30 14:58:03 -07:00
1bee8be071
feat(components): [text2sql] Generate column names by model batch predict
...
PiperOrigin-RevId: 576941675
2023-10-26 11:45:14 -07:00
c83329f69c
chore(components): fix GCPC markdown docstrings rendering
...
PiperOrigin-RevId: 576588522
2023-10-25 11:19:35 -07:00
570e56dd09
fix(components): [text2sql] Turn model_inference_results_path to model_inference_results_directory and remove duplicate comment
...
PiperOrigin-RevId: 576576299
2023-10-25 10:44:01 -07:00
0d75611997
feat(components): [endpoint_batch_predict] Initialize component
...
PiperOrigin-RevId: 576300455
2023-10-24 15:18:22 -07:00
c383eb64cd
chore(components): Update AutoML Vision data converter component
...
PiperOrigin-RevId: 576269528
2023-10-24 13:58:21 -07:00
04aac259a4
chore(components): add GCPC Python 3.7 EOL warning
...
PiperOrigin-RevId: 576214273
2023-10-24 11:50:36 -07:00
c0ef67cb86
chore(components): update GCPC docstrings
...
PiperOrigin-RevId: 576164819
2023-10-24 09:26:32 -07:00
ebb42450d0
feat(components): [text2sql] Generate table names by model batch prediction
...
PiperOrigin-RevId: 575978329
2023-10-23 17:42:33 -07:00
21079b5910
feat(components): [text2sql] Implement preprocess component logic
...
PiperOrigin-RevId: 575976269
2023-10-23 17:32:54 -07:00
2054b7c45d
feat(components) Extend kserve component ( #10136 )
...
* add runtime version, resource requests and resource limits
* adjust kservedeployer
* Update components/kserve/src/kservedeployer.py
Co-authored-by: Tommy Li <Tommy.chaoping.li@ibm.com>
* Update components/kserve/src/kservedeployer.py
Co-authored-by: Tommy Li <Tommy.chaoping.li@ibm.com>
* Update components/kserve/src/kservedeployer.py
Co-authored-by: Tommy Li <Tommy.chaoping.li@ibm.com>
---------
Co-authored-by: Tommy Li <Tommy.chaoping.li@ibm.com>
2023-10-23 22:06:06 +00:00
0cb2217934
chore(components): update GCPC custom job docstrings
...
PiperOrigin-RevId: 575835146
2023-10-23 09:05:18 -07:00
d53dddab1c
feat(components): add support for customizing model_parameters in LLM eval text generation and LLM eval text classification pipelines
...
PiperOrigin-RevId: 575302065
2023-10-20 13:20:33 -07:00
a690009486
chore(components): release GCPC 2.5.0
...
PiperOrigin-RevId: 575263464
2023-10-20 10:53:13 -07:00
1ae7271804
chore(components): pin `apache_beam[gcp]` to `2.50.0`
...
PiperOrigin-RevId: 575018545
2023-10-19 15:22:00 -07:00
99fd2017a7
feat(components): Add ability to preprocess chat llama datasets to `_implementation.llm.chat_dataset_preprocessor`
...
PiperOrigin-RevId: 575004978
2023-10-19 14:35:42 -07:00
0e240db397
No public description
...
PiperOrigin-RevId: 574969883
2023-10-19 12:38:31 -07:00
e8fb6990df
feat(components): Make `model_checkpoint` optional for `preview.llm.infer_pipeline`
...
PiperOrigin-RevId: 574876480
2023-10-19 08:14:58 -07:00
d8a0660df5
feat(components): Add sliced evaluation metrics support for custom and unstructured AutoML models in evaluation feature attribution pipeline
...
PiperOrigin-RevId: 574649081
2023-10-18 16:54:59 -07:00
faba9223ee
feat(components): migrate `DataflowFlexTemplateJobOp` to GA namespace (now `v1.dataflow.DataflowFlexTemplateJobOp`)
...
PiperOrigin-RevId: 574498920
2023-10-18 09:25:37 -07:00
1682ce8ade
feat(components): Support service account in kubeflow model_batch_predict component
...
PiperOrigin-RevId: 574209244
2023-10-17 11:15:37 -07:00
0487f9a8b1
feat(components): Add sliced evaluation metrics support for custom and unstructured AutoML models in evaluation pipeline
...
PiperOrigin-RevId: 573331226
2023-10-13 15:16:55 -07:00
ea93979eed
feat(components): [text2sql] Initialize evaluation component
...
PiperOrigin-RevId: 573329341
2023-10-13 15:08:18 -07:00
633ddeb07e
feat(components): [text2sql] Initialize validate and process component
...
PiperOrigin-RevId: 573317490
2023-10-13 14:18:41 -07:00
9aa750e62f
feat(components): [text2sql] Initialize preprocess component and integrate with text2sql pipeline
...
PiperOrigin-RevId: 573025616
2023-10-12 15:17:32 -07:00
4d71fdac3f
feat(components): Update image tag used by llm pipelines
...
PiperOrigin-RevId: 573014609
2023-10-12 14:35:05 -07:00
1386a826ba
feat(components): Set display names for SFT, RLHF and LLM inference pipelines
...
PiperOrigin-RevId: 572897105
2023-10-12 07:17:39 -07:00
412216f832
feat(components): Add question_answer support for AutoSxS default instructions
...
PiperOrigin-RevId: 572677918
2023-10-11 13:56:06 -07:00
8f07661ae9
feat(components): Add vision data converter component to preview
...
PiperOrigin-RevId: 572660064
2023-10-11 12:55:38 -07:00
b348911974
chore(components): pin GCPC's `google-cloud-aiplatform` dependency
...
PiperOrigin-RevId: 572621401
2023-10-11 10:48:30 -07:00
5c44143742
feat(components): Implement timestamp filtering for chunking
...
PiperOrigin-RevId: 572444659
2023-10-10 20:31:22 -07:00
1f37243ec1
feat(components): Update embedding pipeline containers to use llm-pipeline image
...
PiperOrigin-RevId: 572411103
2023-10-10 17:17:42 -07:00
9cf92c3161
feat(components): Release new model evaluation image versions
...
PiperOrigin-RevId: 572375018
2023-10-10 15:02:19 -07:00
72e7f964c5
feat(components): [text2sql] Initialize text2sql pipeline
...
PiperOrigin-RevId: 572374590
2023-10-10 14:53:50 -07:00
2131dfaf6d
chore(components): Fix formatting in upcoming release notes
...
PiperOrigin-RevId: 572237593
2023-10-10 07:10:00 -07:00
15c24e344f
feat(components): Switch v1 AutoMLImageTrainingJob to use the pipeline remote runner
...
PiperOrigin-RevId: 572073436
2023-10-09 16:39:17 -07:00
2bb57ece35
feat(components): Upload tensorboard metrics from RLHF pipeline if a tensorboard resource id is provided
...
PiperOrigin-RevId: 572040791
2023-10-09 14:26:17 -07:00
067033762d
feat(components): internal change
...
PiperOrigin-RevId: 571455446
2023-10-06 15:56:19 -07:00
b273aabb89
feat(components): Add LLM implementation component that uploads tensorboard metrics after training
...
PiperOrigin-RevId: 571359958
2023-10-06 09:36:57 -07:00
2fbabd9eb8
chore(component): Update KServe component to support Kubeflow 1.8 ( #10062 )
2023-10-05 06:14:15 +00:00
07156ae8a6
fix(components): Minor update for chunking parameter name
...
PiperOrigin-RevId: 570768999
2023-10-04 12:23:42 -07:00
b83b9a4644
docs(components): fix preview.custom_job.create_custom_training_job_from_component reference docs
...
PiperOrigin-RevId: 570738849
2023-10-04 10:42:48 -07:00
f55ec3f74f
docs(components): migrate to `build.os` (additional changes)
...
PiperOrigin-RevId: 570496144
2023-10-03 14:34:15 -07:00
3886ae8637
chore(components): release GCPC SDK 2.4.1
...
PiperOrigin-RevId: 570225887
2023-10-02 17:33:00 -07:00
42df5e1301
fix(components): Fix the feature transform engine arguments
...
PiperOrigin-RevId: 570221353
2023-10-02 17:03:40 -07:00
3581146c5d
chore(components): add `build.os` field to readthedocs config
...
PiperOrigin-RevId: 570215323
2023-10-02 16:38:40 -07:00
cc9d7e7970
chore(components): fix GCPC readthedocs dropdown versions
...
PiperOrigin-RevId: 570190000
2023-10-02 15:01:58 -07:00
4fd1c02fc0
fix(components): Disable caching for LLM pipeline components that store temporary artifacts
...
PiperOrigin-RevId: 570070284
2023-10-02 08:14:00 -07:00
a070006a55
chore(components): release GCPC SDK 2.4.0
...
PiperOrigin-RevId: 569317711
2023-09-28 16:12:06 -07:00
45fe8e8658
feat(components): Use 64 v3 TPUs for llm pipelines
...
PiperOrigin-RevId: 568282755
2023-09-25 11:49:51 -07:00
173be837d1
chore(components): bump GCPC's KFP SDK upper bound to 2.3.0
...
PiperOrigin-RevId: 568254514
2023-09-25 10:15:08 -07:00
a76e385b20
feat(components): Implement the chunking component
...
PiperOrigin-RevId: 568246828
2023-09-25 09:48:55 -07:00
b0cccfee94
fix(components): include model version in upload model output artifact (fix)
...
PiperOrigin-RevId: 567695541
2023-09-22 12:55:52 -07:00
e8b8450e0a
feat(components): Add support for customizing evaluation_display_name in model evaluation pipelines
...
PiperOrigin-RevId: 567648855
2023-09-22 09:56:24 -07:00
623e309446
chore(components): fix import in proto/README
...
PiperOrigin-RevId: 567545593
2023-09-22 00:46:26 -07:00
adb86777a0
No public description
...
PiperOrigin-RevId: 566742090
2023-09-19 14:21:22 -07:00
b31d8a57ef
feat(components): Update default image tag used by LLM implementation components
...
PiperOrigin-RevId: 566661112
2023-09-19 09:56:42 -07:00
4945e2cfc5
feat(components): Support multiple chunking functions
...
PiperOrigin-RevId: 566660535
2023-09-19 09:48:07 -07:00
6468b4db11
feat(components): Use t5-xl reward model when tuning t5-xxl
...
PiperOrigin-RevId: 565809352
2023-09-15 16:43:19 -07:00
df4bc46725
feat(components): Add AutoML image training job v1 remote runner
...
PiperOrigin-RevId: 565796626
2023-09-15 15:41:56 -07:00
f8f01bcd08
feat(components): Add main entry and command-line flags for Templated Custom Job Launcher
...
PiperOrigin-RevId: 565785651
2023-09-15 14:54:03 -07:00
e307545e68
feat(components): Implement `create_templated_custom_job` for Templated Custom Job Launcher
...
PiperOrigin-RevId: 565733608
2023-09-15 11:32:47 -07:00
ad058b5321
chore(components): bump KFP SDK version number in GCPC
...
PiperOrigin-RevId: 565500642
2023-09-14 15:55:11 -07:00
fc1f12b7bd
feat(components): add `persistent_resource_id` to preview GCPC custom job components/utils
...
PiperOrigin-RevId: 565423232
2023-09-14 11:14:20 -07:00
8518e95efc
feat(components): Implement helper functions for Jinja2-based Templated Custom Job Launcher
...
PiperOrigin-RevId: 565417061
2023-09-14 10:55:20 -07:00
1fbdeb2abf
chore(components): fix GCPC markdown docstrings rendering
...
PiperOrigin-RevId: 565397565
2023-09-14 09:51:07 -07:00
cfe671c485
chore(components): Update the pipelines for the Tabular Workflow
...
feat(components): Expose feature selection pipeline
PiperOrigin-RevId: 565182978
2023-09-13 15:44:24 -07:00
510f23a052
chore(components): remove error __init__.py file
...
PiperOrigin-RevId: 565177719
2023-09-13 15:24:39 -07:00
2a4460cb63
chore(components): internal
...
PiperOrigin-RevId: 565100600
2023-09-13 10:57:27 -07:00
4bee3d8dc2
chore(components): Add public-image-gcpc-v2-scan tag for latest gcpc image
...
PiperOrigin-RevId: 564861482
2023-09-12 16:08:03 -07:00
abf05f4819
feat(components): fork a subset of `v1` `custom_job` and `gcp_launcher` container code to `preview`
...
PiperOrigin-RevId: 564809626
2023-09-12 13:21:26 -07:00
0ced6ec7d2
feat(components): Implement chunking for embedding evaluation pipeline
...
PiperOrigin-RevId: 564786040
2023-09-12 11:39:17 -07:00
1791818323
chore(components): release GCPC SDK 2.3.1
...
PiperOrigin-RevId: 564416401
2023-09-11 09:50:02 -07:00
3b8cea060f
fix(components): Have RLHF importer use default image if override is falsy
...
PiperOrigin-RevId: 563521264
2023-09-07 13:03:38 -07:00
e21174f94a
feat(components): Add sampling_strategy parameter to bulk inferrer to support different strategy. By default, we use greedy
...
PiperOrigin-RevId: 562860317
2023-09-05 12:43:17 -07:00
cac1856533
feat(components): Embedding eval pipeline for experimental launch
...
PiperOrigin-RevId: 562829441
2023-09-05 10:54:48 -07:00
3fb199658f
chore(components): convert GCPC docstrings to markdown
...
PiperOrigin-RevId: 562015575
2023-09-01 12:12:27 -07:00
e3bf085997
fix(components):Update batch_prediction_*_gcs_source to predictions_*_gcs_source in information retrieval preprocessor
...
PiperOrigin-RevId: 560800444
2023-08-28 13:20:19 -07:00
110e082481
feat(components): Update policy to reward model name mapping in function based component in _implementation/llm
...
PiperOrigin-RevId: 560479276
2023-08-27 03:45:37 -07:00
9ce2866527
feat(components): Update supported large model reference names that can be resolved by function based component in _implementation/llm
...
PiperOrigin-RevId: 559493244
2023-08-23 11:36:15 -07:00
f43272dee8
feat(components): Update container URIs for embedding eval components
...
PiperOrigin-RevId: 559213412
2023-08-22 13:49:06 -07:00
5b59e4a76f
chore(components): add `__init__.py` file to gcpc `_implementation/llm`
...
PiperOrigin-RevId: 558589929
2023-08-20 10:36:23 -07:00
4e10c5838e
chore(components): GCPC 2.3.0 release
...
PiperOrigin-RevId: 558586924
2023-08-20 10:11:55 -07:00
59aa41d78a
chore(components): fix infer_pipeline invocation
...
PiperOrigin-RevId: 558586379
2023-08-20 10:03:56 -07:00
7d282b91f4
chore(components): reorganize gcpc llm components
...
PiperOrigin-RevId: 558581292
2023-08-20 09:13:49 -07:00
2451b51070
chore(components): use type generics from typing module in GCPC
...
PiperOrigin-RevId: 558574225
2023-08-20 08:09:38 -07:00
9184062f11
docs(components): add LLM docs to GCPC readthedocs
...
PiperOrigin-RevId: 558570554
2023-08-20 07:38:56 -07:00
611298a8ee
feat(components): Add rlhf and infer pipelines to preview/llm. Add llm related components to _implementation/llm
...
PiperOrigin-RevId: 558430903
2023-08-19 11:38:14 -07:00
beb66abcf6
chore(components): INTERNAL
...
PiperOrigin-RevId: 558309338
2023-08-18 19:58:02 -07:00
c3b9550bf5
chore(components): INTERNAL
...
PiperOrigin-RevId: 558295863
2023-08-18 18:11:10 -07:00
f323acf4eb
fix(components): Fix proto reference from range to _range in model evaluation preview utils function
...
PiperOrigin-RevId: 558256414
2023-08-18 15:02:23 -07:00
db3f867cc2
chore(components): Update the pipelines for the Tabular Workflow for Forecasting
...
PiperOrigin-RevId: 558241332
2023-08-18 14:05:17 -07:00
562cd299cc
feat(components): Components for Embedding Eval pipeline
...
PiperOrigin-RevId: 557993650
2023-08-17 18:30:40 -07:00
c405d6bf24
docs(components): fix automl docs
...
PiperOrigin-RevId: 557972304
2023-08-17 16:45:12 -07:00
4ed8b7ceb9
chore(components): add GCPC automl reference docs
...
PiperOrigin-RevId: 557916896
2023-08-17 13:19:40 -07:00
47f11475c5
feat(components): Metric importing for embedding evaluation
...
PiperOrigin-RevId: 557540363
2023-08-16 11:01:58 -07:00
Changyu Zhu
Googler
Connor McCarthy
Magdalena Kuhn
Jason Dai
Tommy Li
Yifan Xiao
Michael Hu
Kevin Naughton