Commit Graph

11 Commits

Author SHA1 Message Date
Googler efeed83406 feat(components): Enable text generation pipeline to generate row based metrics
docs: update description of ModelEvaluation's metadata field accordingly

PiperOrigin-RevId: 590486026
2023-12-13 00:43:57 -08:00
Googler f8f01bcd08 feat(components): Add main entry and command-line flags for Templated Custom Job Launcher
PiperOrigin-RevId: 565785651
2023-09-15 14:54:03 -07:00
Googler e307545e68 feat(components): Implement `create_templated_custom_job` for Templated Custom Job Launcher
PiperOrigin-RevId: 565733608
2023-09-15 11:32:47 -07:00
Googler 8518e95efc feat(components): Implement helper functions for Jinja2-based Templated Custom Job Launcher
PiperOrigin-RevId: 565417061
2023-09-14 10:55:20 -07:00
Googler b71d43eff3 feat(eval): Implement embedding metrics importing
PiperOrigin-RevId: 556837125
2023-08-14 10:28:49 -07:00
Connor McCarthy 99830e3fe7 chore(components): move output artifact util to common utils dir
PiperOrigin-RevId: 551004173
2023-07-25 14:52:00 -07:00
Kevin Naughton c27d23a794 feat(components): Output imported evaluation resource name in ImportModelEvaluationOp
PiperOrigin-RevId: 550982226
2023-07-25 13:37:53 -07:00
Kevin Naughton d331ca0204 feat(components): Allow ImportModelEvaluationOp to take LLM metrics from --metrics and --problem_type parameters
PiperOrigin-RevId: 549107922
2023-07-18 14:12:23 -07:00
Kevin Naughton 2475d0aabe chore(components): Internal change
PiperOrigin-RevId: 542034411
2023-06-20 13:37:28 -07:00
Kevin Naughton 85f6969e88 feat(components): Remove GetVertexModelOp, to add to preview later
PiperOrigin-RevId: 541000049
2023-06-16 14:18:42 -07:00
Connor McCarthy 28b97771c3 chore(components): add preview and implementation container directories
PiperOrigin-RevId: 540991250
2023-06-16 13:52:33 -07:00