Commit Graph

3 Commits

Author SHA1 Message Date
Alexey Volkov c1ab0010be
Components - Upgraded the TFX components to 0.21.4 (#3641)
* Updated and synced the generated code

There is only 1 line of component specific code in each component function (apart frm the sunction signature).

* Updated some components that had older version of the generated code. The generated code is now the same everywhere.
* `input_channels_with_splits` is now generated based on the input artifact types
* TFX broke back compat: Removed `.split` from the artifacts. The components seem to now assume there is a single artifact in the channel.
* TFX broke back compat: changed the way artifact instances are created
* Updated container image to 0.21.4. There might have been backwards incompatible input/output changes - need to check and update.

* Updated component signatures

* Updated the generated component.yaml files

* Updated the sample notebook notebook

* Removed the optional output in Evaluator

Optional outputs are not supported yet. I'm not sure they're even correct according to MLMD.

* Updated the sample
2020-04-29 01:40:24 -07:00
Alexey Volkov daec74b8a7 Samples - Updated the TFX-KFP pipeline (#2867) 2020-01-17 16:22:07 -08:00
Alexey Volkov b63472062b Components - TFX (#2671)
* Added CsvExampleGen component

* Switched to using some processing code from the component class

Needs testing

* Renamed output_examples to example_artifacts for consistency with the original component

* Fixed the docstring a bit

* Added StatisticsGen

First draft

* Added SchemaGen

First draft

* Fixed the input_dict construction

* Use None defaults

* Switched to TFX container image

* Updated component definitions

* Fixed StatisticsGen and SchemaGen

Input artifacts must have splits.
Split URIs should end with "/'.
The ciomponents now work.

Also printing component_class_instance for debugging.

* Printing component instance in CsvExampleGen

* Moved components to directories

* Updated the sample TFX pipeline

* Renamed ExamplesPath to Examples for data passing components

* Corrected output_component_file paths

* Added the Transform component

The component uses almost completely generic code.

* Added the Trainer component

* Added the Evaluator component

* Added the ExampleValidator component

* Added the BigQueryExampleGen component

* Added the ImportExampleGen component

* Updated the sample

Added ExampleValidator, Transform, Trainer, Evaluator

* Upgraded to TFX 0.15.0

* Upgraded the sample to 0.15.0

* Silence Flake8 for annotations
2019-12-04 17:52:31 -08:00