e09a8ffb0e
Improve dataflow job to use GCS to keep temp job states. ( #985 )
...
* Improve dataflow job to use GCS to keep temp job states.
* make default location code reusable.
2019-03-19 18:08:48 -07:00
b00081d01f
Dump job id and change output to /tmp/kfp/output ( #878 )
...
* Dump job id and change output to /tmp/kfp/output
* fix test error
* FIx bug in validate_only mode
2019-03-01 18:40:30 -08:00
a791197baa
Fix bugs in dataflow pipeline ( #870 )
2019-02-27 21:32:49 -08:00
ea26a574bf
Dataflow SDK to support launch beam python code or template ( #833 )
...
* initial files for dataflow commands
* dataflow commands
* add launch python command
* Support launch_python command
* Use display API and default outputs to /tmp/output folder
2019-02-26 16:18:43 -08:00
hongye-sun