kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,602 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

22 Commits

Author SHA1 Message Date
qimingj 875efea1f9 Support replacable arguments in command as well (besides arguments) in container op. (#623) 
* Support replacable arguments in command as well (besides arguments) in container op.

* Fix components builder.

* Fix tests.

* Follow up CR comments.

* Fix test.
 2019-01-07 07:57:36 -08:00
Ning 85c6413a2e Refactor Python SDK (#568) 
* add some comments

* remove unused import; add license to dsl_bridge

* move_convert_k8s_obj_to_dic from compiler to k8s_helper

* move unit test
 2018-12-20 09:51:09 -08:00
hongye-sun 55e18269c3 support tpu settings in dsl (#491) 
* support tpu settings in dsl

* fix issues from review comment
 2018-12-06 21:55:36 -08:00
Alexey Volkov d9c133f7f7 SDK/Components/PythionContainerOp - Make the local output path configurableThis is part of a bigger effort to make all output locations manageable in preparation for storage system. (#424) 2018-12-04 19:56:56 -08:00
Chris Van Pelt 26fd724ec5 Fix for k8s dict parsing (#411) 
* Add support for minio artifacts

* Add new tests for parity

* Fix for sdk env bug

* improved test
 2018-11-30 11:44:38 -08:00
qimingj 0b7120c322 Now pipeline function takes direct default values rather than dsp.PipelineParam. (#110) 
* Now pipeline function takes direct default values rather than dsp.PipelineParam. It simplifies the sample code a lot.

* Remove extraneous parenthesis.

* Follow up CR comments.

* Change Dockerfile (not done).

* Fix dockerfile.

* Fix Dockerfile again.

* Remove unneeded installation of packages in Dockerfile.
 2018-11-26 17:13:55 -08:00
nealgao cc38ca063a remove fire dependency in the component image build (#384) 2018-11-26 16:31:28 -08:00
hongye-sun 486d43ddfb Add support for nvidia gpu limit (#346) 
* Add support for nvidia gpu limit

* Expose resource limits, requests and nodeSelector to ContainerOp

* Fix test data

* Add explicit set_gpu_limit function

* Fix logical bug
 2018-11-21 17:49:42 -08:00
google inc 33f191f308 mount gcp credentials for kaniko worker (#343) 
* mount gcp credentials for kaniko worker

* update test
 2018-11-20 23:33:43 -08:00
nealgao 6937e780c3 refactor component build codes (#260) 
* refactor codes

* change name handler to handle
 2018-11-20 20:03:34 -08:00
nealgao 5908496852 fix bug for the component build with requirements (#320) 
* fix bug for the component build with requirements

* fix unit test failure
 2018-11-20 15:43:28 -08:00
Yang Pan f28a9891d2 return self for container op initialization methods to allow chaining the construction (#313) 
* switch set() to add() for better inheritance.

* return self for container op initialization methods to allow chaining the initialization

* comment
 2018-11-19 16:46:55 -08:00
Yang Pan dfcf92bea8 switch set() to add() for better inheritance. (#312) 2018-11-19 15:18:56 -08:00
Alexey Volkov 906ad680ed SDK/DSL/Compiler - Improved compilation of dsl.Conditional - UX support done (#177) 
* Fixed compilation of dsl.Conditional
The compiler no longer produced intermediate steps.

* Got rid of _create_new_groups

* Changed the sub_group.type check

* Update frontend handling of graphs (#293)

* Updates the frontend to correctly parse the new format of conditional pipelines

* WIP - Assume tasks and templates don't share names

* Greatly simplifies graphing of conditional and non-conditional pipelines

* Adds/updates StaticParser tests

* Give nodes unique names
 2018-11-19 14:01:10 -08:00
nealgao 7d811bff0a add support for dependencies in the component image building (#219) 
* add requirement to component image build

* add unit test for DependencyVersion

* add unit tests, fix bugs

* revert some unit test change

* include the package name inside the VersionedDependency, enable the unit test for the component builder

* disable the component image build, this is done in another PR

* update the version name to dependency

* delete unuseful tests and add more useful unit tests

* add unit tests

* fix some unit tests

* fix bug in DependencyHelper
 2018-11-16 21:49:14 -08:00
Yang Pan a47eb10558 Add volume, volumemount and env to container op (#300) 
* [WIP] change deployment platform to gcp

* debug

* revert test

* add volume

* update test

* to list

* fix

* to list

* to list

* to list

* to list

* stage

* update

* update

* Undid style changes

* address comments

* update comments
 2018-11-16 18:36:38 -08:00
nealgao 263812b070 enable component build unit test (#228) 
* enable component build unit test

* minor fix
 2018-11-15 15:20:51 -08:00
Yang Pan 7e34b12e8d Add gcp secret parameter to container op (#261) 
* add secret

* add secret to contianer op

* update comments

* address comments

* update logic

* fix
 2018-11-15 10:06:14 -08:00
nealgao b7440570b0 minor fixes (#217) 
* minor fixes

* remove the yaml output
 2018-11-12 18:01:45 -08:00
Alexey Volkov 7e4569324b SDK/DSL/Compiler - Reverted fix of dsl.Condition until the UI is ready. (#94) 2018-11-06 12:33:22 -08:00
Alexey Volkov 98e4d2f881 SDK/DSL/Compiler - Fixed compilation of dsl.Condition (#28) 
* Fixed compilation of dsl.Conditional
The compiler no longer produced intermediate steps.

* Got rid of _create_new_groups

* Changed the sub_group.type check

* Fix tfx name bug in the tfma sample test (#67)

* fix tfx name bug

* update release build for the data publish
 2018-11-06 09:26:41 -08:00
Pascal Vicaire 633e2ddcc8 Initial commit of the kubeflow/pipeline project. 2018-11-02 14:02:31 -07:00