kubeflow
/
pipelines
mirror of https://github.com/kubeflow/pipelines.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
1,350 Commits 314 Branches 182 Tags 516 MiB
Commit Graph

1350 Commits

Author SHA1 Message Date
Animesh Singh 629164261d kfserving pipeline update (#2102) 2019-09-19 16:42:59 -07:00
Renmin 29bbe1198f add us to OWNERS for SHA (#2047) 
* add owner

* updated owners per comment, keep at least one from SHA for easy co-operation

* limit OWNERS scope first
 2019-09-19 13:50:58 -07:00
Jiaxiao Zheng 6e95603d19 [Test/sample] Fix the model version in kubeflow_tf_serving sample to avoid potential conflict. (#2170) 
* fix sample - change version number.

* fix notebook
 2019-09-19 11:01:01 -07:00
IronPan a86ee2dfbb Fix more typos in KFP marketplace application (#2158) 
* small fixes

* remove trunk for db name

* Delete Makefile

* more fixes

* more fixes

* more fixes
 2019-09-19 02:09:01 -07:00
IronPan ca4683d9e9
Add Bobgy to test infra owner (#2166) 
/assign @Bobgy
 2019-09-19 15:25:22 +08:00
Yuan (Bob) Gong a687573b47 Pretty print json value in execution/artifact detail page (#2165) 
* Pretty print json property values in ResourceInfo

* Remove console.log
 2019-09-18 22:59:14 -07:00
Ning a855c5655b remove tfx-taxi sample in favor of the tfx oss sample (#2160) 2019-09-18 22:59:06 -07:00
Yuan (Bob) Gong 08f471659e Add URI to artifact details page (#2157) 2019-09-18 22:58:59 -07:00
IronPan 7b28935e7d
Update backend owner file (#2164) 
/assign @neuromage
 2019-09-19 13:24:35 +08:00
Alexey Volkov e420940d67 SDK - Components - Fixed the output types for outputs with converted names (#2162) 
Fixes https://github.com/kubeflow/pipelines/issues/2130
 2019-09-18 20:53:00 -07:00
Ning a71d5b0f28
add kubeflow serving sample test (#2163) 
* add kubeflow serving sample test
 2019-09-18 15:46:20 -07:00
IronPan 0971006bf2
Removing the unnecessary trunk when generating the DB name (#2151) 
* small fixes

* remove trunk for db name

* Delete Makefile

* more fixes
 2019-09-18 23:55:26 +08:00
xaniasd 726551b13d configure db host and port from from config file (#1940) 
* configure db host and port from from config file

* Update client_manager.go

* Update client_manager.go
 2019-09-18 02:19:29 -07:00
Yuan (Bob) Gong 4d9a4e8ed9 Utils to convert metadata api from callback paradigm to promise paradigm (#2153) 2019-09-17 23:39:29 -07:00
Yuan (Bob) Gong 2572013434 Fix presubmit test failure -- build job in QUEUED state (#2152) 2019-09-17 22:43:29 -07:00
Ning 551b0dc56c add preemptible vm and volume snapshot op sample tests (#2149) 
* add preemptible vm and volume snapshot op sample tests

* add config
 2019-09-17 20:51:29 -07:00
Ning d72411cf35 add retry tests (#2141) 
* add retry tests

* add arguments

* fix sample test infra error
 2019-09-17 18:21:29 -07:00
Yuan (Bob) Gong 2106c8fee5 Fix missing execution name in execution list page. (#2135) 2019-09-17 17:47:29 -07:00
Alexey Volkov dd071d39fa SDK - Containers - Raise exception on job failure (#2144) 2019-09-17 17:07:16 -07:00
IronPan c8412a7eb7 fix (#2136) 2019-09-17 16:11:15 -07:00
Alexey Volkov 642dd13dde SDK - Testing - Fix metadata comparison instability (#2145) 
* SDK - Testing - Fix metadata comparison instability

* Stopped comparing annotations at all
 2019-09-17 15:37:22 -07:00
Jiaxiao Zheng d6d3785506 Add a convention to make sure experiment_name is parameterized in notebook sample. (#2112) 
* add a new convention

* Fix config experiment_name

* fix light weight example

* Fix experiment name

* Update guidelin.

* fix lightweight_component.config.yaml

* Remove config yaml

* Fix guideline.md

* Reword.
 2019-09-17 15:37:14 -07:00
Alexey Volkov eae37fba33 SDK - Components - Fixed build_python_component (#2143) 2019-09-17 14:45:15 -07:00
Ning 759d2f6576
add artifact location tests (#2142) 2019-09-17 13:34:28 -07:00
Alexey Volkov 6afb91b902
SDK - Fix pipeline metadata serialization (#2137) 
Two PRs have been merged that turned out to be slightly incompatible. This PR fixes the failing tests.
Root causes:
* The pipeline parameter default values were not properly serialized when constructing the metadata object.
* The `ParameterMeta` class did not validate the default value type, so the lack of serialization has not been caught. The `ParameterMeta` was replaced by `InputSpec` which has strict type validation.
* Previously we did not have samples with complex pipeline parameter default values (e.g. lists) that could trigger the failures. Then two samples were added that had complex default values.
* Travis does not re-run tests before merging
* Prow does not re-run Travis tests before merging
 2019-09-17 13:07:34 -07:00
Ning 4f88a820f5
Add sidecar sample test (#2106) 
* add sidecar sample test
* add more sleep sec for the sidecar to star
 2019-09-17 09:32:46 -07:00
IronPan 6e0357d0c2
Small fixes to the kfp marketplace (#2138) 
* small fixes

* small fixes
 2019-09-17 17:25:10 +08:00
IronPan 6b6b83c9c5
Update documentations for Kubeflow Pipelines marketplace (#2125) 
* fix

* update documentations

* update documentations

* update documentations

* small fixes
 2019-09-17 17:23:31 +08:00
IronPan 0efdb55a84
fix (#2129) 2019-09-17 16:38:39 +08:00
Yuan (Bob) Gong 4166e7afee Artifact list column creation time (#2105) 
* Add artifact creation date in artifact list UI

* Clean up code

* Basic error handling for artifact list page creation time fetching.
 2019-09-16 22:44:22 -07:00
IronPan f2b1437105 Add documentation for Marketplace CLI deployment (#2128) 
* fix

* fix

* fix
 2019-09-16 21:36:23 -07:00
Alexey Volkov e3c72fc251 SDK - Persisting all output values (#2134) 
Currently, the parameter output values are not saved to storage and their values are lost as soon as garbage collector removes the workflow object.
This change makes is so the parameter output values are persisted.
 2019-09-16 19:44:24 -07:00
Alexey Volkov 0e2bf15dbc
SDK - Refactoring - Replaced the *Meta classes with the *Spec classes (#1944) 
* SDK - Refactoring - Replaced the ParameterMeta class with InputSpec and OutputSpec

* SDK - Refactoring - Replaced the internal PipelineMeta class with ComponentSpec

* SDK - Refactoring - Replaced the internal ComponentMeta class with ComponentSpec

* SDK - Refactoring - Replaced the *Meta classes with the *Spec classes

Replaced the ComponentMeta class with ComponentSpec
Replaced the PipelineMeta class with ComponentSpec
Replaced the ParameterMeta class with InputSpec and OutputSpec

* Removed empty fields
 2019-09-16 18:41:12 -07:00
Kevin Bache 2ca7d0ac31 WithParams (#2044) 
* first working commit

* incrememtal commit

* in the middle of converting loop args constructor to accept pipeline param

* both cases working

* output works, passed doesn't

* about to redo compiler section

* rewrite draft done

* added withparam tests

* removed sdk/python/comp.yaml

* minor

* subvars work

* more tests

* removed unneeded artifact outputs from test yaml

* sort keys

* removed dead artifact code
 2019-09-16 17:58:22 -07:00
Alexey Volkov c4c0bb8202 SDK - Components - Fixed kfp.components.set_default_base_image (#2118) 2019-09-16 15:30:26 -07:00
Alexey Volkov 60f9da6c74 SDK - Containers - Fixed kfp.containers.get_default_image_builder (#2116) 2019-09-16 14:56:23 -07:00
Ning 52fc2c824a
add dataflow sample with the new GCP component (#2096) 
* add dataflow sample with tests
 2019-09-16 14:19:35 -07:00
IronPan 8feef600ca fix (#2123) 2019-09-16 13:42:46 -07:00
Alexey Volkov 647867bde1 SDK - Python components - Fixed the default base_image handling (#2119) 
In python the default parameter values are only evaluated once.
 2019-09-16 13:42:38 -07:00
Jiaxiao Zheng b86f64b81c fix name. (#2132) 2019-09-16 12:32:39 -07:00
Jiaxiao Zheng dc3c7a4d37 add exec order (#2114) 2019-09-16 10:46:38 -07:00
Yuan (Bob) Gong 2159a8d7a0 Fix execution detail page fetch params. (#2127) 
* Fix execution detail page fetch params.

* Fix lint warnings
 2019-09-16 02:48:37 -07:00
Yuan (Bob) Gong 49834c4120 Workaround error thrown from metadata server when there is no record (#2126) 2019-09-16 00:48:37 -07:00
Yuan (Bob) Gong 33f4244384 Add script that automatically proxies backend servers for frontend dev server (#2104) 
* Add npm run dev script that automatically proxies both backend and mlmd servers.

* Add more comments + rename command to reflect what it does

* Add error handling for pod discovery

* Make npm run start:proxies a separate command

* Update README about new script too
 2019-09-15 22:58:36 -07:00
IronPan fb9eb2d0a2
close the thread to get gcloud auth token (#2084) 
Error message saw in some cases
```
/tmpfs/BUILD_ENV/lib/python3.5/site-packages/kfp/_auth.py:34: ResourceWarning: unclosed file <_io.TextIOWrapper name=6 encoding='UTF-8'>
  return os.popen('gcloud auth print-access-token').read().rstrip()

```
 2019-09-15 08:54:26 +08:00
IronPan d0bf18d83b
fix (#2122) 2019-09-15 08:46:17 +08:00
Alexey Volkov 3ec743a3e4 SDK - Started to explicitly import submodules into kfp namespace (#2117) 2019-09-13 19:06:39 -07:00
Jiaxiao Zheng 216c80f43f add ips sample test (#2113) 2019-09-13 17:16:40 -07:00
Alexey Volkov 77d0ee014e SDK - Lightweigh - Made wrapper code compatible with python2 (#2035) 2019-09-13 16:44:40 -07:00
Ning f21d3eda0e update kustomize (#2111) 2019-09-13 14:42:29 -07:00