Commit Graph

544 Commits

Author SHA1 Message Date
Rebecca McFadden 93ef78b091 remove generated files 2019-08-01 21:00:55 -07:00
Rebecca McFadden 9ab9e05b12 edit build.sh for !#/bin/bash 2019-08-01 21:00:08 -07:00
Rebecca McFadden 74d7bcdba0 Update README.md 2019-07-29 20:54:03 -07:00
Rebecca McFadden 7b166d211f Remove deprecated services and unnecessary folders 2019-07-29 20:50:22 -07:00
Xiao Kou 607533311e Fix mnist readme service name and deployments name typo (#611) 2019-07-29 20:12:51 -07:00
David Sabater Dinter a9c6e69f0e Lint fixes mnist (#581)
* Remove modules from .pylintrc

* Add lint inline exceptions

* Add lint inline exceptions as all as the specific exception is not available for Pylint 1.8

* Fix string formatting logging message and remove unnecessary Pylint exception

* Update app.yaml with correct environment details
2019-07-24 19:23:52 -07:00
Chun-Hsiang Wang 6e5ba488e2 Update readme for xgboost-synthetic and remove outdated yaml file (#605)
* Update readme for xgboost-synthetic and remove outdated yaml file.

* Update the class name to be more general.

* Update readme.

* Set google_application_credentials in the notebook.

* Install fairing from master branch.

* Do not set credentials again.

* Update readme.
2019-07-22 18:20:54 -07:00
Rebecca McFadden 4dd4d1069a fixed tags 2019-07-19 09:05:34 -07:00
Rebecca McFadden 1d425a1931 bug fixes 2019-07-19 08:56:18 -07:00
Chun-Hsiang Wang fb6cd69def Install pip dependencies and build base image with kaniko (#603)
* Install required pip packages not included in the base package.

* Use Kaniko builder to build the base image first.

* Directly install packages from requirements.txt to be more flexible.
2019-07-18 22:35:12 -07:00
Rebecca McFadden fcd1e4bce1 fixed small errors 2019-07-18 11:44:25 -07:00
Chun-Hsiang Wang cda6efed27 Include newly trained model in the newly built docker image (#601) (#602) 2019-07-17 19:50:11 -07:00
Rebecca McFadden 3b85d55d8c removed incorrect file 2019-07-17 15:08:10 -07:00
Rebecca McFadden 17ddeb49fb added azure pipeline example
Co-Authored-By: Mohona Ahmed <t-moahme@microsoft.com>
Co-Authored-By: Maanav Dalal <maanavdalal@gmail.com>
Co-Authored-By: sethjuarez <me@sethjuarez.com>
2019-07-17 15:04:04 -07:00
Chun-Hsiang Wang ac9f2f1238 Add kubecon demo to xgboost_ames_housing directory (#589)
* Add xgboost-ames-housing demo from Kubecon EU 2019.

* fix links in the .ipynb in the xgboost-ames-housing demo

* update to the xgboost demo example from kubecon
- move example to its own directory
- remove unnecessarry files
- modify util and update notebook

* change the names related to kubecon and update readme

* use fairing instead of own fairing_util in the notebook

* remove fairing_util and move the remaining to util instead

* update synthetic data example as comments
- generalize yaml
- remove updating github procedures
- update readme
- rename files

* fix pylint.

* fix pylint.
2019-07-16 10:33:25 -07:00
Zane Durante 567998cb4e Adding simple pipeline example (#598) 2019-07-15 18:01:24 -07:00
Jin Chi He da903549cc remove useless requirements.txt (#593) 2019-07-14 14:49:03 -07:00
Jin Chi He 41765a5830 fix e2e test failed problem (#594) 2019-07-12 14:29:05 -07:00
Jin Chi He 871895c544 recomment using kustomize v2.0.3 for mnist (#584) 2019-07-04 19:20:35 -07:00
Nick Harvey 9675480997 minor update to the pachyderm seldon example (#562)
* minor update to the pachyderm seldon exaple

* Another minor update to the pipeline
2019-07-04 13:24:19 -07:00
Michelle Casbon a046db57cc Add video show notes (#582) 2019-06-28 18:01:24 -07:00
Michelle Casbon f608c27751 Add stale bot (#579)
Use settings from kubeflow/kubeflow
2019-06-26 16:11:19 -07:00
Jin Chi He 264f48dfe8 add pipeline section and rename README (#577) 2019-06-24 19:04:35 -07:00
Sarah Maddox bb15762ada Added a README to the pipelines samples dir. (#575) 2019-06-24 16:46:36 -07:00
Iman Tabrizian f08389f066 fix: update kfp version (#576) 2019-06-24 06:59:56 -07:00
Michelle Casbon 839140b37d Add .cache dir to gitignore (#573) 2019-06-15 06:52:10 -07:00
Svendegroote91 9332e7226a Update Financial Time Series example to v0.4.0 and add Kubeflow pipelines (#535) 2019-06-14 16:30:10 -07:00
David Sabater Dinter 7a6dc7b911 [pytorch_mnist] Automate image build (#490)
* Add build and test presubmit jobs for Pytorch nmist example
Keep postsubmit jobs as original release job to push images to examples registry

* Refactor all jobs like mnist and GIS, will drop using release jobs

* Implement test scripts and Ksonnet artifacts from mnist example to enable E2E tests

* Remove release components as they are no longer used

* Refactor YAML manifests as Ksonnet components

* Update documentation to submit training jobs from Ksonnet

* Updated to point to correct component and refactor to PytorchJob

* Add seldon image build
Add train CPU and GPU in jsonnet to build workflow
Add Dockerfile.ksonnet and entrypoint

* Commented out calls to tf-util until
https://github.com/kubeflow/pytorch-operator/issues/108 is implemented

* Refactor to PytorchJob

* Add seldon image build
Add train CPU and GPU in jsonnet to build workflow
Add Dockerfile.ksonnet and entrypoint

* Refactor to PytorchJob

* Rename workflow to avoid dns issue with "_"

* Add TODO note to convert to GRPC

* Rename workflow to avoid dns issue with "_"

* Rename workflow to avoid dns issue with "_"

* Fix path to build Seldon image in Makefile

* Fix tabs in Makefile

* Fix tabs in Makefile

* Fix rule in Makefile

* Add sleep in Makefile to wait for docker ps

* Change node worker image to have docker

* Remove seldon image step from Makefile
Add steps to wrap model with Seldon
Add boolean flag to build Seldon steps

* Add step id build- in jsonnet

* Skip pull step for Seldon

* Fix wait for in Seldon build

* Fix lint errors

* Set useimagecache to false first time the pipeline is executed to avoid error

* Set contextDir as absolute path for Seldon step

* Remove unnecessary argument and Dockerfile in Seldon step

* Add absolute path for build in Seldon steps

* Include absolute path inside jsonnet hardcoded to GCB /workspace/
Remove setting rootDir from Makefile

* Update images with new naming from E2E tests

* Change test-worker image version

* Update images with new naming from E2E tests

* Set useimagecache to true now that we have first images built

* Fix cachelist in Seldon build

* Fix cachelist in Seldon build

* Leverage tf-operator test framework for test_runner
As per https://github.com/kubeflow/pytorch-operator/issues/108

* Consolidate testing imports
Rename testing package as https://github.com/kubeflow/tf-operator/pull/945
Added correct path to import test framework from tf-operator

* Add test framework in PYTHONPATH in build_template

* Remove old release jobs to build images

* Update stepimage to same as GIS example

* Bump up supported Pytorch operator versions from v1alpha2/v1beta1 to v1beta1/v1beta2 to support Kubeflow 0.5
- Refactor training manifests from v1alpha2 to v1beta2
- Update documents

* Update KF cluster version to latest to run tests

* Update KF cluster zone

* Add pylint exception while importing test_runner class from tf-operator

* Pass dummy tests to train, deploy and predict
Remove no longer used test_data and conftest

* Pass dummy tests to train, deploy and predict
Remove no longer used test_data and conftest
2019-06-14 16:20:09 -07:00
Zane Durante 45ece829aa Fixed typo (#572)
Changed "intalled" to "installed"
2019-06-10 19:32:18 -07:00
Jin Chi He 45f03e6fd9 fix issue for s3 case in mnist example (#566) 2019-06-09 19:17:05 -07:00
Karthik Vadla 8efa3e72fb MNIST: Update web-ui reference for GCS (#570)
* Update webui url for GCS

* clean up
2019-06-07 17:57:06 -07:00
Jin Chi He 4f8bbe1e9e update TFJob version to v1 (#568) 2019-06-06 21:11:59 -07:00
Jin Chi He 73d3a00c8b Examples for pipelines running on-premise (#559) 2019-06-04 20:49:52 -07:00
Amy 767ecd240d Use the client libs to do a GCS copy instead of gsutil (#558)
* use gcs client libs to copy checkpoint dir

* more minor cleanup, use tagged image, use newer pipeline param spec. syntax.
pylint cleanup.
added set_memory_limit() to notebook pipeline training steps.
modified the pipelines definitions to use the user-defined params as defaults.

* put a retry loop around the copy_blob
2019-05-17 14:00:11 -07:00
ssivart 21f76812ec [docs]: enhance documentation for chosen namespace (#555) 2019-05-15 02:44:19 -07:00
Michelle Casbon 1ebcd33881 Add memory limit (#552)
This aids GKE autoprovisioning in creation of appropriate node sizes
2019-05-14 17:54:18 -07:00
Amy ed38a1a35c re-add file that I'd missed in porting over; minor comment phrasing change in notebook (#556) 2019-05-13 12:28:50 -07:00
Iman Tabrizian fce8fa0a3f [docs]: fix minor bug in the documentation (#554) 2019-05-12 18:08:08 -07:00
Jin Chi He 064f1ebf45 update_owner (#550) 2019-05-08 21:04:47 -07:00
Jin Chi He 5fac627725 drop_ksonnet_from_mnist (#546) 2019-05-07 19:54:32 -07:00
Amy b23adc1f0b import of Pipelines Github issue summarization examples & tutorial (#507)
* initial import of Pipelines Github issue summarization examples & lab

* more linting/cleanup, fix tf version to 1.12

* bit more linting; pin some lib versions

* last? lint fixes

* another attempt to fix linting issues

* ughh

* changed test cluster config info

* update ktext package in a test docker image

* hmm, retrying fix for the ktext package update
2019-04-18 17:57:54 -07:00
Hamel Husain ae0adbe7cd Create issue_label_bot.yaml (#542)
* Create issue_label_bot.yaml

For issue label bot

* Update issue_label_bot.yaml

* Update issue_label_bot.yaml
2019-04-15 05:56:05 -07:00
Daniel Castellanos aaea8024be Fixed issue with TFJob api version in tfjob component (#541)
Signed-off-by: Luis Daniel Castellanos <luis.daniel.castellanos@intel.com>
2019-04-13 12:58:00 -07:00
Jeremy Lewi cc2f569ddd Cleanup the owners file. (#538)
* Remove top level approvers and reviewers who aren't very active.
* We should also be building out the per directory OWNERs files to do
  a better job auto-assigning reviewers.
2019-04-11 07:18:17 -07:00
Jin Chi He 335c2a1d6e Enhance mnist training and add serving steps for local mode (#528) 2019-04-09 14:54:45 -07:00
Jin Chi He fb0c5eb115 fix import issue in the mnist e2e testing (#531) 2019-04-05 18:36:27 -07:00
Derek Hao Hu 07b485ec8c Correct some image tags (#532) 2019-03-24 13:31:05 -07:00
Nick Harvey 52795bcaf5 Adding Pachyderm Example (squashed) (#522)
* Adding Pachyderm Example (squashed)

* Add Dan Sanche to OWNERS (#520)

Fixed tf_operator import for github_issue_summarization example (#527)

* fixed tf_operator import

* updated tf-operator import path

* small change

* updated PYTHONPATH

* fixed syntax error

* formating issue

Mnist pipelines (#524)

* added mnist pipelines sample

* fixed lint issues
2019-03-20 08:41:00 -07:00
Daniel Sanche 895e88bf67 Mnist pipelines (#524)
* added mnist pipelines sample

* fixed lint issues
2019-03-16 14:14:55 -07:00
zabbasi 7924e0fe21 Fixed tf_operator import for github_issue_summarization example (#527)
* fixed tf_operator import

* updated tf-operator import path

* small change

* updated PYTHONPATH

* fixed syntax error

* formating issue
2019-03-14 18:36:58 -07:00