Commit Graph

68 Commits

Author SHA1 Message Date
Jeff Grafton 14700b68c8 Rename build-tools/ back to build/ 2016-12-14 13:42:15 -08:00
foxish 14ff380105 Remove namespaces from all examples. 2016-11-11 11:57:33 -08:00
Tim Hockin e87fd7b5f0 Remove 'this is HEAD' warning on docs 2016-10-26 00:06:59 +02:00
Mike Danese c4bdc646ac rename build/ to build-tools/ 2016-10-24 14:41:56 -07:00
Elson Rodriguez 25281885a4 Updating Spark Example.
Few usability improvements:

- Added a proxy to enable viewing worker logs
- Removed seperate webui service
- Modified Zeppelin and spark-ui services to be Loadbalancers
- Changed pyspark example to be platform agnostic
- Improved kubectl context setup
- Minor grammar/flow fixes
2016-10-10 13:36:31 -07:00
David McMahon 63e1c77a21 Update the latestReleaseBranch to release-1.4 in the munger. 2016-09-01 14:40:55 -07:00
joe2far 10b5aff955 Fix broken warning image link in docs 2016-07-15 10:44:58 +01:00
k8s-merge-robot adef1ee4ab Merge pull request #28703 from mulloymorrow/patch-4
Automatic merge from submit-queue

fix proxy url

<!--
Checklist for submitting a Pull Request

Please remove this comment block before submitting.

1. Please read our [contributor guidelines](https://github.com/kubernetes/kubernetes/blob/master/CONTRIBUTING.md).
2. See our [developer guide](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/development.md).
3. If you want this PR to automatically close an issue when it is merged,
   add `fixes #<issue number>` or `fixes #<issue number>, fixes #<issue number>`
   to close multiple issues (see: https://github.com/blog/1506-closing-issues-via-pull-requests).
4. Follow the instructions for [labeling and writing a release note for this PR](https://github.com/kubernetes/kubernetes/blob/master/docs/devel/pull-requests.md#release-notes) in the block below.
-->

```release-note
* Use the release-note-* labels to set the release note state 
* Clear this block to use the PR title as the release note 
-OR-
* Enter your extended release note here
```


[![Analytics](https://kubernetes-site.appspot.com/UA-36037335-10/GitHub/.github/PULL_REQUEST_TEMPLATE.md?pixel)]()

fix proxy url
2016-07-12 09:16:55 -07:00
Cindy Wang edf093b61b Consolidated examples into storage/ and volume/ folders
Search and replace for references to moved examples

Reverted find and replace paths on auto gen docs

Reverting changes to changelog

Fix bugs in test-cmd.sh

Fixed path in examples README

ran update-all successfully

Updated verify-flags exceptions to include renamed files
2016-07-08 13:34:32 -07:00
Mulloy Morrow 577645cdbd fix proxy url
fix proxy url
2016-07-08 13:30:08 -07:00
Janet Kuo 68d7709815 Fix broken spark example e2e test 2016-06-21 11:50:26 -07:00
David McMahon f05b9a47e9 Updated docs and examples for release-1.3. 2016-06-13 12:24:34 -07:00
Dawn Chen 0cba8b9eae Revert "Versioning docs and examples for v1.4.0-alpha.0."
This reverts commit cce9db3aa9555671c5ddf69549b46ed0fd7e472a.
2016-06-10 16:46:46 -07:00
David McMahon b1e6c67b24 Versioning docs and examples for v1.4.0-alpha.0. 2016-06-10 14:55:35 -07:00
Adrian Ursu 2166fce94b Update README.md 2016-05-16 14:32:33 +01:00
Adrian Ursu 7a628d406a Fixed namespace name to spark-cluster 2016-05-16 14:06:07 +01:00
Klaus Ma cb3a53c090 Added namespace to Spark example. 2016-04-19 00:34:47 +08:00
k8s-merge-robot 8e99f7242b Merge pull request #21899 from zmerlynn/update-spark
Auto commit by PR queue bot
2016-03-12 07:25:17 -08:00
David McMahon 74811d373b Update the latestReleaseBranch to release-1.2 in the munger. 2016-03-08 18:59:28 -08:00
Zach Loafman dd09c35bff Bump Spark / Zeppelin to 1.5.2 / 0.5.6 tags
From https://github.com/kubernetes/application-images/pull/5
2016-03-04 13:26:05 -08:00
Tim St. Clair 3c6084e32d Detect & fix backwards markdown links (of the form (foo)[bar]) 2016-02-26 13:24:21 -08:00
Alex Robinson 6473156e68 Merge pull request #21626 from jayunit100/examples-spark-fix
Fix broken spark tests to use yaml files, 1 worker, declare DNS depe…
2016-02-24 16:30:19 -08:00
jay vyas bb61d63872 [examples] [e2e] Fix spark example e2e tests: labels, forEach, json->yaml 2016-02-22 16:40:30 -05:00
k8s-merge-robot 4c97951d65 Merge pull request #21634 from jayunit100/spark-README
Auto commit by PR queue bot
2016-02-20 23:59:59 -08:00
jay vyas f73a54823b Update spark README with container location and DNS req. 2016-02-20 17:33:30 -05:00
Matthew Farrellee 352a7b7c2e update spark example yaml to use new images 2016-02-09 17:18:47 -05:00
Matthew Farrellee 86d7561354 move spark images to github.com/kubernetes/application-images/spark 2016-01-16 11:15:23 -05:00
Chao Xu 533747fa0f run hack/update-generated-docs.sh 2015-12-21 10:41:30 -08:00
Matthew Farrellee 43a66a30d6 Eliminate need for wget (use curl), use fewer intermediate files be quiet 2015-11-20 18:54:13 -05:00
Matthew Farrellee af958f8ea7 Change default to local build, require explicit "make push" to push 2015-11-20 16:58:59 -05:00
Matthew Farrellee 71d545093e Install numpy on all spark images 2015-11-20 16:05:47 -05:00
Matthew Farrellee f7a9390aec Use upstream zeppelin 0.5.5 release 2015-11-20 14:22:56 -05:00
Matthew Farrellee b1863993b8 Add cleaning to clean target 2015-11-20 10:19:57 -05:00
Zach Loafman 5102d9115e Zeppelin: Compress the image by doing the build on a separate image
Pull the tar through to the image we need it on.

Addresses #17231
2015-11-17 14:51:16 -08:00
k8s-merge-robot 6f5bbcf2b8 Merge pull request #17025 from zmerlynn/zeppelin
Auto commit by PR queue bot
2015-11-13 16:12:54 -08:00
Tim Hockin 34577ed6aa Run update-gendocs 2015-11-13 13:57:57 -08:00
Zach Loafman 077eb36715 Zeppelin: Add Zeppelin image to Spark example
This adds a very basic Zeppelin image that works with the existing
Spark example. As can be seen from the documentation, it has a couple
of warts:

* It requires kubectl port-forward (which is unstable across long
periods of time, at least for me, on this app, bug incoming). See

* I needed to roll my own container (none of the existing containers
exactly matched needs, or even built anymore against modern Zeppelin
master, and the rest of the example is Spark 1.5).

The image itself is *huge*. One of the further refinements we need to
look at is how to possibly strip the Maven build for this container
down to just the interpreters we care about, because the deps here
are frankly ridiculous.

This might be a case where, if possible, we might want to open an
upstream request to build things dynamically, then use something like
probably the cut the image down considerably. (This might already be
possible, need to poke at whether you can late-bind interpreters
later.)
2015-11-13 12:02:11 -08:00
Zach Loafman a2f750b3fb Remove unneeded pieces 2015-11-05 14:58:18 -08:00
Zach Loafman 569684a36c Spark: Don't daemonize, don't pretend to tail logs we don't use
Along the way: Fixup port mismatch in worker container
2015-10-30 11:52:17 -07:00
Zach Loafman 4856ee94ff Spark: Add liveness probes for master/worker
It turns out, the pods don't exit when the master or worker crash.

Along the way: remove redundant metadata.
2015-10-29 05:59:31 -07:00
Zach Loafman 034036670d Spark: Update example to use kubectl proxy rather than load balancer 2015-10-29 05:59:31 -07:00
Zach Loafman dd77b24146 Spark: Update to current example standards, add GCS connector
* Pod -> ReplicationController, which also forced me to hack around
hostname issue on the master. (Spark master sees the incoming slave
request to spark-master and assumes it's not meant for it, since it's
name is spark-master-controller-abcdef.)

* Remove service env dependencies (depend on DNS instead).

* JSON -> YAML.

* Add GCS connector.

* Make example do something actually useful: A familiar example to
anyone at Google, implement wordcount of all of Shakespeare's works.

* Fix a minor service connection issue in the gluster example.
2015-10-27 15:06:34 -07:00
Zach Loafman e12c90514e Spark: Bump images to 1.5.1, add Makefile 2015-10-24 12:44:12 -07:00
Jon Cope 815d004761 Add Spark-GlusterFS example 2015-10-23 09:01:56 -05:00
Marcin Wielgus 2e26b33b92 Add image version to examples/spark 2015-08-14 19:52:26 +02:00
Marcin Wielgus c54437e537 Fix spark-driver in examples/spark 2015-08-05 15:45:43 +02:00
Gurvinder Singh bbfb267c02 fixed documentations after running gendocs.sh 2015-07-29 22:21:10 +02:00
Gurvinder Singh 26e32e325b added standard copyright 2015-07-27 23:01:49 +02:00
Gurvinder Singh 745400137f added indent for sleep 2015-07-25 21:16:06 +02:00
Gurvinder Singh 126e49424b fixed conflict with the current upstream master 2015-07-25 21:15:34 +02:00