Commit Graph

52 Commits

Author SHA1 Message Date
Klaus Ma cb3a53c090 Added namespace to Spark example. 2016-04-19 00:34:47 +08:00
k8s-merge-robot 8e99f7242b Merge pull request #21899 from zmerlynn/update-spark
Auto commit by PR queue bot
2016-03-12 07:25:17 -08:00
David McMahon 74811d373b Update the latestReleaseBranch to release-1.2 in the munger. 2016-03-08 18:59:28 -08:00
Zach Loafman dd09c35bff Bump Spark / Zeppelin to 1.5.2 / 0.5.6 tags
From https://github.com/kubernetes/application-images/pull/5
2016-03-04 13:26:05 -08:00
Tim St. Clair 3c6084e32d Detect & fix backwards markdown links (of the form (foo)[bar]) 2016-02-26 13:24:21 -08:00
Alex Robinson 6473156e68 Merge pull request #21626 from jayunit100/examples-spark-fix
Fix broken spark tests to use yaml files, 1 worker, declare DNS depe…
2016-02-24 16:30:19 -08:00
jay vyas bb61d63872 [examples] [e2e] Fix spark example e2e tests: labels, forEach, json->yaml 2016-02-22 16:40:30 -05:00
k8s-merge-robot 4c97951d65 Merge pull request #21634 from jayunit100/spark-README
Auto commit by PR queue bot
2016-02-20 23:59:59 -08:00
jay vyas f73a54823b Update spark README with container location and DNS req. 2016-02-20 17:33:30 -05:00
Matthew Farrellee 352a7b7c2e update spark example yaml to use new images 2016-02-09 17:18:47 -05:00
Matthew Farrellee 86d7561354 move spark images to github.com/kubernetes/application-images/spark 2016-01-16 11:15:23 -05:00
Chao Xu 533747fa0f run hack/update-generated-docs.sh 2015-12-21 10:41:30 -08:00
Matthew Farrellee 43a66a30d6 Eliminate need for wget (use curl), use fewer intermediate files be quiet 2015-11-20 18:54:13 -05:00
Matthew Farrellee af958f8ea7 Change default to local build, require explicit "make push" to push 2015-11-20 16:58:59 -05:00
Matthew Farrellee 71d545093e Install numpy on all spark images 2015-11-20 16:05:47 -05:00
Matthew Farrellee f7a9390aec Use upstream zeppelin 0.5.5 release 2015-11-20 14:22:56 -05:00
Matthew Farrellee b1863993b8 Add cleaning to clean target 2015-11-20 10:19:57 -05:00
Zach Loafman 5102d9115e Zeppelin: Compress the image by doing the build on a separate image
Pull the tar through to the image we need it on.

Addresses #17231
2015-11-17 14:51:16 -08:00
k8s-merge-robot 6f5bbcf2b8 Merge pull request #17025 from zmerlynn/zeppelin
Auto commit by PR queue bot
2015-11-13 16:12:54 -08:00
Tim Hockin 34577ed6aa Run update-gendocs 2015-11-13 13:57:57 -08:00
Zach Loafman 077eb36715 Zeppelin: Add Zeppelin image to Spark example
This adds a very basic Zeppelin image that works with the existing
Spark example. As can be seen from the documentation, it has a couple
of warts:

* It requires kubectl port-forward (which is unstable across long
periods of time, at least for me, on this app, bug incoming). See

* I needed to roll my own container (none of the existing containers
exactly matched needs, or even built anymore against modern Zeppelin
master, and the rest of the example is Spark 1.5).

The image itself is *huge*. One of the further refinements we need to
look at is how to possibly strip the Maven build for this container
down to just the interpreters we care about, because the deps here
are frankly ridiculous.

This might be a case where, if possible, we might want to open an
upstream request to build things dynamically, then use something like
probably the cut the image down considerably. (This might already be
possible, need to poke at whether you can late-bind interpreters
later.)
2015-11-13 12:02:11 -08:00
Zach Loafman a2f750b3fb Remove unneeded pieces 2015-11-05 14:58:18 -08:00
Zach Loafman 569684a36c Spark: Don't daemonize, don't pretend to tail logs we don't use
Along the way: Fixup port mismatch in worker container
2015-10-30 11:52:17 -07:00
Zach Loafman 4856ee94ff Spark: Add liveness probes for master/worker
It turns out, the pods don't exit when the master or worker crash.

Along the way: remove redundant metadata.
2015-10-29 05:59:31 -07:00
Zach Loafman 034036670d Spark: Update example to use kubectl proxy rather than load balancer 2015-10-29 05:59:31 -07:00
Zach Loafman dd77b24146 Spark: Update to current example standards, add GCS connector
* Pod -> ReplicationController, which also forced me to hack around
hostname issue on the master. (Spark master sees the incoming slave
request to spark-master and assumes it's not meant for it, since it's
name is spark-master-controller-abcdef.)

* Remove service env dependencies (depend on DNS instead).

* JSON -> YAML.

* Add GCS connector.

* Make example do something actually useful: A familiar example to
anyone at Google, implement wordcount of all of Shakespeare's works.

* Fix a minor service connection issue in the gluster example.
2015-10-27 15:06:34 -07:00
Zach Loafman e12c90514e Spark: Bump images to 1.5.1, add Makefile 2015-10-24 12:44:12 -07:00
Jon Cope 815d004761 Add Spark-GlusterFS example 2015-10-23 09:01:56 -05:00
Marcin Wielgus 2e26b33b92 Add image version to examples/spark 2015-08-14 19:52:26 +02:00
Marcin Wielgus c54437e537 Fix spark-driver in examples/spark 2015-08-05 15:45:43 +02:00
Gurvinder Singh bbfb267c02 fixed documentations after running gendocs.sh 2015-07-29 22:21:10 +02:00
Gurvinder Singh 26e32e325b added standard copyright 2015-07-27 23:01:49 +02:00
Gurvinder Singh 745400137f added indent for sleep 2015-07-25 21:16:06 +02:00
Gurvinder Singh 126e49424b fixed conflict with the current upstream master 2015-07-25 21:15:34 +02:00
Tim Hockin 2c5c45b47f Collected markedown fixes around syntax. 2015-07-20 09:51:22 -07:00
Tim Hockin d504a77b74 Run gendocs 2015-07-17 15:35:43 -07:00
Daniel Smith d2a40718e6 apply changes 2015-07-17 11:04:46 -07:00
Tim Hockin f653a8f0c4 Better scary message 2015-07-17 09:28:49 -07:00
Tim Hockin 8d25501cdf Run gendocs 2015-07-14 17:28:47 -07:00
Tim Hockin 71fcd5bfe1 Run gendocs 2015-07-14 15:28:59 -07:00
Mike Danese 945b5fd98b automated link fixes 2015-07-14 10:51:10 -07:00
Daniel Smith 7edc7fc668 fix broken example links 2015-07-13 17:47:48 -07:00
Chao Xu c0c18d5fa0 Update output of kubectl in examples 2015-07-10 12:48:58 -07:00
Gurvinder Singh a7023d5591 modified spark example to use kubectl exec to interact with cluster and create spark driver pod 2015-07-10 11:19:55 +02:00
Marcin Wielgus 9720c44580 Updated spark examples with docker images moved to gcr.io/google_containers 2015-07-07 19:36:32 +02:00
Kris Rousey 3adcdb6c23 Change spark example to use v1 2015-06-10 13:57:17 -07:00
RichieEscarez c4cb658210 Fixes #8701. Added inline links to "services" "pods" and "replication controllers" (using relative linking ../../folder/filename.md) 2015-06-04 09:24:50 -07:00
Daniel Smith 92279a772c doc updates 2015-06-03 15:41:09 -07:00
Paul Morie 2839e3b5fa Make references to files in examples links 2015-05-24 03:22:26 -04:00
Jeff Lowdermilk 29edafa519 Add ga-beacon analytics to gendocs scripts
hack/run-gendocs.sh puts ga-beacon analytics link into all md files,
hack/verify-gendocs.sh verifies presence of link.
2015-05-15 18:56:38 -07:00