Klaus Ma
cb3a53c090
Added namespace to Spark example.
2016-04-19 00:34:47 +08:00
k8s-merge-robot
8e99f7242b
Merge pull request #21899 from zmerlynn/update-spark
...
Auto commit by PR queue bot
2016-03-12 07:25:17 -08:00
David McMahon
74811d373b
Update the latestReleaseBranch to release-1.2 in the munger.
2016-03-08 18:59:28 -08:00
Zach Loafman
dd09c35bff
Bump Spark / Zeppelin to 1.5.2 / 0.5.6 tags
...
From https://github.com/kubernetes/application-images/pull/5
2016-03-04 13:26:05 -08:00
Tim St. Clair
3c6084e32d
Detect & fix backwards markdown links (of the form (foo)[bar])
2016-02-26 13:24:21 -08:00
Alex Robinson
6473156e68
Merge pull request #21626 from jayunit100/examples-spark-fix
...
Fix broken spark tests to use yaml files, 1 worker, declare DNS depe…
2016-02-24 16:30:19 -08:00
jay vyas
bb61d63872
[examples] [e2e] Fix spark example e2e tests: labels, forEach, json->yaml
2016-02-22 16:40:30 -05:00
k8s-merge-robot
4c97951d65
Merge pull request #21634 from jayunit100/spark-README
...
Auto commit by PR queue bot
2016-02-20 23:59:59 -08:00
jay vyas
f73a54823b
Update spark README with container location and DNS req.
2016-02-20 17:33:30 -05:00
Matthew Farrellee
352a7b7c2e
update spark example yaml to use new images
2016-02-09 17:18:47 -05:00
Matthew Farrellee
86d7561354
move spark images to github.com/kubernetes/application-images/spark
2016-01-16 11:15:23 -05:00
Chao Xu
533747fa0f
run hack/update-generated-docs.sh
2015-12-21 10:41:30 -08:00
Matthew Farrellee
43a66a30d6
Eliminate need for wget (use curl), use fewer intermediate files be quiet
2015-11-20 18:54:13 -05:00
Matthew Farrellee
af958f8ea7
Change default to local build, require explicit "make push" to push
2015-11-20 16:58:59 -05:00
Matthew Farrellee
71d545093e
Install numpy on all spark images
2015-11-20 16:05:47 -05:00
Matthew Farrellee
f7a9390aec
Use upstream zeppelin 0.5.5 release
2015-11-20 14:22:56 -05:00
Matthew Farrellee
b1863993b8
Add cleaning to clean target
2015-11-20 10:19:57 -05:00
Zach Loafman
5102d9115e
Zeppelin: Compress the image by doing the build on a separate image
...
Pull the tar through to the image we need it on.
Addresses #17231
2015-11-17 14:51:16 -08:00
k8s-merge-robot
6f5bbcf2b8
Merge pull request #17025 from zmerlynn/zeppelin
...
Auto commit by PR queue bot
2015-11-13 16:12:54 -08:00
Tim Hockin
34577ed6aa
Run update-gendocs
2015-11-13 13:57:57 -08:00
Zach Loafman
077eb36715
Zeppelin: Add Zeppelin image to Spark example
...
This adds a very basic Zeppelin image that works with the existing
Spark example. As can be seen from the documentation, it has a couple
of warts:
* It requires kubectl port-forward (which is unstable across long
periods of time, at least for me, on this app, bug incoming). See
* I needed to roll my own container (none of the existing containers
exactly matched needs, or even built anymore against modern Zeppelin
master, and the rest of the example is Spark 1.5).
The image itself is *huge*. One of the further refinements we need to
look at is how to possibly strip the Maven build for this container
down to just the interpreters we care about, because the deps here
are frankly ridiculous.
This might be a case where, if possible, we might want to open an
upstream request to build things dynamically, then use something like
probably the cut the image down considerably. (This might already be
possible, need to poke at whether you can late-bind interpreters
later.)
2015-11-13 12:02:11 -08:00
Zach Loafman
a2f750b3fb
Remove unneeded pieces
2015-11-05 14:58:18 -08:00
Zach Loafman
569684a36c
Spark: Don't daemonize, don't pretend to tail logs we don't use
...
Along the way: Fixup port mismatch in worker container
2015-10-30 11:52:17 -07:00
Zach Loafman
4856ee94ff
Spark: Add liveness probes for master/worker
...
It turns out, the pods don't exit when the master or worker crash.
Along the way: remove redundant metadata.
2015-10-29 05:59:31 -07:00
Zach Loafman
034036670d
Spark: Update example to use kubectl proxy rather than load balancer
2015-10-29 05:59:31 -07:00
Zach Loafman
dd77b24146
Spark: Update to current example standards, add GCS connector
...
* Pod -> ReplicationController, which also forced me to hack around
hostname issue on the master. (Spark master sees the incoming slave
request to spark-master and assumes it's not meant for it, since it's
name is spark-master-controller-abcdef.)
* Remove service env dependencies (depend on DNS instead).
* JSON -> YAML.
* Add GCS connector.
* Make example do something actually useful: A familiar example to
anyone at Google, implement wordcount of all of Shakespeare's works.
* Fix a minor service connection issue in the gluster example.
2015-10-27 15:06:34 -07:00
Zach Loafman
e12c90514e
Spark: Bump images to 1.5.1, add Makefile
2015-10-24 12:44:12 -07:00
Jon Cope
815d004761
Add Spark-GlusterFS example
2015-10-23 09:01:56 -05:00
Marcin Wielgus
2e26b33b92
Add image version to examples/spark
2015-08-14 19:52:26 +02:00
Marcin Wielgus
c54437e537
Fix spark-driver in examples/spark
2015-08-05 15:45:43 +02:00
Gurvinder Singh
bbfb267c02
fixed documentations after running gendocs.sh
2015-07-29 22:21:10 +02:00
Gurvinder Singh
26e32e325b
added standard copyright
2015-07-27 23:01:49 +02:00
Gurvinder Singh
745400137f
added indent for sleep
2015-07-25 21:16:06 +02:00
Gurvinder Singh
126e49424b
fixed conflict with the current upstream master
2015-07-25 21:15:34 +02:00
Tim Hockin
2c5c45b47f
Collected markedown fixes around syntax.
2015-07-20 09:51:22 -07:00
Tim Hockin
d504a77b74
Run gendocs
2015-07-17 15:35:43 -07:00
Daniel Smith
d2a40718e6
apply changes
2015-07-17 11:04:46 -07:00
Tim Hockin
f653a8f0c4
Better scary message
2015-07-17 09:28:49 -07:00
Tim Hockin
8d25501cdf
Run gendocs
2015-07-14 17:28:47 -07:00
Tim Hockin
71fcd5bfe1
Run gendocs
2015-07-14 15:28:59 -07:00
Mike Danese
945b5fd98b
automated link fixes
2015-07-14 10:51:10 -07:00
Daniel Smith
7edc7fc668
fix broken example links
2015-07-13 17:47:48 -07:00
Chao Xu
c0c18d5fa0
Update output of kubectl in examples
2015-07-10 12:48:58 -07:00
Gurvinder Singh
a7023d5591
modified spark example to use kubectl exec to interact with cluster and create spark driver pod
2015-07-10 11:19:55 +02:00
Marcin Wielgus
9720c44580
Updated spark examples with docker images moved to gcr.io/google_containers
2015-07-07 19:36:32 +02:00
Kris Rousey
3adcdb6c23
Change spark example to use v1
2015-06-10 13:57:17 -07:00
RichieEscarez
c4cb658210
Fixes #8701 . Added inline links to "services" "pods" and "replication controllers" (using relative linking ../../folder/filename.md)
2015-06-04 09:24:50 -07:00
Daniel Smith
92279a772c
doc updates
2015-06-03 15:41:09 -07:00
Paul Morie
2839e3b5fa
Make references to files in examples links
2015-05-24 03:22:26 -04:00
Jeff Lowdermilk
29edafa519
Add ga-beacon analytics to gendocs scripts
...
hack/run-gendocs.sh puts ga-beacon analytics link into all md files,
hack/verify-gendocs.sh verifies presence of link.
2015-05-15 18:56:38 -07:00