Commit Graph

5437 Commits

Author SHA1 Message Date
Justin Santa Barbara f43ba79a72 Merge pull request #63 from justinsb/upup_parallel
upup: run create & delete in parallel
2016-06-07 15:34:06 -04:00
Justin Santa Barbara 8a53149eef upup: use protokube
This wires up protokube, replacing a lot of the nodeup functionality.

The option of not using protokube is retained, via the _not_protokube
tag.
2016-06-07 15:32:37 -04:00
Justin Santa Barbara 4c0f54f95d upup: run create & delete in parallel
It makes logging harder, but we want to start testing it!
2016-06-07 15:23:07 -04:00
Justin Santa Barbara 5e4013077a Merge pull request #62 from justinsb/upup_iam_fixes
upup: apply IAM changes
2016-06-07 15:19:59 -04:00
Justin Santa Barbara fdeeb81b99 Merge pull request #60 from justinsb/protokube_2
Protokube: components through volumes
2016-06-07 15:19:44 -04:00
Justin Santa Barbara c228d2a51e protokube: DNS and direct etcd support
Adds changes to support clustered etcd:

* Configure node names in DNS
* Parse annotations on the volume to infer the etcd configuration

Using annotations on the volumes to control what manifests launch feels
pretty powerful.  Though we could also just write the manifest to a
central location (e.g. S3) and then sync them into the kubelet
directory.

This also means we no longer have to directly spawn kubelet - we can now
just write the manifests.
2016-06-07 15:18:53 -04:00
Justin Santa Barbara 6cf5cd423e upup: apply IAM changes
We now apply changes to IAM policies, and print the diffs.
2016-06-07 15:17:59 -04:00
Justin Santa Barbara 833bfa40f8 Merge pull request #61 from justinsb/upup_elb_healthchecks
cloudup: Add support for ELB health checks
2016-06-07 09:03:28 -04:00
Justin Santa Barbara c95656177f cloudup: Add support for ELB health checks 2016-06-07 09:01:35 -04:00
Justin Santa Barbara 062d2ece96 Merge pull request #54 from justinsb/upup_protokube
Use protokube with upup
2016-06-07 08:56:23 -04:00
Justin Santa Barbara 274696c0c5 Merge pull request #58 from justinsb/upup_smarter_delete
upup: better cluster delete
2016-06-07 08:47:21 -04:00
Justin Santa Barbara cf840ef21a upup: better cluster delete 2016-06-07 08:46:28 -04:00
Justin Santa Barbara e18833fcb7 Merge pull request #57 from justinsb/upup_resource_tagging
cloudup: better retrying around resource tagging
2016-06-07 08:43:21 -04:00
Justin Santa Barbara ed2f81b6c7 Merge pull request #56 from justinsb/upup_fix_hasdependencies
nodeup: make sure tasks implement HasDependencies
2016-06-07 08:43:11 -04:00
Mike Danese 00108bbdd2 Merge pull request #55 from justinsb/upup_dont_hardcode_122
upup: don't hard-code v1.2.2 in image names
2016-06-06 14:26:41 -07:00
Mike Danese ad6b42081b Merge pull request #53 from justinsb/upup_makefile
upup: Add gofmt,codegen command to Makefile
2016-06-06 14:26:09 -07:00
Mike Danese 6e700cedce Merge pull request #41 from roblalonde/master
Added information for the Navops Launch installer by Univa
2016-06-06 14:02:57 -07:00
Justin Santa Barbara 9d6847ff49 cloudup: better retrying around resource tagging 2016-06-04 16:14:00 -04:00
Justin Santa Barbara 82f373cba0 nodeup: make sure tasks implement HasDependencies 2016-06-04 16:13:25 -04:00
Justin Santa Barbara 71c2835007 upup: don't hard-code v1.2.2 in image names 2016-06-04 16:12:51 -04:00
Justin Santa Barbara 540c46fe4e nodeup: pass --master argument to protokube 2016-06-04 16:11:11 -04:00
Justin Santa Barbara d5141af03f protokube: only try to mount the master disk on the master 2016-06-04 16:10:52 -04:00
Justin Santa Barbara b730d40a83 upup: Add gofmt,codegen command to Makefile 2016-06-04 16:09:34 -04:00
Justin Santa Barbara c774777160 Merge pull request #50 from justinsb/upup_keys
upup: better secrets support
2016-06-04 15:57:08 -04:00
Justin Santa Barbara 4802292c3b Merge pull request #49 from justinsb/protokube
Protokube: prototyping the 'missing' kubelet pieces
2016-06-04 15:57:03 -04:00
Justin Santa Barbara 4a85ef64fb Merge pull request #48 from justinsb/upup_elb
upup: simple ELB support
2016-06-04 15:56:57 -04:00
Justin Santa Barbara b9597c53ec Merge pull request #47 from justinsb/upup_delete_cluster
upup: simple command to delete (AWS) clusters
2016-06-04 15:56:51 -04:00
Justin Santa Barbara 5f4c03cd11 Merge pull request #46 from justinsb/upup_route53
upup: Simple route53 (DNS) support
2016-06-04 15:56:48 -04:00
Justin Santa Barbara 1fde849d5b Merge pull request #45 from justinsb/use_generator
upup: Replace unmarhsal code with per-type unmarshallers
2016-06-04 15:56:43 -04:00
Justin Santa Barbara a4408f76be upup: better secrets support
Start creating commands to manage secrets, and also stop implicitly
creating them.
2016-05-30 18:47:20 -04:00
Justin Santa Barbara b11ad36f94 Protokube: prototyping the 'missing' kubelet pieces
Working towards self-hosting of k8s, we will likely have to add some
features to kubelet, such as independent mounting of disks or copying of
resources from S3.  protokube lets us develop those features prior to
moving them into kubelet.

In particular, today we need to mount an EBS volume on the master prior
to starting kubelet, if we want to run the master in an ASG.

protokube is a service that runs on boot, and it tries to mount the
master volume.  Once it mounts the master volume, it runs kubelet.
Currently it runs kubelet by looking at a directory
/etc/kubernetes/bootstrap; the intention is that we could actually have
multiple versions of kubelet in here (or other services) and then we
could automatically roll-back from a failed update.
2016-05-30 18:05:24 -04:00
Justin Santa Barbara 095bf95fc9 upup: simple command to delete (AWS) clusters
A relatively dumb retry strategy to work around dependencies, but it
works and it is difficult to do _much_ better.
2016-05-30 17:57:40 -04:00
Justin Santa Barbara 3a660fe8fa upup: simple ELB support
Add support for ELB, though this doesn't wire it up yet
2016-05-30 17:53:05 -04:00
Justin Santa Barbara 3389323392 upup: Simple route53 (DNS) support 2016-05-30 17:50:55 -04:00
Justin Santa Barbara 3aeaf73788 upup: move string-slice comparison functions to utils 2016-05-30 17:46:36 -04:00
Justin Santa Barbara 1aeea67510 upup: replace parse code with standard json unmarshaller
Instead of reimplementing the unmarshal code, we implement a trick: we
implement an alternative JSON representation of an object: a string.

We unmarshal as normal, and then we reconcile these pointer values to
the primary values, by walking the unmarshalled tree.
2016-05-30 17:46:36 -04:00
Justin Santa Barbara c72593fcf7 Use generators in tasks 2016-05-30 17:46:36 -04:00
Justin Santa Barbara b1aa92f3d8 Simple go code generator for fitasks
Based on the canonical example in the go code
2016-05-30 17:46:32 -04:00
Justin Santa Barbara 212224b3cc Merge pull request #21 from justinsb/upup_executor
upup: Executor that performs some retry logic
2016-05-22 22:26:44 +01:00
Justin Santa Barbara 16559c9010 upup: Executor that performs some retry logic
If there is an error performing a task, we will reattempt it as long as
forward progress is still being made (i.e. at least one other task
completed successfully)

This makes everything more reliable (though we should still fix these
problems), but it also lays the groundwork for parallel execution.
2016-05-22 21:02:53 +01:00
Justin Santa Barbara 7dc7e848a7 Merge pull request #20 from justinsb/upup_export_kubecfg
upup: add command to generate kubecfg
2016-05-22 21:00:34 +01:00
Mike Danese 3e57457d80 Merge pull request #12 from luxas/docker_multinode
WIP: Initial add of docker-multinode
2016-05-22 12:56:15 -07:00
Mike Danese 6cdb33cf48 Merge pull request #30 from mikedanese/reorg
reorganize turnup directory structure
2016-05-17 11:25:06 -07:00
Justin Santa Barbara 6a85472cd2 Add glide dependency on cobra 2016-05-17 12:58:27 -04:00
Justin Santa Barbara 505ef056d9 Add upup command, with a subcommand to generate kubecfg 2016-05-17 12:54:13 -04:00
Justin Santa Barbara bbc460f5a7 Refactor Certificate and PrivateKey to implement io.WriterTo 2016-05-17 12:54:13 -04:00
Mike Danese 19bb767767 Merge pull request #28 from justinsb/upup_aws_retry_tags_on_eventual_consistency_error
upup: tolerate aws eventual-consistency errors on tags
2016-05-17 09:34:53 -07:00
Mike Danese 01590a9704 Merge pull request #27 from justinsb/upup_aws_image_aliases
upup: Map matching image ids to source name
2016-05-17 09:34:42 -07:00
Mike Danese 026bb16e49 Merge pull request #26 from justinsb/upup_aws_instance_userdata
upup: Fetch instance userdata on AWS
2016-05-17 09:34:30 -07:00
Mike Danese 7466c48a75 Merge pull request #25 from justinsb/upup_dryrun_print_interface
upup: fix dryrun spurious printing of interface values
2016-05-17 09:34:17 -07:00