kubernetes
/
kops
mirror of https://github.com/kubernetes/kops.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
5,172 Commits 31 Branches 256 Tags 544 MiB
Commit Graph

1692 Commits

Author SHA1 Message Date
Justin Santa Barbara 09dd3002ff Make sure that we enable systemd services 
We were previously just starting them, which works fine for the new
machine and machine termination case, but doesn't work when doing a
machine restart (e.g. init 6)

Issue #70
 2016-07-06 23:04:51 -04:00
Justin Santa Barbara 40cbdc4d00 Add support for r3 family 
Fix #76
 2016-07-06 22:02:56 -04:00
Justin Santa Barbara fcd644441e Merge pull request #61 from justinsb/typo_1 
Fix typo in error message
 2016-07-06 16:42:47 -04:00
Justin Santa Barbara 957d30a157 Merge pull request #68 from justinsb/fix_elb_pagesize 
Fetch ELB tags in chunks of 20
 2016-07-06 13:47:30 -04:00
Justin Santa Barbara 274a8eff3c Fetch ELB tags in chunks of 20 
ELB DescribeTags has a limit of 20 ELBs / call.  So we paginate the
DescribeLoadBalancers call with page size = 20 also.
 2016-07-06 13:46:16 -04:00
Justin Santa Barbara 7347f1815a Parse SSH public keys with 'odd' whitespace 
e.g. a key with \r instead of spaces

Fix #63
 2016-07-06 11:18:09 -04:00
Justin Santa Barbara a91cc6e9a4 Add tests for SSH key fingerprint 
Issue #63
 2016-07-06 10:47:20 -04:00
Justin Santa Barbara 4dc869756f Quote public key in error message 
Just in case it contains invalid characters

Issue #63
 2016-07-06 10:22:09 -04:00
Justin Santa Barbara b6035bffaf Fix typo in error message 
Fingerpring -> Fingerprint
 2016-07-06 10:04:13 -04:00
Justin Santa Barbara db4b190831 Fix panic when IAMInstanceProfile not found 2016-07-06 09:51:44 -04:00
Justin Santa Barbara e953d76f9f Merge pull request #51 from justinsb/fix_48 
Only warn if a _different_ ephemeral device is attached
 2016-07-06 03:07:05 -04:00
Justin Santa Barbara fa3157e512 Merge pull request #54 from justinsb/fix_tests 
Update & get tests working again
 2016-07-06 03:06:59 -04:00
Justin Santa Barbara 981cbe0189 Merge pull request #55 from justinsb/fix_22 
Fix #22
 2016-07-06 03:06:45 -04:00
Justin Santa Barbara 6f49a50886 Wait for InstanceProfile to be readable after creation 
This should avoid spurious errors when creating dependent resources,
which fail if we try to create before the InstanceProfile is fully
created.

Issue #35
 2016-07-06 01:01:24 -04:00
Justin Santa Barbara 2f84573e2b DebugPrint should handle the case where the resource cannot be found 
We print "unknown resource" instead

Issue #22
 2016-07-06 00:40:51 -04:00
Justin Santa Barbara 7b57329f34 Don't panic if asked to Open an empty resource 
Return an error instead

Issue #22
 2016-07-06 00:37:18 -04:00
Justin Santa Barbara c956bdada5 Update & get tests working again 
They're still hitting the AWS APIs, have terrible coverage and are slow.
But it's a start!
 2016-07-06 00:33:07 -04:00
Justin Santa Barbara 05af11b72e Only warn if a _different_ ephemeral device is attached 
When we retry a task, we run the Run method again.  But in this case,
the run method actually populated some default values.  Only warn if the
values we are populating are different, to avoid spurious warnings.

We probably need a stronger lifecycle - for example having a Validate
method would probably be helpful.

Fix #48
 2016-07-05 22:05:42 -04:00
Justin Santa Barbara 9c2f92f289 AWS: set hostname-override from metadata service 
This is a weird edge case, because it can't be determined in advance.

We carve out a special well-known name, `@aws`, which nodeup/protokube
will expand to the local-hostname from the aws metadata service when it
is found in the HostnameOverride value.

Ideally we wouldn't do this at all now that we have DNS integration, but
we first want to get into the tested & working configuration!

Fixes #19
 2016-07-05 11:36:47 -04:00
Justin Santa Barbara 8e4d751eb9 Update schema to sync up with coming changes in API 
Thankfully we aren't yet using any of these properties
 2016-07-02 14:58:34 -04:00
Justin Santa Barbara 0fbb35dec0 Merge pull request #10 from justinsb/az_diagnostics 
More diagnostics when an AZ is not recognized
 2016-07-01 10:07:12 -04:00
Justin Santa Barbara 58fbef0572 Apply gofmt 2016-07-01 10:02:30 -04:00
Justin Santa Barbara bfdd976855 More diagnostics when an EC2 zone is not recognized 2016-07-01 10:00:19 -04:00
Justin Santa Barbara ac119289fd Add ap-south-1 region 2016-07-01 09:59:56 -04:00
Justin Santa Barbara 3886c03efe Cleanup: move docs to top-level, add .gitignore 
Rearranging for the new repo
 2016-06-30 10:31:18 -04:00
Justin Santa Barbara d8b661777b Merge cloudup tool into `kops create cluster` 2016-06-30 10:25:50 -04:00
Justin Santa Barbara d427858477 Rename to kops 
The upup tool is now called kops, and we have moved repos
 2016-06-30 09:25:25 -04:00
Justin Santa Barbara 1a5a4c2238 upup: add doc for philosophy 2016-06-28 13:17:25 -04:00
Justin Santa Barbara be4be57f3a upup: workaround for secrets problem with upgrade 2016-06-28 13:08:41 -04:00
Justin Santa Barbara 80c1e40784 upup: Add get commands 2016-06-28 11:49:41 -04:00
Justin Santa Barbara e3062a9f51 upup: improved upgrade procedure 2016-06-28 11:49:17 -04:00
Justin Santa Barbara e315564cfa upup: More delete cleanup, use statestore by default 2016-06-28 11:47:19 -04:00
Justin Santa Barbara ddd81010c4 upup: update same vpc docs 2016-06-27 20:22:36 -04:00
Justin Santa Barbara 46be00c79f upup: fix terraform docs 2016-06-27 17:08:12 -04:00
Justin Santa Barbara a0cd203317 upup: More glide deps 2016-06-27 16:35:34 -04:00
Justin Santa Barbara cfcc2f1ba9 Make StateStore a top-level concept, with subdirs for each cluster 2016-06-27 16:21:51 -04:00
Justin Santa Barbara 9ff5dcd902 Make IAM permission abstraction more generic 
At least in the JSON representation!
 2016-06-27 15:48:16 -04:00
Justin Santa Barbara d1f6f4bfab Remove AdmissionControl from top level 2016-06-27 15:37:21 -04:00
Justin Santa Barbara 947a045667 Rename DNSDomain -> ClusterDNSDomain for clarity 2016-06-27 15:36:11 -04:00
Justin Santa Barbara 26d05341b4 Move options to common stage, so that it works with terraform generation 2016-06-27 15:21:31 -04:00
Justin Santa Barbara c36607644b Better shared VPC support: more validation 2016-06-27 15:00:51 -04:00
Justin Santa Barbara a9ab4904e8 upup: fix error message to reflect correct flag name 2016-06-27 15:00:51 -04:00
Justin Santa Barbara 36925f11d9 upup: infer --cloud from known zones 2016-06-27 15:00:51 -04:00
Justin Santa Barbara ee8bdb907e upup delete: don't always print dependencies 2016-06-27 15:00:51 -04:00
Justin Santa Barbara 65135db3be upup: group DNS properties 2016-06-27 15:00:51 -04:00
Justin Santa Barbara 4704846051 upup: add edit command 2016-06-27 15:00:51 -04:00
Justin Santa Barbara a0d8302255 Merge pull request #156 from slack/protokube-dns 
upup/protokube: tell protokube to use --dns-zone-name
 2016-06-27 00:41:11 -04:00
Justin Santa Barbara e1b4f0ffe4 Use default handling for CLI tools for parent tasks 2016-06-27 00:35:21 -04:00
Justin Santa Barbara b6cf38c96e AllocateNodeCIDRs need no longer be "bubbled down" 
We have it on the KCM config; just set it there
 2016-06-27 00:32:19 -04:00
Justin Santa Barbara 944900153f Rename `kubecfg generate` to `export kubecfg` 
Following the k8s pattern
 2016-06-27 00:17:10 -04:00
Justin Santa Barbara 6932ff4a06 Make sure terraform output is stable across runs 
Fixes #132
 2016-06-27 00:04:43 -04:00
Justin Santa Barbara 87b7c71fcc Remove spurious errors when deleting a cluster 2016-06-27 00:03:49 -04:00
Justin Santa Barbara 492856069a Apply gofmt 2016-06-26 23:24:17 -04:00
Justin Santa Barbara eeed4a3031 Rationalize API to something we want to support forever 2016-06-26 23:09:02 -04:00
Justin Santa Barbara ee325435e6 Rationalize properties to the minimal set 2016-06-26 09:45:05 -04:00
Jason Hansen 0d276591d5 upup/cloudup: use configured URL for nodeup location 2016-06-26 04:26:37 +00:00
Jason Hansen 9ebe071855 upup/dns: lets protokube use sub-sub domains 2016-06-26 03:28:23 +00:00
Justin Santa Barbara eb2087ed00 upup: add docs for statestore concept 2016-06-23 12:05:30 -04:00
Justin Santa Barbara 0a6260f7c4 Merge pull request #130 from justinsb/upup_vfs_context 
upup: Add VFS context object, centralize usage
 2016-06-23 10:30:09 -04:00
Justin Santa Barbara 1737f7dadb upup: temporarily mark GCE as not-necessarily working 
It's lagging a bit, so fail early
 2016-06-23 10:28:25 -04:00
Justin Santa Barbara 3185a3fe5c Fix upgrade 2016-06-23 10:28:17 -04:00
Justin Santa Barbara 75af0d089d upup: Add VFS context object, centralize usage 
Replaces ad-hoc construction of VFS paths
 2016-06-23 10:27:32 -04:00
Justin Santa Barbara 506d0d555a Merge pull request #127 from justinsb/upup_upgrade_tooling 
upup: improved delete; create upup export and upup upgrade
 2016-06-23 10:27:32 -04:00
Justin Santa Barbara ac8ca9ad06 Merge pull request #126 from justinsb/upup_use_vfs 
upup: use vfs for secretstore/keystore
 2016-06-23 10:26:42 -04:00
Justin Santa Barbara 90d7fb87ad upup: improved delete; create upup export and upup upgrade 2016-06-23 08:59:20 -04:00
Justin Santa Barbara 93f634b428 upup: use vfs for secretstore/keystore 
This is needed so that we can have encrypted storage and complex keys
(e.g. multiple CA certs).  Multiple CA certs are needed for an in-place
upgrade from kube-up v1.
 2016-06-23 08:58:54 -04:00
Justin Santa Barbara fcc1f57c2d Updates for 1.3: Docker 1.11.2, 1.3 image 2016-06-23 08:58:23 -04:00
Justin Santa Barbara 75f386235a upup: rolling-update add mutex lock 2016-06-17 09:36:43 -04:00
Justin Santa Barbara 1e7159a923 upup: detach internet gateway if vpc is to be deleted 2016-06-17 09:36:27 -04:00
Justin Santa Barbara 3ede6c1f4a upup: uncompress gzipped data in delete cluster 2016-06-17 09:36:12 -04:00
Justin Santa Barbara 8472b39016 upup: symlink models directory for people building from source 2016-06-17 09:35:12 -04:00
Justin Santa Barbara 3040676a3b upup: enable subnet changes on ASG 
For kube-up upgrade
 2016-06-15 22:56:19 -04:00
Justin Santa Barbara 22bf484777 upup: Assign subnet CIDRs based on AZs 2016-06-15 14:03:19 -04:00
Justin Santa Barbara b147091e5c upup: fix dryrun when adding a subnet 
When adding a subnet in --dryrun, the ID might not be set during a Find
 2016-06-15 14:03:19 -04:00
Justin Santa Barbara a10c76a954 upup: prevent spurious comparison failure on VPC/IGW 2016-06-15 14:03:19 -04:00
Justin Santa Barbara eb23e22b3c upup: rolling-update should take --name, not --cluster-id 2016-06-13 17:37:30 -04:00
Justin Santa Barbara 1c4d5eaa43 upup: glog flag parsing with cobra 
Bind the glog flags to the root command, use the goflag
parse-empty-slice trick to avoid warnings.
 2016-06-13 17:37:30 -04:00
Justin Santa Barbara 14bae04e01 upup: turn down a few more logging messages 2016-06-13 17:37:30 -04:00
Justin Santa Barbara 0559ec1210 upup: Support for shared VPCs 
A lot of work that had to happen here:

* Better reuse of config
* Ability to mark VPC & InternetGateway as shared
* Find models relative to the executable, to run from a dir-per-cluster

Fixes #95
 2016-06-13 11:37:06 -04:00
Justin Santa Barbara 0d617c7ffb Merge pull request #109 from justinsb/upup_addons 
upup: experimental addon management
 2016-06-13 11:37:07 -04:00
Justin Santa Barbara 530b4c79db upup: experimental addon management 2016-06-13 11:35:00 -04:00
Justin Santa Barbara 5edefd92a4 upup: switch from skydns to kube-dns 2016-06-13 11:32:24 -04:00
Justin Santa Barbara 6925094133 upup: rename zone arg -> zones in README 2016-06-11 23:13:22 -04:00
Justin Santa Barbara cba6559092 upup: set GO15VENDOREXPERIMENT, update docs for 1.5 
We set GO15VENDOREXPERIMENT in the makefile.  It doesn't appear to
actually work for go code generation, so there's a note in the README
that you really want to be using 1.6 for development.

Fixes #97
 2016-06-11 23:09:45 -04:00
Justin Santa Barbara ff48515e2c upup: build tar distribution file 
Enables us to do integration tests
 2016-06-11 23:09:44 -04:00
Justin Santa Barbara 55574ec3f5 upup: apply gofmt 2016-06-11 23:09:44 -04:00
Justin Santa Barbara 226f0284b1 upup: Fix log message 2016-06-11 23:09:44 -04:00
Justin Santa Barbara 7006746be4 upup: allow master-size to be specified through CLI 2016-06-11 23:09:44 -04:00
Justin Santa Barbara 53e4875a5b upup: kubecfg generate can default the master API name 
It is api.<clustername> by default
 2016-06-11 23:08:40 -04:00
Justin Santa Barbara 72afa859a3 upup: delete cluster should take -name to be consistent 
Still not entirely sure on cluster-id vs name, but name is consistent
 2016-06-11 23:08:40 -04:00
Justin Santa Barbara 771c436101 Merge pull request #103 from justinsb/upup_dns_zone 
upup: allow -dns-zone to be specified
 2016-06-11 23:06:04 -04:00
Justin Santa Barbara 96247daf6d Merge pull request #101 from justinsb/upup_fix_delete_asg 
upup: fixes for ASG deletion
 2016-06-11 23:06:00 -04:00
Justin Santa Barbara f9ac7af7df Merge pull request #100 from justinsb/upup_zones 
upup: separate node & master zone configuration; validate
 2016-06-11 23:05:55 -04:00
Justin Santa Barbara ee056fa975 upup: Retry if race detected in FindOrCreateSecret 
We do a read / create-if-empty.  If the create fails because of a
concurrent creation, we retry the operation.

Fix #73
 2016-06-11 22:40:47 -04:00
Justin Santa Barbara 68f899756c upup: allow -dns-zone to be specified 
We default to the last two components of the cluster DNS name.  But a
lot of people will delelgate a subdomain and want to use that.

Fixes #98
 2016-06-11 22:37:24 -04:00
Justin Santa Barbara 0263826163 upup: delete cluster should check status of ASG 
Before deleting the ASG, we need to check it exists.

Issue #99
 2016-06-11 21:33:56 -04:00
Justin Santa Barbara e63426ce65 upup: delete cluster should eventually give up 
If it isn't making progress, eventually we should bail out so that we
can use this in scripts.  However, we don't need to be too aggressive,
because it is not good to leak resources, and a user will likely
Control-C us pretty fast when they see they're in a loop.

Issue #99
 2016-06-11 21:33:56 -04:00
Justin Santa Barbara b52877e2ce upup: separate node & master zone configuration; validate 
We allow --zones & --master-zones to be specified separately now, but we
validate for common errors (using a region where you meant a zone,
duplicating a zone, spanning regions, entering an invalid AZ etc)
 2016-06-11 21:06:31 -04:00
Justin Santa Barbara b091e4ad60 upup: fix typo 
Duplicated zone name
 2016-06-10 18:47:12 -04:00
Justin Santa Barbara d489fccd28 upup: make NodeConfig be JSON-clean 
We use JSON-merging in our option parsing, so we need it to only
populate values that are actually set.
 2016-06-10 13:37:48 -04:00
Justin Santa Barbara f3ebc088f1 upup: make LaunchConfiguration compatible with terraform 
This way we can output a LaunchConfiguration prefix into terrform that
we can then read later, so that we can create with terraform and then
transfer to another mode of operation if desired.
 2016-06-10 13:36:36 -04:00
Justin Santa Barbara c54ef2773d upup: support Base64 and raw-string JSON encoding of certs/keys 
For compatability reasons, we write the certificate & keys as base64
encoded strings.  I don't think we have to any more, but we have to be
able to parse it.
 2016-06-10 13:35:40 -04:00
Justin Santa Barbara 70002068fa upup: Allow node-count to be specified on the CLI 
The other super-important option!
 2016-06-10 13:35:16 -04:00
Justin Santa Barbara 7543d1c19d upup: apply gofmt 
Missed a few gofmt places
 2016-06-10 11:41:10 -04:00
Justin Santa Barbara 1cbcb82fe9 upup: use JSON as fallback in --dryrun printing 
Rather than giving up with an error, we can simply use JSON format.
 2016-06-10 11:38:21 -04:00
Justin Santa Barbara 9b32edfb81 upup: add experimental cluster rolling-update command 
Little more than a hack right now, but a good place to start.
 2016-06-10 11:36:57 -04:00
Justin Santa Barbara 52496ac73a upup: split launchconfiguration from ASG 
It is much more logical this way, and mirrors the way GCE & terraform
work.
 2016-06-10 11:36:17 -04:00
Justin Santa Barbara eeabcc0cb1 upup: fix options processing 
We want to make sure that any values we set are treated both as defaults
and as overrides (i.e. the options shouldn't be able to override a value
the user has explicitly set)
 2016-06-10 11:35:31 -04:00
Justin Santa Barbara 6e7c4209de upup: Simple tag fixes to avoid comparison failures 
We populate the actual expected tags in-place now
 2016-06-10 11:33:33 -04:00
Justin Santa Barbara 2c5e0c0164 upup: populate Name, to support --dryrun 
Some of these types were coming up as spurious changes.
 2016-06-10 11:33:29 -04:00
Justin Santa Barbara e10f09a81f Merge pull request #83 from justinsb/upup_node_sizes 
upup: node size on CLI and more instance type families
 2016-06-10 11:32:49 -04:00
Justin Santa Barbara 2bacc2035c upup: define m3, m4, c4 families 
This allows us to set up their ephemeral volumes
 2016-06-10 11:31:20 -04:00
Justin Santa Barbara e8af8f8efc upup: allow node size to be specific on CLI 2016-06-10 11:31:11 -04:00
Justin Santa Barbara 7c478c794f upup: harmonize model with official config types 2016-06-10 01:28:44 -04:00
Justin Santa Barbara 6e203da852 upup: split model into two parts 
This is probably a good idea anyway, but it also lets us side-step the
terraform no-dots-in-tags bug.
 2016-06-09 23:14:36 -04:00
Justin Santa Barbara 5d10678c23 Merge pull request #77 from justinsb/upup_default_release 
upup: default to latest stable release
 2016-06-09 23:12:59 -04:00
Justin Santa Barbara fa860ca730 Merge pull request #75 from justinsb/upup_vfs 
upup: Add VFS for storing state in S3 or locally
 2016-06-09 23:12:54 -04:00
Justin Santa Barbara f3359d4bb9 upup: default to latest stable release 
Avoids an extra CLI arg
 2016-06-09 23:11:06 -04:00
Justin Santa Barbara 338f158d22 upup: Add VFS for storing state in S3 or locally 
This also fixes a few concurrency issues, because we're writing in one
place now.
 2016-06-09 23:08:10 -04:00
Justin Santa Barbara 93284d5d13 upup: reformat terraform output 
Using string manipulation, sadly, but I believe it's safe as we don't
use heredocs
 2016-06-09 23:07:12 -04:00
Justin Santa Barbara c826f46a60 upup: support for terraform on AWS 
All seems good except for a bug with volume tagging
 2016-06-08 12:19:15 -04:00
Justin Santa Barbara 70d7c1b92e upup: avoid warning when building filters with nil name 2016-06-08 12:18:07 -04:00
Justin Santa Barbara e4c093a229 upup: protokube is launched from a container; asset not needed 
We don't need to include an asset for protokube; we're running it from
the docker registry (like most of the k8s core components)
 2016-06-08 12:18:07 -04:00
Justin Santa Barbara 9934755bde upup: use bare binaries, instead of the release tarball 
Expanding the release tarball was one of the slowest pieces of the
install, and we only need kubelet & kubectl from it.
 2016-06-08 12:18:07 -04:00
Justin Santa Barbara 42e32f7379 upup: include kope-routing, but only if _kope_routing is set 2016-06-08 12:18:04 -04:00
Justin Santa Barbara 59124fd6fb upup: include count of tasks as we are executing them 2016-06-08 12:16:19 -04:00
Justin Santa Barbara 4d331e2881 upup: Reattempt up to 3 times when no progress made 
Now that we're running in parallel, sometimes AWS eventual consistency
causes us problems.  We now retry up to 3 times, sleeping 10 seconds in
between each run even when we aren't making progress.
 2016-06-08 12:16:19 -04:00
Justin Santa Barbara 44507e64cf upup: remove some bad logging 
Was left over from move to simpler unmarshal model
 2016-06-08 12:16:19 -04:00
Justin Santa Barbara a392d5572c upup: Update makefile, readme, deps 2016-06-07 17:53:35 -04:00
Justin Santa Barbara 1eaf0d36a8 upup: HA support 
Specifying multiple zones will bring up an HA cluster.
 2016-06-07 15:44:00 -04:00
Justin Santa Barbara fd554601a8 Merge pull request #65 from justinsb/upup_fi_comparison 
upup: Add back in CompareWithID functions
 2016-06-07 15:39:51 -04:00
Justin Santa Barbara 901d6e8159 Merge pull request #64 from justinsb/use_protokube 
upup: use protokube
 2016-06-07 15:38:11 -04:00
Justin Santa Barbara 6ea399fc79 upup: Add back in CompareWithID functions 
Removed when we pulled this functionality out of the go generator, but
then the manual code not re-added.

Also a few other small tweaks to Tasks.
 2016-06-07 15:37:07 -04:00
Justin Santa Barbara 8a53149eef upup: use protokube 
This wires up protokube, replacing a lot of the nodeup functionality.

The option of not using protokube is retained, via the _not_protokube
tag.
 2016-06-07 15:32:37 -04:00
Justin Santa Barbara 4c0f54f95d upup: run create & delete in parallel 
It makes logging harder, but we want to start testing it!
 2016-06-07 15:23:07 -04:00
Justin Santa Barbara 6cf5cd423e upup: apply IAM changes 
We now apply changes to IAM policies, and print the diffs.
 2016-06-07 15:17:59 -04:00
Justin Santa Barbara c95656177f cloudup: Add support for ELB health checks 2016-06-07 09:01:35 -04:00
Justin Santa Barbara 062d2ece96 Merge pull request #54 from justinsb/upup_protokube 
Use protokube with upup
 2016-06-07 08:56:23 -04:00
Justin Santa Barbara 274696c0c5 Merge pull request #58 from justinsb/upup_smarter_delete 
upup: better cluster delete
 2016-06-07 08:47:21 -04:00
Justin Santa Barbara cf840ef21a upup: better cluster delete 2016-06-07 08:46:28 -04:00
Justin Santa Barbara e18833fcb7 Merge pull request #57 from justinsb/upup_resource_tagging 
cloudup: better retrying around resource tagging
 2016-06-07 08:43:21 -04:00
Justin Santa Barbara ed2f81b6c7 Merge pull request #56 from justinsb/upup_fix_hasdependencies 
nodeup: make sure tasks implement HasDependencies
 2016-06-07 08:43:11 -04:00
Mike Danese 00108bbdd2 Merge pull request #55 from justinsb/upup_dont_hardcode_122 
upup: don't hard-code v1.2.2 in image names
 2016-06-06 14:26:41 -07:00
Justin Santa Barbara 9d6847ff49 cloudup: better retrying around resource tagging 2016-06-04 16:14:00 -04:00
Justin Santa Barbara 82f373cba0 nodeup: make sure tasks implement HasDependencies 2016-06-04 16:13:25 -04:00
Justin Santa Barbara 71c2835007 upup: don't hard-code v1.2.2 in image names 2016-06-04 16:12:51 -04:00
Justin Santa Barbara 540c46fe4e nodeup: pass --master argument to protokube 2016-06-04 16:11:11 -04:00
Justin Santa Barbara b730d40a83 upup: Add gofmt,codegen command to Makefile 2016-06-04 16:09:34 -04:00
Justin Santa Barbara c774777160 Merge pull request #50 from justinsb/upup_keys 
upup: better secrets support
 2016-06-04 15:57:08 -04:00
Justin Santa Barbara 4a85ef64fb Merge pull request #48 from justinsb/upup_elb 
upup: simple ELB support
 2016-06-04 15:56:57 -04:00
Justin Santa Barbara b9597c53ec Merge pull request #47 from justinsb/upup_delete_cluster 
upup: simple command to delete (AWS) clusters
 2016-06-04 15:56:51 -04:00
Justin Santa Barbara 5f4c03cd11 Merge pull request #46 from justinsb/upup_route53 
upup: Simple route53 (DNS) support
 2016-06-04 15:56:48 -04:00
Justin Santa Barbara a4408f76be upup: better secrets support 
Start creating commands to manage secrets, and also stop implicitly
creating them.
 2016-05-30 18:47:20 -04:00
Justin Santa Barbara 095bf95fc9 upup: simple command to delete (AWS) clusters 
A relatively dumb retry strategy to work around dependencies, but it
works and it is difficult to do _much_ better.
 2016-05-30 17:57:40 -04:00
Justin Santa Barbara 3a660fe8fa upup: simple ELB support 
Add support for ELB, though this doesn't wire it up yet
 2016-05-30 17:53:05 -04:00
Justin Santa Barbara 3389323392 upup: Simple route53 (DNS) support 2016-05-30 17:50:55 -04:00
Justin Santa Barbara 3aeaf73788 upup: move string-slice comparison functions to utils 2016-05-30 17:46:36 -04:00
Justin Santa Barbara 1aeea67510 upup: replace parse code with standard json unmarshaller 
Instead of reimplementing the unmarshal code, we implement a trick: we
implement an alternative JSON representation of an object: a string.

We unmarshal as normal, and then we reconcile these pointer values to
the primary values, by walking the unmarshalled tree.
 2016-05-30 17:46:36 -04:00
Justin Santa Barbara c72593fcf7 Use generators in tasks 2016-05-30 17:46:36 -04:00
Justin Santa Barbara b1aa92f3d8 Simple go code generator for fitasks 
Based on the canonical example in the go code
 2016-05-30 17:46:32 -04:00
Justin Santa Barbara 16559c9010 upup: Executor that performs some retry logic 
If there is an error performing a task, we will reattempt it as long as
forward progress is still being made (i.e. at least one other task
completed successfully)

This makes everything more reliable (though we should still fix these
problems), but it also lays the groundwork for parallel execution.
 2016-05-22 21:02:53 +01:00
Justin Santa Barbara 6a85472cd2 Add glide dependency on cobra 2016-05-17 12:58:27 -04:00
Justin Santa Barbara 505ef056d9 Add upup command, with a subcommand to generate kubecfg 2016-05-17 12:54:13 -04:00
Justin Santa Barbara bbc460f5a7 Refactor Certificate and PrivateKey to implement io.WriterTo 2016-05-17 12:54:13 -04:00
Mike Danese 19bb767767 Merge pull request #28 from justinsb/upup_aws_retry_tags_on_eventual_consistency_error 
upup: tolerate aws eventual-consistency errors on tags
 2016-05-17 09:34:53 -07:00
Mike Danese 01590a9704 Merge pull request #27 from justinsb/upup_aws_image_aliases 
upup: Map matching image ids to source name
 2016-05-17 09:34:42 -07:00
Mike Danese 026bb16e49 Merge pull request #26 from justinsb/upup_aws_instance_userdata 
upup: Fetch instance userdata on AWS
 2016-05-17 09:34:30 -07:00
Mike Danese 7466c48a75 Merge pull request #25 from justinsb/upup_dryrun_print_interface 
upup: fix dryrun spurious printing of interface values
 2016-05-17 09:34:17 -07:00
Mike Danese d5928df6a4 Merge pull request #24 from justinsb/upup_aws_iamrole_policies 
upup: Perform JSON comparison on IAMRole PolicyDocuments
 2016-05-17 09:34:03 -07:00
Mike Danese cf98b75d39 Merge pull request #23 from justinsb/upup_aws_instance_tags 
upup: Discover tags on AWS instances
 2016-05-17 09:33:50 -07:00
Mike Danese 03ae922b01 Merge pull request #22 from justinsb/upup_aws_keypairs 
upup: Fix fingerprint calculation in AWS keypair
 2016-05-17 09:33:38 -07:00
Mike Danese a4344e1564 Merge pull request #19 from justinsb/upup_keypair 
upup: better keypair support
 2016-05-17 09:33:24 -07:00
Mike Danese d6026a431e Merge pull request #18 from justinsb/upup_reflection_redux 
upup: Make reflective walk more logical, use for dryrun change printing
 2016-05-17 09:33:16 -07:00
Mike Danese b48b503a7c Merge pull request #17 from justinsb/upup_gce_metadata 
upup: Discover metadata on GCE instance
 2016-05-17 09:33:11 -07:00
Mike Danese 5aa64c72a6 Merge pull request #16 from justinsb/upup_image_url 
upup: Map GCE image-url to string consistently
 2016-05-17 09:33:02 -07:00
Justin Santa Barbara c68aeec94d upup: tolerate aws eventual-consistency errors on tags 
AWS will sometimes return an error like "resource not found" when a
DescribeTags or CreateTags call immediately follows creation of the
resource.  Introduce a retry-loop when we get an error that is of the
appropriate type.
 2016-05-16 12:08:28 -04:00
Justin Santa Barbara 14ac983241 upup: Map matching image ids to source name 
This avoids spurious changes, and also is more intuitive for the user -
whatever name the user gave it, if it resolves to the same image, that
is the name we will use.
 2016-05-16 11:20:24 -04:00
Justin Santa Barbara a00e974a95 upup: Fetch instance userdata on AWS 
We simply weren't doing this until now
 2016-05-16 11:12:13 -04:00
Justin Santa Barbara e90f5c78e1 upup: fix dryrun spurious printing of interface values 
We missed the case where the interface changed (this only shows up if
other fields change also)
 2016-05-16 10:58:44 -04:00
Justin Santa Barbara ba77aea0ea upup: Perform JSON comparison on IAMRole PolicyDocuments 
AWS reformats them (inserting lots of whitespace), making a string
comparison incorrect.  Instead we parse to JSON and do a
reflect.DeepEqual check; if they are the same then we pretend the actual
value was the expected value.
 2016-05-15 23:49:01 -04:00
Justin Santa Barbara e6ce439fcd upup: Discover tags on AWS instances 
We simply weren't mapping them previously.
 2016-05-15 23:32:49 -04:00
Justin Santa Barbara 8752db39aa upup: Fix fingerprint calculation in AWS keypair 
Both fix the calculation itself to match AWS's weird fingerprint
algorithm, and also fix the comparison logic by which we infer that if
the fingerprint matches, that the public key matches also.
 2016-05-15 23:28:19 -04:00
Justin Santa Barbara 1c97a94d87 Rework keypair to fit our change model 
We also remove another special-case context (pki), so that it is just
another object type.
 2016-05-15 21:46:53 -04:00
Justin Santa Barbara c4742045ab Support changing GCE instance metadata 
This works, but is only a part-way there because:

1. We need to trigger cloudup
2. Our manifests don't pick up the change (e.g. kube-apiserver)
 2016-05-15 17:46:34 -04:00
Justin Santa Barbara ac220d2ba1 Allow Render methods to take fi.Context 
We call the Render methods on Tasks by reflection, and some of them
don't care about the Target, but do care about the Context (e.g. the PKI
tasks, which only care about the CAStore)
 2016-05-15 17:43:04 -04:00
Justin Santa Barbara cb7e20be3b Create HasAddress interface 
AWS ElasticIPs and GCE Addresses implement HasAddress.  This will be
used by dependent tasks to extract the IP address at runtime.
 2016-05-15 17:42:59 -04:00
Justin Santa Barbara 02d980c681 Make reflective walk more logical, use for dryrun change printing 
Remove a bunch of inconsistencies so that the reflective walk is not
suprising, and also rename it to ReflectRecursive.

Then use this for dry-run change printing.
 2016-05-15 17:41:19 -04:00
Justin Santa Barbara 0976ee1a73 Discover metadata on GCE instance 
We simply weren't mapping it before, which was causing spurious changes.
 2016-05-15 17:40:32 -04:00
Justin Santa Barbara 5a61c35052 Map GCE image-url to string consistently 
We need to reverse our image shortening consistently with how we resolve
the image, so that --dryrun does not report spurious changes.
 2016-05-15 17:39:26 -04:00
Justin Santa Barbara 370727aa44 Support for persistent disks, users & symlinks 
These are required to mount the master PD.  We use the kubernetes
safe-format-and-mount implementation.
 2016-05-13 13:29:56 -04:00
Justin Santa Barbara caccb8953f UpUp: AWS support 
Adds AWS support for both cloudup & nodeup.
Also cleaning up things found along the way!
 2016-05-09 13:08:27 -04:00
Justin Santa Barbara d4c2cfaae7 Initial version of upup: cloudup & nodeup 
* GCE support only
* Key and secret generation
* "Direct mode" makes API calls
* "Dry run mode" previews the changes
* Terraform output (though key generation not working for master ip)
* cloud-init output (though debian image does not ship with cloud-init)
 2016-05-06 16:01:33 -04:00