Commit Graph

1640 Commits

Author SHA1 Message Date
Kashif Saadat e315c350be Implement ability to update Load Balancer subnets 2018-01-17 11:57:29 +00:00
k8s-ci-robot 96268846c2
Merge pull request #4217 from justinsb/support_writeto_in_vfs_path
VFS: Support io.WriterTo interface
2018-01-09 12:42:14 -08:00
Justin Santa Barbara 6f6bafb65e VFS: Support io.WriterTo interface
Allows us to handle much bigger files (no need to buffer in-memory)
2018-01-08 22:34:27 -05:00
Justin Santa Barbara 7b04ede10e GCE: Don't set bucket-level permissions
We previously needed them to allow list operations; however we now use a
keyset.yaml file instead of listing keys.  That should be the sole use,
so we should no longer need this permission.

If not, we can re-enable the code easily.
2018-01-08 00:58:36 -05:00
Justin Santa Barbara 3b983dfabd gce: mounter asset has moved
The mounter asset is now available directly, no longer in
kubernetes-manifests.tar.gz
2018-01-07 17:07:54 -05:00
k8s-ci-robot 2f3f0548c2
Merge pull request #4154 from chrislovecnm/missed-lifecycle-elb
adding missed lifecycles in elb code
2018-01-05 12:14:12 -08:00
Justin Santa Barbara ec8db8b78c Initial implementation of bundle command
The bundle command will support enrollment of a machine via SSH.
2018-01-04 18:55:28 -05:00
k8s-ci-robot fcc904f468
Merge pull request #4170 from chrislovecnm/bazel-improvements
Improving bazel make targets, adding a target for kops cli, bumping go_rules version
2018-01-04 08:48:31 -08:00
chrislovecnm 6bc37d33ba Adding capability to handle tgz files as archive files 2018-01-02 13:04:26 -07:00
chrislovecnm 53565eedeb Adding CNI v0.6.0 which is required for Kubernetes 1.9 2018-01-02 13:04:25 -07:00
chrislovecnm 88baba38de fixing security lifecycle for additional security groups 2017-12-30 09:00:11 -07:00
Justin Santa Barbara 8c23031561 Add roundtrip tests for certs & private keys
Travis should cover all our supported go versions.
2017-12-29 21:18:29 -05:00
chrislovecnm 4dd3bb1dea Updating bazel BUILD files with new go_rules version 2017-12-29 15:03:14 -07:00
k8s-ci-robot 96bff2246b
Merge pull request #3840 from justinsb/avoid_list_for_keypairs_5
Implement mirroring for API CAStore
2017-12-27 16:12:36 -08:00
chrislovecnm 7f998802ee fixing lifecycle type for network in security phase 2017-12-27 13:47:45 -07:00
Albert c52472cfa8 Add support for cn-northwest-1. 2017-12-27 15:37:09 +08:00
Kubernetes Submit Queue e7443ca345
Merge pull request #3839 from justinsb/avoid_list_for_keypairs_4
Automatic merge from submit-queue.

Force nodeup to use the bundle

We disable fallback entirely for nodeup, so we can still share code, but
won't accidentally be using the wrong code path.

Builds on #3839
2017-12-22 09:51:58 -08:00
Kubernetes Submit Queue 9ca326391f
Merge pull request #4120 from KashifSaadat/protokube-custom
Automatic merge from submit-queue.

Fix null pointer issues when custom PROTOKUBE_IMAGE is specified.

When setting a custom protokube location via the environment variable `PROTOKUBE_IMAGE`, this appeared to not be getting set properly at the time of applying Cluster updates (via `kops update cluster ${KOPS_CLUSTER_NAME} --yes`), resulting in a runtime exception.

This PR resolves the above issue, so cluster updates are correctly applied with reference to a custom protokube image location (if provided).
2017-12-22 07:50:06 -08:00
Justin Santa Barbara ca6268b25b Implement mirroring for API CAStore
Makes the mirror code essentially identical.
2017-12-21 21:48:43 -05:00
Justin Santa Barbara 5cc5a936f9 Force nodeup to use the bundle
We disable fallback entirely for nodeup, so we can still share code, but
won't accidentally be using the wrong code path.
2017-12-21 16:06:11 -05:00
Justin Santa Barbara e981e708e4 Use bundles when loading keysets
This avoids the need to list directories, which is problematic on GCE.

It also makes for a more consistent experience; we can move nodeup to
use the bundle always, and we can move writing to the Mirror task, so
that VFS & kops-server are more similar.
2017-12-21 12:58:26 -05:00
Kubernetes Submit Queue 7d15b5be05
Merge pull request #3837 from justinsb/avoid_list_for_keypairs_2
Automatic merge from submit-queue.

Refactor VFS CA store to reuse keyset from clientset

This ensures the two behave more similarly, but also will help us parse a
serialized keyset.

Builds on #3836
2017-12-21 09:26:46 -08:00
Kashif Saadat 0b9a1116ad Fix null pointer issues when custom PROTOKUBE_IMAGE is specified. 2017-12-20 12:28:40 +00:00
Kubernetes Submit Queue 4f05a694d0
Merge pull request #4116 from bitfusionio/f1-instance-types
Automatic merge from submit-queue.

added instance types for f1 family
2017-12-20 04:15:18 -08:00
Justin Santa Barbara ad82cd24eb Refactor VFS CA store to reuse keyset from clientset
This ensures the two behave more similarly, but also will help us parse
a serialized keyset.
2017-12-20 00:54:47 -05:00
Justin Santa Barbara f3e68c954c Remove use of deprecated create-if-missing functions
Generally tightening up the interface to make it easier to remove list
operations.
2017-12-20 00:54:47 -05:00
Justin Santa Barbara 9e5c086c5b Remove use of deprecated create-if-missing functions
Generally tightening up the interface to make it easier to remove list
operations.
2017-12-20 00:52:18 -05:00
Peter Whitesell 7b10093082 added instance types for f1 family 2017-12-19 16:25:29 -06:00
Kubernetes Submit Queue e43ac18590
Merge pull request #3834 from justinsb/cleanup_ssh_3
Automatic merge from submit-queue.

Refactor: clean up SecretStore to not use KeystoreItem

More moving to use API objects, except in this case we eventually want to
deprecate SecretStore entirely.

Builds on #3833
2017-12-19 10:29:15 -08:00
Justin Santa Barbara 7f3d3544c4 Refactor: clean up SecretStore to not use KeystoreItem
More moving to use API objects, except in this case we eventually want
to deprecate SecretStore entirely.
2017-12-19 11:43:43 -05:00
Manuel de Brito Fontes cb9859719d Update ottoyiu/k8s-ec2-srcdst docker image 2017-12-19 09:46:09 -03:00
Kubernetes Submit Queue e88496a248
Merge pull request #4061 from meringu/create-subnets
Automatic merge from submit-queue.

Add --subnets and --utility-subnets to kops create cluster

This change adds two new options to `kops create cluster`

When specifying `--vpc`, `--subnets` can be specified as an unordered array of subnet ids. Kops will then look up the zones of the subnets to find which zone to add the subnet id to.

If `--topology private` is also specified, `--utility-subnets` can similarly be specified.

~If a zone was specified but a subnet wasn't given that matches the zone, then the subnet will be allocated a CIDR with the current behaviour.~ This case fails validation here 7bd0a6a703/pkg/apis/kops/validation/validation.go (L151)

I can add unit tests and docs changes if required, but I am keen to get feedback before I proceed much further.

I have only added support for AWS.

I have tested this by running a command similar to this:

```bash
kops create cluster \
  --zones=us-east-1a,us-east-1b,us-east-1c \
  --topology private \
  --master-zones=us-east-1a,us-east-1b,us-east-1c  \
  --vpc $vpc_id \
  --subnets subnet-111111,subnet-222222,subnet-333333 \
  --utility-subnets subnet-444444,subnet-555555,subnet-666666 \
  $cluster_hosted_zone_name
```

And the cluster spec was as expected.
2017-12-18 21:12:59 -08:00
Kubernetes Submit Queue 78b61a5b6e
Merge pull request #4106 from justinsb/fix_comment_onPhaseiam
Automatic merge from submit-queue.

Fix code comment on PhaseSecurity
2017-12-18 20:38:33 -08:00
Kubernetes Submit Queue ca0a720a7e
Merge pull request #3833 from justinsb/cleanup_ssh_2
Automatic merge from submit-queue.

Refactor CAStore to use API types

We now return KeySet objects


Builds on #3832
2017-12-18 20:08:41 -08:00
Justin Santa Barbara be9d15b565 Fix code comment on PhaseSecurity 2017-12-18 22:33:05 -05:00
Raúl Cuza cd442b3560
make it go to f
`aws ec2 describe-availability-zones` returns 1a-1f for my account. This change allows me to provision things in the 1f availability zone.
2017-12-18 10:05:41 -05:00
Kubernetes Submit Queue 15c7d61dfb
Merge pull request #3997 from aledbf/amazon-vpc-cni
Automatic merge from submit-queue.

Add support for Amazon VPC CNI plugin

TODO:
- [x] IAM perms so that the CNI provider only has perms for the nodes in the cluster
- [x] Cleanup of security groups
- [ ] Replace image aledbf/k8s-ec2-srcdst:v0.1.0-5 with the official after https://github.com/ottoyiu/k8s-ec2-srcdst/pull/5 and https://github.com/ottoyiu/k8s-ec2-srcdst/pull/6
2017-12-17 21:41:13 -08:00
Kubernetes Submit Queue ff857218df
Merge pull request #4098 from chrislovecnm/gazelle-updates
Automatic merge from submit-queue.

fixing bazel

man we need a ci test for this :(
2017-12-17 17:36:13 -08:00
Justin Santa Barbara bf74133fd4 Refactor CAStore to use API types
We now return KeySet objects
2017-12-17 20:09:00 -05:00
Kubernetes Submit Queue dd49d69399
Merge pull request #3254 from chrislovecnm/file-assets
Automatic merge from submit-queue.

work on using files assets

Basic MVP for file assests.

- using file assest builder
- able to upload files
- using URL structs instead of strings everywhere
2017-12-17 16:10:23 -08:00
chrislovecnm c0da5e7fbb fixing bazel 2017-12-17 17:03:58 -07:00
Kubernetes Submit Queue 7768729cf2
Merge pull request #3832 from justinsb/cleanup_ssh
Automatic merge from submit-queue.

Refactor: separate out SSHCredentials from Keyset stores
2017-12-17 15:05:09 -08:00
chrislovecnm 7057aaf1bb Enabling the file assets
File assets and the SHA files are uploaded to the new location. Files
when are users uses s3 are upload public read only. The copyfile task
uses only the existing SHA value.

This PR include major refactoring of the use of URLs.  Strings are no
longer categnated, but converted into a URL struct and path.Join is
utlilized.

A new values.go file is included so that we can start refactoring more
code out of the "fi" package.

A
2017-12-17 15:26:57 -07:00
Manuel de Brito Fontes 2e05dd17aa Add support for Amazon VPC CNI plugin 2017-12-17 18:08:24 -03:00
Kubernetes Submit Queue 922a0d3ac6
Merge pull request #3924 from justinsb/remove_nodeup_templates
Automatic merge from submit-queue.

Remove nodeup templating
2017-12-16 09:58:09 -08:00
Kubernetes Submit Queue b44d894813
Merge pull request #3860 from justinsb/batching
Automatic merge from submit-queue.

Copy dnsprovider into our code, implement route53 batching

Fixes #3121
2017-12-15 15:44:12 -08:00
Kubernetes Submit Queue 96ee92a4b3
Merge pull request #4063 from rajivm/fix-canal-hostport
Automatic merge from submit-queue.

Support for hostPort when using canal

Similar to: https://github.com/kubernetes/kops/pull/3206

Without this, we are unable to get `hostPort` working with `canal`. The same is true for `flannel`, but this does add support for plain flannel.
2017-12-15 07:00:22 -08:00
Kubernetes Submit Queue 794b7a12f4
Merge pull request #4075 from justinsb/assetstore_atomic_expand
Automatic merge from submit-queue.

assetstore: extract tar files to a temp directory
2017-12-15 06:09:19 -08:00
Kubernetes Submit Queue 56da7ed34e
Merge pull request #4081 from justinsb/files_npe
Automatic merge from submit-queue.

files task: fix potential nil pointer error
2017-12-15 03:47:04 -08:00
Justin Santa Barbara 6cedbbf456 Remove nodeup templating
As it is now unused
2017-12-15 01:20:34 -05:00