Commit Graph

1749 Commits

Author SHA1 Message Date
Mike Splain 45a57915e2 Fix bazel deprecation notice 2018-02-26 09:36:13 -05:00
Justin Santa Barbara 412cf377c2 VFS: WriteFile takes an io.ReadSeeker
Means we don't have to buffer big files in memory, in combination with
WriteTo for reading.
2018-02-26 09:09:17 -05:00
k8s-ci-robot aa6e801e18
Merge pull request #3829 from mikesplain/suspendAZRebalance
Add Instance Group Suspend Processes
2018-02-25 22:20:52 -08:00
Rohith d065111453 Etcd TLS Peer & CLient Auth 2018-02-24 10:02:41 +00:00
chrislovecnm fe790df0ce fixing bazel files to pass CI 2018-02-23 17:36:43 -07:00
chrislovecnm f758919f21 Adding additional tags to various AWS components
This PR adds the base tags to DHCP Options, IGW, and Route Tables.
These components are not tagged correctly, and this can cause issues
with deletion. Name tags are not added to shared resources, as we allow
shared resources to have maintained names.  A owned/shared tags with the
syntax  "kubernetes.io/cluster/$CLUSTERNAME" = "owned" is added to the
resources as well.  We are maintaining the Name tag value for private
route tables, as these resources do not use the standard value.
2018-02-23 14:02:50 -07:00
Justin Santa Barbara b68f58d746 Change NewAssetBuilder to take a kops.Cluseter 2018-02-22 21:42:40 -08:00
k8s-ci-robot 8d5da313af
Merge pull request #4479 from justinsb/kubedns_no_negcache
kube-dns: turn off negcache
2018-02-20 20:59:39 -08:00
Justin Santa Barbara fe0f2f2c77 kube-dns: turn off negcache
The equivalent of https://github.com/kubernetes/kubernetes/pull/53604

Not backporting to 1.5 at this point.
2018-02-20 21:13:45 -05:00
Justin Santa Barbara 7b647431b1 Update kube-dns to 1.14.8 2018-02-20 21:09:16 -05:00
k8s-ci-robot 4b8db1eee0
Merge pull request #4137 from thockin-tmp/gcr-vanity
Convert registry to k8s.gcr.io
2018-02-20 08:54:39 -08:00
Mike Splain fdc2695fe1 Add suspendProcesses to IGs 2018-02-20 09:30:18 -05:00
k8s-ci-robot 87fbb349c6
Merge pull request #4469 from justinsb/update_metrics
Support updating autoscaling metrics
2018-02-20 00:54:38 -08:00
Justin Santa Barbara 6e562e0742 Support updating autoscaling metrics 2018-02-20 00:53:24 -05:00
chrislovecnm 6a77fca293 Updating missed BUILD files for gazelle 2018-02-19 21:02:44 -07:00
chrislovecnm 13ff0875e5 adding flag options to update_cluster for the user to pass in overrides 2018-02-19 13:27:07 -07:00
chrislovecnm e14b4ed6fe Updating documentation and tweaking log level 2018-02-19 13:27:07 -07:00
chrislovecnm 31bb4850d9 wiring in handling of task overrides 2018-02-19 13:27:07 -07:00
chrislovecnm e6b9a15be5 adding new generated tasks 2018-02-19 13:27:07 -07:00
chrislovecnm a68cf85aba modifying generator to create SetLifecycle 2018-02-19 13:27:07 -07:00
chrislovecnm aed1000a0f Fixing ExistsAndWarnIfChanges so that it will allow a user to pass
This PR implmenents a new custom error that is returned when a task
lifecycle set to fi.LifecycleExistsAndWarnIfChanges. This will allow
a task to to fail validation, but the task is marked as completed and
the error is cleared.
2018-02-18 19:00:17 -07:00
Seth Pollack 3ae8ac1329 add option for BYOEIP 2018-02-16 12:08:05 -05:00
k8s-ci-robot 4f6dc89642
Merge pull request #4384 from leeeboo/master
Add  to aws-china.md to prevent Etag not match the HASH of file.
2018-02-16 08:32:39 -08:00
Rohith c8e4a1caf8 Kubernetes Calico TLS
The current implementation when Etcd TLS was added does not support using calico as the configuration and client certificates are not present. This PR updates the calico manifests and adds the distribution of the client certificate
2018-02-14 23:41:45 +00:00
Tim Hockin 79d5f793e7 Convert registry to k8s.gcr.io 2018-02-14 10:08:41 -08:00
Manabu Sakai 882ccbeb75 Updates for x1 instance family 2018-02-13 23:09:46 +09:00
k8s-ci-robot b385caf054
Merge pull request #4406 from kkaneda/kenji/error_check
upup: Make RenderTerraform handle an error from AddOutputVariableArray
2018-02-11 11:53:49 -08:00
k8s-ci-robot 287976e996
Merge pull request #4421 from justinsb/bump_weave_220
Bump weave version to 2.2.0
2018-02-11 11:11:50 -08:00
Justin Santa Barbara d96b6ee865 Bump weave version to 2.2.0
Follow-on to #4413
2018-02-11 12:57:19 -05:00
Ilya Dmitrichenko 4e495dc2ab
Update Weave Net to version 2.2.0 2018-02-09 13:42:40 +00:00
Kenji Kaneda aacbde4aac upup: Make RenderTerraform handle an error from AddOutputVariableArray 2018-02-08 00:27:27 -08:00
k8s-ci-robot 357eadd244
Merge pull request #4405 from romana/romana-v2.0.2
Update versions for romana container images
2018-02-07 18:00:43 -08:00
Caleb Gilmour d132c0c1a0 Update versions for romana container images. 2018-02-07 23:06:08 +00:00
Chris Phillips b620deba0f adds CONN_LIMIT to the WeaveNetworkingSpec
Weave limits the number of connections between peers and the default is 30.
As described here: ce9c5162bd/site/kubernetes/kube-addon.md
Setting the CONN_LIMIT environment variable controls this setting. Adding a field in the
WeaveNetworkingSpec and adding the env var to the associated templates lets users
have clusters larger than 30 nodes and still use weave's peer discovery

The weave authors have indicated that 100 is not an unreasonable setting.
https://github.com/weaveworks/weave/issues/1621#issuecomment-152713060
2018-02-07 09:52:12 -08:00
Albert 0cfc1ac36b User can specify CNI_ASSET_HASH_STRING 2018-02-05 16:44:52 +08:00
Justin Santa Barbara 712144a84a Update kopeio-networking to 1.0.20180203
No major changes, just version updates.
2018-02-03 13:14:23 -05:00
k8s-ci-robot 9d9646d0ce
Merge pull request #4367 from wlan0/master
Fix ccm startup wrt dns controller (set dnsPolicy to Default and host…
2018-02-02 06:54:09 -08:00
wlan0 a7668f17fb fix ccm startup wrt dns controller (set dnsPolicy to Default and hostNetwork: true) 2018-02-01 20:38:58 -08:00
Martyn Ranyard e0200fbe95 Add TerraformProviderExtraConfig to cluster spec 2018-01-31 11:33:49 +01:00
k8s-ci-robot cc67497776
Merge pull request #4246 from ottoyiu/s3_vfs
Improve S3 url parsing for vfsPath to support more naming conventions
2018-01-29 05:34:34 -08:00
k8s-ci-robot e299ff29d7
Merge pull request #4342 from johanneswuerbach/enable-asg-metrics
Enable metrics for AutoScalingGroups
2018-01-26 04:39:30 -08:00
k8s-ci-robot 5e68a5a33e
Merge pull request #4338 from denniswebb/latest-image
When kops searches for AMI by name, if > 1 are returned, uses the latest.
2018-01-25 17:25:28 -08:00
Johannes Würbach 02855fc13f
Enable metrics for AutoScalingGroups
Those metrics simplify monitoring the created ASGs and are free [0].

Enable them by default.

[0] https://aws.amazon.com/about-aws/whats-new/2016/08/free-auto-scaling-group-metrics-with-graphs/
2018-01-25 20:06:10 +01:00
k8s-ci-robot 9ddc915e8e
Merge pull request #4332 from justinsb/default_gcp_project
GCE: Get default project from gcloud CLI
2018-01-25 10:53:16 -08:00
k8s-ci-robot f1a439f163
Merge pull request #4341 from justinsb/aws_lc_err_handling_fix
AWS LaunchConfiguration error handling fix
2018-01-25 09:25:17 -08:00
Dennis Webb 5855787574 returns latest image if more than 1 found 2018-01-25 10:04:12 -06:00
Justin Santa Barbara 9919254205 AWS LaunchConfiguration error handling fix
We would loop forever on an unexpected error.
2018-01-25 08:35:15 -05:00
Justin Santa Barbara af2f4af705 GCE: Dial down logging
Turn off a few of the more spurious log messages
2018-01-24 09:44:10 -05:00
Justin Santa Barbara 5e49b6f831 GCE: Get default project from gcloud CLI
This means we don't have to specify a project for the common use case,
when gcloud is already configured with a project.
2018-01-24 09:43:05 -05:00
Justin Santa Barbara e2f91917d9 ReadTree: clarify that returns only files
Because the primary use-case is S3-style stores, we haven't really used
directories.  If we have a use-case, we can always pass a boolean
parameter or create an alternative function.
2018-01-23 23:42:00 -05:00
k8s-ci-robot 752c7bd96d
Merge pull request #4306 from justinsb/update_kopeio_networking
Bump kopeio-networking to 1.0.20180120
2018-01-21 12:45:25 -08:00
Justin Santa Barbara 54af8e41b9 Bump kopeio-networking to 1.0.20180120 2018-01-20 16:33:09 -05:00
Jeff Grafton dcb7c96b84 run make bazel-gazelle 2018-01-19 14:32:50 -08:00
k8s-ci-robot d8c6b25890
Merge pull request #4297 from blakebarnett/bdb/update_calico_cni_2-6-6
Upgrade to calico v2.6.6
2018-01-19 14:19:28 -08:00
Blake c78336fa99 Update bootstrap calico versions 2018-01-19 13:42:00 -08:00
k8s-ci-robot 77c21509b0
Merge pull request #4298 from blakebarnett/bdb/bazel_updates
bazel 0.9.0 running `make bazel-build` updates
2018-01-19 12:54:28 -08:00
Blake 0450d08c0b bazel 0.9.0 running `make bazel-build` updates 2018-01-18 13:26:27 -08:00
Blake 93fb66c223 Upgrade to calico v2.6.6 2018-01-18 13:23:56 -08:00
Kashif Saadat e315c350be Implement ability to update Load Balancer subnets 2018-01-17 11:57:29 +00:00
Otto Yiu e4427e9672 improve S3 url parsing for vfsPath to support more naming conventions 2018-01-12 16:07:18 -08:00
k8s-ci-robot 96268846c2
Merge pull request #4217 from justinsb/support_writeto_in_vfs_path
VFS: Support io.WriterTo interface
2018-01-09 12:42:14 -08:00
Justin Santa Barbara 6f6bafb65e VFS: Support io.WriterTo interface
Allows us to handle much bigger files (no need to buffer in-memory)
2018-01-08 22:34:27 -05:00
Justin Santa Barbara 7b04ede10e GCE: Don't set bucket-level permissions
We previously needed them to allow list operations; however we now use a
keyset.yaml file instead of listing keys.  That should be the sole use,
so we should no longer need this permission.

If not, we can re-enable the code easily.
2018-01-08 00:58:36 -05:00
Justin Santa Barbara 3b983dfabd gce: mounter asset has moved
The mounter asset is now available directly, no longer in
kubernetes-manifests.tar.gz
2018-01-07 17:07:54 -05:00
k8s-ci-robot 2f3f0548c2
Merge pull request #4154 from chrislovecnm/missed-lifecycle-elb
adding missed lifecycles in elb code
2018-01-05 12:14:12 -08:00
Justin Santa Barbara ec8db8b78c Initial implementation of bundle command
The bundle command will support enrollment of a machine via SSH.
2018-01-04 18:55:28 -05:00
k8s-ci-robot fcc904f468
Merge pull request #4170 from chrislovecnm/bazel-improvements
Improving bazel make targets, adding a target for kops cli, bumping go_rules version
2018-01-04 08:48:31 -08:00
chrislovecnm 6bc37d33ba Adding capability to handle tgz files as archive files 2018-01-02 13:04:26 -07:00
chrislovecnm 53565eedeb Adding CNI v0.6.0 which is required for Kubernetes 1.9 2018-01-02 13:04:25 -07:00
chrislovecnm 88baba38de fixing security lifecycle for additional security groups 2017-12-30 09:00:11 -07:00
Justin Santa Barbara 8c23031561 Add roundtrip tests for certs & private keys
Travis should cover all our supported go versions.
2017-12-29 21:18:29 -05:00
chrislovecnm 4dd3bb1dea Updating bazel BUILD files with new go_rules version 2017-12-29 15:03:14 -07:00
k8s-ci-robot 96bff2246b
Merge pull request #3840 from justinsb/avoid_list_for_keypairs_5
Implement mirroring for API CAStore
2017-12-27 16:12:36 -08:00
chrislovecnm 7f998802ee fixing lifecycle type for network in security phase 2017-12-27 13:47:45 -07:00
Albert c52472cfa8 Add support for cn-northwest-1. 2017-12-27 15:37:09 +08:00
Kubernetes Submit Queue e7443ca345
Merge pull request #3839 from justinsb/avoid_list_for_keypairs_4
Automatic merge from submit-queue.

Force nodeup to use the bundle

We disable fallback entirely for nodeup, so we can still share code, but
won't accidentally be using the wrong code path.

Builds on #3839
2017-12-22 09:51:58 -08:00
Kubernetes Submit Queue 9ca326391f
Merge pull request #4120 from KashifSaadat/protokube-custom
Automatic merge from submit-queue.

Fix null pointer issues when custom PROTOKUBE_IMAGE is specified.

When setting a custom protokube location via the environment variable `PROTOKUBE_IMAGE`, this appeared to not be getting set properly at the time of applying Cluster updates (via `kops update cluster ${KOPS_CLUSTER_NAME} --yes`), resulting in a runtime exception.

This PR resolves the above issue, so cluster updates are correctly applied with reference to a custom protokube image location (if provided).
2017-12-22 07:50:06 -08:00
Justin Santa Barbara ca6268b25b Implement mirroring for API CAStore
Makes the mirror code essentially identical.
2017-12-21 21:48:43 -05:00
Justin Santa Barbara 5cc5a936f9 Force nodeup to use the bundle
We disable fallback entirely for nodeup, so we can still share code, but
won't accidentally be using the wrong code path.
2017-12-21 16:06:11 -05:00
Justin Santa Barbara e981e708e4 Use bundles when loading keysets
This avoids the need to list directories, which is problematic on GCE.

It also makes for a more consistent experience; we can move nodeup to
use the bundle always, and we can move writing to the Mirror task, so
that VFS & kops-server are more similar.
2017-12-21 12:58:26 -05:00
Kubernetes Submit Queue 7d15b5be05
Merge pull request #3837 from justinsb/avoid_list_for_keypairs_2
Automatic merge from submit-queue.

Refactor VFS CA store to reuse keyset from clientset

This ensures the two behave more similarly, but also will help us parse a
serialized keyset.

Builds on #3836
2017-12-21 09:26:46 -08:00
Kashif Saadat 0b9a1116ad Fix null pointer issues when custom PROTOKUBE_IMAGE is specified. 2017-12-20 12:28:40 +00:00
Kubernetes Submit Queue 4f05a694d0
Merge pull request #4116 from bitfusionio/f1-instance-types
Automatic merge from submit-queue.

added instance types for f1 family
2017-12-20 04:15:18 -08:00
Justin Santa Barbara ad82cd24eb Refactor VFS CA store to reuse keyset from clientset
This ensures the two behave more similarly, but also will help us parse
a serialized keyset.
2017-12-20 00:54:47 -05:00
Justin Santa Barbara f3e68c954c Remove use of deprecated create-if-missing functions
Generally tightening up the interface to make it easier to remove list
operations.
2017-12-20 00:54:47 -05:00
Justin Santa Barbara 9e5c086c5b Remove use of deprecated create-if-missing functions
Generally tightening up the interface to make it easier to remove list
operations.
2017-12-20 00:52:18 -05:00
Peter Whitesell 7b10093082 added instance types for f1 family 2017-12-19 16:25:29 -06:00
Kubernetes Submit Queue e43ac18590
Merge pull request #3834 from justinsb/cleanup_ssh_3
Automatic merge from submit-queue.

Refactor: clean up SecretStore to not use KeystoreItem

More moving to use API objects, except in this case we eventually want to
deprecate SecretStore entirely.

Builds on #3833
2017-12-19 10:29:15 -08:00
Justin Santa Barbara 7f3d3544c4 Refactor: clean up SecretStore to not use KeystoreItem
More moving to use API objects, except in this case we eventually want
to deprecate SecretStore entirely.
2017-12-19 11:43:43 -05:00
Manuel de Brito Fontes cb9859719d Update ottoyiu/k8s-ec2-srcdst docker image 2017-12-19 09:46:09 -03:00
Kubernetes Submit Queue e88496a248
Merge pull request #4061 from meringu/create-subnets
Automatic merge from submit-queue.

Add --subnets and --utility-subnets to kops create cluster

This change adds two new options to `kops create cluster`

When specifying `--vpc`, `--subnets` can be specified as an unordered array of subnet ids. Kops will then look up the zones of the subnets to find which zone to add the subnet id to.

If `--topology private` is also specified, `--utility-subnets` can similarly be specified.

~If a zone was specified but a subnet wasn't given that matches the zone, then the subnet will be allocated a CIDR with the current behaviour.~ This case fails validation here 7bd0a6a703/pkg/apis/kops/validation/validation.go (L151)

I can add unit tests and docs changes if required, but I am keen to get feedback before I proceed much further.

I have only added support for AWS.

I have tested this by running a command similar to this:

```bash
kops create cluster \
  --zones=us-east-1a,us-east-1b,us-east-1c \
  --topology private \
  --master-zones=us-east-1a,us-east-1b,us-east-1c  \
  --vpc $vpc_id \
  --subnets subnet-111111,subnet-222222,subnet-333333 \
  --utility-subnets subnet-444444,subnet-555555,subnet-666666 \
  $cluster_hosted_zone_name
```

And the cluster spec was as expected.
2017-12-18 21:12:59 -08:00
Kubernetes Submit Queue 78b61a5b6e
Merge pull request #4106 from justinsb/fix_comment_onPhaseiam
Automatic merge from submit-queue.

Fix code comment on PhaseSecurity
2017-12-18 20:38:33 -08:00
Kubernetes Submit Queue ca0a720a7e
Merge pull request #3833 from justinsb/cleanup_ssh_2
Automatic merge from submit-queue.

Refactor CAStore to use API types

We now return KeySet objects


Builds on #3832
2017-12-18 20:08:41 -08:00
Justin Santa Barbara be9d15b565 Fix code comment on PhaseSecurity 2017-12-18 22:33:05 -05:00
Raúl Cuza cd442b3560
make it go to f
`aws ec2 describe-availability-zones` returns 1a-1f for my account. This change allows me to provision things in the 1f availability zone.
2017-12-18 10:05:41 -05:00
Kubernetes Submit Queue 15c7d61dfb
Merge pull request #3997 from aledbf/amazon-vpc-cni
Automatic merge from submit-queue.

Add support for Amazon VPC CNI plugin

TODO:
- [x] IAM perms so that the CNI provider only has perms for the nodes in the cluster
- [x] Cleanup of security groups
- [ ] Replace image aledbf/k8s-ec2-srcdst:v0.1.0-5 with the official after https://github.com/ottoyiu/k8s-ec2-srcdst/pull/5 and https://github.com/ottoyiu/k8s-ec2-srcdst/pull/6
2017-12-17 21:41:13 -08:00
Kubernetes Submit Queue ff857218df
Merge pull request #4098 from chrislovecnm/gazelle-updates
Automatic merge from submit-queue.

fixing bazel

man we need a ci test for this :(
2017-12-17 17:36:13 -08:00
Justin Santa Barbara bf74133fd4 Refactor CAStore to use API types
We now return KeySet objects
2017-12-17 20:09:00 -05:00
Kubernetes Submit Queue dd49d69399
Merge pull request #3254 from chrislovecnm/file-assets
Automatic merge from submit-queue.

work on using files assets

Basic MVP for file assests.

- using file assest builder
- able to upload files
- using URL structs instead of strings everywhere
2017-12-17 16:10:23 -08:00
chrislovecnm c0da5e7fbb fixing bazel 2017-12-17 17:03:58 -07:00