kubernetes
/
kops
mirror of https://github.com/kubernetes/kops.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
19,165 Commits 31 Branches 256 Tags 544 MiB
Commit Graph

175 Commits

Author SHA1 Message Date
Kubernetes Prow Robot 2649cbc598
Merge pull request #10995 from haugenj/release-1.19 
Add NTH Queue Processor Mode
 2021-04-22 12:15:58 -07:00
Ole Markus With 020652e096 Add ability to enable/configure warm pool for ASG 
Apply suggestions from code review

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>

Apply suggestions from code review

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
 2021-04-20 09:02:09 +02:00
Jason Haugen cceb9dd296 lifecycle integ test, docs, & small cleanup 2021-04-19 15:43:06 -05:00
Jason Haugen 318a116ba6 fix staticcheck 2021-04-19 15:43:05 -05:00
Jason Haugen 10df4a9a14 integ tests 2021-04-19 15:43:05 -05:00
Jason Haugen fe78fa5fb7 run make verify 2021-04-19 15:43:05 -05:00
Jason Haugen c8bb48ba81 fix existing tests 2021-04-19 15:43:05 -05:00
Ole Markus With 09615935fd Make kOps CLI handle ASG warm pools 2021-04-15 11:10:23 +02:00
Peter Rifel 51cec7e556
Use "tag on create" for EIPs, NLBs, and TargetGroups 
These are the remaining resources that support "tag on create" of which we werent taking advantage.

This allows more fine-grained IAM permissions for the kops cli.
 2021-03-22 07:21:51 -05:00
Bharath Vedartham 0c0767c0c9 Remove support for launch configurations 2021-03-09 09:04:15 +02:00
Peter Rifel 2ebd448602
Add integration test for transit gateway support 2021-02-28 13:02:11 -06:00
Kubernetes Prow Robot 1b42286cfe
Merge pull request #10832 from rifelpet/aws-sdk 
Add Tagging to Instance Profiles and OIDC Providers
 2021-02-24 05:40:50 -08:00
Timothy Clarke 1577b0a54b
Adding Elastic IP Allocations to NLB API 2021-02-18 12:27:28 +00:00
Peter Rifel d52fd9f76c
Add tagging support to AWS Instance Profiles and OIDC Providers 2021-02-15 16:48:43 -06:00
Peter Rifel 6e6e072d93
Use AWS SDK const for IAM entities not found 2021-02-15 15:53:59 -06:00
Kubernetes Prow Robot cd10383fa0
Merge pull request #10741 from codablock/nlb-subnets 
Allow to control which subnets and IPs get used for the API loadbalancer
 2021-02-14 14:23:06 -08:00
Peter Rifel c91ea29cb8
Add cloudmock support for launch template versions and updating ASGs 2021-02-06 23:06:46 -06:00
Alexander Block 49e7ec8890 Use SubnetMappings for NLBs instead of Subnets 
SubnetMappings allow to explicitely set the private IPv4 address that
must be used for the NLB.

SubnetMappings and Subnets in the AWS API are compatible as long as the
address settings are not changes, making this commit backwards compatible.
 2021-02-05 17:53:20 +01:00
Ciprian Hacman d18a02df73 Add throughput field for gp3 volumes to mock 2021-01-21 09:00:58 +02:00
Jesse Haka 185ccba246 Use random instance names in OpenStack 2021-01-12 14:52:39 +02:00
Peter Rifel 4ee5d7a543
Add tagging support for AWS IAM Roles 2020-12-23 15:11:07 -06:00
Peter Rifel 1760d06332
cloudmock - guard the VPC CIDR association calls with a mutex 
This should fix a flaky TestLifecycleComplex test that I've only been able to repro <1% of the time.
 2020-12-16 20:32:35 -06:00
Bharath Vedartham 7f6e125733 Add support for aws ec2 instance metadata v2 
A new field is add to the InstanceGroup spec with 2 sub fields,
HTTPPutResponseHopLimit and HTTPTokens. These fields enable the user
to disable IMDv1 for instances within an instance group.

By default, both IMDv1 and IMDv2 are enabled in instances in an instance group.
 2020-12-07 02:57:02 +05:30
Ciprian Hacman e11d934268 Add option to reuse existing Elastic IPs for NAT gateways 2020-12-06 09:37:17 +02:00
Ciprian Hacman fdf976809e Use pagination when listing LaunchTemplates 2020-11-09 21:41:58 +02:00
Ciprian Hacman ed37c34a92 Use LaunchTemplate id instead of name for ASGs 2020-11-09 21:41:56 +02:00
Ciprian Hacman 565adceab9 Use LaunchTemplate versions instead of timestamped LaunchTemplates 2020-11-09 21:40:33 +02:00
Peter Rifel 11bf3ff202
Add missing cloudmock functionality for enabling lifecycle integration test on complex cluster 2020-10-30 10:06:36 -05:00
Peter Rifel 839a1185cf
Create cloudmock implementations for elbv2 API calls used by future NLB support 2020-10-30 10:06:36 -05:00
Peter Rifel b81f9b290f
Add a test ensuring shared VPCs dont have unrelated CIDR blocks disassociated 2020-10-02 14:23:16 -05:00
Ole Markus With 80ef2473b5 Various mock fixes 2020-10-01 19:15:40 +02:00
Justin SB 786423f617 Expose JWKS via a feature-flag 
When the PublicJWKS feature-flag is set, we expose the apiserver JWKS
document publicly (including enabling anonymous access).  This is a
stepping stone to a more hardened configuration where we copy the JWKS
document to S3/GCS/etc.

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
 2020-08-30 10:15:11 -04:00
Ole Markus With 6615d55eb1 Remove duplicate code 2020-08-23 06:46:22 +02:00
Ole Markus With 8e5e3d4ea5 Mock create server should associate with mock ports 2020-08-22 22:08:02 +02:00
Ole Markus With 29682700c7 Don't use nova for glance mocks 
Fetching images through nova is deprecated and removed in newer versions
of the compute API. Mocks now reflect this behavior.
 2020-08-21 10:18:52 +02:00
Peter Rifel 4d9f0128a3
Upgrade to klog2 
This splits up the kubernetes 1.19 PR to make it easier to keep up to date until we get it sorted out.
 2020-08-16 20:56:48 -05:00
Ole Markus With 9890839cec Add an integration test for openstack floating ip 
* Integration test for floatingip cluster
* Implements mocking of floatingIP (only list for now)
* Expands various cloudmocks
* Fixes an NPR in openstack validation
* Fixes a bug where kops tries to use DNS even if the cluster is gossip
 2020-08-12 12:59:30 +02:00
Peter Rifel 230d870ad6
Implement CRUD logic for cloudmock openstack 
This is the bulk of the changes necessary to support openstack integration tests.

As mentioned in cloudmock/openstack/README.md, this involved a lot of wireshark to understand
how the gophercloud clients builds the requests and expects the responses.
 2020-08-10 15:22:49 -05:00
Kubernetes Prow Robot da710a0c3c
Merge pull request #9691 from rifelpet/openstack-cloudmock-part3 
Add an initial structure for openstack cloudmock
 2020-08-06 00:00:55 -07:00
Peter Rifel 23dc8383da
Add an initial structure for openstack cloudmock 
More info in the docs changes. This adds stubbed http handlers for every resource type used by Kops.
 2020-08-05 23:13:34 -05:00
John Gardiner Myers ae772c3bd9 Add missing locking in MockEC2 2020-08-04 20:40:13 -07:00
Peter Rifel 690f2e3605
Add keypair tag and ID support to cloudmock 2020-07-28 13:35:09 -05:00
Peter Rifel b1e7704d09
Use "lt-" IDs for launch templates and add tagging support 2020-07-08 08:53:01 -05:00
Peter Rifel 844626ae44
cloudmock - recognize and store tags provided in Create requests 2020-07-08 08:53:01 -05:00
Peter Rifel 7e34e786ce
cloudmock - use ResourceType constants that are now in aws-sdk-go 2020-07-08 08:53:01 -05:00
Peter Rifel a7d2161c0e
Add OIDC Provider awstask, mock, and resource lister and deleter 2020-06-16 14:36:56 -05:00
John Gardiner Myers 3ce8dd165b Use launch templates by default 2020-06-10 09:34:48 -07:00
Peter Rifel 64ef8c2d42
Add DescribeInstanceTypes to AWSCloud 2020-06-09 10:13:00 -05:00
John Gardiner Myers 9f9b98e9f4 Merge branch 'master' into surge 2020-02-17 09:17:26 -08:00
Matt Ouille f025ff0e70
Add External Policies (AWS managed policy attachments) 2020-02-16 21:54:12 -08:00
John Gardiner Myers 640f5f5b74 Terminate AWS instances through EC2 instead of Autoscaling 2020-01-27 20:15:10 -08:00
John Gardiner Myers e4082aaf4c Fix cloudmock/aws/mockelbv2 staticcheck failures 2019-12-28 21:25:29 -08:00
Kubernetes Prow Robot e29a04e5af
Merge pull request #7854 from FayerZhang/master 
fix golint failures
 2019-11-07 11:37:43 -08:00
John Gardiner Myers d8128d2d59 Fix behavior of mock DescribeAutoScalingGroups when no names supplied 2019-11-02 16:50:18 -07:00
feifei.zhang@huawei.com 4b49412105 fix golint failures 2019-10-31 20:22:37 +08:00
tanjunchen 43bf6bdab6 fix-up gosimple check error 2019-10-07 11:59:57 +08:00
chentanjun d47b4b6534 fix-typo 2019-09-25 21:34:24 +08:00
mikesplain 9e55b8230a Update copyright notices 
Also cleans some white spaces
 2019-09-09 14:47:51 -04:00
Justin SB 76d03b3f71
Generated files: glog -> klog 2019-05-06 12:56:03 -04:00
Justin SB 3e33ac7682
Change code from glog to klog 
We don't call klog.InitFlags yet, because that will cause a flag
redefinition error until we get everyone to stop using glog.  That
will happen when we update to k8s 1.13.
 2019-05-06 12:54:51 -04:00
Kubernetes Prow Robot e497f33104
Merge pull request #6809 from xichengliudui/update-go-const-part5 
Using const() defines constants together (part:3)
 2019-04-23 06:36:17 -07:00
Justin SB de581b1b64
Switch to golang 1.11.5 
For cherry-picking to 1.13

https://github.com/kubernetes/kubernetes/blob/release-1.13/build/build-image/cross/Dockerfile
 2019-04-20 17:36:56 -04:00
xichengliudui 16ee9c4342 Using const() defines constants together (part:3) 2019-04-20 05:02:21 -04:00
Rohith 6c3a125f9e - adding the ec2 mock methods for launch templates .. gosh 2019-02-05 12:22:57 +00:00
Justin SB 18d117d84e
cloudmock: replace unimplemented methods with interface embedding 
It's simpler, and it lets us move to newer versions of the AWS API more easily.
 2018-12-20 18:13:28 -05:00
Justin SB 1d14c361d1
Add missing locking to awsmock LaunchConfigurations 
Caused a test flake in #6121
 2018-11-27 10:17:34 -05:00
Justin Santa Barbara fa7b408607 cloudmock: govet fixes 2018-09-23 11:23:08 -04:00
k8s-ci-robot 2ad8588e51
Merge pull request #5635 from nareshku/support-albs-nlbs 
Support for deletion of aws resources albs nlbs during delete
 2018-09-21 11:40:33 -07:00
Naresh Kumar Amrutham 2242e4cd0a modified comments 2018-09-10 10:57:56 -07:00
Naresh Kumar Amrutham 22069c5d27 removed unwanted methods 2018-08-17 15:30:11 -07:00
Naresh Kumar Amrutham 504414dd1c include tests 2018-08-17 13:04:28 -07:00
wangxy518 79233c8e7e
Update iaminstanceprofile.go 2018-08-16 14:10:24 +08:00
Justin Santa Barbara a9eb6fed2e AWS: Delete old LaunchConfigurations 
We delete old AWS LaunchConfigurations when we see that we have more
than 3.  We add a feature flag KeepLaunchConfigurations to disable this
functionality, for backwards compatability.

Fixes #329
 2018-06-17 23:24:53 -04:00
Justin Santa Barbara 0234285826 Stub out EC2 & IAM interfaces 
This auto implements the new methods (they panic if called).  Technique
borrowed from mockelb (thanks @vainu-arto ).

Assuming this approach works, we can get rid of the annoying
unimplemented.go files.
 2018-06-03 22:08:41 -07:00
Justin Santa Barbara afa0577749 Check tags in lifecycle tests 
We want to make sure that everything owned is tagged as such, and that
some shared resources (in particular subnets) are tagged as such.
 2018-03-25 15:55:44 -04:00
k8s-ci-robot 01cacbd53c
Merge pull request #4786 from justinsb/refactor_discover_security_groups 
SecurityGroup deletion: recognize shared tags
 2018-03-25 08:33:01 -07:00
Justin Santa Barbara 8250cf0571 cloudmock: update to support tag-key query on securitygroup 2018-03-25 01:17:27 -04:00
Justin Santa Barbara e81e53b5b2 mockec2: allow elastic ip tagging 2018-03-25 00:01:41 -04:00
Justin Santa Barbara 1edd7d49fa Add deletion to lifecycle test 2018-03-24 16:30:40 -04:00
Justin Santa Barbara c8a8d72534 mockec2: more missing locking 2018-03-20 19:20:39 -04:00
k8s-ci-robot 4ab61d924f
Merge pull request #4712 from justinsb/cloudmock_rta_key 
cloudmock: fix prefix for RouteTableAssociation
 2018-03-19 21:49:02 -07:00
Justin Santa Barbara 0711df9de4 Improve logic around VPC detection 
Issue #4265
 2018-03-19 18:15:37 -04:00
Justin Santa Barbara b442b4222e cloudmock: fix prefix for RouteTableAssociation 
We were generating ids with two hyphens (rta--1)
 2018-03-18 17:11:47 -04:00
Justin Santa Barbara baf57f3d2b cloudmock: fix locking around vpcs and subnets 2018-03-18 10:25:25 -04:00
Justin Santa Barbara a46d981d81 More mocks - for shared VPC 2018-03-15 20:11:54 -04:00
k8s-ci-robot 4ad014647b
Merge pull request #4654 from justinsb/private_topology_roundtrip_test 
More mocks - sufficient for privatecalico to roundtrip
 2018-03-12 22:59:11 -07:00
k8s-ci-robot 3822992c32
Merge pull request #4655 from justinsb/cloudmock_docs 
Add README to say what cloudmock is
 2018-03-12 08:18:23 -07:00
Justin Santa Barbara ab7439b360 More mocks - sufficient for privatecalico to roundtrip 2018-03-11 23:12:22 -04:00
Justin Santa Barbara 5f828ae7ec Add README to say what cloudmock is 2018-03-11 17:35:54 -04:00
Justin Santa Barbara 85b972bc28 Fill out cloudmock to do a basic lifecycle test 2018-03-11 17:04:30 -04:00
Justin Santa Barbara 725bfc90ff Add new EC2 mock functions 2018-02-28 23:06:21 -05:00
Johannes Würbach 02855fc13f
Enable metrics for AutoScalingGroups 
Those metrics simplify monitoring the created ASGs and are free [0].

Enable them by default.

[0] https://aws.amazon.com/about-aws/whats-new/2016/08/free-auto-scaling-group-metrics-with-graphs/
 2018-01-25 20:06:10 +01:00
Albert 43efd9d07a Update aws-sdk-go to 1.12.57 2018-01-09 17:22:38 +08:00
Kubernetes Submit Queue e88496a248
Merge pull request #4061 from meringu/create-subnets 
Automatic merge from submit-queue.

Add --subnets and --utility-subnets to kops create cluster

This change adds two new options to `kops create cluster`

When specifying `--vpc`, `--subnets` can be specified as an unordered array of subnet ids. Kops will then look up the zones of the subnets to find which zone to add the subnet id to.

If `--topology private` is also specified, `--utility-subnets` can similarly be specified.

~If a zone was specified but a subnet wasn't given that matches the zone, then the subnet will be allocated a CIDR with the current behaviour.~ This case fails validation here 7bd0a6a703/pkg/apis/kops/validation/validation.go (L151)

I can add unit tests and docs changes if required, but I am keen to get feedback before I proceed much further.

I have only added support for AWS.

I have tested this by running a command similar to this:

```bash
kops create cluster \
  --zones=us-east-1a,us-east-1b,us-east-1c \
  --topology private \
  --master-zones=us-east-1a,us-east-1b,us-east-1c  \
  --vpc $vpc_id \
  --subnets subnet-111111,subnet-222222,subnet-333333 \
  --utility-subnets subnet-444444,subnet-555555,subnet-666666 \
  $cluster_hosted_zone_name
```

And the cluster spec was as expected.
 2017-12-18 21:12:59 -08:00
Henry Muru Paenga afc1b58722 Tests for create cluster in shared vpc 2017-12-15 18:29:20 +13:00
chrislovecnm c8c3926efa missing mockelb build file 2017-12-13 23:57:45 -07:00
Peter Rifel 3da1bdc069 Don't report an InternetGateway rename when using shared IGWs 
Adds test to confirm fixed behavior
 2017-12-06 16:36:35 -08:00
Kubernetes Submit Queue 23319a0974
Merge pull request #3941 from vainu-arto/private_dns_cert_fix 
Automatic merge from submit-queue.

When using private DNS add ELB name to the api certificate

This fixes issue #2032 by using the gossip paths with private dns as well:

* When creating the api server certificate, include the ELB hostname
* When generating kubeconfig, use the ELB hostname as the api server name
 2017-12-04 06:01:25 -08:00
Arto Jantunen 53669b8217 Make ELB somewhat mockable 2017-11-28 11:48:57 +02:00
Rodrigo Menezes 662dfb33e6 update cloudmock for aws-sdk-go v1.10.34 2017-11-18 18:01:34 -08:00