Commit Graph

605 Commits

Author SHA1 Message Date
Ciprian Hacman b0cb0c77d4 Update integration tests for "update cluster" 2021-01-15 15:51:02 +02:00
Ciprian Hacman 19514f431c Update integration tests for "create cluster" 2021-01-15 15:40:33 +02:00
Ciprian Hacman 65ebf4760d Update integration test for gp3 with etcd volumes 2021-01-15 09:53:10 +02:00
Ciprian Hacman e20900a2de Add CF integration test for gp3 volumes 2021-01-15 09:53:10 +02:00
Kubernetes Prow Robot d441149cd0
Merge pull request #10575 from srikiz/DO-Add-E2E-Tests
[DigitalOcean] add e2e tests
2021-01-14 06:39:04 -08:00
Ole Markus With afbd057286 Use consistent naming for the remaining SGRs 2021-01-14 12:57:33 +01:00
Srikanth Rao 6eda2a4d7f
Update tests/e2e/kubetest2-kops/do/zones.go
Co-authored-by: Peter Rifel <rifelpet@users.noreply.github.com>
2021-01-14 13:40:05 +05:30
Peter Rifel 59c312ff5f
Give kubetest2 its own makefile
Use GOOS and GOARCH for running the kops binary

Also try deploying and testing against k8s 1.20.2
2021-01-13 21:59:15 -06:00
srikiz d2aa454465 Add zones for DO 2021-01-14 01:24:50 +05:30
Kubernetes Prow Robot 8e5f71702d
Merge pull request #10559 from rifelpet/kubetest2-tester
kubetest2 - Add manifest template support
2021-01-13 10:50:36 -08:00
Kubernetes Prow Robot 09bf333433
Merge pull request #10567 from rifelpet/nlb-listener-order
Fix NLB listener -> target group association for TF & CF
2021-01-13 01:04:35 -08:00
Peter Rifel 580d73bdc7
Fix NLB listener -> target group association for TF & CF
The old code made the incorrect assumption that the NLB's list of TargetGroup tasks is in the same order as the NLB's list of listeners for their associations.
Because the model adds them in opposite orders this resulted in the TLS listener being forwarded to the TCP TG and vice versa.

This updates the terraform and cloudformation generation code to search the NLB's list of target groups by name for the target group that should be associated with the listener.
This matches the logic used in the "direct" target.
2021-01-12 23:21:55 -06:00
Peter Rifel 2cff487a6d
export admin credentials after creating cluster 2021-01-12 22:52:09 -06:00
Peter Rifel cef43d2002
Use kops create -f for creating clusters via manifest 2021-01-12 19:58:58 -06:00
Bharath Vedartham a8d709acf2 Default cgroup driver to systemd from k8s 1.20
Currently, kOps uses cgroupfs cgroup driver for the kubelet and CRIs. This PR defaults
the cgroup driver to systemd for clusters created with k8s versions >= 1.20.

Using systemd as the cgroup-driver is the recommended way as per
https://kubernetes.io/docs/setup/production-environment/container-runtimes/
2021-01-12 20:39:25 +05:30
Peter Rifel 196e678205
kubetest2 - Add manifest template support
I'm updating the test-e2e make target as I go to make the presubmit job use it but soon I'll work on how we'll actually configure and invoke kubetest2 from our variety of jobs
2021-01-11 21:53:21 -06:00
Peter Rifel f671acc5d6
Use anonymous struct for wrapping ginkgo.Tester 2021-01-10 18:41:40 -06:00
Peter Rifel 720dcb6428
Add troubleshooting statements 2021-01-10 18:41:40 -06:00
Peter Rifel 5074f327a2
Ensure pretestSetup is ran
I was wrapping the ginkgo tester functions in a way that pretestSetup was never actually being called
2021-01-10 11:34:40 -06:00
Peter Rifel 1ffc565526
Fix kubectl PATH element, add logging verbosity 2021-01-10 11:18:38 -06:00
Peter Rifel 17468d496f
Kubetest2 - use our own tester that wraps kubetest2's ginkgo tester
This allows us to share tester flags (package version and bucket) for downloading kubectl while passing them to the ginkgo tester
2021-01-09 23:44:26 -06:00
Kubernetes Prow Robot 7df2521a09
Merge pull request #10523 from justinsb/test_upgrade
Simple upgrade test using kubetest2 framework
2021-01-09 15:51:05 -08:00
Justin Santa Barbara 116f81c5c9 Simple upgrade test using kubetest2 framework
Starting very simple and hard-coded!

Co-authored-by: Peter Rifel <rifelpet@users.noreply.github.com>
2021-01-09 17:06:08 -05:00
Justin Santa Barbara b04b5f556c kubetest2: support specifying admin-access value
Otherwise I was getting my IPv6 address, which doesn't work well.
2021-01-09 13:12:37 -05:00
srikiz d0d41fa649 Rebase deployer changes 2021-01-09 00:45:29 +05:30
srikiz 6e507478b5 Add DO for e2e tests 2021-01-08 23:58:19 +05:30
Ole Markus With 2b3a8f133e Add control-plane node role annotation to cp nodes
Update docs/releases/1.20-NOTES.md

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
2021-01-08 12:39:42 +01:00
Kubernetes Prow Robot 0ca0e38518
Merge pull request #10424 from rifelpet/ebs-tf-012
Don't allow ebs volume TF resource names to begin with digit
2021-01-05 09:19:58 -08:00
Kubernetes Prow Robot 2e202badc5
Merge pull request #10361 from hakman/single-az-multi-master
Prefix etcd cluster names with letters
2021-01-05 07:51:58 -08:00
Kubernetes Prow Robot 551a805ebd
Merge pull request #10530 from hakman/gp3-throughput
Add possibility to set volume throughput for gp3 volumes
2021-01-05 04:53:58 -08:00
Ciprian Hacman a7bb949936 Add possibility to set volume throughput for gp3 volumes 2021-01-05 13:18:32 +02:00
Peter Rifel a15957da2f
IRSA - continue adding route53 permisions to masters
These are needed by protokube to create the kops-controller DNS record to allow nodes to bootstrap.

See these logs: https://storage.googleapis.com/kubernetes-jenkins/logs/e2e-kops-grid-scenario-public-jwks/1345956556562239488/artifacts/ip-172-20-48-1.sa-east-1.compute.internal/protokube.log

```
I0104 05:03:51.264472    6482 dnscache.go:74] querying all DNS zones (no cached results)
I0104 05:03:51.264570    6482 route53.go:53] AWS request: route53 ListHostedZones
W0104 05:03:51.389485    6482 dnscontroller.go:124] Unexpected error in DNS controller, will retry: error querying for zones: error querying for DNS zones: AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-kops-scenario-public-jwks.test-cncf-aws.k8s.io/i-05b1db10d1a5b8637 is not authorized to perform: route53:ListHostedZones
```

and the nodeup logs on nodes that couldn't join the cluster:

```
Jan 04 04:55:53.500187 ip-172-20-38-84 nodeup[2070]: W0104 04:55:53.500117    2070 executor.go:131] error running task "BootstrapClient/BootstrapClient" (9m52s remaining to succeed): Post "https://kops-controller.internal.e2e-kops-scenario-public-jwks.test-cncf-aws.k8s.io:3988/bootstrap": dial tcp: lookup kops-controller.internal.e2e-kops-scenario-public-jwks.test-cncf-aws.k8s.io on 127.0.0.53:53: no such host
```
2021-01-04 21:03:53 -06:00
Kubernetes Prow Robot 22c5975591
Merge pull request #10519 from seh/restrict-api-server-security-groups-to-masters
Only include API server additional security groups in InstanceGroups for masters
2021-01-04 14:15:58 -08:00
Kubernetes Prow Robot 137c8368d3
Merge pull request #10524 from justinsb/kubetest2_gce
kubetest2: add initial support for GCE
2021-01-04 10:51:56 -08:00
Justin Santa Barbara 28261a5dcc kubetest2: Pass through some AWS env vars
To run directly, I need to specify AWS_PROFILE.
2021-01-04 11:34:31 -05:00
Justin Santa Barbara 28184756c3 kubetest2: add initial support for GCE
Filling in some of the GCE-equivalents to the AWS code.
2021-01-04 11:32:12 -05:00
Steven E. Harris 76feb2e637 Correct integration test to reflect SG restriction 2021-01-04 08:38:25 -05:00
Peter Rifel cf74053426
Dump cluster and IG manifests into artifacts 2021-01-03 21:49:32 -06:00
Peter Rifel d8abaa77fd
cleanup some input validation error messages 2021-01-03 19:50:53 -06:00
Peter Rifel 0ac86d13e3
Support a --kubernetes-version flag that is passed to `kops create cluster` 2021-01-03 19:50:53 -06:00
Kubernetes Prow Robot 66fe512b69
Merge pull request #10504 from rifelpet/kubetest2-test
Run k/k's e2e suite via new kubetest2 make target
2020-12-31 09:17:51 -08:00
Kubernetes Prow Robot 22a9a13abf
Merge pull request #10488 from rifelpet/iam-role-tag
AWS IAM Role Tagging
2020-12-29 22:33:48 -08:00
Ciprian Hacman 01019f09ed Update integration tests 2020-12-28 21:11:34 +02:00
Ciprian Hacman 66039f150e Add containerd option for registry mirrors 2020-12-28 19:32:06 +02:00
Peter Rifel 95b7210e27
Dump cluster logs to artifacts directory 2020-12-28 11:29:39 -06:00
Peter Rifel 38215210c6
Run k/k's e2e suite via new kubetest2 make target 2020-12-27 13:25:27 -06:00
Ciprian Hacman c02e5a20ea Remove support for Kubenet with containerd 2020-12-27 18:21:16 +02:00
Peter Rifel 5406744c55
Update integration test output 2020-12-23 15:13:45 -06:00
Ciprian Hacman ff6a782303 Add config options for container runtime package URL and Hash 2020-12-23 13:29:22 +02:00
Ciprian Hacman eff2af2fe2 Update CNI plugins to v0.8.7 2020-12-21 11:07:57 +02:00