Commit Graph

618 Commits

Author SHA1 Message Date
Kubernetes Prow Robot 53c80ebae3
Merge pull request #10602 from justinsb/terraform_renamed
Require KOPS_TERRAFORM_0_12_RENAMED, to guard against tf breakage
2021-01-19 00:05:46 -08:00
Ciprian Hacman 3799d135a3 Fix tests and spelling 2021-01-19 09:06:02 +02:00
Peter Rifel c2bfc3b2ac
update skip listo 2021-01-18 22:39:58 -06:00
Peter Rifel 9b7f3fb54e
Use calico in upgrade test 2021-01-18 21:37:59 -06:00
Peter Rifel 18c684590f
Temporarily set kops-version-marker on presubmit job
This should have kubetest use the kops binary and base url used in periodic jobs rather than building it using the PR's HEAD
2021-01-18 21:37:59 -06:00
Peter Rifel 2235496423
revert kubernetes version marker support in upgrade test 2021-01-18 21:33:10 -06:00
Peter Rifel 3d31c1aa11
Add --kops-version-marker for specifying an existing kops version to download
This allows us to use kubetest2-kops in periodic jobs without rebuilding kops every time
2021-01-18 21:33:10 -06:00
Peter Rifel 0ca76f91f8
Move http utils to pkg/util 2021-01-18 21:11:02 -06:00
Peter Rifel 3f0fb7f80d
Only require --kubernetes-version for --up not --test 2021-01-18 20:57:47 -06:00
Peter Rifel 2d365b4543
Add --networking flag 2021-01-18 20:56:52 -06:00
Kubernetes Prow Robot 470ff01ec0
Merge pull request #10600 from rifelpet/kubetest-upgrade
Provide required --kubernetes-version flags to kubetest2-kops --up
2021-01-18 08:59:44 -08:00
Peter Rifel 6f2260bee4
Provide required --kubernetes-version flags to kubetest2-kops --up
Also use version markers rather than hard-coded patch versions

Also dropping the --kubenretes-version requirement for kubetest2-kops --test because it is never used. Initially I was thinking we could use it to determine the e2e.test version to pull down but the ginkgo tester has its own --test-package-* flags for that. Perhaps in the future we can consolidate them into just the --kubernetes-version flag

Hoping to fix this periodic job: https://prow.k8s.io/view/gcs/kubernetes-jenkins/logs/e2e-kops-aws-misc-upgrade/1351188585260257280

```
 Error: missing required --kubernetes-version flag
```

No
2021-01-18 10:19:28 -06:00
Barry Melbourne 337c9c4c66 Set default container runtime to containerd 2021-01-16 14:55:35 +00:00
Ciprian Hacman b0cb0c77d4 Update integration tests for "update cluster" 2021-01-15 15:51:02 +02:00
Ciprian Hacman 19514f431c Update integration tests for "create cluster" 2021-01-15 15:40:33 +02:00
Ciprian Hacman 65ebf4760d Update integration test for gp3 with etcd volumes 2021-01-15 09:53:10 +02:00
Ciprian Hacman e20900a2de Add CF integration test for gp3 volumes 2021-01-15 09:53:10 +02:00
Kubernetes Prow Robot d441149cd0
Merge pull request #10575 from srikiz/DO-Add-E2E-Tests
[DigitalOcean] add e2e tests
2021-01-14 06:39:04 -08:00
Ole Markus With afbd057286 Use consistent naming for the remaining SGRs 2021-01-14 12:57:33 +01:00
Srikanth Rao 6eda2a4d7f
Update tests/e2e/kubetest2-kops/do/zones.go
Co-authored-by: Peter Rifel <rifelpet@users.noreply.github.com>
2021-01-14 13:40:05 +05:30
Peter Rifel 59c312ff5f
Give kubetest2 its own makefile
Use GOOS and GOARCH for running the kops binary

Also try deploying and testing against k8s 1.20.2
2021-01-13 21:59:15 -06:00
srikiz d2aa454465 Add zones for DO 2021-01-14 01:24:50 +05:30
Kubernetes Prow Robot 8e5f71702d
Merge pull request #10559 from rifelpet/kubetest2-tester
kubetest2 - Add manifest template support
2021-01-13 10:50:36 -08:00
Kubernetes Prow Robot 09bf333433
Merge pull request #10567 from rifelpet/nlb-listener-order
Fix NLB listener -> target group association for TF & CF
2021-01-13 01:04:35 -08:00
Peter Rifel 580d73bdc7
Fix NLB listener -> target group association for TF & CF
The old code made the incorrect assumption that the NLB's list of TargetGroup tasks is in the same order as the NLB's list of listeners for their associations.
Because the model adds them in opposite orders this resulted in the TLS listener being forwarded to the TCP TG and vice versa.

This updates the terraform and cloudformation generation code to search the NLB's list of target groups by name for the target group that should be associated with the listener.
This matches the logic used in the "direct" target.
2021-01-12 23:21:55 -06:00
Peter Rifel 2cff487a6d
export admin credentials after creating cluster 2021-01-12 22:52:09 -06:00
Peter Rifel cef43d2002
Use kops create -f for creating clusters via manifest 2021-01-12 19:58:58 -06:00
Bharath Vedartham a8d709acf2 Default cgroup driver to systemd from k8s 1.20
Currently, kOps uses cgroupfs cgroup driver for the kubelet and CRIs. This PR defaults
the cgroup driver to systemd for clusters created with k8s versions >= 1.20.

Using systemd as the cgroup-driver is the recommended way as per
https://kubernetes.io/docs/setup/production-environment/container-runtimes/
2021-01-12 20:39:25 +05:30
Peter Rifel 196e678205
kubetest2 - Add manifest template support
I'm updating the test-e2e make target as I go to make the presubmit job use it but soon I'll work on how we'll actually configure and invoke kubetest2 from our variety of jobs
2021-01-11 21:53:21 -06:00
Peter Rifel f671acc5d6
Use anonymous struct for wrapping ginkgo.Tester 2021-01-10 18:41:40 -06:00
Peter Rifel 720dcb6428
Add troubleshooting statements 2021-01-10 18:41:40 -06:00
Peter Rifel 5074f327a2
Ensure pretestSetup is ran
I was wrapping the ginkgo tester functions in a way that pretestSetup was never actually being called
2021-01-10 11:34:40 -06:00
Peter Rifel 1ffc565526
Fix kubectl PATH element, add logging verbosity 2021-01-10 11:18:38 -06:00
Peter Rifel 17468d496f
Kubetest2 - use our own tester that wraps kubetest2's ginkgo tester
This allows us to share tester flags (package version and bucket) for downloading kubectl while passing them to the ginkgo tester
2021-01-09 23:44:26 -06:00
Kubernetes Prow Robot 7df2521a09
Merge pull request #10523 from justinsb/test_upgrade
Simple upgrade test using kubetest2 framework
2021-01-09 15:51:05 -08:00
Justin Santa Barbara 116f81c5c9 Simple upgrade test using kubetest2 framework
Starting very simple and hard-coded!

Co-authored-by: Peter Rifel <rifelpet@users.noreply.github.com>
2021-01-09 17:06:08 -05:00
Justin Santa Barbara b04b5f556c kubetest2: support specifying admin-access value
Otherwise I was getting my IPv6 address, which doesn't work well.
2021-01-09 13:12:37 -05:00
srikiz d0d41fa649 Rebase deployer changes 2021-01-09 00:45:29 +05:30
srikiz 6e507478b5 Add DO for e2e tests 2021-01-08 23:58:19 +05:30
Ole Markus With 2b3a8f133e Add control-plane node role annotation to cp nodes
Update docs/releases/1.20-NOTES.md

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
2021-01-08 12:39:42 +01:00
Kubernetes Prow Robot 0ca0e38518
Merge pull request #10424 from rifelpet/ebs-tf-012
Don't allow ebs volume TF resource names to begin with digit
2021-01-05 09:19:58 -08:00
Kubernetes Prow Robot 2e202badc5
Merge pull request #10361 from hakman/single-az-multi-master
Prefix etcd cluster names with letters
2021-01-05 07:51:58 -08:00
Kubernetes Prow Robot 551a805ebd
Merge pull request #10530 from hakman/gp3-throughput
Add possibility to set volume throughput for gp3 volumes
2021-01-05 04:53:58 -08:00
Ciprian Hacman a7bb949936 Add possibility to set volume throughput for gp3 volumes 2021-01-05 13:18:32 +02:00
Peter Rifel a15957da2f
IRSA - continue adding route53 permisions to masters
These are needed by protokube to create the kops-controller DNS record to allow nodes to bootstrap.

See these logs: https://storage.googleapis.com/kubernetes-jenkins/logs/e2e-kops-grid-scenario-public-jwks/1345956556562239488/artifacts/ip-172-20-48-1.sa-east-1.compute.internal/protokube.log

```
I0104 05:03:51.264472    6482 dnscache.go:74] querying all DNS zones (no cached results)
I0104 05:03:51.264570    6482 route53.go:53] AWS request: route53 ListHostedZones
W0104 05:03:51.389485    6482 dnscontroller.go:124] Unexpected error in DNS controller, will retry: error querying for zones: error querying for DNS zones: AccessDenied: User: arn:aws:sts::768319786644:assumed-role/masters.e2e-kops-scenario-public-jwks.test-cncf-aws.k8s.io/i-05b1db10d1a5b8637 is not authorized to perform: route53:ListHostedZones
```

and the nodeup logs on nodes that couldn't join the cluster:

```
Jan 04 04:55:53.500187 ip-172-20-38-84 nodeup[2070]: W0104 04:55:53.500117    2070 executor.go:131] error running task "BootstrapClient/BootstrapClient" (9m52s remaining to succeed): Post "https://kops-controller.internal.e2e-kops-scenario-public-jwks.test-cncf-aws.k8s.io:3988/bootstrap": dial tcp: lookup kops-controller.internal.e2e-kops-scenario-public-jwks.test-cncf-aws.k8s.io on 127.0.0.53:53: no such host
```
2021-01-04 21:03:53 -06:00
Kubernetes Prow Robot 22c5975591
Merge pull request #10519 from seh/restrict-api-server-security-groups-to-masters
Only include API server additional security groups in InstanceGroups for masters
2021-01-04 14:15:58 -08:00
Kubernetes Prow Robot 137c8368d3
Merge pull request #10524 from justinsb/kubetest2_gce
kubetest2: add initial support for GCE
2021-01-04 10:51:56 -08:00
Justin Santa Barbara 28261a5dcc kubetest2: Pass through some AWS env vars
To run directly, I need to specify AWS_PROFILE.
2021-01-04 11:34:31 -05:00
Justin Santa Barbara 28184756c3 kubetest2: add initial support for GCE
Filling in some of the GCE-equivalents to the AWS code.
2021-01-04 11:32:12 -05:00
Steven E. Harris 76feb2e637 Correct integration test to reflect SG restriction 2021-01-04 08:38:25 -05:00