Commit Graph

485 Commits

Author SHA1 Message Date
Kubernetes Prow Robot f32503e413
Merge pull request #12919 from olemarkus/cilium-11-default
Use Cilium 1.11 as default
2022-04-06 04:18:56 -07:00
Ole Markus With 2e3c9f3a36 Don't hash parts of the cluster name for e2e
Previously we hashed the name because the IAM role names otherwise
became too large. This has since been fixed. We want to avoid hashing to
better understand what tests/runs may leak resources.
2022-04-03 12:44:01 +02:00
Ole Markus With dcb35cdc85 Bump semver for kubetest2 2022-03-31 21:47:25 +02:00
Ole Markus With f10ec875ab Skip upstream e2e log dump 2022-03-30 08:52:35 +02:00
Ole Markus With 9d62968919 Skip expected failure on cilium 1.11 2022-03-29 19:22:10 +02:00
Ole Markus With e657a1a0f2 Remap images to add digest to them 2022-03-26 18:40:21 +01:00
Ciprian Hacman 3da84d4480 Update golangci-lint to v1.45.0
Signed-off-by: Ciprian Hacman <ciprian@hakman.dev>
2022-03-23 11:38:46 +02:00
Bronson Mirafuentes 83d0d63784 update k8s dependencies 2022-03-21 11:45:02 -07:00
srikiz b0b7ca8992 Use available regions as per the latest DO documentation 2022-03-20 20:08:24 +05:30
Kubernetes Prow Robot 65694b20b8
Merge pull request #13234 from spotinst/feat-ocean-template
Spotinst: Ocean as a template for VNGs
2022-03-19 00:45:08 -07:00
srikiz ef092b7b6a Add more supported regions for e2e tests 2022-03-18 00:08:17 +05:30
srikiz f6072832cb Remove sfo2 region from the list of supported DO regions 2022-03-18 00:03:43 +05:30
Ole Markus With dbe860bbfd If kubetest2 fails cluster validation, we run down before exiting 2022-03-16 19:48:45 +01:00
srikiz 28a5d7e53a Fix seeding for generating random zones 2022-03-15 00:19:48 +05:30
Ole Markus With c7f8bee350 Add e2e for pod identity webhook 2022-03-05 14:33:32 +01:00
Kubernetes Prow Robot b79157ff43
Merge pull request #13059 from johngmyers/api-cloudprovider
Make cloudProvider a struct in v1alpha3 API
2022-03-03 14:57:15 -08:00
Ole Markus With bd9230a809 Bump AWS SDK to v1.43.11 2022-03-03 20:39:26 +01:00
John Gardiner Myers cac727c357 Make cloudProvider a struct in v1alpha3 API 2022-03-02 21:59:49 -08:00
liranp 55de5a31bf
feat(spot): ocean as a template for vngs 2022-03-02 21:37:45 +02:00
Ole Markus With 4023114ce7 Update kubetest2 deps 2022-03-01 21:18:01 +01:00
Ole Markus With 9b84ee2554 Use current tree in presubmit upgrade jobs if version b is latest 2022-02-19 08:46:11 +01:00
Indeed 183098fc05 run test with pure kubetest2 2022-02-17 07:06:33 -08:00
Kubernetes Prow Robot 156941d416
Merge pull request #13267 from olemarkus/lbc-124
Update LBC to 2.4.0
2022-02-16 22:07:36 -08:00
Ole Markus With 9431c0ab69 Update LBC to 2.4.0 2022-02-16 21:39:31 +01:00
Indeed 0be7443944 re-organize the test with kubetest2-tester-exec. 2022-02-16 09:04:37 -08:00
Indeed 1aa8b3b518 make CLUSTER_NAME and KOPS_STATE_STORE optional.
because these may be filled from kubetest2.
2022-02-16 09:03:29 -08:00
Jiahui Feng e832b4dc19 service account workaround for gce. 2022-02-15 12:13:37 -08:00
Jiahui Feng 39d4b68609 generated: go mod tidy
with go1.17.7
2022-02-14 15:38:57 -08:00
Jiahui Feng 5948ab6c9a test fixtures and script. 2022-02-14 15:38:12 -08:00
Jiahui Feng 1496708358 a recorder to observe the leader migration. 2022-02-14 15:37:34 -08:00
Ole Markus With c88f9995a6 Update metrics-server e2e test for 0.6.0 2022-02-12 20:21:50 +01:00
Kubernetes Prow Robot ce5539c8ff
Merge pull request #13237 from jiahuif-forks/feature/test-gcp-project-env
allow specify GCP project via env.
2022-02-11 21:25:47 -08:00
Jiahui Feng 1eb7b3a2af allow specify GCP project via env. 2022-02-11 14:59:44 -08:00
Ole Markus With 2625264fe5 Add support for graceful node shutdown
Update docs/cluster_spec.md

Co-authored-by: Ciprian Hacman <ciprianhacman@gmail.com>
2022-02-11 20:51:02 +01:00
Ole Markus With 709e0bf36a Use short commit sha for default stage location instead of git-describe 2022-02-05 12:36:19 +01:00
Kubernetes Prow Robot 4afc826e33
Merge pull request #13174 from olemarkus/ab-version
Add support for AB tests starting out with released kops version
2022-02-03 18:27:59 -08:00
Nick Turner 84f41e424a More descriptive error message when public key file can't be opened 2022-02-02 03:08:16 -08:00
Ole Markus With 7620c232d8 Add support for AB tests starting out with released kops version 2022-01-31 19:51:29 +01:00
Kubernetes Prow Robot 6ed628cff2
Merge pull request #13154 from olemarkus/bump-cas-2232
Bump cert-manager and related godep to 1.6.2
2022-01-27 09:57:59 -08:00
Ole Markus With 3fe8a56291 Add missing v prefix to default upgrade test version 2022-01-27 12:02:31 +01:00
Ole Markus With 85a7877666 Bump cert-manager and related godep to 1.6.2 2022-01-26 20:28:23 +01:00
Jin c17ddb1600 Update to aws-sdk-go to v1.42.37 2022-01-21 00:36:31 +08:00
Jesse Haka 2bad52ea8c update deps 2021-12-29 13:22:05 +02:00
Ciprian Hacman d3bdba29e1 Update k8s dependencies to v1.23.1 2021-12-23 14:56:18 +02:00
Peter Rifel 7474a727e8
kubetest2 - Use the same binary path and env when fetching instance groups
The GetInstanceGroup function was used in kubetest2-tester-kops which has the desired `kops` set in PATH and KOPS_STATE_STORE already set.
Now that we're using GetInstanceGroups in kubetest2-kops (the deployer) we need to override these to the values that the deployer determines.
2021-12-20 20:34:48 -06:00
Kubernetes Prow Robot 681b5006d6
Merge pull request #13008 from olemarkus/skip-sctp-check
Skip SCTP check for all versions of k8s 1.23/1.24
2021-12-20 00:31:25 -08:00
Ole Markus With 244aadd4fb Skip SCTP check for all versions of k8s 1.23/1.24 2021-12-20 08:50:18 +01:00
Peter Rifel 7c55698a36
Add kubetest2-kops flags for overriding instance group fields
This allows us to disable IMDSv2 on flatcar tests
2021-12-19 16:26:46 -06:00
Ciprian Hacman 1e565d8d83 Skip RuntimeClass tests for older Kubernetes versions 2021-12-19 21:38:52 +02:00
justinsb b2cfc5c4c4 dep: update github.com/pkg/sftp
This picks up changes to use go errors, instead of the (deprecated?)
pkg/errors.
2021-12-18 19:37:16 -05:00
Ciprian Hacman 2cb6e0e0d4 Do not skip RuntimeClass tests 2021-12-15 16:39:41 +02:00
Ciprian Hacman c177ab09c2 Do not skip HPA tests 2021-12-15 10:21:22 +02:00
Ciprian Hacman e529bac103 Update controller-runtime to v0.11.0 2021-12-15 07:49:53 +02:00
Kubernetes Prow Robot 8aed137a50
Merge pull request #12960 from hakman/unskip_calico_nodeport
Do not skip NodePort tests for Calico
2021-12-14 06:37:48 -08:00
Ciprian Hacman 8a6ac67739 Do not skip NodePort tests for Calico 2021-12-14 10:29:20 +02:00
Ciprian Hacman 07ae296531 Do not explicitly skip Dashboard tests 2021-12-14 10:27:55 +02:00
Ciprian Hacman 133177f0c1 Skip IPv6 LB test in the k/s e2e 2021-12-13 15:56:19 +02:00
John Gardiner Myers a0736b3c29 Remove support for Aliyun/Alibaba Cloud 2021-12-11 21:49:13 -08:00
Kubernetes Prow Robot 9e9c8d5713
Merge pull request #12891 from justinsb/fix_e2e_flake_zone
e2e: fix test flakes where we specify a non-schedulable zone
2021-12-10 10:37:11 -08:00
justinsb 57f14f4d23 e2e: fix test flakes where we specify a non-schedulable zone
If we specify a zone to the e2e tests, it will try to pre-provision
volumes into it for the inline tests.  We then will be unable to
attach a volume to test pods if we don't have (normal) nodes in that
zone.

Pick a zone that is schedulable for test pods.
2021-12-10 12:56:23 -05:00
Ciprian Hacman 620426bf84 Update k8s dependencies to v1.23.0 2021-12-08 00:22:34 +02:00
Ciprian Hacman 87ac5ceb47 Update k8s dependencies to v1.23.0-rc.1 2021-12-04 16:45:47 +02:00
Ciprian Hacman 6adf0dc7a4 Update controller-runtime to v0.11.0-beta.0 2021-12-04 05:46:45 +02:00
Ciprian Hacman e27c412834 Update k8s dependencies to v1.23.0-rc.0 2021-12-03 22:46:44 +02:00
justinsb 88918791ac tests gce: fix project arg on gsutil rm
Because we don't actually need to pass the project when deleting
objects (as it can be inferred from the bucket), the syntax for
passing it is a little different.
2021-12-02 08:35:13 -05:00
Kubernetes Prow Robot 0be79b25b7
Merge pull request #12867 from hakman/gofumpt_script
Add gofumpt scripts
2021-12-01 22:13:32 -08:00
Ciprian Hacman ea7df00719 Run hack/update-gofmt.sh 2021-12-01 22:39:50 +02:00
Peter Rifel 75a6866f40
Skip e2e tests that can't be configured with the required topology keys 2021-12-01 13:10:46 -06:00
Kubernetes Prow Robot 87f6b6545f
Merge pull request #12531 from rifelpet/ebs140
Stop skipping snapshot fields tests in EBS CSI e2e
2021-11-30 06:00:56 -08:00
John Gardiner Myers 3b53c2d1c8 Fix upgrade tests to kops version < 1.22 2021-11-29 17:26:22 -08:00
Peter Rifel 5a37ff5932
Use same instance types as upstream EBS CSI tests 2021-11-29 15:36:49 -08:00
Peter Rifel d90ba4f84b
Stop skipping snapshot fields tests in EBS CSI e2e 2021-11-29 15:36:48 -08:00
John Gardiner Myers ad46b4d5bd Revert "Open nodeport to IPv6 in e2e tests"
This reverts commit 064fd9215c.
2021-11-28 19:21:35 -08:00
Kubernetes Prow Robot a1ff0953f4
Merge pull request #12848 from johngmyers/nodeport-ipv6
Open nodeport to IPv6 in e2e tests
2021-11-27 17:11:21 -08:00
John Gardiner Myers 064fd9215c Open nodeport to IPv6 in e2e tests 2021-11-27 15:54:23 -08:00
John Gardiner Myers b44a5b0747 Fix e2e scenario tests 2021-11-27 15:26:19 -08:00
Kubernetes Prow Robot 430df843ce
Merge pull request #12840 from johngmyers/fix-lbc-test
Pin the aws-lb-controller scenario to k8s 1.21
2021-11-26 19:00:41 -08:00
John Gardiner Myers 0f676c553c Pin the aws-lb-controller scenario to k8s 1.21 2021-11-26 12:09:52 -08:00
John Gardiner Myers 53502a5a4d Fix upgrade tests with dest kOps version < 1.22 2021-11-26 11:14:48 -08:00
Peter Rifel 0beadefb7d
Skip SCTP test on cilium clusters in k8s 1.24 as well 2021-11-25 20:42:52 -08:00
John Gardiner Myers b5e4d5206c Upgrade aws-sdk-go to v1.42.11 2021-11-23 20:17:37 -08:00
Ole Markus With b127f958e4 Bump cert-manager godep to 1.6.1 2021-11-18 19:22:50 +01:00
justinsb 0c42630f30 e2e tests: recognize a full KOPS_BASE_URL as a KOPS_VERSION
This allows us to easily test arbitrary versions (e.g. PR builds)
2021-11-18 10:31:57 -05:00
Jesse Haka c7e0585e3a update gophercloud deps 2021-11-16 17:10:04 +02:00
John Gardiner Myers 0c08f047ba Upgrade aws-sdk-go to v1.42.5 2021-11-15 18:05:50 -08:00
justinsb b74ad8dade Remove dependencies on k8s.io/code-generator 2021-11-15 10:44:43 -05:00
Eng Zer Jun 425173ae9f
refactor: move from io/ioutil to io and os packages
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil. This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2021-11-12 15:37:18 +08:00
Peter Rifel 030a657690
Add --request-timeout to some kubectl commands to shorten wait times when the cluster isnt up 2021-11-02 06:37:20 -05:00
Peter Rifel 13af636d57
kubetest2 dumplogs - Make directories prior to creating files in them
Also cleanup some error handling so that the remaining teardown steps can run even if dumplogs fails
2021-11-02 06:36:39 -05:00
Peter Rifel ddb32519c9
Log `kops toolbox dump` output to artifacts dir rather than stdout
This should reduce some of the verbose clutter in the job logs during cluster teardown
2021-10-29 17:47:45 -05:00
Kubernetes Prow Robot 26f2f9a1d8
Merge pull request #12631 from rifelpet/kubetest-more-resources
Dump more resource types from kubectl into cluster-info directory
2021-10-28 21:12:52 -07:00
Peter Rifel 422fbc571a
Dump more resource types from kubectl into cluster-info directory
`kubectl cluster-info dump` only covers some resource types. These additional resource types should help with troubleshooting prow jobs.
2021-10-28 22:31:17 -05:00
Kubernetes Prow Robot f61fc88ec8
Merge pull request #12624 from justinsb/up_show_plan
kubetest2: force printing of the plan on cluster creation
2021-10-28 07:20:27 -07:00
justinsb 005d070f80 kubetest2: remove duplicate admin-access flag
It was being specified twice.
2021-10-28 08:37:00 -04:00
justinsb 6c14d0f6ef kubetest2: Add --admin flag to update 2021-10-28 08:36:05 -04:00
justinsb c0b4de5feb kubetest2: force printing of the plan on cluster creation
When we run create with --yes, we skip printing the plan.  Instead, we
run a "normal" create, and then run an update.

We don't touch the terraform case, as there may be issues here and we
want to tackle those separately.
2021-10-27 23:36:30 -04:00
Kubernetes Prow Robot 10e2f7a159
Merge pull request #12498 from justinsb/bazel-bin
Use .bazel-bin to help gopls & VSCode
2021-10-27 01:11:26 -07:00
justinsb 05ae9aa5b4 Use .bazel-bin to help gopls & VSCode
This means that gopls will ignore the bazel-* symlinks, in particular
when using the go LSP plugin (gopls) with VSCode.

Idea from https://bitworking.org/news/2021/06/bazel-and-gopls/
2021-10-26 08:04:06 -04:00
justinsb 59d6174eb2 gce: don't try to specify a pre-existing network
We now automatically create a network if an existing one is not
specified.
2021-10-24 21:31:32 -04:00
Kubernetes Prow Robot 727cdf73ad
Merge pull request #12156 from justinsb/prune_via_labels
Prune addons via labels
2021-10-22 12:54:43 -07:00
Peter Rifel f3170d6dbd
Upgrade tests - cleanup previous cluster with newer kops version
This way if any additional VFS files are introduced in newer kops versions, the files can be cleaned up without having the older kops version fail to recognize the orphaned files.
2021-10-20 16:35:41 -07:00
Ciprian Hacman 7f0bdc09d3 Update google/go-containerregistry to v0.6.0 2021-10-20 15:41:38 +03:00
justinsb 50cd7152d9 resource-tracking e2e: fixup bash conditions 2021-10-15 17:47:19 -04:00
justinsb 7eda9a41c5 kubetest2-kops: get KOPS_BASE_URL in non-periodic jobs
Otherwise we're not using the version we just built
2021-10-15 17:47:13 -04:00
justinsb d90885e7b8 Update addon-resource-tracking test to roll control plane
Otherwise we don't get the new version of channels that supports pruning.
2021-10-15 17:47:13 -04:00
Ole Markus With 7a7aa77b44 Bump cert-manager dependency 2021-10-14 20:46:36 +02:00
Ole Markus With cd45a2191d Update ebs csi scenario to use latest tag 2021-10-13 20:44:43 +03:00
Kubernetes Prow Robot c4a8601916
Merge pull request #12520 from rifelpet/addon-resource-tracking
Fix addon-resource-tracking e2e scenario
2021-10-11 08:02:40 -07:00
Peter Rifel eb883bb149
Fix addon-resource-tracking e2e scenario 2021-10-11 09:19:36 -05:00
Ciprian Hacman 6bd597f372 Convert go.mod files to Go 1.17 2021-10-09 06:27:27 +03:00
justinsb 4dc2c062fd Support GCE TPM verification 2021-10-06 08:40:20 -04:00
Ciprian Hacman 206211e6c8 Update controller-runtime to v0.10.2 2021-10-05 18:52:34 +03:00
Ciprian Hacman 97ecd445a5 Update k8s dependencies to v1.22.2 2021-10-05 08:55:17 +03:00
Peter Rifel eeda5f927d
Skip load balancer test in IPv6 clusters 2021-09-30 15:41:47 -05:00
Peter Rifel 08ad2c6765
Skip certain e2e tests in GCE
These tests will never work with how kOps configures GCE clusters, so skip them for now
2021-09-27 22:28:54 -05:00
Kubernetes Prow Robot 25f43e194d
Merge pull request #12428 from rifelpet/apiserver-e2e
Add kubetest2-kops template for testing dedicated APIServer nodes
2021-09-27 11:17:45 -07:00
Peter Rifel cfdfb65e04
Allow api-server taint in e2e tests 2021-09-27 10:12:40 -05:00
Peter Rifel 6dd0d99f9b
Include --name in `kops toolbox template` 2021-09-27 10:12:40 -05:00
Peter Rifel d1148bce67
Add kubetest2-kops template for testing dedicated APIServer nodes 2021-09-27 10:12:40 -05:00
justinsb 464879a405 Update google.golang.org/api to 0.57.0
In particular, we want the vTPM (shielded VM) support.
2021-09-26 09:39:10 -04:00
Ole Markus With 5cdcff163c Add sleep to upgrade-ab scenario 2021-09-22 19:51:30 +02:00
Peter Rifel e423650857
Fix parsing output of kops toolbox dump 2021-09-21 08:54:52 -05:00
Peter Rifel 6deeda1ea2
Fix parsing of kops toolbox dump yaml output
Also add logging to help troubleshoot which command is failing
2021-09-20 07:06:08 -05:00
Kubernetes Prow Robot 3101180638
Merge pull request #12372 from rifelpet/dump-k8s-ssh
kubetest2 - add support for dumping k8s resources via SSH
2021-09-19 21:26:09 -07:00
Peter Rifel 5526744471
kubetest2 - add support for dumping k8s resources via SSH
Some of our jobs are currently failing because `kops validate cluster` times out waiting for the k8s API DNS record to be updated.
To assist in troubleshooting, we can get insight into the k8s resources present on the cluster even though the DNS record hasnt been set if we use kubectl on the control plane host via SSH.

This will SSH into a control plane host when the local kubectl dump fails.
2021-09-19 18:21:37 -05:00
Peter Rifel cf16b4a6bf
Fix version check in cilium SCTP test skipping 2021-09-19 09:12:05 -05:00
Peter Rifel 8d14376708
Skip SCTP e2e tests on cilium + k8s 1.23 2021-09-17 19:30:20 -05:00
Peter Rifel 62a232866b
Upgrade hcl to 2.10.1 2021-09-12 07:32:30 -04:00
Ole Markus With bba3c3abfe Bump aws ebs csi driver to 1.2.1 2021-09-11 14:15:31 +02:00
Peter Rifel d2c8d4a4fb
Update aws-sdk-go 2021-09-08 10:39:04 -05:00
Ciprian Hacman fd9e5659ed Update controller-runtime to v0.9.7 2021-09-04 09:25:44 +03:00
Peter Rifel 5e04f20ce1
Update metrics-server tag used in e2e scenario 2021-08-31 21:03:03 -05:00
Peter Rifel 407df76ac9
Update all e2e scenario tests to use k8s 1.22 2021-08-27 11:50:04 -05:00
Kubernetes Prow Robot 2222e22a08
Merge pull request #12165 from rifelpet/metricsgrabber-condition
Fix MetricsGrabber skip regex condition
2021-08-19 19:15:24 -07:00
Peter Rifel a80855ce3c
Fix scaling of metrics-server deployment in e2e scenario 2021-08-17 06:51:26 -05:00
Peter Rifel 7936cc48c5
Fix unbound variable in metrics server scenario 2021-08-16 23:24:43 -05:00
Peter Rifel 11e3571263
Fix MetricsGrabber skip regex condition
The release/latest version marker will stay on 1.23.0-alpha.0 until another 1.23 pre-release is tagged which isnt for a while.
This will skip the MetricsGrabber test for that tag which has been fixed in master. Once a new 1.23 pre-release has been tagged we can remove this.

Alternatively we migrate all jobs off of the release/latest version marker since it isn't particularly valuable.
2021-08-16 22:20:14 -05:00
Peter Rifel feb41cad0c
Make metrics-server scenario executable 2021-08-16 17:58:52 -05:00
Ole Markus With caf46fef6a Bump AWS CSI Driver to 1.2.0 2021-08-13 11:14:05 +02:00
Ole Markus With f27c8bd21f Add e2e scenario for metrics-server 2021-08-12 12:22:25 +02:00
Ole Markus With 6a1b58666c Set IRSA flag on scenarios where needed 2021-08-11 12:42:57 +02:00
Kubernetes Prow Robot 64f00d71ae
Merge pull request #12109 from olemarkus/useserviceaccountexternalpermissions
Remove UseServiceAccountIAM feature flag and rename feature to UseServiceAccountExternalPermissions
2021-08-07 15:13:30 -07:00
Ole Markus With 0439bb0d76 Remove UseServiceAccountIAM feature flag and rename feature to UseServiceAccountExternalPermissions 2021-08-07 21:20:03 +02:00
Peter Rifel ce821a614f
In-line openstack loadbalancer feature detection
This was our only reliance on cloud-provider-openstack which depends on k8s.io/kubernetes.

With the logic in-lined, kops no longer has any indirect dependencies of k/k
2021-08-06 08:19:53 -04:00
Peter Rifel f10649f658
Stop skipping MetricsGrabber tests on CI k8s versions 2021-08-05 11:28:37 -04:00
Ciprian Hacman cf6ab7cd76 Skip GlusterFS tests 2021-08-05 07:26:24 +03:00
John Gardiner Myers 832e773324 Update Kubernetes dependencies to 1.22.0 2021-08-04 16:54:07 -07:00
Peter Rifel 6c71c234b0
Also skip MetricsGrabber tests on 1.23 version marker
ci/latest is already using 1.23 alpha tags so we need to skip these tests for 1.23 until the PR is merged
2021-08-03 08:38:19 -04:00
Peter Rifel 1e1db4d867
Kubetest2 scenarios - provide absolute path to kops binary
This allows the rest of the scenario to change directories and the "down" step still uses the correct location of the kops binary

This should fix https://prow.k8s.io/view/gs/kubernetes-jenkins/pr-logs/directory/pull-kops-e2e-aws-ebs-csi-driver/1413601399341584384
2021-08-02 22:10:08 -04:00
Peter Rifel 75b00eb2b2
Temporarily skip MetricsGrabber test
The fix won't make it into 1.22.0, instead slated for 1.22.1.
To avoid additional jobs failing (those that use release/stable k8s version marker) we can ignore the test now that the issue is known and the fix is ready to be merged.
2021-08-02 20:17:11 -04:00