Commit Graph

167 Commits

Author SHA1 Message Date
Arnaud M. 4decbdadd5 Allow override of the DNS domain used by the tests.
In order to move the kOps prowjobs to the new community infrastructure, we need to
be able to use a custom domain for the required AWS public zone.
2024-01-04 14:15:01 +00:00
Ciprian Hacman e67862cd65 test: Print the `create cluster` command 2024-01-02 10:32:04 +02:00
Kubernetes Prow Robot e37355cc73
Merge pull request #16196 from rifelpet/dumpk8s
Parallelize k8s resource dumps with kops toolbox dump
2023-12-31 09:27:31 +01:00
Peter Rifel 64f3e8a1b2
Stop dumping k8s resources with kubetest2-kops
Signed-off-by: Peter Rifel <pgrifel@gmail.com>
2023-12-30 19:22:54 -08:00
Peter Rifel 5ce9d0a321
Add cert-manager resource types to kubetest2-kops artifacts
Signed-off-by: Peter Rifel <pgrifel@gmail.com>
2023-12-27 20:19:33 -08:00
Ciprian Hacman b8a52fd36e Set validation interval only when higher than 10s 2023-12-27 13:16:18 +02:00
upodroid 3f17147571 add validation interval, cleanup 0 byte log files 2023-12-21 19:48:31 +00:00
Arnaud Meukam 5b3fbe7a7b
Allow EKS Pod identity env variables
Allow env variables required by EKS Pod identity for authentification
are passed to the kops binary.

See https://docs.aws.amazon.com/eks/latest/userguide/pod-id-how-it-works.html

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
2023-12-07 19:29:48 +01:00
Kubernetes Prow Robot 4d36cd2aff
Merge pull request #16133 from rifelpet/set-containerd-129
Only set containerd plugins on kops versions that include quote fixes
2023-11-30 15:52:18 +01:00
upodroid f76852048e limit jobname value to 80 2023-11-30 11:48:02 +00:00
Peter Rifel 797903d6ca
Only set containerd plugins on kops versions that include --set quote fixes 2023-11-29 21:45:36 -06:00
upodroid a09dc4c99a enable test handler for containerd runtime 2023-11-27 15:28:22 +00:00
justinsb e0622ba3a2 Support writing traces to a directory, wire it up in kubetest2
If given a directory, we can construct a reasonable name based on the
executable name, pid and timestamp.  Then this is relatively easy to
wire up from kubetest2, if we have an artifacts directory.
2023-11-18 09:12:19 -05:00
Peter Rifel b7befc1cb5
Don't get cluster --full when attempting leak cleanup
If a job's --down was interrupted, the state store can be in an inconsistent state.
This can cause `kops get cluster --full` to fail if certain additional objects are missing, yet `kops get cluster` would succeed.
We omit `--full` to ensure `kops get cluster` succeeds and leak cleanup is reattempted.
2023-11-13 21:19:49 -06:00
Kubernetes Prow Robot 21b9af6e56
Merge pull request #16054 from borg-land/trim-down-logs
don't dump logs if the cluster doesn't exist
2023-10-26 18:32:50 +02:00
upodroid fedb4876a0 don't dump logs if the cluster doesn't exist 2023-10-24 10:49:35 +01:00
Ciprian Hacman aecae413d2 Fix tests for multi-arch clusters 2023-10-23 11:46:22 +03:00
upodroid 1fb7776553 build kubernetes from source with kops 2023-10-20 22:27:55 +01:00
Kubernetes Prow Robot 24f23543b4
Merge pull request #15972 from borg-land/bump-gcp-ccm
Bump GCP CCM again
2023-10-07 03:41:20 +02:00
Kubernetes Prow Robot 3d30b4070b
Merge pull request #15981 from borg-land/boskos-support
Create a temporary staging bucket for kops builds
2023-10-06 22:56:20 +02:00
upodroid e08472ddc5 bump cloud-provider-gcp to latest build 2023-10-06 17:52:23 +01:00
upodroid f1c3d6659d create a dedicated staging bucket for kops builds 2023-10-06 17:51:17 +01:00
Peter Rifel 6b70292167
Attempt to dump cluster info when encountering earlier errors 2023-09-28 20:52:40 -05:00
upodroid de0c99b192 bump gcp ccm image and dump more resources 2023-09-27 15:04:51 +01:00
Ciprian Hacman 98f8ab7828 Wait 20 min for cluster validation 2023-09-24 02:09:02 +02:00
upodroid 6bdefda4ec fix bugs in e2e testing and add kube feature gates 2023-09-22 19:32:15 +01:00
Peter Rifel 36940bf665
E2E - Dont set --master-count if --control-plane-count is in --create-args
Previously we were only not setting --master-count if --master-count was in --create-args.
Now we recognize either flag. This fixes E2E jobs that specify --control-plane-count and kops create cluster ends up having both flags
2023-08-06 08:57:03 -05:00
Kubernetes Prow Robot 4fcd5943e6
Merge pull request #15742 from hakman/testing_use_master-count
Use `--master-count` in testing for backwards compatibility
2023-08-05 06:00:42 -07:00
Ciprian Hacman ab18f79405 Use --master-count in testing for backwards compatibility 2023-08-05 09:18:03 +03:00
Ciprian Hacman f87e8c5ba6 aws: Don't use ap-northeast-2d and us-east-1e for testing 2023-08-05 08:57:14 +03:00
Ciprian Hacman 99e047574f kubetest2: Mark `--control-plane-size` as deprecated 2023-08-01 06:40:27 +03:00
Ciprian Hacman 53385bc0b4
Apply suggestions from code review
Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
2023-07-21 05:24:03 +03:00
justinsb 7352f30783 kubetest2-kops: rename control-plane-size flag to control-plane-count
For consistency with kops create cluster.

It doesn't appear to be used outside this repo, although test-infra
declares KOPS_CONTROL_PLANE_SIZE and that is then passed to our
e2e/scenarios scripts.

Issue #15559
2023-07-19 16:17:27 -04:00
Tone c2ed4b6f64
Upgrade Karpenter to v0.27.5 (#15144)
* feat(karpenter): Upgrade to version 0.27.0

Upgrade Karpenter to current last stable version `0.27.0`.
Template have been updated to use the same templates than the Helm chart.

* feat(karpenter): Use AWSNodeTemplate for launchTemplate

To set Launch Templates is deprecated into the provisioner, it is recommends using the `AWSNodeTemplate` to set it.
Ref:
 - https://karpenter.sh/v0.27.0/concepts/node-templates/

* feat(karpenter): Enable pruning addon

* Use extra flags in upgrade-ab scenario test

* feat(karpenter): Drop `karpenter` feature flag

* feat(karpenter): Add release note for `1.27`

* feat(karpenter): Upgrade to version 0.27.3

* feat(karpenter):  fix template

* feat(karpenter): Upgrade to version 0.27.5

* Update Karpenter documentation with depending kops version

* Delete KOPS_FEATURE_FLAGS from e2e test `run-test`

* Run hack/update-expected.sh
2023-06-29 22:57:45 -07:00
Justin SB 21a6fa550d kubetest2: don't cache version markers
When uploading the version marker, make sure we turn off caching.

Otherwise we see jobs using older versions than they should be
running.
2023-03-03 15:06:31 -05:00
justinsb 12d32c3273 kubetest2-kops: update tests for new zones
We previously tested that we could not generate 4 zones in a region,
but now us-east-1 has 6 zones, so we need to update the tests to fail
only when even more zones are requested.
2023-02-12 11:05:44 -05:00
Ciprian Hacman d884e5f4d9 Remove the SpecOverrideFlag feature flag 2023-01-13 20:40:17 +02:00
justinsb 571bd38ea1 kubetest: pass through KOPS_ARCH if set
This allows us to test with a fast single-architecture build, useful
when running kubetest locally.
2023-01-07 17:24:03 -05:00
justinsb 0fa22cacad kubetest2-kops: include stderr when calling kops toolbox dump
We're seeing some logs that don't include any output from kops toolbox
dump, but probably should.  Make sure we're including any stderr
output in our logs.
2023-01-06 07:58:45 -05:00
Ciprian Hacman 55940e03b1 Fix logging of the generated e2e cluster name 2022-12-21 12:47:02 +02:00
Ciprian Hacman d45a4c07f8 Use --set instead of deprecated --override flag 2022-12-21 07:12:41 +02:00
Kubernetes Prow Robot ae37c4596c
Merge pull request #14640 from justinsb/e2e_upload_versioned
e2e: always upload to a versioned directory
2022-11-24 14:12:04 -08:00
John Gardiner Myers f862447560 Fix dumping of control-plane nodes 2022-11-23 21:32:10 -08:00
justinsb b631e91645 e2e: always upload to a versioned directory
Otherwise on our first upload we were truncating one level of the
upload path.

Issue #14639
2022-11-23 17:17:32 -05:00
justinsb f887d51996 kubetest: dump poddisruptionbudgets and fieldManagers
Should help diagnose what's going on in some of our complex upgrade
tests when we detect conflicts.

Issue #14520
2022-11-22 07:50:26 -05:00
John Gardiner Myers 7af3162897 c7g.large doesn't exist in all regions yet 2022-11-13 07:47:06 -08:00
John Gardiner Myers 40b23eb911 Use ARM instancetype for ARM images in tests 2022-11-12 23:03:59 -08:00
Ole Markus With d5372e7387 Use PULL_PULL_SHA as gcs location sha if available 2022-06-28 20:23:43 +02:00
justinsb 29b168b9d7 gce: Move out of beta, drop feature flag
GCE support seems stable now, and we have good clarity at the API
level and how that translates to GCP resources, which was our blocker
previously.

Drop the need for the feature-flag.
2022-06-28 11:22:34 -04:00
Ole Markus With 0973246b04 Add a small sleep between creation and validation to allow for dns propagation 2022-06-19 15:59:22 +02:00