Commit Graph

2866 Commits

Author SHA1 Message Date
hakuna-matatah 1973f630b0 Increase cidrs to battle insufficient cidr blocks issue with EC2 2023-12-12 17:17:52 -08:00
hakuna-matatah 7350927309 Add warm ip and min ip for better prefix management 2023-12-11 11:24:55 -08:00
Kubernetes Prow Robot de0a002eb3
Merge pull request #16166 from rifelpet/scalability-m5
Remove duplicate m5.large from scalability test
2023-12-08 17:56:22 +01:00
Peter Rifel 02f32f896e
Remove duplicate m5.large from scalability test 2023-12-08 08:57:44 -06:00
Kubernetes Prow Robot d5293ebd51
Merge pull request #16164 from kubernetes/dependencies/update-1702015595
Update dependencies
2023-12-08 14:40:55 +01:00
github-actions 0f2669a9e9 Update dependencies 2023-12-08 06:06:35 +00:00
Peter Rifel 3012202ab7
./hack/update-expected.sh 2023-12-07 19:14:39 -06:00
Arnaud Meukam 5b3fbe7a7b
Allow EKS Pod identity env variables
Allow env variables required by EKS Pod identity for authentification
are passed to the kops binary.

See https://docs.aws.amazon.com/eks/latest/userguide/pod-id-how-it-works.html

Signed-off-by: Arnaud Meukam <ameukam@gmail.com>
2023-12-07 19:29:48 +01:00
Kubernetes Prow Robot 2dfb93fb65
Merge pull request #16157 from hakuna-matatah/master
Reduce disk volume size to reduce cost
2023-12-07 11:00:15 +01:00
Kubernetes Prow Robot 05e5f20865
Merge pull request #16155 from rifelpet/lbc-262
Upgrade AWS Load Balancer Controller to v2.6.2
2023-12-07 07:01:18 +01:00
hakuna-matatah 6f6abc8d45 reduce disk volume size to improvise cost 2023-12-06 21:38:55 -08:00
hakuna-matatah 999c2a8e40 Order instances in terms of cost 2023-12-06 16:17:58 -08:00
Peter Rifel 3c77624d5c
./hack/update-expected.sh 2023-12-06 17:35:09 -06:00
upodroid 1a593e4f6f fix the gce info shown in kops get cmd and set node-tag ginkgo flag 2023-12-03 11:41:45 +00:00
Aaron U'Ren 1c16117d1e
kube-router: skip 1.28 tests that fail consistently 2023-12-02 12:08:50 -06:00
Matt Morrison 4305adc9eb
revert default storage class change 2023-12-02 07:25:05 +13:00
Matt Morrison 35895f6a52
Update test expected output 2023-12-02 07:08:48 +13:00
Kubernetes Prow Robot ec9dbe4b99
Merge pull request #16146 from kubernetes/dependencies/update-1701410810
Update dependencies
2023-12-01 10:43:24 +01:00
github-actions 28600cfdf9 Update dependencies 2023-12-01 06:06:50 +00:00
Peter Rifel 5ae2b972a3
Skip hostname test in DigitalOcean 2023-11-30 22:13:59 -06:00
Kubernetes Prow Robot 4d36cd2aff
Merge pull request #16133 from rifelpet/set-containerd-129
Only set containerd plugins on kops versions that include quote fixes
2023-11-30 15:52:18 +01:00
upodroid f76852048e limit jobname value to 80 2023-11-30 11:48:02 +00:00
Peter Rifel 797903d6ca
Only set containerd plugins on kops versions that include --set quote fixes 2023-11-29 21:45:36 -06:00
Moshe Vayner 8b0b880fb0 hack/update-expected 2023-11-28 08:17:57 -05:00
upodroid a09dc4c99a enable test handler for containerd runtime 2023-11-27 15:28:22 +00:00
github-actions ceae8ab49c Update dependencies 2023-11-24 06:07:40 +00:00
Peter Rifel 6dbc164969
./hack/update-expected.sh 2023-11-21 20:55:05 -06:00
Peter Rifel 88872b3b96
./hack/update-expected.sh 2023-11-20 22:35:32 -06:00
Kubernetes Prow Robot bcbf6c79a4
Merge pull request #16113 from h3poteto/iss-16027
Replace * in IAM tags when IRSA namespace has wildcard
2023-11-20 18:43:09 +01:00
AkiraFukushima 91d3e89313
Replace * in IAM tags when IRSA namespace has wildcard 2023-11-20 21:48:10 +09:00
justinsb e0622ba3a2 Support writing traces to a directory, wire it up in kubetest2
If given a directory, we can construct a reasonable name based on the
executable name, pid and timestamp.  Then this is relatively easy to
wire up from kubetest2, if we have an artifacts directory.
2023-11-18 09:12:19 -05:00
justinsb e0a79e1bd1 Generated code / vendoring 2023-11-18 09:12:19 -05:00
github-actions 003d1fc965 Update dependencies 2023-11-17 06:06:41 +00:00
Ciprian Hacman 2a0c7620ea hack/update-expected.sh 2023-11-17 04:39:43 +02:00
Peter Rifel b7befc1cb5
Don't get cluster --full when attempting leak cleanup
If a job's --down was interrupted, the state store can be in an inconsistent state.
This can cause `kops get cluster --full` to fail if certain additional objects are missing, yet `kops get cluster` would succeed.
We omit `--full` to ensure `kops get cluster` succeeds and leak cleanup is reattempted.
2023-11-13 21:19:49 -06:00
Ciprian Hacman 8916d1e547
Release 1.29.0-alpha.2 (#16095) 2023-11-11 13:29:12 +01:00
github-actions 9f9a297b78 Update dependencies 2023-11-10 06:06:26 +00:00
github-actions 9ba2a5ba65 Update dependencies 2023-11-04 13:23:11 +00:00
Kubernetes Prow Robot a779f524af
Merge pull request #16068 from kubernetes/dependencies/update-1698387067
Update dependencies
2023-10-27 11:35:28 +02:00
github-actions 454578f893 Update dependencies 2023-10-27 06:11:07 +00:00
upodroid ecf212d736 add --node-instance-group flag to ginkgo 2023-10-26 23:08:18 +01:00
Kubernetes Prow Robot 21b9af6e56
Merge pull request #16054 from borg-land/trim-down-logs
don't dump logs if the cluster doesn't exist
2023-10-26 18:32:50 +02:00
Harish K 104393c2ba
scale-test: Scrape APIServer only metrics (#16029)
* Scrape APIServer only metrics

* Increase validation time for successful checks to avoid flakiness

* Remove node selector override

---------

Co-authored-by: Ciprian Hacman <ciprian@hakman.dev>
2023-10-26 10:42:40 +02:00
Kubernetes Prow Robot 165cbd5333
Merge pull request #15705 from zadjadr/feature/cilium-14
Bump to Cilium 1.14
2023-10-25 19:54:22 +02:00
shapirus dd665fbe1e Support setting cluster-autoscaler's skip-nodes-with-custom-controller-pods parameter 2023-10-25 14:03:57 +03:00
zadjadr 2cd697aef2
hack/update-expected.sh 2023-10-24 17:09:19 +02:00
upodroid fedb4876a0 don't dump logs if the cluster doesn't exist 2023-10-24 10:49:35 +01:00
Kubernetes Prow Robot 1f6d49217b
Merge pull request #16043 from hakman/containerd-1.7.7
Update containerd to v1.7.7
2023-10-23 14:13:34 +02:00
Ciprian Hacman aecae413d2 Fix tests for multi-arch clusters 2023-10-23 11:46:22 +03:00
Ciprian Hacman 99bd57ca32 hack/update-expected.sh 2023-10-22 13:49:12 +03:00
Ciprian Hacman 8f461f9a04 hack/update-expected.sh 2023-10-21 11:57:32 +03:00
upodroid 1fb7776553 build kubernetes from source with kops 2023-10-20 22:27:55 +01:00
Kubernetes Prow Robot dd7a3a667e
Merge pull request #16013 from sl1pm4t/enable-gcp-cloud-platform-scope
Add cloud-platform GCP VM scope
2023-10-20 18:42:17 +02:00
github-actions 6c546e1a95 Update dependencies 2023-10-20 06:09:46 +00:00
Kubernetes Prow Robot 1038071e8b
Merge pull request #15963 from hakuna-matatah/master
scale-test: Measure APIServer SLOs
2023-10-18 01:28:57 +02:00
Harish Kuna e0e54dd76e add kube-proxy metrics-bind-address for prom to scrape for cl2 test 2023-10-17 14:10:40 -07:00
Harish Kuna 892046df9e apply kubeproxy selector key to scrape kube-proxy service 2023-10-17 10:24:11 -07:00
Harish Kuna 16ab312e7c add anonymous auth for CL2 Prometheus pod to scrape APIServer metrics endpoint 2023-10-17 09:37:22 -07:00
github-actions 3f742986d3 Update dependencies 2023-10-13 06:09:08 +00:00
Harish Kuna 3c7e90ef0b Clean up code; Move from arm to amd for kubenodes, for cl2 prom, grafana test pods to come up 2023-10-12 20:51:52 -07:00
Matt Morrison 9f15dd71f0
Update expected test output 2023-10-11 21:07:31 +13:00
github-actions 6b6d16e842 Update dependencies 2023-10-11 07:12:47 +00:00
Ciprian Hacman 53729a291b Update Go to v1.21.3 2023-10-11 08:05:08 +03:00
Kubernetes Prow Robot 66835ecaa4
Merge pull request #16005 from hakman/dns_none_default
Use dns=none for newly created clusters except for AWS and GCE
2023-10-09 03:09:32 +02:00
Ciprian Hacman e1caa8aa2b hack/update-expected.sh 2023-10-08 09:17:51 +03:00
Ciprian Hacman 4632188467 hack/update-expected.sh 2023-10-07 15:46:27 +03:00
Kubernetes Prow Robot d2b789da07
Merge pull request #15993 from johngmyers/nlb-sg
aws: Attach security groups to NLBs
2023-10-07 10:57:01 +02:00
John Gardiner Myers 3f1ee1e820 hack/update-expected.sh 2023-10-06 22:33:31 -07:00
Kubernetes Prow Robot 24f23543b4
Merge pull request #15972 from borg-land/bump-gcp-ccm
Bump GCP CCM again
2023-10-07 03:41:20 +02:00
Kubernetes Prow Robot 3d30b4070b
Merge pull request #15981 from borg-land/boskos-support
Create a temporary staging bucket for kops builds
2023-10-06 22:56:20 +02:00
upodroid e08472ddc5 bump cloud-provider-gcp to latest build 2023-10-06 17:52:23 +01:00
upodroid f1c3d6659d create a dedicated staging bucket for kops builds 2023-10-06 17:51:17 +01:00
Moshe Vayner 89aa632c61 hack/update-expected 2023-09-29 11:22:00 -04:00
Mia-Cross e12f3dc07b
scaleway: terraform support (#15892)
* tasks dependencies

* FindAddresses should proceed even if LBID is empty

* refacto instance: handle several instances in IG + volumeSize in model

* refacto lb_backend: set servers' IPs in backend task rather than instance

* dns changes for tf support

* render Scaleway s3 objects + add zone to outputs

* add terraform support to documentation

* new instance unique name should be given according to actual instances names

* avoid untimely changes in tf + tag instance IPs to avoid orphaned IPs at cluster deletion

* update integration tests

* review comments

* add IPs to the resources to be deleted with the cluster

* add task + model for DNS record
2023-09-29 04:22:42 -07:00
github-actions 616920cbbe Update dependencies 2023-09-29 06:10:00 +00:00
Peter Rifel 6b70292167
Attempt to dump cluster info when encountering earlier errors 2023-09-28 20:52:40 -05:00
upodroid d630f9c520 add missing rbac roles and don't run gkenetparamset controller 2023-09-28 12:06:52 +01:00
upodroid cb8fd9180b update ccm path 2023-09-27 17:23:28 +01:00
upodroid de0c99b192 bump gcp ccm image and dump more resources 2023-09-27 15:04:51 +01:00
Ciprian Hacman 626213c2c1 hack/update-expected.sh 2023-09-25 18:21:49 +02:00
Kubernetes Prow Robot 97c89f49b0
Merge pull request #15903 from hakman/aws_list_eni_by_vpc
aws: Filter ENI list by VPC
2023-09-24 16:22:56 -07:00
Ciprian Hacman 98f8ab7828 Wait 20 min for cluster validation 2023-09-24 02:09:02 +02:00
Ciprian Hacman 4945a8ea0c hack/update-expected.sh 2023-09-24 01:56:48 +02:00
Dan Ports 32b0416547 Configure Karpenter resources. 2023-09-23 11:16:28 -04:00
Kubernetes Prow Robot bd6c6852dc
Merge pull request #15935 from junm-cloudnatix/karpenter-typo
aws: Fix minor typos for Karpenter setup
2023-09-23 07:16:55 -07:00
Ciprian Hacman 1aecb5304d aws: Filter ENI list by VPC 2023-09-23 05:25:56 +03:00
Kubernetes Prow Robot 06d1d8965a
Merge pull request #15900 from borg-land/fix-e2e-testing
Fix e2e testing logic
2023-09-22 13:38:49 -07:00
upodroid 6bdefda4ec fix bugs in e2e testing and add kube feature gates 2023-09-22 19:32:15 +01:00
github-actions 96edd05b93 Update dependencies 2023-09-22 06:09:07 +00:00
Ciprian Hacman 11eec46eb2 scale-test: Re-enable etcd metrics 2023-09-21 05:29:59 +03:00
Jun Mukai bbfd71aa8f update expected test data. 2023-09-20 15:42:10 -07:00
Jun Mukai 0573e6d39e Fix minor typos for karpenter setup.
`on-demand` is the right string to indicate OnDemand in Karpenter.
See: https://github.com/aws/karpenter-core/blob/main/pkg/apis/v1alpha5/labels.go#L30
As the result it does not fall back to ondemand instances.

Also add `ec2:DescribeImages` to karpenter IAM policies -- it's
noted in https://karpenter.sh/docs/getting-started/migrating-from-cas/#create-iam-roles
(the list also has DeleteLaunchTemplates but I don't think this
is necessary for kOps).
2023-09-20 09:57:46 -07:00
Harish K 46d541fbbe
Update tests/e2e/scenarios/scalability/run-test.sh
Co-authored-by: Ciprian Hacman <ciprian@hakman.dev>
2023-09-19 14:04:10 -07:00
Harish Kuna a2a11b9802 Need for separate etcd cluster for events 2023-09-19 13:56:57 -07:00
Ciprian Hacman 828995728b Optimize subnets asignment to IGs for clusters with multiple CIDRs 2023-09-17 07:25:55 +03:00
Harish Kuna 190f262555 add couple more cidrs to divide equally /16's 2023-09-15 11:57:20 -07:00
github-actions ebd47c2365 Update dependencies 2023-09-15 06:09:12 +00:00
Ciprian Hacman c05afb6028 scale-test: Increase validation wait time to 45m 2023-09-15 07:02:51 +03:00
Dan Ports ae1584c6f0 Add Cognito permissions for AWS LBC. 2023-09-14 12:15:30 -04:00
Harish Kuna b5e2161bf5 increase the etcd db size to accomodate large scale k8s cluster resources 2023-09-13 05:58:17 -07:00
Harish Kuna 90793f9012 increase vpc cidrs to allocate more ip's for large scale k8s clusters 2023-09-12 11:34:51 -07:00
zadjadr 47919e5727 hack/update-expected.sh 2023-09-10 09:05:51 +02:00
zadjadr 61d036933e hardcode ingress secrets namespace & lb mode 2023-09-10 08:57:04 +02:00
zadjadr 4807f2c0c6 Implement Cilium Ingress 2023-09-10 08:57:03 +02:00
Kubernetes Prow Robot a7555dcc1b
Merge pull request #15885 from borg-land/disable-metadata-proxy
Remove metadata-proxy from GCE Clusters from 1.29+ onwards
2023-09-09 09:08:08 -07:00
upodroid 20e7a5aad4 disable metadata-proxy on k8s version older than 1.29 2023-09-09 16:18:51 +01:00
github-actions 7b947c91be Update dependencies 2023-09-08 06:10:34 +00:00
John Gardiner Myers 9ae4e967d1
Release 1.29.0-alpha.1 (#15889) 2023-09-07 22:00:13 -07:00
Ciprian Hacman 693a72a228 hack/update-expected.sh 2023-09-06 06:32:57 +03:00
Kubernetes Prow Robot 09bc180686
Merge pull request #15871 from hakman/remove-docker
Remove Docker config option
2023-09-05 15:00:51 -07:00
Harish Kuna 0ae70abd83 explictly define the value for profiling 2023-09-05 11:27:24 -07:00
Harish Kuna 49f04f5143 fix apiserver casing 2023-09-05 11:27:24 -07:00
Harish Kuna 043aecb6b5 tune apiserver, kcm and scheduler flags for scale performance tests 2023-09-05 11:27:24 -07:00
Ciprian Hacman 120c0b65aa hack/update-expected.sh 2023-09-05 12:34:20 +03:00
Kubernetes Prow Robot 92c0f48e33
Merge pull request #15872 from johngmyers/aws-ccm-always
Remove dead code for in-tree CCM
2023-09-04 21:03:51 -07:00
John Gardiner Myers edd3d0bf42 hack/update-expected.sh 2023-09-04 16:12:00 -07:00
John Gardiner Myers 965712d22b hack/update-expected.sh 2023-09-04 15:43:23 -07:00
Kubernetes Prow Robot efab9bc626
Merge pull request #15859 from hakman/scale_mixed-instances
Use mixed instances for scale tests
2023-09-04 15:23:48 -07:00
Kubernetes Prow Robot bb03f4160e
Merge pull request #15866 from hakman/fix_aws-vpc-cni
Default to 100.64.0.0/13 as IPv4 service cluster IP range
2023-09-04 12:13:48 -07:00
Ciprian Hacman bb954f4f0b Use mixed instances for scale tests 2023-09-04 20:54:26 +03:00
justinsb 9daf0908c2 Update expected test output 2023-09-04 08:36:22 -04:00
Ciprian Hacman d41f7164d1 hack/update-expected.sh 2023-09-04 10:42:09 +03:00
John Gardiner Myers b3908e592c Remove support for Kubernetes 1.23 2023-09-03 16:22:18 -07:00
Ciprian Hacman 9caf0b2662
Release 1.29.0-alpha.0 (#15858) 2023-09-02 23:19:12 -07:00
Kubernetes Prow Robot 7b729e9577
Merge pull request #15854 from hakman/aws_additonal_node-size
aws: Add option to provide multiple instance types on cluster creation
2023-09-02 22:33:12 -07:00
Ciprian Hacman db8b0f32f9
Release 1.28.0-beta.1 (#15855) 2023-09-02 21:29:12 -07:00
Ciprian Hacman 6fbc9e58a2 aws: Add option to provide multiple instance types on cluster creation 2023-09-02 17:01:02 +03:00
github-actions 771905d239 Update dependencies 2023-09-01 06:08:36 +00:00
Kubernetes Prow Robot 62e7d71ae8
Merge pull request #15842 from hakman/update-deps
Update dependencies
2023-08-31 09:18:49 -07:00
Davanum Srinivas 8c506804a4
Let us spread across all AZ(s) in us-east-2
Signed-off-by: Davanum Srinivas <davanum@gmail.com>
2023-08-31 06:54:05 -04:00
Ciprian Hacman 5d43d5fe88 Update dependencies 2023-08-31 13:53:46 +03:00
Prateek Gogia 8c0af0571f
Scale config changes for scale prow job on AWS (#15599)
* [Dont merge] temp change for prow tests

* Set maxPods=45

* Set parallel=1

* Set networking.subnets[0].cidr=10.0.0.0/16

* Increase number of pods created during tests

* Remove settings for number of pods created during tests

* Set endpoint/SliceUpdatesBatchPeriod=500m

* Use latest-ci marker instead of latest-ci-updown-green

* Update tests/e2e/scenarios/scalability/run-test.sh

* aws scale test increase cidr count during cluster creation

* Fix kubetest flag deduplication

---------

Co-authored-by: Ciprian Hacman <ciprian@hakman.dev>
2023-08-26 22:41:21 -07:00
Ciprian Hacman 35e7bbad85 Apply suggestions from code review 2023-08-26 10:38:36 +03:00
Ciprian Hacman 4e0e28a32b aws: Create subnets for additional network CIDRs 2023-08-26 10:18:44 +03:00
Kubernetes Prow Robot 8d5b74064f
Merge pull request #15814 from hakman/number_of_subnets
Split network CIDR into even bigger subnets
2023-08-25 22:01:21 -07:00
Peter Rifel de8b406793
Skip UDP LoadBalancer test on k8s 1.26 2023-08-25 20:39:34 -05:00
Moshe Vayner 8064f4e249 hack/update-expected 2023-08-24 11:29:00 -04:00
justinsb f7bed48d3e Update expected output for additional mirrors 2023-08-24 08:47:09 -04:00
Ciprian Hacman b2fe8978f3 hack/update-expected.sh 2023-08-23 05:31:34 +03:00
Kubernetes Prow Robot a913d3c0db
Merge pull request #15810 from moshevayner/cert-manager-1-12-3
Bump Cert Manager to 1.12.3
2023-08-22 06:06:54 -07:00
Moshe Vayner 3974754d8d hack/update-expected 2023-08-22 00:32:37 -04:00
Moshe Vayner 0b2de28f70 hack/update-expected 2023-08-22 00:14:53 -04:00
Kubernetes Prow Robot fc30975eba
Merge pull request #15791 from hakman/number_of_subnets
Create clusters with bigger default subnets
2023-08-20 21:57:22 -07:00
Peter Rifel ff799a3102
Continue skipping SCTP HostPort tests in older k8s versions
After no longer skipping these in kops 1.28, the e2e tests began failing again.

It turns out cilium doesn't enable SCTP support by default, it is guarded by a `enable-sctp` config boolean.
In k8s 1.27 the test was also renamed and added [Serial], so it is still being skipped on k8s 1.27+ test jobs
2023-08-20 19:56:34 -05:00
Kubernetes Prow Robot 3395a4e048
Merge pull request #15792 from hakman/skip_failing_ProxyTerminatingEndpoints
Skip failing ProxyTerminatingEndpoints test
2023-08-17 07:09:22 -07:00
Ciprian Hacman 7783e6254c Skip failing ProxyTerminatingEndpoints test 2023-08-17 08:42:23 +03:00
Ciprian Hacman 1593aabee9 hack/update-expected.sh 2023-08-17 05:30:11 +03:00
Kubernetes Prow Robot 73159cd6f5
Merge pull request #15670 from johngmyers/aws-ccm
Fix AWS CCM defaults for IPAM to match KCM
2023-08-16 07:22:27 -07:00
Kubernetes Prow Robot edf1982d61
Merge pull request #15783 from hakman/scale_us-east-2
Use us-east-2 region for scale tests
2023-08-15 22:30:27 -07:00
Ciprian Hacman b8594e4c21 gce: Skip failing Cilium test 2023-08-16 07:46:55 +03:00