Commit Graph

400 Commits

Author SHA1 Message Date
Ciprian Hacman 9023db3d87 Allow setting resource.Quantity from the command line 2023-09-05 14:15:52 +03:00
justinsb e56c530ba2 Add cdn.dl.k8s.io as a mirror for dl.k8s.io
This should help with reachability, and lets us add more mirrors in
future.
2023-08-24 08:46:46 -04:00
Ciprian Hacman 4b3bb2a16d Allow setting metav1.Duration from the command line 2023-08-18 19:07:21 +03:00
Ciprian Hacman cd28f25c8b Allow setting env vars from the command line 2023-08-11 07:50:05 +03:00
John Gardiner Myers 0d1c6371d6 Get VFSContext from Factory in channels 2023-07-15 15:32:50 -07:00
Kubernetes Prow Robot 436732b724
Merge pull request #15395 from Codelax/vfs-remove-all
add removeAll to vfs
2023-07-15 14:55:13 -07:00
John Gardiner Myers 11304807f2 Hold reference to VFSContext from simple.Clientset 2023-07-06 19:41:45 -07:00
Ciprian Hacman 83de21981a Clarify error message when overriding int and uint values 2023-06-30 07:33:16 +03:00
Ciprian Hacman c90bdc791e Allow overriding int16 and uint16 values 2023-06-30 07:33:16 +03:00
Ciprian Hacman d70e6803b4 Allow overriding uint values 2023-06-27 16:07:30 +03:00
John Gardiner Myers 432ced6e57 Remove support for Ubuntu 18.04 2023-06-22 23:03:16 -07:00
Kubernetes Prow Robot 9cbb48c4a2
Merge pull request #15458 from peaaceChoi/master
Support intstr.IntOrString type  in cmd
2023-06-22 07:13:40 -07:00
Ciprian Hacman 9579feab98
Apply suggestions from code review 2023-06-17 09:25:13 +03:00
Reilly Brogan a7e9c58ba7 Debian 12 Bookworm: Fix DNS resolution 2023-06-15 13:42:27 -05:00
Kubernetes Prow Robot a9b1d89a07
Merge pull request #15481 from jsafrane/add-rhel9
Add RHEL9 support
2023-06-08 07:22:13 -07:00
Jan Safranek 9ce9aa754a Add RHEL9 support 2023-06-08 14:52:03 +02:00
guoguangwu da8c0ca830 chore: remove refs to deprecated io/ioutil 2023-06-07 18:02:33 +08:00
Pyeongkang Choi 0a862fdb70
Support intstr.IntOrString type 2023-05-31 16:38:04 +09:00
Jules Casteran e27ae94daf add removeAll to vfs 2023-05-10 15:24:15 +02:00
srikiz efdccb2e65 incorporate review comments 2023-04-11 07:51:36 +05:30
srikiz e77e660ed9 More changes based on testing 2023-04-11 07:51:36 +05:30
Peter Rifel 036bb8c62b
Initial Amazon Linux 2023 support
This is untested, I'll add an e2e job once this merges
2023-03-16 18:03:31 -05:00
Reilly Brogan 281de53cab Initial support for Debian 12 Bookworm
Signed-off-by: Reilly Brogan <reilly@reillybrogan.com>
2023-03-15 15:05:09 -05:00
Kubernetes Prow Robot b5dc9f6371
Merge pull request #15122 from Mia-Cross/scw_profiles
scaleway: get credentials from Scaleway profile
2023-02-24 07:43:34 -08:00
Kubernetes Prow Robot dfb9c424d5
Merge pull request #14954 from justinsb/use_google_storage_object_acl
gce terraform: Use google_storage_object_acl
2023-02-11 21:59:30 -08:00
Leïla MARABESE 9f950f4a3a scaleway profiles feature 2023-02-10 17:02:45 +01:00
Ciprian Hacman fbabea98e9 aws: Remove S3 region validation 2023-02-04 06:55:33 +02:00
justinsb 0b8cb933ad gce terraform: Use google_storage_object_acl
We are using the schema of google_storage_object_acl.
2023-01-22 10:15:25 -05:00
Leïla MARABESE 543d59758a removed SCW_DEFAULT_REGION and SCW_DEFAULT_ZONE env vars 2023-01-10 16:11:23 +01:00
justinsb c2810a5c96 Refactor to reduce vfs -> terraformWriter dependency 2023-01-04 13:38:47 -05:00
Kubernetes Prow Robot aeca5f9b54
Merge pull request #14926 from justinsb/multiple_tfproviders
Support multiple terraform file providers
2023-01-04 09:24:02 -08:00
justinsb 50556d6ab1 vfs: don't cache bucketDetails in S3Path
We cache it in the S3Context anyway, and this potentially avoids some
race conditions (albeit likely harmless race conditions).

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
2023-01-04 08:26:48 -05:00
justinsb 707758f1e9 Support multiple terraform file providers
By adding them on-demand, it is arguably a little simpler as well.

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
2023-01-04 08:14:18 -05:00
justinsb 6c2edaee7e Add Context arg to vfs ReadFile
This is an "action" method, so should take a context.
2023-01-01 09:51:44 -05:00
justinsb ae074bbc6b VFS: Add context to CreateFile & WriteFile
As "request" methods, these should have context parameters.
2022-12-23 10:39:52 -05:00
Kubernetes Prow Robot 5922daed00
Merge pull request #14852 from justinsb/ssh_vfscontext
vfs: wire context into SSHPath
2022-12-22 09:31:38 -08:00
Kubernetes Prow Robot c15ab50738
Merge pull request #14851 from justinsb/azure_context
vfs: azure client support for context and defer client construction
2022-12-22 09:31:26 -08:00
justinsb 4c789c7295 vfs: cleanup of SSH code
Generally cleaning up the SSH/SFTP code, only real change is to use posix rename.
2022-12-22 10:42:40 -05:00
justinsb 0a24aa99be vfs: wire context into SSHPath
It doesn't follow quite the same patterns, but we still need to lay
the groundwork here.
2022-12-22 10:37:50 -05:00
justinsb c81ec7f435 vfs: azure client support for context and defer client construction
Updating azure to follow the context patterns we've defined, where
BuildVFSPath no longer makes network calls.
2022-12-22 10:32:11 -05:00
justinsb 6406bfe150 VFS: Add context to internals of Openstack Swift client
Setting up context usage internally ready for the context to be
exposed.

Also avoid initializing the client until the first usage, making
building VFS path more of a builder function (deterministic, not
expected to fail for good inputs).
2022-12-21 10:07:03 -05:00
Kubernetes Prow Robot da9775972c
Merge pull request #14832 from justinsb/aws_s3_context
vfs: add context to s3 functions
2022-12-20 16:25:25 -08:00
Kubernetes Prow Robot 93a5be1599
Merge pull request #14833 from justinsb/cleanup_double_license_header
Cleanup double-license header in file
2022-12-20 14:11:35 -08:00
justinsb b233bdd67d Cleanup double-license header in file
We somehow ended up with 2 license headers here (the same, though with
different dates).
2022-12-20 15:36:31 -05:00
justinsb bba2eaf946 vfs: add context to s3 functions
We don't have the early initialization problem, but we do want to pass
the context through to the requests e.g. for tracing.
2022-12-20 15:34:42 -05:00
justinsb 46f27168b8 vfs: avoid early initialization of GCS client
By initializing on demand, we avoid the need for some context.Context
during "build" time and better reflect the notion of (passive)
builders vs (active) requests.
2022-12-20 15:23:16 -05:00
John Gardiner Myers 89cda928e1 Fixes for checking if S3 bucket is public 2022-12-17 11:05:38 -08:00
justinsb f4984dafab Support public buckets for serviceAccountIssuers on S3
S3 is also nudging towards bucket level permissions, so don't set an ACL when bucket is public.
2022-12-17 09:57:45 -08:00
justinsb 5fde739814 Introduce context.Context into some of our "Context" objects
The rule of thumb is that we shouldn't be embedding a context.Context,
but it is reasonable when the lifetime is similar and when the
refactor would otherwise be unacceptably large.

This is a minimal way to introduce it, based on adding the support
needed in the GCS support for serviceAccountIssuerDiscovery.  We will
need to plumb through the context in many more places over time.
2022-12-12 09:56:09 -05:00
John Gardiner Myers 235aa61594 v1alpha3: move networking fields under networking 2022-12-02 19:19:59 -08:00
Ciprian Hacman dbef6209c2 Remove support for using Vault as state store
Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
2022-11-30 18:38:21 +02:00
John Gardiner Myers 8b6f2973f8 Refactor GSPath use of Literal 2022-11-26 19:24:23 -08:00
John Gardiner Myers c2d9b871a5 Refactor Literal unit tests 2022-11-26 19:24:16 -08:00
Ole Markus With 8042756967 Add test confirming json merge behavior 2022-09-29 10:49:24 +02:00
Leïla MARABESE 0fa996890d featureflag and env vars for nodeup ready for testing 2022-09-26 13:55:08 +02:00
Leïla MARABESE 76562f80d5 support for scaleway in s3 buckets 2022-09-01 12:06:23 +02:00
Ciprian Hacman cb99db0757 Run make goimports 2022-08-17 07:03:33 +03:00
Ciprian Hacman 3d24d76cd6 Set higher verbosity when logging the endpoint of non-AWS S3 backend 2022-08-03 04:54:47 +03:00
Abirdcfly 9983ed68fb
delete t.FailNow after t.Fatalf
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
2022-07-22 00:14:53 +08:00
Rémy Léone 80d2d53643 fix tenv linter 2022-06-15 18:06:28 +02:00
Kubernetes Prow Robot 6377b68811
Merge pull request #13572 from hakman/hetzner
Add initial support for Hetzner Cloud
2022-05-08 20:57:18 -07:00
Ciprian Hacman b5f14b589b Add initial support for Hetzner Cloud 2022-05-09 06:12:15 +03:00
Steven E. Harris 9300ac1ad5
Avoid resolv.conf file loopback for Flatcar distro
In Flatcar Container Linux versions at 2748.0 and later, configure the
kubelet to use an alternate DNS resolver configuration. Rather than
using the "/etc/resolv.conf" file, use systemd-resolved's
"/run/systemd/resolve/resolv.conf" file.

Without this configuration, pods like CoreDNS that use the "Default"
DNS policy wind up with a DNS forwarding loop.

Signed-off-by: Steven E. Harris <seh@panix.com>
2022-05-08 06:58:50 -04:00
Jesse Haka 52d2cb08a8 update deps 2022-05-04 10:25:42 +03:00
Ciprian Hacman c8645f0156 Add support for Rocky Linux 8
... as an alternative to CentOS 8, after its deprecation and removal.
2022-04-26 12:23:14 +03:00
Kubernetes Prow Robot 5e641c77bb
Merge pull request #13557 from hakman/ubuntu-18.04
Add back support for Ubuntu 18.04
2022-04-25 23:06:52 -07:00
Ciprian Hacman 4fe9822cf1 Add back support for Ubuntu 18.04 2022-04-26 08:22:50 +03:00
Nat Henderson 9b08c4bb51 Enable internal load balancers when running on GCP
* Add ILBs, broadly following the AWS model.  The following new
capabilities are added for clusters in GCP:
  * Cluster's spec.api.loadBalancer can be set to 'type: internal' on
    GCP.
    * Therefore, GCP can now create:
        * regional backend services
        * regional (non-legacy) healthchecks
        * firewall rules with "internal" load-balancing scheme
        * firewall rules with dot-notation-specified IP addresses
  * Cluster's spec.api.loadBalancer's 'subnets' field functions
    as in the AWS model.

A few incidental changes are included, either because this change
touched the relevant code or because my use case happened to trigger the
issues that are fixed here.

* Cluster's spec.networkID field can be prefixed by project to use
  GCP's common cross-project networking model.
    * The presumption is that all specified subnets belong to this
      network and therefore this project.

* Add missing operation wait on forwarding rule creation.

* Some Terraform output improvements:
    * Permit no-ACL files in GCS buckets in Terraform output.
    * Enable marginally better cross-resource reference in Terraform outputs
    * Add project to network + subnetwork literals in Terraform output.
    * Add terraform output to backend services and health checks.

Testing:
  * Add mocks for backend services and health checks.
  * Add minimal integration test - copied from gce_private and ilb added.
  * Add update cluster goldens.

Co-authored-by: Travis Reid <travis_reid@apple.com>
2022-04-25 13:31:47 -07:00
Ciprian Hacman 6a51577cb0 Creaate kubeconfig for the root user on Ubuntu 2022-04-24 10:45:37 +03:00
Tessia Piboubès 705a7b536c Use a pointer type in type assertion 2022-04-20 20:07:58 +02:00
Kubernetes Prow Robot 6d264080ed
Merge pull request #13484 from olemarkus/no-bazel-targets
Remove bazel targets and tools
2022-04-17 23:16:41 -07:00
Ciprian Hacman 8b8dd8d2dd Use aws_s3_object instead of deprecated aws_s3_bucket_object 2022-04-13 16:49:03 +03:00
Ole Markus With ce2e877aeb Remove bazel files from vendor 2022-04-12 13:29:03 +02:00
Justin Menga 210d072da9 Correctly detect GovCloud regions 2022-03-24 12:59:32 -07:00
Eng Zer Jun deede3ecd4
test: use `T.TempDir` to create temporary test directory
The directory created by `T.TempDir` is automatically removed when the
test and all its subtests complete.

Reference: https://pkg.go.dev/testing#T.TempDir
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2022-02-18 16:57:41 +08:00
justinsb 9ccc100f92 tests: ensure that we use ACLs with memfs
They weren't fully wired up previously
2022-01-30 15:04:11 -05:00
Robbie Lankford 88a9d50e73
fix ineffectual assignments 2021-12-12 18:16:46 -06:00
Ole Markus With af4c12c5e9
Revert "Recognize debian bullseye as having "broken" resolv.conf" 2021-12-12 14:41:52 +01:00
John Gardiner Myers a0736b3c29 Remove support for Aliyun/Alibaba Cloud 2021-12-11 21:49:13 -08:00
justinsb 689f66a390 Recognize debian bullseye as having "broken" resolv.conf
Debian bullseye also has the loopback resolv.conf that needs special
handling.
2021-12-11 10:15:46 -05:00
Ciprian Hacman e19a1bbad9 Remove support for RHEL/CentOS 7 2021-12-03 21:40:10 +02:00
Ciprian Hacman 2030055c54 Remove support for Ubuntu 18.04 2021-12-03 21:28:12 +02:00
Ciprian Hacman 45094241f6 Remove support for Ubuntu 16.04 2021-12-03 21:28:12 +02:00
Ciprian Hacman 2055eec0f9 Remove support for Debian 9 2021-12-03 21:12:28 +02:00
Kubernetes Prow Robot ca966310e8
Merge pull request #12121 from rifelpet/gcs-tf
Support GSFS Terraform Managed Files
2021-12-03 06:32:27 -08:00
John Gardiner Myers c070c4def5 Remove support for CentOS 8 2021-12-02 23:09:08 -08:00
Peter Rifel f5f52eec92
Add mock GCP credentials to fix unit tests 2021-12-02 08:01:35 -06:00
Peter Rifel f56f98154a
Add TerraformProvider 2021-12-02 08:01:35 -06:00
Peter Rifel 675754edeb
Add Terraform support for GS Paths 2021-12-02 08:01:34 -06:00
Peter Rifel 5813b7f0e0
Add a unit test for S3Path.RenderTerraform
Unfortunately it needs to be in a different package to avoid a rather complex import loop: terraform -> kops api -> vfs -> terraform
2021-12-02 07:55:45 -06:00
Ciprian Hacman ea7df00719 Run hack/update-gofmt.sh 2021-12-01 22:39:50 +02:00
Ole Markus With 2fa53989c4 Configure dualstack endpoint for s3
Use dualstack https endpoints on ipv6only cluster. Always use
dualstack endpoints through the SDK
2021-11-20 08:00:00 +01:00
John Gardiner Myers 18d58f900c Support setting empty maps and structs 2021-11-13 19:10:29 -08:00
Kubernetes Prow Robot 49162378aa
Merge pull request #12722 from Juneezee/deprecate-ioutil
refactor: move from io/ioutil to io and os packages
2021-11-12 20:50:53 -08:00
Ciprian Hacman 471bcefb89 Recognize Ubuntu 22.04 (Jammy Jellyfish) 2021-11-13 05:23:09 +02:00
Eng Zer Jun 425173ae9f
refactor: move from io/ioutil to io and os packages
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil. This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.

Signed-off-by: Eng Zer Jun <engzerjun@gmail.com>
2021-11-12 15:37:18 +08:00
Peter Rifel 7eaa647b2a
Include the provider alias on TerraformPath resources that reference their provider 2021-09-17 18:08:59 -05:00
Peter Rifel c3a7f9f75a
Add TerraformProvider definition to TerraformPath interface 2021-09-17 18:08:58 -05:00
Kubernetes Prow Robot 1b431b4c9c
Merge pull request #11628 from olemarkus/gpu-runtime
Pre-install nvidia container runtime + drivers on GPU instances
2021-09-11 13:00:07 -07:00
Ciprian Hacman a7bb55b72f Recognize Ubuntu 21.10 (Impish Indri) 2021-09-11 08:56:33 +03:00