Commit Graph

544 Commits

Author SHA1 Message Date
Robbie Lankford 221272cee2
add verify-golangci-lint.sh script 2021-12-12 18:14:17 -06:00
Ole Markus With 7b91e5c257 Only shellcheck files 2021-12-11 11:07:49 +01:00
Ciprian Hacman 82512f2c65 Add gofumpt scripts 2021-12-01 22:37:41 +02:00
justinsb b74ad8dade Remove dependencies on k8s.io/code-generator 2021-11-15 10:44:43 -05:00
justinsb 0fd94706d4 Makefile: run codegen using go modules
This no longer carries a (significant) performance penalty, and
simplifies the process greatly.
2021-11-15 10:41:05 -05:00
Peter Rifel 7b4dbd486d
Check for hardcoded partitions in integration tests 2021-10-30 06:42:13 -05:00
justinsb b43afba89a Replace bazel :gofmt target with direct invocation
The rule to run from the workspace is broken by the .bazel-bin change,
but bazel now supports direct invocation.
2021-10-26 08:04:08 -04:00
Ciprian Hacman 6bd597f372 Convert go.mod files to Go 1.17 2021-10-09 06:27:27 +03:00
Ciprian Hacman 97ecd445a5 Update k8s dependencies to v1.22.2 2021-10-05 08:55:17 +03:00
Ciprian Hacman 895ac428e2 Upgrade cnf-lint to 0.54.2 2021-09-24 15:11:10 +03:00
Peter Rifel d3f657bdc4
Run verify-cloudformation in host network 2021-09-24 06:20:31 -05:00
Ciprian Hacman b1be79800b Use host network when running docker 2021-09-24 11:15:13 +03:00
Peter Rifel db5a1251c9
Upgrade terraform to 1.0.7 2021-09-23 22:49:25 -05:00
Ciprian Hacman 19564888f4 Use "//go:build" lines together with "// +build" lines
The go command now understands //go:build lines and prefers them over // +build lines. The new syntax uses boolean expressions, just like Go, and should be less error-prone. As of this release, the new syntax is fully supported, and all Go files should be updated to have both forms with the same meaning. To aid in migration, gofmt now automatically synchronizes the two forms. For more details on the syntax and migration plan, see https://golang.org/design/draft-gobuild.
2021-09-20 07:35:31 +03:00
Justin SB 1562ce4e8a Script for iterating development on AWS
Somewhat opinionated, but should be an easy and quick way to build for
dev in most cases.
2021-09-18 13:42:14 -04:00
Ciprian Hacman 23dc3508bd Update Bazel to v4.2.1 2021-09-11 15:41:28 +03:00
justinsb 055ef00384 dev: hack/update-expected script should clear KOPS_ARCH
This is another env var that we don't want to be set when generating
test data, or else we generate tests only for the specified
architectures.
2021-09-06 14:45:08 -04:00
Peter Rifel 94bcc3aa57
Update staticcheck to latest 2021-08-30 09:07:29 -05:00
Peter Rifel adf60a266e
Update terraform to 1.0.5 2021-08-24 18:31:08 -05:00
Justin SB 343227cfd4 Script for iterating development on GCE
AWS one to follow!
2021-08-23 08:37:09 -04:00
John Gardiner Myers 832e773324 Update Kubernetes dependencies to 1.22.0 2021-08-04 16:54:07 -07:00
Ciprian Hacman b30890ffdc Update cfn-lint to v1.52.0 2021-07-29 05:40:05 +03:00
Aaron Crickenberger e4ae593554 hack/upload: avoid ACLs for GCS buckets with UBLA enabled 2021-07-14 22:46:07 -07:00
Rui Chen d1146fa157 brew: remove kops.rb
Right now the kops formula is well maintained in the homebrew-core side,
see [the past PRs](https://github.com/Homebrew/homebrew-core/pulls?q=is%3Apr+kops+) and [the latest one](https://github.com/Homebrew/homebrew-core/pull/79634).

Thus removing the kops.rb formula file in favor of
[the homebrew-core one](https://github.com/Homebrew/homebrew-core/blob/master/Formula/kops.rb).

Signed-off-by: Rui Chen <rui@chenrui.dev>
2021-06-19 16:22:26 -04:00
John Gardiner Myers 863c18585e Fix set-version leaving backup files with "-e" suffix 2021-06-04 15:06:54 -07:00
Ciprian Hacman d407c62e5f Always install the latest plugin versions for Terraform tests 2021-05-10 17:02:41 +03:00
Peter Rifel d15168c74a
Update verify-terraform to use 0.15.3
This updates the GPG key according to https://discuss.hashicorp.com/t/hcsec-2021-12-codecov-security-event-and-hashicorp-gpg-key-exposure/23512
2021-05-09 13:57:08 -04:00
John Gardiner Myers b31baebe2a Verify all versions are set correctly 2021-05-07 21:09:11 -07:00
John Gardiner Myers fe1e850cab Simplify use of hack/set-version 2021-05-07 21:09:11 -07:00
Peter Rifel 39072df39c
Update terraform and cloudformation lint versions 2021-04-19 21:38:31 -05:00
Ciprian Hacman 676f442c72 Update k8s dependencies to v1.21.0 2021-04-09 08:09:38 +03:00
Peter Rifel e108cd732e
Update rules_go and gazelle 2021-03-20 16:02:51 -05:00
Peter Rifel f36e9a449a
Remove go-bindata 2021-03-20 16:02:09 -05:00
Peter Rifel 7c900b7fae Generate and upload keys.json + discovery.json to public store
Generate and upload keys.json + discovery.json to public store

Don't enable anonymous auth on publicjwks

Remove tests that won't work using FS VFS anymore
2021-03-19 20:03:26 +01:00
Ciprian Hacman 4235fd3835 Update Bazel to v3.5.0 2021-03-18 14:58:09 +02:00
Kubernetes Prow Robot 2083133cfc
Merge pull request #11047 from bmelbourne/update-misc-go-mods
Update Go modules to latest versions
2021-03-15 00:11:04 -07:00
Barry Melbourne a04a523434 Update Terraform to v0.14.8 2021-03-14 16:09:43 +00:00
Barry Melbourne e30bf1cf35 Update Go modules to latest versions 2021-03-14 15:08:27 +00:00
Ciprian Hacman a17b90548c Update k8s dependencies to v1.21.0-beta.1 2021-03-12 20:26:04 +02:00
Barry Melbourne 1a6ff4efbf Update Go to v1.16 2021-03-04 18:41:48 +00:00
Barry Melbourne 10dff62a1d Update k8s.io Go modules to v0.20.4 2021-03-03 18:38:21 +00:00
Barry Melbourne a77233a843 Update Openstack Cloud Go module to v1.20.1 2021-02-21 12:19:05 +00:00
Ole Markus With 076ae3dfe4 Remove coredns dnsprovider 2021-01-22 09:19:35 +01:00
Ciprian Hacman 3f25569bec Update cfn-python-lint to v0.44.4 2021-01-21 11:35:41 +02:00
Ciprian Hacman bb787d3075 Release 1.20.0-alpha.1 2021-01-15 15:29:55 +02:00
Peter Rifel 521f0d654c
Upgrade cfn-lint to 0.44.3 2021-01-12 20:14:56 -06:00
Barry Melbourne f2ecb5c153 Upgrade Go v1.15.6 / Bazel v3.4.1 2021-01-10 18:13:12 +00:00
Kubernetes Prow Robot ac082bd091
Merge pull request #10182 from h3poteto/fix/hack-verify-bazel
Fix to handle exit code of gazelle command in hack/verify-bazel.sh
2021-01-10 08:23:05 -08:00
Ciprian Hacman a7bb949936 Add possibility to set volume throughput for gp3 volumes 2021-01-05 13:18:32 +02:00
Barry Melbourne 1c96e826d9 Remove copyright YEAR from generated Go files 2021-01-03 12:48:50 +00:00
Peter Rifel 13675fa061
hack/goimports - Replace mapfile with read
`mapfile` was introduced in bash 4.
We can use `read` instead to achieve the same thing - listing all .go files in the repo into an array
2020-12-11 08:22:54 -06:00
Peter Rifel a8a0b6783f
Replace goimports python scripts with shell scripts, remove unnecessary .packages 2020-12-10 21:50:36 -06:00
Peter Rifel 8bde95df70
Move code-generator to hack go module 2020-12-10 21:47:54 -06:00
Peter Rifel 82e25599f7
Move tools.go into separate go module without vendoring 2020-12-08 23:06:44 -06:00
AdamKorcz 5a1f13d123 Added fuzzer to integrate with OSS-fuzz 2020-12-04 10:53:48 +00:00
Peter Rifel df1e30182f
Fix cloudformation lint job
The dockerfile we were using in the cfn-python-lint repo wasn't actually pinned to the version associated with the git tag, it always installs the latest version.
A recent release consolidated error rules regarding invalid values.
We use an invalid "us-test-1" region and zones in much of our testing.
We used to be able to ignore this "invalid AZ" error, but now we would need to ignore all invalid values for all resource properties.
This pins cfn-python-lint to an older version but we'll have to figure out how we want to handle this longer term.
2020-11-17 20:03:40 -06:00
AkiraFukushima 51aadf1cbc Fix to handle exit code of gazelle command in hack/verify-bazel.sh
When some diff are detected in gazelle, the command exit(1), so verify-bazel.sh exit without any messages
2020-11-07 00:05:38 +09:00
Kubernetes Prow Robot b7f66a6d98
Merge pull request #10109 from bmelbourne/set-minimum-terraform-0.12
Set minimum Terraform version to 0.12.26/0.13.0
2020-10-29 01:52:58 -07:00
Peter Rifel a240507fce
Make verify-cloudformation job fail when issues are found 2020-10-28 21:01:22 -05:00
Barry Melbourne 84417c330b Set minimum Terraform version to 0.12.26/0.13.0 2020-10-28 20:24:41 +00:00
Peter Rifel b3cdca7908
Add verify-cloudformation script
This is an official AWS linter for cloudformation.
It has already caught a few bugs in our cloudformation json generation logic
2020-10-28 10:09:01 -05:00
Peter Rifel 50348742e9
Fix various shellcheck failures 2020-10-26 15:55:13 -05:00
Peter Rifel 1f4e02be6c
Compile hack tools into _output/bin/ rather than temp directories 2020-10-26 15:01:43 -04:00
Peter Rifel b2e06093d8
Make hack/update and hack/verify scripts more consistent 2020-10-26 15:01:43 -04:00
Kubernetes Prow Robot c9aa53895a
Merge pull request #10048 from hakman/container-runtime-assets
Install container runtime packages as assets
2020-10-25 21:03:01 -07:00
Peter Rifel 676c6f5a7f
Add tests/e2e go module support to hack/verify-gomod.sh 2020-10-22 20:57:38 -05:00
Kubernetes Prow Robot 3ba214dbe1
Merge pull request #10031 from rifelpet/kubetest2
Initial kubetest2 structure for e2e testing
2020-10-20 06:56:08 -07:00
Ciprian Hacman b27431d86f Install container runtime packages as assets - Tests 2020-10-14 15:41:51 +03:00
Ciprian Hacman e6e3fc1309 Fix docs feature table not being rendered 2020-10-12 07:37:39 +03:00
Peter Rifel edd3258c0a
Update gitignore and some verify scripts for new e2e code 2020-10-08 19:39:28 -05:00
Ciprian Hacman 0c6f1c733c Use all kops mirrors to determine artifacts hashes 2020-09-18 09:44:37 +03:00
Ciprian Hacman 0eb626fcdd Release 1.19.0-alpha.4 2020-09-16 11:37:38 +03:00
Justin SB 8498ac9dbb Create PublicJWKS feature flag
This should be much easier to start and to get under testing; it only
works with a load balancer, it sets the apiserver into anonymous-auth
allowed, it grants the anonymous auth user permission to read our jwks
tokens.  But it shouldn't need a second bucket or anything of that
nature.

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
2020-09-09 09:57:06 -04:00
Justin SB 5f9d3b3431 verify-terraform: rearrange arguments to find
Otherwise we get a warning:

"find: warning: you have specified the global option -maxdepth after the argument -type, but global options are not positional, i.e., -maxdepth affects tests specified before it as well as those specified after it.  Please specify global options before other arguments."
2020-09-07 17:35:57 -04:00
Kubernetes Prow Robot cf0466bded
Merge pull request #9851 from MaXinjian/shellcheck
fix "unbound variable" issue
2020-09-02 00:05:06 -07:00
Ma Xinjian 1bda78be78 fix "unbound variable" issue
IGNORE is an empty array, it throws error when make verify-staticcheck
$ make verify-staticcheck
hack/verify-staticcheck.sh
hack/verify-staticcheck.sh: line 50: IGNORE[*]: unbound variable
make: *** [verify-staticcheck] Error 1

Signed-off-by: Ma Xinjian <maxj.fnst@cn.fujitsu.com>
2020-09-01 16:33:50 +08:00
Kubernetes Prow Robot e0da9c0b36
Merge pull request #9849 from MaXinjian/shellcheck
Keep SHELLCHECK_IMAGE vesion sync with SHELLCHECK_VERSION defined before
2020-08-31 20:45:50 -07:00
Ma Xinjian dc852fbb73 Keep SHELLCHECK_IMAGE vesion sync with SHELLCHECK_VERSION defined before
Signed-off-by: Ma Xinjian <maxj.fnst@cn.fujitsu.com>
2020-09-01 09:55:13 +08:00
Justin SB 0cda0f5068 Support authentication helper for kubectl
We create a simple exec plugin command which can create and renew
short-lived admin credentials on the fly, essentially leveraging the
security of the underlying cloud credentials.

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
2020-08-30 15:16:20 -04:00
Justin Santa Barbara f32fcc35fa Addons: Support arbitrary additional objects
We will be managing cluster addons using CRDs, and so we want to be
able to apply arbitrary objects as part of cluster bringup.

Start by allowing (behind a feature-flag) for arbitrary objects to be
specified.

Co-authored-by: John Gardiner Myers <jgmyers@proofpoint.com>
2020-08-28 09:03:41 -04:00
Ciprian Hacman a4ff90205a Pull images from k8s.gcr.io/kops instead of docker.io/kope 2020-08-25 08:04:36 +03:00
Ciprian Hacman 92a3676e51 Ignore untracked files in "git status" 2020-08-24 05:30:30 +03:00
Ciprian Hacman c52a21f9ba Update shellcheck to v0.7.1 2020-08-23 12:07:44 +03:00
Kubernetes Prow Robot 10405bc4d3
Merge pull request #9792 from olemarkus/openstack-newer-nova-2
Don't use nova for glance mocks
2020-08-21 10:19:40 -07:00
Ole Markus With 29682700c7 Don't use nova for glance mocks
Fetching images through nova is deprecated and removed in newer versions
of the compute API. Mocks now reflect this behavior.
2020-08-21 10:18:52 +02:00
Peter Rifel 5052ae866a
Unset more env vars in update-expected.sh
this prevents spurious changes from being made based on the shell's env vars.

Also adding a parameter to override the package being updated, so that we dont need to test the full repo
2020-08-20 10:17:36 -05:00
Ciprian Hacman e68ee80a93 Move and rename the "distros" package 2020-08-17 07:25:43 +03:00
Kubernetes Prow Robot 713c3b20ae
Merge pull request #9653 from johngmyers/kops-controller-server
Bootstrap worker nodes using kops-controller
2020-08-16 18:00:17 -07:00
Justin SB 2b8fcd816c Clear KOPS_FEATURE_FLAGS in update-expected.sh
This ensures update-expected still works even when KOPS_FEATURE_FLAGS
is set.
2020-08-15 21:06:57 -04:00
John Gardiner Myers 00c60ddff6 Add server code to kops-controller 2020-08-15 09:46:30 -07:00
Kubernetes Prow Robot 69954dc124
Merge pull request #9737 from hakman/remove-tags
Remove unused Tags and FSRoot from NodeUp
2020-08-13 00:40:13 -07:00
Peter Rifel bd771c6b6c
Update verify-terraform to use 0.13.0 2020-08-12 22:19:17 -05:00
Ciprian Hacman ec8bb515c9 Update packages 2020-08-12 18:35:26 +03:00
Ciprian Hacman ecc30f7b47 Fix update and verify goimports 2020-08-12 16:24:17 +03:00
Kubernetes Prow Robot ea2d0da1cc
Merge pull request #8577 from justinsb/dump
Capture logs from a kops cluster
2020-08-09 17:18:19 -07:00
Ciprian Hacman f772c552e7 Remove outdated docs for Calico 2020-08-08 11:08:26 +03:00
Kubernetes Prow Robot b6f4307231
Merge pull request #9672 from srikiz/DO-upload-to-spaces
[Digital Ocean] Upload binaries to DO Spaces
2020-08-06 14:05:51 -07:00
Srikanth 42b1daf5a6 Upload binaries to DO Spaces 2020-08-07 00:09:30 +05:30
Peter Rifel 23dc8383da
Add an initial structure for openstack cloudmock
More info in the docs changes. This adds stubbed http handlers for every resource type used by Kops.
2020-08-05 23:13:34 -05:00
John Gardiner Myers 9596ed8f37 Reimplement fitask generator using gengo 2020-07-28 11:48:08 -07:00