Commit Graph

516 Commits

Author SHA1 Message Date
Kubernetes Prow Robot 22ddc3b423
Merge pull request #8191 from Aresforchina/fix-staticcheck-pkg-resources01
fix staticcheck failures in pkg/resources
2019-12-25 12:03:38 -08:00
tanjunchen cc0f7022f0 /hack: improve shell script in hack 2019-12-25 17:16:31 +08:00
Kubernetes Prow Robot 5cb2d3605c
Merge pull request #8149 from hakman/staticcheck-dnsprovider
dnsprovider/pkg/dnsprovider - fix static check
2019-12-24 06:55:29 -08:00
Aresforchina 8ebcea0024 fix staticcheck failures in pkg/resources 2019-12-24 17:12:53 +08:00
Kubernetes Prow Robot dffc8975d6 pkg/resources/aws:simplify code and remove code 2019-12-24 10:56:57 +08:00
Kubernetes Prow Robot 61d556f9e9
Merge pull request #8188 from Aresforchina/fix-pkg-resources-aws
pkg/resources/aws:simplify code and remove code
2019-12-23 16:19:29 -08:00
Kubernetes Prow Robot 6fd4762290
Merge pull request #8186 from johngmyers/instancegroup-staticcheck
pkg/instancegroups - fix static check
2019-12-23 15:25:29 -08:00
Peter Rifel c6dbe9d686 Remove make command from verify-staticcheck.sh
This script should now be called using `make verify-staticcheck` which will handle the go-bindata dependency.
2019-12-23 09:25:42 -06:00
Aresforchina 8f86a1b201 pkg/resources-aws:simplify code and remove code 2019-12-23 19:00:17 +08:00
Kubernetes Prow Robot 5f588f0a50
Merge pull request #8165 from hakman/staticcheck-protokube
protokube/pkg - fix static check
2019-12-23 02:49:32 -08:00
John Gardiner Myers 1d3d5c1d2f pkg/instancegroups - fix static check 2019-12-22 20:56:27 -08:00
Ciprian Hacman deadeaed1e dnsprovider/pkg/dnsprovider - fix static check 2019-12-23 06:23:38 +02:00
Peter Rifel e7e9e62bcc Remove packages from staticcheck failure list that are no longer failing 2019-12-22 15:12:15 -06:00
Peter Rifel ef8f07c451 Fix verify-staticcheck prow job
The new job was missing the generated files from go-bindata.

I noticed some of the prow jobs use make and others call hack/ scripts directly.

I think it'd be better to use make so we can more easily add dependencies like this, therefor I'd like to propose that we merge this, update the jobs to call make targets, then remove the make command I added to hack/verify-staticcheck.sh

By fixing the existing job as well as the make target, we can unblock other PRs and not get another swarm of failure notifications when the job gets updated to use make.
2019-12-22 15:03:29 -06:00
Ciprian Hacman defcbe8151 protokube/pkg - fix static check 2019-12-20 20:17:19 +02:00
Kubernetes Prow Robot 6856358cd0
Merge pull request #8118 from tanjunchen/fix-staticcheck-001
upup/pkg/fi/ upup/pkg/kutil : simplify code and remove code
2019-12-20 07:41:33 -08:00
Ciprian Hacman fa665943ac nodeup/pkg/model - fix static check 2019-12-18 22:07:31 +02:00
tanjunchen d5fef40863 upup/pkg/fi/cloudup/ upup/pkg/fi/nodeup/ hack/.staticcheck_failures : simplify code and remove code 2019-12-18 09:47:58 +08:00
Kubernetes Prow Robot 252a733415
Merge pull request #8121 from tanjunchen/fix-staiccheck-003
util/pkg/ upup/tools/ :  simplify code and remove unused  code
2019-12-17 11:23:57 -08:00
Kubernetes Prow Robot 40c2762367
Merge pull request #8128 from mikesplain/add_inf1
Add inf1 isntances
2019-12-17 08:13:59 -08:00
tanjunchen e4302e3630 util/pkg/: simplify code and remove unused code 2019-12-17 09:44:18 +08:00
tanjunchen 52537053cc simplify code and remove unused code 2019-12-17 00:28:35 +08:00
mikesplain 77f9cb155e
Add inf1 isntances 2019-12-16 09:20:14 -05:00
Justin Santa Barbara e479ecf682 dev: ignore kops-controller in hack/update-expected.sh
hack/update-expected.sh should ignore KOPSCONTROLLER_IMAGE when
regenerating the golden test outputs, just as it ignores the local
DNSCONTROLLER_IMAGE override.
2019-12-14 10:53:25 -05:00
Peter Rifel 8e9f7e63be Install vendored goimports prior to running it 2019-11-26 19:33:58 -06:00
Kubernetes Prow Robot 7022a4f1c1
Merge pull request #7998 from justinsb/goimports-gomod
Run goimports from locked version in go.mod
2019-11-25 08:25:40 -08:00
Srikanth 0cc3bc0e37 Update packages 2019-11-24 12:56:46 +05:30
Justin Santa Barbara 3239f44ba8 Run goimports from locked version in go.mod
This avoids relying on the version that happens to be installed.
2019-11-24 01:00:30 -05:00
mikesplain e897124c50
Add new instance types 2019-11-18 09:44:52 -08:00
mikesplain 663ef95171
Update for NA storage 2019-11-18 09:43:07 -08:00
Srikanth 9d0b63b482 Fix build issue with verify-packages 2019-10-29 11:48:25 +05:30
Kubernetes Prow Robot 18cfa5f5b2
Merge pull request #7593 from mikesplain/docs_site_map
Docs cleanup / mkdocs migration
2019-10-25 08:31:40 -07:00
Kubernetes Prow Robot c4245be7b7
Merge pull request #7802 from bittopaz/alicloud
Alicloud: add OSS as upload dest
2019-10-19 15:27:43 -07:00
Xiaoyu Zhong a719e04a6d Alicloud: add OSS as upload dest 2019-10-16 21:43:26 +08:00
Guangming Wang 40dca69298 fix string trim func in main
Signed-off-by: Guangming Wang <guangming.wang@daocloud.io>
2019-10-16 21:37:28 +08:00
Justin SB b6862103bb
Change default port for memberlist from 3997
We had a port collision on 3997; change the default memberlist ports
to avoid the collision (we haven't shipped a release with this in it).

Also create a go file so that we can use constants to keep track of
our port numbers, rather than magic values.
2019-10-14 07:26:27 -04:00
Justin SB d3bad10aa9
Move kops-controller to use a yaml configuration file
This is more in keeping with componentconfig, and lets us add more
options easily in future.
2019-10-13 07:27:52 -07:00
Kubernetes Prow Robot 0c66a304c3
Merge pull request #7754 from tanjunchen/fix-up-gosimple-error
fix-up gosimple check error
2019-10-12 11:18:44 -07:00
Kubernetes Prow Robot ff1d94c7cb
Merge pull request #7692 from zetaab/kops_ctrl_openstack
Kops controller support for OpenStack
2019-10-11 09:13:41 -07:00
Thomas Jackson 6b53d4a199 Update hack packages 2019-10-10 13:09:22 -07:00
tanjunchen 43bf6bdab6 fix-up gosimple check error 2019-10-07 11:59:57 +08:00
Jesse Haka ed8dbc41d0 kops controller support for openstack 2019-09-28 10:06:39 +03:00
Peter Rifel 466ca95243 Dont assign unused values to variables 2019-09-27 12:51:19 -07:00
Peter Rifel 413580f13f aws sdk - replace deprecated session.New with session.NewSession 2019-09-27 12:51:19 -07:00
Peter Rifel 974a1c6b3c Add verify-staticcheck script mostly copied from kubernetes/hack/verify-staticcheck.sh 2019-09-27 11:58:33 -07:00
Justin SB cdaa7a3a48
Fix boilerplate: headers & packages 2019-09-25 12:48:14 -04:00
mikesplain c420249120 Add g4dn 2019-09-23 13:23:03 -04:00
mikesplain 1c4c541938 Fix machine types for new nvme string formatting 2019-09-23 13:22:30 -04:00
mikesplain 45a8e5a3b8 First pass 2019-09-19 20:56:29 -04:00
Justin SB 39d642ee97
hack/update-expected.sh: mask development env vars
There are a few env vars which are frequently set in development, but
should not be reflected in the tests.  Clear them before generated the
expected output.
2019-09-14 11:45:27 -04:00
mikesplain 9e55b8230a Update copyright notices
Also cleans some white spaces
2019-09-09 14:47:51 -04:00
mikesplain 2c95884c25 Update and add back some sizes 2019-09-03 15:15:35 -04:00
Justin SB 3fbc906cbc
Create env-var helper function
Refactor to start to centralize the env-var configuration for system
components, also start to add test coverage so we can be sure we
haven't broken things!
2019-09-02 10:26:09 -07:00
Justin SB 810c65eb46
Copy well-known users from apiserver
This should eliminate the dependency on k8s.io/apiserver
2019-08-31 08:50:09 -07:00
Justin SB e48cf36353
Create verify-gomod script
Wrapper around go mod tidy

Currently doesn't delete from go.sum, which is untidy but expected
behaviour.
2019-08-30 21:17:17 -07:00
Justin SB 40928493b5
Update apimachinery
Also fix hack/make-apimachinery.sh script problem with files that are
not marked writeable.
2019-08-26 21:35:06 -07:00
Justin SB 08c6f0c807
Update packages 2019-08-25 16:00:41 -04:00
Justin SB 5d7d7aa647
hack/update-expected: regenerate gobindata
Otherwise we don't always pick up the latest changes to manifests.
2019-07-23 07:49:46 -07:00
Justin SB 512378b335
Rationalize golden-output comparison
Create a single helper function: AssertMatchesFile

Also a few output files that weren't consistent.
2019-07-21 23:08:48 -04:00
Justin SB 30d8dd8692
Create hack/update-expected.sh to update test output
This should streamline things a little!
2019-07-19 10:48:37 -04:00
Kubernetes Prow Robot 5340fc2799
Merge pull request #6811 from xichengliudui/delete-function-script-keyword
Delete the function keyword to prevent shellcheck from failing
2019-07-18 20:09:10 -07:00
Kubernetes Prow Robot 21b5e3b3f4
Merge pull request #7195 from rekcah78/add_new_m5_r5_instances
update instances list with make update-machine-types
2019-07-09 09:32:02 -07:00
Kashif Saadat 0a32417375 Add verify-goimports to tests and fix the script so it fails correctly 2019-07-03 16:32:45 +01:00
Christophe GASMI 2cc94d53ab update instances list with make update-machine-types 2019-06-28 01:29:14 +02:00
Kubernetes Prow Robot 00edef84b3
Merge pull request #7166 from rekcah78/add_new_c5_instances
add c5.12xlarge, c5.24xlarge, c5.metal, i3en.metal
2019-06-20 11:31:09 -07:00
Christophe GASMI 00353c736f update instances list with make update-machine-types 2019-06-20 20:31:30 +09:00
Austin Moore 67d9f5f190
Move getProxyEnvVars into a util package 2019-06-05 15:59:19 -04:00
Justin SB 02b67a69a9
Add script to verify CRD generation
Issue #6892
2019-05-16 03:25:45 -07:00
Mike Splain 28dc1dd7de Add i3en 2019-05-09 12:46:15 -04:00
mikesplain 3d3dc5781d Fix machine types with klog 2019-05-07 09:02:31 -04:00
Justin SB 76d03b3f71
Generated files: glog -> klog 2019-05-06 12:56:03 -04:00
Justin SB 3e33ac7682
Change code from glog to klog
We don't call klog.InitFlags yet, because that will cause a flag
redefinition error until we get everyone to stop using glog.  That
will happen when we update to k8s 1.13.
2019-05-06 12:54:51 -04:00
Kubernetes Prow Robot 78f5b2c06a
Merge pull request #6837 from mikesplain/add_t3a_family
Add t3a family
2019-04-26 12:16:09 -07:00
mikesplain 835ccf2973 Remove sets to expose error 2019-04-26 12:46:19 -04:00
mikesplain 148bbd9c7a Add t3a family 2019-04-26 11:06:44 -04:00
Justin SB bf4c4a1a95
Source gofmt from bazel go
Using the approach from k8s.io/repo-infra.  This avoids problems where
we are testing with a different version of go than we are building
with.
2019-04-21 16:41:11 -04:00
xichengliudui 2aab2d15cd Delete the function keyword to prevent shellcheck from failing 2019-04-20 07:04:24 -04:00
mikesplain db6c0eb02c Update instances types
adds m5ad's and r5ad's
2019-04-03 11:22:50 -04:00
LilyFaFa 12d54b6a1f support gossip for AliCloud 2019-03-15 15:26:12 +08:00
Gennady Trafimenkov b8b7840c0f Update list of packages 2019-03-03 16:16:08 +03:00
Justin SB 148a370f39 update-machine-types: more metal instance types
m5, m5d, r5, r5d, z1d metal types
2019-02-28 15:48:33 -05:00
Eric Greer 31a4c40131 merge conflict resolution 2019-02-21 15:20:05 -08:00
Eric Greer 8362b1260e etcd memory requests can now be specified 2019-02-21 15:14:51 -08:00
Kubernetes Prow Robot 1564a67461
Merge pull request #6277 from gambol99/mix_instances_policy
AWS Mixed Instances Policy / Fleet
2019-02-20 10:30:33 -08:00
Rohith 098b4486f5 - fixing up the spelling mistake and the package update 2019-02-04 11:59:43 +00:00
mikesplain a331b107b6 Fix machine types and cleanup makefile 2019-01-31 17:44:18 -05:00
Kubernetes Prow Robot 70484c009a
Merge pull request #6232 from justinsb/ask_kops_for_its_version
kops version: Add --short flag, use it to get version in scripts
2019-01-27 13:50:37 -08:00
Justin SB b40c9034bd
kops version: Add --short flag, use it to get version in scripts
We upload to a location that includes the version, but we need to
specify the version in KOPS_BASE_URL.  We expose an option to make
`kops version` more amenable to this scripting.
2019-01-22 22:27:33 -05:00
Derek Lemon -T (delemon - AEROTEK INC at Cisco) 6022679e6b Openstack package updates 2019-01-19 14:07:10 -07:00
Derek Lemon -T (delemon - AEROTEK INC at Cisco) 103268710c update packages 2019-01-15 16:29:02 -07:00
Justin SB 533a57a096 Recognize 2019 as a year
Happy new year!
2019-01-02 18:30:54 -05:00
Justin SB a3a48e9078
Create dev-upload tasks, for a faster upload during dev builds 2018-12-20 11:37:30 -05:00
Justin Santa Barbara b78e4312ec machine-types: remove duplicate dedup
PR #6058 addded dedup in a better way than I had previously done, so
remove my more complicated and now superfluous second dedup.
2018-11-27 23:10:35 -05:00
k8s-ci-robot f57d836345
Merge pull request #6117 from justinsb/add_a1_and_c5n
Add a1 and c5n instance types
2018-11-27 09:56:27 -08:00
Justin Santa Barbara a29d223bc1 machine-type generator: Warn if instance type not in ENI map
And we write these warnings to the output, so that we can see them in
PR review.
2018-11-27 07:33:47 -05:00
Justin Santa Barbara 9a8100f74b Add a1 and c5n instance types
* Updated vpc_ip_resource_limits
* Ran `make update-machine-types`
2018-11-27 06:57:10 -05:00
Ripta Pasay 56a8059f8e Update bazel 2018-11-25 22:46:38 +00:00
Ripta Pasay 7ca6ddc9e0 Replace MaxPods in machine type data with InstanceENIs and InstanceIPsPerENI 2018-11-25 22:35:25 +00:00
Ripta Pasay ab8565df9c Import awsutils from amazon-vpc-cni-k8s plugin
https://raw.githubusercontent.com/aws/amazon-vpc-cni-k8s/master/pkg/awsutils/vpc_ip_resource_limit.go
2018-11-25 20:45:33 +00:00
Ripta Pasay aa34956560 Ignore any duplicates being returned by the pricing API when rebuilding machine types 2018-11-25 20:45:33 +00:00
Ripta Pasay c2d82abd88 Calculate max pods based on Amazon VPC CNI plugin library 2018-11-25 20:45:33 +00:00
Justin SB 5dfcb9b59e
Update machine type generator
* Handle NA ECU value (map to zero)
* Deduplicate machine types (I was getting duplicates)
2018-11-18 21:02:40 -05:00
Ilya Dmitrichenko 17a2c47495
Separate subnet utils into a standalone package 2018-10-26 12:01:47 +01:00
Liran Polak 6509e32b1b fix: boilerplate headers and packages list 2018-10-14 11:37:31 +03:00
Justin Santa Barbara 4378015f47 Remove last vestiges of _vendor directory
It got left behind because goautoneg is in mercurial, I believe.

Remove the _vendor/ directory & references to it - we have it in
vendor/ anyway.
2018-10-02 18:39:43 -07:00
Justin Santa Barbara 2a2b873656 Move flag parsing out of init block
For whatever reason it wasn't working for me...
2018-09-22 02:47:39 -04:00
Justin Santa Barbara f9bd0185d9
Merge branch 'master' into docs 2018-09-21 23:43:15 -07:00
k8s-ci-robot 2ad8588e51
Merge pull request #5635 from nareshku/support-albs-nlbs
Support for deletion of aws resources albs nlbs during delete
2018-09-21 11:40:33 -07:00
k8s-ci-robot 5db443d06a
Merge pull request #5785 from justinsb/vendor_misspell
Move verify-spelling to script, install from vendor
2018-09-17 13:30:07 -07:00
k8s-ci-robot 13ffa0f5a3
Merge pull request #5787 from justinsb/machine_type_generator_3
machine-type generator: go vet fixes
2018-09-14 10:43:40 -07:00
Justin Santa Barbara f0e541ec55 Move verify-spelling to script, install from vendor 2018-09-14 10:42:19 -04:00
Justin Santa Barbara bb3e90513c machine-type generator: go vet fixes
Keep go vet happy - address its complaints about error formatting
2018-09-14 10:37:09 -04:00
k8s-ci-robot d81ab2acba
Merge pull request #5553 from mikesplain/machine_type_generator
Machine type generator
2018-09-14 07:24:59 -07:00
Justin Santa Barbara e8650ca8ca Tweak machine_types generator to match our existing values
We weren't outputing the Burstable or GPU attributes, and the sorting
order wasn't quite the same.  This made verification harder.
2018-09-14 09:39:04 -04:00
Naresh Kumar Amrutham 37651c3534 fixed merge conflicts 2018-09-10 11:45:47 -07:00
k8s-ci-robot 2f1d2e07f7
Merge pull request #5565 from justinsb/refactor_printer
Refactor tables package to be more reusable
2018-09-03 15:28:36 -07:00
Mike Splain 29e852a731 Add readme 2018-08-31 12:42:13 -04:00
Mike Splain 1fa04f82de Add makefile changes 2018-08-31 12:42:13 -04:00
Mike Splain 9f01ea79cb Add deps 2018-08-31 12:42:13 -04:00
Mike Splain 2e2039f03d First pass 2018-08-31 12:35:53 -04:00
Levi Blackstone 206d95d614
OpenStack: enable cluster state deletion
Stub out a list resources method and call it from the collector
so that cluster state can be deleted via the API.
2018-08-30 20:08:57 -06:00
Naresh Kumar Amrutham 29050e276d update packages file 2018-08-17 13:24:20 -07:00
Justin Santa Barbara 76f5ed2d9c Refactor tables package to be more reusable
We still need the reflect helpers, but we allow for clients to
register their own pretty-printers, which avoids the package
dependency for our pretty-printer.  We register our pretty printers in
an init function in the relevant package (in this case,
upup/pkg/fi/printers.go)

Fix #5551
2018-08-02 14:09:05 -04:00
k8s-ci-robot ed7408540b
Merge pull request #5507 from mikesplain/fix_gendocs
Fix api-gen-docs dependencies
2018-07-28 22:46:56 -07:00
Justin Santa Barbara 6505dc08f6 Add error handling for failed deletion of tempfiles
We create a helper package `try`
2018-07-27 15:14:08 -04:00
Mike Splain a291b6161e Fix api-gen-docs 2018-07-24 10:00:43 -04:00
k8s-ci-robot 28118f3da4
Merge pull request #5478 from kampka/bash-shebangs
Use portable shebang for hack scripts
2018-07-20 13:07:50 -07:00
k8s-ci-robot 61fe8626c9
Merge pull request #5477 from chrisz100/fix/travis-apimachinery
have travis fail when verify-apimachinery.sh fails and fix incompatible apimachinery
2018-07-20 10:52:59 -07:00
Christian Kampka 2c104e2779 Use portable shebang for hack scripts 2018-07-20 14:28:12 +02:00
Christian Jantz 574c99d4cc have travis fail when verify-apimachinery.sh fails 2018-07-20 12:51:24 +02:00
Justin Santa Barbara 128417c6d4 Introduce a global backoff to rate limit failed image downloads
This should help with runaway downloads of protokube.tar.gz
2018-07-19 12:13:17 -04:00
Rohith 528117b631 - adding the node authorization service into kops
- updated the Makefile to build the image (i think)
2018-07-06 20:14:35 +01:00
Rohith 304d0ce8a9 - consuming the node authorization api spec in nodeup binary
- adding the options builder to fill in the model
- adding the spec into the bootstrap config
2018-07-06 20:14:35 +01:00
LilyFaFa 7e1f400d11 delete cloud resources for ALicloud 2018-06-30 09:55:43 +08:00
k8s-ci-robot fbd1db81c5
Merge pull request #4564 from justinsb/vendor_gazelle
vendor gazelle
2018-06-04 20:05:56 -07:00
Justin Santa Barbara b13979660d bazel: add notes that tasks do not work 2018-06-04 10:45:52 -07:00
Justin Santa Barbara fe832e7be8 Add gazelle dependency, update toml, fix script 2018-06-04 08:12:05 -07:00
k8s-ci-robot e323fa918f
Merge pull request #5126 from justinsb/optional_etcd_manager
Support (optional) etcd-manager
2018-05-25 15:45:32 -07:00
Justin Santa Barbara ba87c36f73 Support (optional) etcd-manager 2018-05-25 16:01:22 -04:00
Manuel de Brito Fontes 6b205e599a
Generate live project documentation using mkdocs and gh-pages 2018-05-01 15:10:09 -03:00
xh4n3 2bdb9ede97 add user-agent for statistic purpose, add dep 2018-04-19 20:57:56 +08:00
Mike Splain 0f26d60339 Update rules go and gazelle 2018-04-18 14:48:42 -04:00
zengchen1024 280e775466 add network builder 2018-04-02 14:18:26 +08:00
k8s-ci-robot 96b6d1c6dc
Merge pull request #4714 from justinsb/boilerplate_year
Update boilerplate year
2018-03-19 13:42:59 -07:00
k8s-ci-robot 22561e4ecf
Merge pull request #4708 from justinsb/move_aws_resources
Move AWS resources into its own subpackage
2018-03-19 09:41:01 -07:00
Justin Santa Barbara 44dd26c3fc Update boilerplate year 2018-03-19 10:58:43 -04:00
Justin Santa Barbara b95b0cfc1e Fix boilerplate scripts
update-header.sh uses the output of verify-boilerplate
2018-03-18 17:31:10 -04:00
Justin Santa Barbara 0f6645a9d7 Move AWS resources into its own subpackage 2018-03-18 14:43:12 -04:00
k8s-ci-robot 994a348cb4
Merge pull request #4569 from justinsb/mock_aws_roundtrip
Create lifecycle test against AWS mocks
2018-03-11 16:11:10 -07:00
Justin Santa Barbara 85b972bc28 Fill out cloudmock to do a basic lifecycle test 2018-03-11 17:04:30 -04:00
Justin Santa Barbara b677684c9e typo: anmed -> named 2018-03-11 12:57:50 -04:00
k8s-ci-robot d1e7128da6
Merge pull request #4633 from chrislovecnm/verify-fail-output
Updating verify scripts so that output is highlighted
2018-03-10 16:58:09 -08:00
chrislovecnm 4e989bccfb Updating verify scripts so that output is highlighted
When a verify script fails we now output the word 'FAIL' at the start of the message
so that it is highlighted in the build logs.
2018-03-09 14:39:06 -07:00
chrislovecnm f785d2bd12 patching with PR 4598, need to remove this commit 2018-03-09 14:22:12 -07:00
k8s-ci-robot 5c1518dbda
Merge pull request #4561 from chrislovecnm/new-bazel-version
Bumping gazelle version on bazel scripts
2018-03-02 14:27:54 -08:00
chrislovecnm 07b1ae9e66 Bumping gazelle version on bazel scripts 2018-03-02 13:03:41 -07:00
chrislovecnm 2e0d7fb92b Adding script to test that apimachinery is up to date
Added a bash script to run a make target that tests that apimachinery is
up to date.  I updated the existing make target so that we can pass in a
flag which enables validation only, and not generation.
2018-03-01 18:25:20 -07:00
chrislovecnm 0efb600c72 Updating gazelle sha in bazel scripts 2018-02-26 13:03:19 -07:00
k8s-ci-robot e317a5ab00
Merge pull request #4381 from justinsb/kops_set_cluster_1
Experimental kops set cluster command
2018-02-26 10:58:45 -08:00
Mike Splain 45a57915e2 Fix bazel deprecation notice 2018-02-26 09:36:13 -05:00
Justin Santa Barbara 6f52996c2a Experimental kops set cluster command
Introduce an experimental kops set cluster command, for setting
individual fields in the same style as the kops create cluster
--override flags.

For now, feature flag gated by the same SpecOverrideFlag feature flag.

Also split out pkg/commands package to facilitate testing.
2018-02-26 09:33:16 -05:00
chrislovecnm fe790df0ce fixing bazel files to pass CI 2018-02-23 17:36:43 -07:00
chrislovecnm 798d40b4a2 updating functionality to verify bazel build files 2018-02-23 17:36:42 -07:00
Justin Santa Barbara e4fafa6065 Use legacy image registry gcr.io/google_containers for <= 1.9
The k8s.gcr.io prefix is an alias, but for CI builds we run from a
docker load, and we only double-tag from 1.10 onwards.  For versions
prior to 1.10, remap k8s.gcr.io to the old name.  This also means that
we won't start using the aliased names on existing clusters, which could
otherwise be surprising to users.
2018-02-22 21:42:33 -08:00
k8s-ci-robot c37eab74ca
Merge pull request #4435 from chrislovecnm/remove-submodules
Remove submodules
2018-02-19 14:54:38 -08:00
chrislovecnm 0ccd413f82 Fixing problems in dev build script example 2018-02-13 10:22:38 -07:00
chrislovecnm 6a7d80a49a removing old python file for updating submodules 2018-02-12 21:45:13 -07:00
k8s-ci-robot 27c8ddc09d
Merge pull request #4382 from justinsb/try_dep
Use dep to maintain vendor directory
2018-02-12 16:24:49 -08:00
Kashif Saadat ac25853cd5 - Add etcdClusterSpec Image & Version in bootstrap data for Master nodes
- Reuse execWithTee fn for ETCD Command (tee & mkfifo in different path for newer image versions)
2018-02-10 12:14:36 +00:00
Justin Santa Barbara 9fbbbcb76a Add hack/dep.py to check dep status against k8s Godeps.json 2018-02-04 21:52:34 -05:00
Justin Santa Barbara 7dfca05c09 Remove federation support
As it has been removed from upstream kubernetes, in favor of the
multicluster revamp.
2018-02-03 16:53:39 -05:00
Kashif Saadat e315c350be Implement ability to update Load Balancer subnets 2018-01-17 11:57:29 +00:00
k8s-ci-robot 48365c3883
Merge pull request #4194 from justinsb/kubedisco
Add experimental kube-discovery
2018-01-04 18:08:12 -08:00
Justin Santa Barbara ec8db8b78c Initial implementation of bundle command
The bundle command will support enrollment of a machine via SSH.
2018-01-04 18:55:28 -05:00
Justin Santa Barbara b8b426b800 Add experimental kube-discovery
To split off master discovery from protokube.
2018-01-04 13:29:43 -05:00
Justin Santa Barbara bf24a6443c Avoid ListSecrets call in nodeup
This helps up with GCE permissions, but also helps us get rid of auth
tokens.
2017-12-19 11:45:04 -05:00
Kubernetes Submit Queue dd49d69399
Merge pull request #3254 from chrislovecnm/file-assets
Automatic merge from submit-queue.

work on using files assets

Basic MVP for file assests.

- using file assest builder
- able to upload files
- using URL structs instead of strings everywhere
2017-12-17 16:10:23 -08:00
Kubernetes Submit Queue 7768729cf2
Merge pull request #3832 from justinsb/cleanup_ssh
Automatic merge from submit-queue.

Refactor: separate out SSHCredentials from Keyset stores
2017-12-17 15:05:09 -08:00
chrislovecnm 7057aaf1bb Enabling the file assets
File assets and the SHA files are uploaded to the new location. Files
when are users uses s3 are upload public read only. The copyfile task
uses only the existing SHA value.

This PR include major refactoring of the use of URLs.  Strings are no
longer categnated, but converted into a URL struct and path.Join is
utlilized.

A new values.go file is included so that we can start refactoring more
code out of the "fi" package.

A
2017-12-17 15:26:57 -07:00
Kubernetes Submit Queue b44d894813
Merge pull request #3860 from justinsb/batching
Automatic merge from submit-queue.

Copy dnsprovider into our code, implement route53 batching

Fixes #3121
2017-12-15 15:44:12 -08:00
Justin Santa Barbara 6d166a41dd Refactor protokube hosts file into its own package
So we can bring this in without our gossip layer

This supports an imminent implementation that uses DNS-SD
2017-12-15 01:22:51 -05:00
Justin Santa Barbara 1cceb8ed9e Update hack/.packages 2017-12-13 21:32:21 -05:00
Justin Santa Barbara 509b83ac7a Refactor: separate out SSHCredentials from Keyset stores
We've done this in the API already, but we had a single CAStore
interface that did Keysets and SSHCredentials.  Separate out
SSHCredentials into SSHCredentialStore, and start using API objects as
our primary representation.
2017-12-13 20:16:59 -05:00
Arto Jantunen 53669b8217 Make ELB somewhat mockable 2017-11-28 11:48:57 +02:00
zengchen1024 0949d597b7 build volume task 2017-11-20 11:52:19 +08:00
zengchen1024 76b9aebafb update hack/.package 2017-11-13 17:03:30 +08:00
chrislovecnm 30acda868a updating to bazel 0.0.7 and adding verify scripts 2017-11-04 20:59:01 -06:00
Kubernetes Submit Queue b02c3a269c
Merge pull request #3726 from justinsb/storage_acls
Automatic merge from submit-queue.

GCS: Use ACLs for GCE permissions

This needs less permissions, but also allows for more granular control over
access to files than whole-bucket permissions that IAM gives us.
2017-10-29 20:18:51 -07:00
Justin Santa Barbara b2bcba4a6d GCE: Use object-level permissions for files in GCS
This lets us configure cross-project permissions while ourselves needing
minimal permissions, but also gives us a nice hook for future lockdown
of object-level permissions.
2017-10-29 19:17:00 -04:00
Justin Santa Barbara 1f0601126c Refactor gce resources into pkg/resources/gce
Should be a no-op refactor
2017-10-29 18:37:23 -04:00
Justin Santa Barbara 66e74fac6a Rename pkg/resources/utils -> pkg/resources/ops
That seems to be what utils really is.
2017-10-29 16:32:48 -04:00
Justin Santa Barbara a18363f059 Refactor toolbox dump & dump structured instances
This will enable log collection even if nodes don't register.

AWS: Dumps ids & addresses
GCE: Dumps names - addresses to follow
Others: Not yet!
2017-10-28 14:46:28 -04:00
Kubernetes Submit Queue a4d6895472 Merge pull request #3707 from andrewsykim/droplet
Automatic merge from submit-queue.

Implement DigitalOcean Droplet FI Task

Implements cloudup fi tasks for DigitalOcean droplets. It makes a few assumptions to reduce the size of this PR, those will be addressed in future PRs. 

Also does some cleanup in the DigitalOcean `dns` package.
2017-10-27 08:30:57 -07:00
andrewsykim 45bf2cb3a7 Implement DigitalOcean Droplet FI Task 2017-10-27 09:48:42 -04:00
Justin Santa Barbara ed2dab1af5 kops-server: ig short-name
Also cleanup the shared REST subclass
2017-10-23 00:55:55 -04:00
Justin Santa Barbara 56ecd4ac14 Add missing hack/make-gendocs.sh script 2017-10-09 01:29:54 -04:00
Justin Santa Barbara 38ea16a4ae GCE: Fix subnets vs zones formatting of instance groups 2017-10-03 13:42:14 -04:00
Justin Santa Barbara 544990842a More fixes for 1.8 API changes 2017-10-01 23:02:32 -04:00
Justin Santa Barbara 2205e26257 Updates for new apimachinery 2017-10-01 13:53:26 -04:00
Kubernetes Submit Queue 0905e71741 Merge pull request #3411 from justinsb/mirror_stores
Automatic merge from submit-queue.

Mirror keystore & secretstore
2017-09-30 23:08:33 -07:00
Justin Santa Barbara 7fd1196708 Add Zones field to InstanceGroup
The Zones field can specify zones where they are not specified on a
Subnet, for example on GCE where we have regional subnets.
2017-09-30 19:44:35 -04:00
Kubernetes Submit Queue eb110f5b6c Merge pull request #3478 from chrislovecnm/using-same-disk-size-gce
Automatic merge from submit-queue.

using same disk sizes for gce

Using the same disk size for gce and aws.  We need to override the disk sizes in the e2e tests, but that is another PR.

Closes: https://github.com/kubernetes/kops/issues/3294
2017-09-30 16:01:38 -07:00
chrislovecnm c4c63b2b0c using same disk sizes for gce 2017-09-29 16:07:38 -06:00
chrislovecnm a431eb3e43 refactoring to use cloud based GetGroups 2017-09-29 12:29:07 -06:00
Justin Santa Barbara 559d885480 Mirror keystore & secretstore
This allows us to have our API objects in kops-server, but our
configuration on S3 or GCS.
2017-09-24 00:09:02 -04:00
Justin Santa Barbara e730e043ab Add function to get etcd status
This will allow us to permit changing the etcd configuration only if
etcd has not yet been configured.
2017-09-22 23:27:26 -04:00
Kubernetes Submit Queue 9ebe302939 Merge pull request #3291 from justinsb/baremetal_1
Automatic merge from submit-queue

Skeleton bare-metal provider
2017-09-14 15:55:59 -07:00
Rohith aaf6143a98 Toolbox Templating
Extending the current implementation of toolbox template to include multiple files and snippets. Note, i've removed the requirements for defaults as I think people should be forced to specifically pass them.

- fixing the vetting iseues to the method YamlToJson -> YAMLToJSON
- adding a safety check to ensure templates don't reference an unknown value
- extending the unit test to ensure the above works on main and snippets
- include the ability to specify multiple configuration files, useful for common.yaml and prod.yaml etc

Requested Changes - Toolbox Templating

Added the requested changes

- moved the templater into it's own package rather than using base util
- moved to using the sprig library for additional template function
- @note: i couldn't find a native way in sprig to do snippets, also the i've overloaded the indent as it appears to do the indent on all lines rather than on the newline, meaning i'd have to shift my first line back by the indent to get it to work, which seems ugly
2017-09-08 20:30:21 +01:00
Kubernetes Submit Queue 05cf84dc3d Merge pull request #3299 from justinsb/extract_userdata
Automatic merge from submit-queue

Extract UserData from CloudFormation output during testing
2017-09-06 10:05:39 -07:00
andrewsykim d9fa618de6 refactor resource tracker to be usable across packages 2017-09-02 17:37:21 -04:00
Justin Santa Barbara 8e68be7932 Skeleton bare-metal provider
Just creating the provider, it isn't wired in yet.
2017-08-30 21:10:46 -04:00
Justin Santa Barbara e793562ee6 Extract UserData from CloudFormation output during testing
This gives us some sanity, so we can peek inside the base64 blob
2017-08-29 09:47:11 -04:00
Justin Santa Barbara a16c8b1500 Refactor PKI classes into their own package
This will support generation of keys on the node.
2017-08-27 08:14:55 -04:00
andrewsykim 525fde3609 implement digitalocean volumes task 2017-08-21 09:50:36 -04:00
chrislovecnm ee17e6567c starting work on file assets builder 2017-08-18 13:04:12 -06:00
Mike Splain 4331c12f73 Update image
To make it more copy and paste friendly
2017-08-16 09:59:40 -04:00
Mike Splain f6018df43e Fix quote typo 2017-08-16 09:36:42 -04:00
andrewsykim 1f0d0bbc75 initial cloud interface for DigitalOcean 2017-08-11 19:33:17 -04:00
Kubernetes Submit Queue ac887ce290 Merge pull request #3016 from justinsb/upload_taskify_2
Automatic merge from submit-queue

Copy docker images when they are redirected
2017-07-21 12:10:47 -07:00
Justin Santa Barbara 76743e64de Copy docker images when they are redirected 2017-07-20 23:40:46 -04:00
Phillip Wittrock 6a020bcd59 Check in generated openapi for the kops apiserver.
- Note the openapi will not be regenerated on each change.  This needs to done in a follow up.
2017-07-19 18:42:09 -07:00
Justin Santa Barbara d21d81dc5b Initial experimental kops-apiserver 2017-07-17 00:51:20 -04:00
Justin Santa Barbara 7a870f65b9 Example of how to do bash in our CLI help
* Use the pretty.LongDesc function (which doesn't pipe it through
markdown -> ascii)
* Use pretty.Bash helper to avoid problems with backticks in
go-backtick-quoted-strings
* Make sure indentation is consistent
2017-07-15 22:09:48 -04:00
andrewsykim a866f70e1e digitalocean support -- dns provider 2017-07-14 09:00:15 -04:00
Justin Santa Barbara 1965a4be49 Updates to fix unit tests 2017-07-08 18:46:01 -04:00
Justin Santa Barbara e945322cab Support generated clientset as alternative to vfs clientset
We modelled our VFS clientset (for API objects backed by a VFS path)
after the "real" clientsets, so now it is relatively easy to add a
second implementation that will be backed by a real clientset.

The snafu here is that we weren't really using namespaces previously.
Namespaces do seem to be the primary RBAC scoping mechanism though, so
we start using them with the real clientset.

The namespace is currently inferred from the cluster name.  We map dots
to dashes, because of namespace limitations, which could yield
collisions, but we'll deal with this by simply preventing users from
creating conflicting cluster names - i.e. you simply won't be able to
create a.b.example.com and a-b.example.com
2017-06-20 22:29:37 -04:00
Justin Santa Barbara 9d40b0e6ca Support internal (gossip) names for AWS also 2017-06-19 14:16:35 -04:00
Chris Love 0c1fd6b272 Merge pull request #2617 from WillemMali/move-verify-gendocs-to-makefile
Move verify-gendocs into Makefile and tighten Makefile safety
2017-06-14 09:45:27 -06:00
Willem Mali 60ad299075 moved verify-gendocs into Makefile and tightened Makefile safety (enabled noclobber, errexit and errunset) 2017-06-12 22:25:14 +02:00
andrewsykim e8c99ee72e removes cluster delete code in upup/pkg/kutil duplicated in pkg/resources and puts instancegroup and rollingupdate code into its own packges 2017-06-10 15:21:06 -04:00
Willem Mali cc7fdf91f4 Implemented a Git hook for the CI tests and related installer in the Makefile.
Funnily enough, while trying to commit the hook code it rejected my commit because the hook was missing the standardized script header.
2017-05-14 18:25:38 +02:00
chrislovecnm 7487b0d756 updating docs, adding verify-gendocs and more build tweaks 2017-05-04 18:58:10 -06:00
Justin Santa Barbara eddd73549c Use LB IP address for private dns 2017-04-25 01:32:27 -04:00
Justin Santa Barbara c8b18be9dd Gossip backed DNS 2017-04-25 01:32:21 -04:00
Miao Luo aed9f154ad Fix minor errors due to rebase. 2017-04-21 11:03:13 -07:00
Miao Luo de72c50a0d Change the default image name for vsphere provider and other minor fix. 2017-04-20 23:38:33 -07:00
Miao Luo 58197e6dab Support user-defined s3 endpoint.
When Environment variable S3_ENDPOINT is not empty, kops will use
the bucket on this specific s3 endpoint, instead of using AWS S3
by default.
2017-04-20 23:38:32 -07:00
Miao Luo b15014f9a3 Address review comments and add installing instructions. 2017-04-20 23:37:41 -07:00
prashima 5c92bc6a2d Added featureflag for vSphere cloud. Fixes #26. (#29) 2017-04-20 23:37:40 -07:00
prashima fc8faea2c8 Fixed environment variable setting process for vSphere. (#16) 2017-04-20 23:37:19 -07:00
prashima bc3e8c3734 Added code to enable nodeup and protokube building and execution for vSphere VM (#11)
* Added code to enable nodeup and protokube building and execution for vSphere VM.

* Fixed nodeup template for vSphere.
2017-04-20 23:37:19 -07:00
SandeepPissay 3ed60bd708 Fixed the formatting and added copyright headers to new files 2017-04-20 23:31:49 -07:00
Justin Santa Barbara 30361eef68 Merge pull request #2328 from andrewsykim/2310
Move cluster delete files to pkg/resources
2017-04-19 21:31:38 -04:00
Justin Santa Barbara a7c2c554e1 channels: support targeting kubernetes versions 2017-04-08 11:08:03 -04:00
andrewsykim fe1dc540d1 add k8s.io/kops/pkg/resources to pkg/resources 2017-04-08 10:52:06 -04:00
Chris Love e28c7beb2a Merge pull request #2316 from justinsb/add_fix_for_hack_update_header
Add fix for hack/update-header.sh
2017-04-07 11:00:49 -06:00
Justin Santa Barbara 38d4d69a1d Add fix for hack/update-header.sh
Without this verify-boilerplate.sh gave an exit code of 1 and the script
exited.
2017-04-07 00:24:44 -04:00
chrislovecnm a3a97c665e updating CI in hack script 2017-04-06 16:59:54 -04:00
Kris Nova c0e88558f0 Getting deps up to speed for the server
Protobuf and etcd updates - yey
2017-03-28 11:10:21 +02:00
Justin Santa Barbara b6401a384c Merge pull request #2127 from justinsb/godeps_sync_tool
Script to sync our submodules from Godeps
2017-03-27 21:26:00 -04:00