Commit Graph

228 Commits

Author SHA1 Message Date
liranp 80020052d3
feat(spotinst): new instance group type: ocean 2019-06-03 12:38:46 +03:00
Derek Lemon (delemon) 9542e9d1d7 Removing Unused type 2019-05-31 11:18:12 -06:00
Derek Lemon (delemon) 7b433cfae7 Openstack port resources derived from network 2019-05-29 07:42:09 -06:00
Derek Lemon (delemon) 7c53b35c9d Delete floating IP's based on the subnet resource, to clean up dynamically added ones as well, allowing for subnet deletion
Bazel updates

Updating deletion logic for octavia clusters
2019-05-23 07:53:09 -06:00
Justin SB 49b40c9150
VPC cleanup: recognize the error code for concurrent VPC deletion
Hit this when I was cleaning up my VPCs manually.
2019-05-16 16:06:41 -04:00
Justin SB 76d03b3f71
Generated files: glog -> klog 2019-05-06 12:56:03 -04:00
Justin SB 3e33ac7682
Change code from glog to klog
We don't call klog.InitFlags yet, because that will cause a flag
redefinition error until we get everyone to stop using glog.  That
will happen when we update to k8s 1.13.
2019-05-06 12:54:51 -04:00
Lily dafbc17c5a add natGateways tasks for ALICloud 2019-03-15 16:39:37 +08:00
Kubernetes Prow Robot 1564a67461
Merge pull request #6277 from gambol99/mix_instances_policy
AWS Mixed Instances Policy / Fleet
2019-02-20 10:30:33 -08:00
Kubernetes Prow Robot 12307284d6
Merge pull request #6487 from justinsb/ssh_guess_username_for_rhel_family
Guess SSH usernames for RHEL & Centos in toolbox dump
2019-02-20 02:37:14 -08:00
Kubernetes Prow Robot 2094ef7d20
Merge pull request #6438 from zetaab/octavia
support both octavia and old lbaasv2 api in openstack
2019-02-20 00:23:30 -08:00
Justin SB cf4bd22a80
Guess SSH usernames for RHEL & Centos in toolbox dump
A small bit of polish!
2019-02-19 21:23:34 -05:00
Kubernetes Prow Robot ced14aa57e
Merge pull request #6442 from zetaab/fixhostnames
fix hostnames in kops openstack
2019-02-18 13:34:00 -08:00
Kubernetes Prow Robot 7f93a102d9
Merge pull request #6367 from zetaab/os_owner
add OWNERS file to openstack spesific folders
2019-02-18 10:44:03 -08:00
Jesse Haka 0a2d375c7b removing dims from reviewer and add drekle as reviewer 2019-02-05 17:09:22 +02:00
Jesse Haka 3482a34ef5 support both octavia and old lbaasv2 api 2019-02-05 16:45:44 +02:00
Jesse Haka 306895fb4b ports should also use replaced name 2019-02-05 16:01:56 +02:00
Rohith 093e1f2fff - adding the logic to delete the launch template on cluster destruction
- fixing up the goformat for v1.10
2019-02-05 10:52:13 +00:00
Jesse Haka 44b5b4d57d fix hostnames in kops 2019-02-03 23:26:18 +02:00
Derek Lemon -T (delemon - AEROTEK INC at Cisco) 752775d613 Bazel updates for openstack floating ip resource deletion
Variable Naming Sanity
2019-01-31 15:18:40 -07:00
Derek Lemon -T (delemon - AEROTEK INC at Cisco) 498615e10c Openstack Floating IP Deletion 2019-01-31 14:50:50 -07:00
Jesse Haka 98ad9126c5 implement delete cluster for openstack 2019-01-29 12:56:48 +02:00
Jesse Haka 93974b4637 find sshkey resource when updating cluster 2019-01-24 08:59:23 +02:00
Jesse Haka c989dd52f5 add OWNERS file to openstack spesific folders
bootstrap
2019-01-20 19:29:09 +02:00
Derek Lemon -T (delemon - AEROTEK INC at Cisco) 4f0169bb79 codegen 2019-01-16 09:30:40 -07:00
Jon Perritt 3064f6be15 server groups, lb, instance, and dns tasks, models and resources 2019-01-15 14:06:54 -07:00
Justin SB 26bd75aecb
Bulk spelling fixes
Experimenting with my own spelling checker, these are the typos it caught.
2018-12-20 17:43:56 -05:00
SataQiu d6a7299038 fix typos: dnsmaq -> dnsmasq, mutiple -> multiple 2018-11-21 18:47:47 +08:00
Liran Polak 9ccbe5b39a fix: do not log unmatched groups as warnings 2018-10-31 16:50:46 +02:00
Liran Polak e1f85e0827 fix: update doc comments 2018-10-14 11:37:31 +03:00
Liran Polak 6509e32b1b fix: boilerplate headers and packages list 2018-10-14 11:37:31 +03:00
Liran Polak 9f94c06e67 fix: rename spotinst's feature flag 2018-10-14 11:37:31 +03:00
Liran Polak 4c8ac60bf3 deps: vendor dependencies 2018-10-14 11:37:31 +03:00
Liran Polak 7654a923f1 feature: new integration: spotinst 2018-10-14 11:37:31 +03:00
mikeweiwei 027d324aaf If don't use formatted output,fix logging calls 2018-10-10 19:19:09 +08:00
k8s-ci-robot 2ad8588e51
Merge pull request #5635 from nareshku/support-albs-nlbs
Support for deletion of aws resources albs nlbs during delete
2018-09-21 11:40:33 -07:00
Justin Santa Barbara 7861a056d8 Recognize ubuntu images in sshUser dumping 2018-09-16 21:56:44 -04:00
Naresh Kumar Amrutham 37651c3534 fixed merge conflicts 2018-09-10 11:45:47 -07:00
Naresh Kumar Amrutham 2242e4cd0a modified comments 2018-09-10 10:57:56 -07:00
k8s-ci-robot d622f05054
Merge pull request #5686 from wingyplus/fix_go_vet
Fixes go vet complains
2018-09-04 18:36:46 -07:00
Levi Blackstone 206d95d614
OpenStack: enable cluster state deletion
Stub out a list resources method and call it from the collector
so that cluster state can be deleted via the API.
2018-08-30 20:08:57 -06:00
Thanabodee Charoenpiriyakij 49b203e126 Fixes go vet complains
When try `make govet` on `go1.11beta1`. It complains many things
related to invalid string formatting:

```
pkg/kubemanifest/visitor.go:35: Verbose.Infof format %s has arg v of wrong type bool
pkg/kubemanifest/visitor.go:40: Verbose.Infof format %s has arg v of wrong type float64
upup/pkg/fi/cloudup/alitasks/disk.go:76: Verbose.Info call has possible formatting directive %q
upup/pkg/fi/cloudup/alitasks/disk.go:91: Verbose.Info call has possible formatting directive %q
upup/pkg/fi/cloudup/alitasks/launchconfiguration.go:89: Verbose.Info call has possible formatting directive %q
upup/pkg/fi/cloudup/alitasks/loadbalancer.go:71: Verbose.Info call has possible formatting directive %q
upup/pkg/fi/cloudup/alitasks/loadbalancer.go:125: Verbose.Info call has possible formatting directive %q
upup/pkg/fi/cloudup/alitasks/scalinggroup.go:71: Verbose.Info call has possible formatting directive %q
dns-controller/pkg/dns/dnscontroller.go:603: Verbose.Infof format %s has arg records of wrong type []dns.Record
dns-controller/cmd/dns-controller/main.go:184: Verbose.Info call has possible formatting directive %q
pkg/acls/s3/storage.go:62: Verbose.Infof format %q arg u.String is a func value, not called
pkg/apis/kops/validation/validation_test.go:199: T.Fatalf format %q has arg config of wrong type *k8s.io/kops/pkg/apis/kops.DockerConfig
pkg/resources/aws/aws.go:1306: Warning call has possible formatting directive %q
pkg/resources/aws/aws.go:1313: Warning call has possible formatting directive %v
upup/pkg/fi/cloudup/aliup/ali_cloud.go:218: Verbose.Info call has possible formatting directive %q
upup/pkg/fi/cloudup/aliup/ali_cloud.go:290: Verbose.Info call has possible formatting directive %q
upup/pkg/fi/fitasks/keypair.go:266: Errorf format %q has arg e.Name of wrong type *string
upup/pkg/fi/files_owner.go:56: Infof format %s has arg group of wrong type *fi.Group
upup/pkg/fi/users.go:57: Warning call has possible formatting directive %q
upup/pkg/fi/users.go:63: Warning call has possible formatting directive %q
upup/pkg/fi/users.go:68: Warning call has possible formatting directive %q
upup/pkg/fi/users.go:129: Warning call has possible formatting directive %q
upup/pkg/fi/users.go:135: Warning call has possible formatting directive %q
upup/pkg/fi/nodeup/nodetasks/file.go:313: Errorf format %q has arg e.Mode of wrong type *string
upup/pkg/fi/cloudup/awsup/aws_cloud.go:1021: Warningf format %q reads arg #2, but call has 1 arg
upup/pkg/fi/cloudup/awsup/aws_cloud.go:1025: Warningf format %q reads arg #2, but call has 1 arg
```
2018-08-22 22:48:22 +07:00
Naresh Kumar Amrutham 97b258ca64 update build files 2018-08-17 13:12:03 -07:00
Naresh Kumar Amrutham ff2c0d4157 Revert "include dep"
This reverts commit b9c09878cd.
2018-08-17 12:59:58 -07:00
Naresh Kumar Amrutham b9c09878cd include dep 2018-08-15 11:14:19 -07:00
Naresh Kumar Amrutham 4e9d6760b8 initialize elbv2 session 2018-08-15 10:51:55 -07:00
Naresh Kumar Amrutham 76a0018d53 add delete support for NLBs, ALBs and Target groups 2018-08-14 16:15:22 -07:00
Justin Santa Barbara 5933aed899 Add ssh user to kops toolbox dump
Where we can identify the SSH user to use, we can include it in kops
toolbox dump.  This is a precursor to trying to better understand
what's in an image (warnings about NVME or network drivers, or showing
the correct SSH username)
2018-07-24 17:18:40 -04:00
LilyFaFa 7e1f400d11 delete cloud resources for ALicloud 2018-06-30 09:55:43 +08:00
andrewsykim da1adfd764 digitalocean: only delete A DNS records 2018-04-15 20:38:58 -04:00
andrewsykim ae93b02f02 digitalocean: list/delete DNS 2018-04-05 23:13:27 -04:00
andrewsykim 47c41463ce digitalocean: use pagination for all list requests 2018-04-05 11:12:20 -04:00
andrewsykim 6831bd8583 digitalocean: list/delete resources 2018-04-04 23:58:26 -04:00
andrewsykim bdd2a2dc9b digitalocean: resource record set should include zone 2018-04-04 23:58:26 -04:00
andrewsykim 61dd1317a8 digitalocean: dns operations should be idempotent 2018-04-03 17:52:29 -04:00
andrewsykim b480898af7 digitalocean: add protokube support 2018-04-01 21:47:31 -04:00
andrewsykim 27e8902016 digitalocean: add nodeup support 2018-04-01 10:11:07 -04:00
k8s-ci-robot 973397f28a
Merge pull request #4805 from justinsb/toolbox_dump_vpc
Add VPC to kops toolbox dump
2018-03-31 20:13:02 -07:00
Justin Santa Barbara 4498d23d22 Fix toolbox dump bug: store subnet in resource 2018-03-31 14:29:17 -04:00
Justin Santa Barbara 8214ad7200 Add VPC to kops toolbox dump 2018-03-31 14:10:22 -04:00
Justin Santa Barbara e6621fd623 kops toolbox dump: Add Subnets to dump 2018-03-27 00:03:20 -04:00
k8s-ci-robot 6be6b22630
Merge pull request #4791 from justinsb/natgateway_shared
NAT gateway deletion: honor shared tag
2018-03-25 18:13:01 -07:00
Justin Santa Barbara 29433aa17a ElasticIP deletion: Honor shared tags
We previously weren't tagging as shared, so there was no reason to
consider the tag.  Now we are tagging, we should.
2018-03-25 18:39:22 -04:00
Justin Santa Barbara c2c0e97c0e NAT gateway deletion: honor shared tag
We previously weren't tagging NAT gateways (it wasn't supported).  Now
we are, so if a NAT gateway is tagged as shared, we will honor that tag.
2018-03-25 18:38:51 -04:00
Justin Santa Barbara 8250cf0571 cloudmock: update to support tag-key query on securitygroup 2018-03-25 01:17:27 -04:00
Justin Santa Barbara 32ec8d8253 SecurityGroups: recognize shared tag 2018-03-25 01:17:27 -04:00
Justin Santa Barbara d1fd74a30c Move code to new file 2018-03-25 01:17:27 -04:00
k8s-ci-robot b6ae8fb011
Merge pull request #4778 from justinsb/routetable_tags
Move routetable detection to new logic
2018-03-24 20:54:01 -07:00
Justin Santa Barbara 4a6b5bb61f Move routetable detection to new logic 2018-03-24 18:26:39 -04:00
Justin Santa Barbara 46b6ea5c2a Deletion: check if VPC is shared
We have logic that checks if a VPC is being deleted, but it did not
consider the fact that VPCs can be shared.
2018-03-24 14:33:52 -04:00
Justin Santa Barbara 0711df9de4 Improve logic around VPC detection
Issue #4265
2018-03-19 18:15:37 -04:00
Justin Santa Barbara 0f6645a9d7 Move AWS resources into its own subpackage 2018-03-18 14:43:12 -04:00
Justin Santa Barbara 85b972bc28 Fill out cloudmock to do a basic lifecycle test 2018-03-11 17:04:30 -04:00
chrislovecnm aabfc1cf13 Updating comment so we do not have gofmt issues with go 1.9 and go 1.10
There is a change in gofmt between go 1.10 and go 1.9.  The aws.go file
needs formating with go 1.10, while it is passing 1.9.  This commit moves
a comment above the parens so that both go 1.9 and 1.10 formats the file
in the same manner.
2018-03-09 14:53:17 -07:00
k8s-ci-robot 3b78618327
Merge pull request #4302 from sethpollack/eip
Add option for using existing EIP's
2018-02-27 22:27:46 -08:00
Mike Splain 45a57915e2 Fix bazel deprecation notice 2018-02-26 09:36:13 -05:00
andrewsykim 662939e626 dns-controller: support digitalocean 2018-02-24 13:48:43 -05:00
chrislovecnm e853fba1e4 Fixing deleting of shared IGW and DHCPOptions
Currently shared IGW and DHCPOptions are deleted, even if the shared
tags exist.  This PR adds the HasSharedTags func to the Shared member on
both IGW and DHCPOptions resources.
2018-02-18 19:56:21 -07:00
Seth Pollack 3ae8ac1329 add option for BYOEIP 2018-02-16 12:08:05 -05:00
chrislovecnm 4dd3bb1dea Updating bazel BUILD files with new go_rules version 2017-12-29 15:03:14 -07:00
Justin Santa Barbara f03cc5dbd9 Update dnsprovider imports to use our version 2017-12-13 20:43:01 -05:00
Kubernetes Submit Queue e07d610fb4
Merge pull request #3934 from justinsb/roles_in_toolbox
Automatic merge from submit-queue.

Include roles in toolbox dump structured output
2017-12-11 02:36:29 -08:00
Justin Santa Barbara f02595e915 toolbox dump now dumps instances in alphabetical order 2017-12-01 00:25:07 -05:00
Justin Santa Barbara f3f5e6dba0 Include roles in toolbox dump structured output
Proves very handy when diagnosing problems.
2017-11-26 23:37:16 -05:00
georgebuckerfield eab351c913 Add tests for ListRouteTables function 2017-11-18 12:34:39 +00:00
georgebuckerfield df550ec2b5 Set the Shared field of RouteTable resources when listing 2017-11-17 17:27:16 +00:00
chrislovecnm 609e268a1d gazelle updates with new bazel version 2017-11-05 17:41:53 -07:00
Justin Santa Barbara b3e00c0dd1 GCE Dump: Include instance IPs
The challenge here is that we normally only get the instance url.  So we
have to do another call to GCE, but we also don't want to do one call
per instance.

Instead, we create a dump operation context object which we pass into the dump.
2017-10-29 23:22:40 -04:00
Justin Santa Barbara 1f0601126c Refactor gce resources into pkg/resources/gce
Should be a no-op refactor
2017-10-29 18:37:23 -04:00
Justin Santa Barbara 66e74fac6a Rename pkg/resources/utils -> pkg/resources/ops
That seems to be what utils really is.
2017-10-29 16:32:48 -04:00
Justin Santa Barbara 1eb17ae6b9 Move DeleteResources into pkg/resources/utils 2017-10-29 12:26:07 -04:00
Justin Santa Barbara a18363f059 Refactor toolbox dump & dump structured instances
This will enable log collection even if nodes don't register.

AWS: Dumps ids & addresses
GCE: Dumps names - addresses to follow
Others: Not yet!
2017-10-28 14:46:28 -04:00
Kubernetes Submit Queue a4d6895472 Merge pull request #3707 from andrewsykim/droplet
Automatic merge from submit-queue.

Implement DigitalOcean Droplet FI Task

Implements cloudup fi tasks for DigitalOcean droplets. It makes a few assumptions to reduce the size of this PR, those will be addressed in future PRs. 

Also does some cleanup in the DigitalOcean `dns` package.
2017-10-27 08:30:57 -07:00
andrewsykim 45bf2cb3a7 Implement DigitalOcean Droplet FI Task 2017-10-27 09:48:42 -04:00
Justin Santa Barbara badef7b056 bazel: set test size on pkg/resources 2017-10-22 16:55:36 -04:00
Justin Santa Barbara 5b08c36cbb Delete firewall rules on GCE
As part of cluster delete on GCE, we now clean up our firewall rules.
2017-10-22 16:54:43 -04:00
Kubernetes Submit Queue 518e97d97b Merge pull request #3510 from justinsb/bazel
Automatic merge from submit-queue.

Initial bazel support

Builds on the 1.8 version bump

The "trick" is to strip the BUILD & BUILD.bazel files from the vendor-ed deps.

Will rebase after 1.8 version bump merges.
2017-10-03 01:19:27 -07:00
Justin Santa Barbara 737f2fcd80 rolling-update - initial GCE support 2017-10-02 23:07:35 -04:00
Justin Santa Barbara 0143be7c4f autogen: BUILD and BUILD.bazel 2017-10-02 14:27:21 -04:00
Justin Santa Barbara 3478031533 API types changed package 2017-10-01 14:03:56 -04:00
Justin Santa Barbara a5d72ca190 DRY FindAutoscalingGroups by removing from resources pkg 2017-09-30 17:39:53 -04:00
chrislovecnm c9cc561885 refactoring FindInstanceTemplates into gce cloud interface 2017-09-30 14:02:58 -06:00
chrislovecnm a431eb3e43 refactoring to use cloud based GetGroups 2017-09-29 12:29:07 -06:00
chrislovecnm db5b931579 Adding three new funcs for cloud providers, for refactoring delete and
get
2017-09-28 15:52:49 -06:00
Justin Santa Barbara 8ff312397b GCE: Don't remove (shared) DNS Zone
We don't create it, we shouldn't be deleting it.
2017-09-22 09:31:49 -04:00
andrewsykim d9fa618de6 refactor resource tracker to be usable across packages 2017-09-02 17:37:21 -04:00
chrislovecnm 0779fb6fc4 Implementing GCE as an inteface modelling aws cloud provider 2017-08-27 22:19:25 -06:00
andrewsykim 0411ba270e Create cluster requirements for DigitalOcean 2017-08-22 09:01:19 -04:00
andrewsykim 525fde3609 implement digitalocean volumes task 2017-08-21 09:50:36 -04:00
andrewsykim 1f0d0bbc75 initial cloud interface for DigitalOcean 2017-08-11 19:33:17 -04:00
asifdxtreme 18f6edd850 Fix Typo to improve GoReportCard 2017-08-08 10:48:14 +08:00
Justin Santa Barbara db2d2c7d54 Honor shared tags when deleting subnets/vpcs
We expose the Shared state on the resource, bubble it down into derived
resources (like NAT Gateways or Internet Gateways).

Deletion then skips Shared items.  Listing (currently) does not skip
them.
2017-07-15 23:19:52 -04:00
Lars Lehtonen 1da7d66fd1
fixed swallowed errors under pkg subdirectory. 2017-07-15 13:49:17 -07:00
Justin Santa Barbara 3139e89fae Merge pull request #2864 from andrewsykim/digitalocean
digitalocean support -- dns provider
2017-07-15 13:07:30 -04:00
Hanfei Shen 8bffe17200 fix delete_cluster for those regions don't have route53 2017-07-15 10:51:36 +08:00
andrewsykim d94357b8cb add glog logging for applying record change sets 2017-07-14 09:00:15 -04:00
andrewsykim 401fc22450 add response handling function 2017-07-14 09:00:15 -04:00
andrewsykim 135e4e9051 use fmt.Errorf for consistency 2017-07-14 09:00:15 -04:00
andrewsykim f396799bc9 add docstrings for cloud.go 2017-07-14 09:00:15 -04:00
andrewsykim a866f70e1e digitalocean support -- dns provider 2017-07-14 09:00:15 -04:00
Justin Santa Barbara d2df318ecc Move CloudProvider to kops API
This avoids a circular reference when breaking up the fi package
2017-06-17 16:27:07 -04:00
andrewsykim e8c99ee72e removes cluster delete code in upup/pkg/kutil duplicated in pkg/resources and puts instancegroup and rollingupdate code into its own packges 2017-06-10 15:21:06 -04:00
andrewsykim 02c7c917c1 fix gce disk dependency bug 2017-05-31 16:29:19 -04:00
andrewsykim eecd2072b2 Generalize Cluster Resources 2017-05-30 20:43:08 -04:00
Justin Santa Barbara c8b18be9dd Gossip backed DNS 2017-04-25 01:32:21 -04:00
Miao Luo aed9f154ad Fix minor errors due to rebase. 2017-04-21 11:03:13 -07:00
Miao Luo 30573e9aaf Add more supports for vsphere.
Accept vSphere's server, datacenter, cluster setting by flags
"vsphere-server", "vsphere-datacenter", and "vsphere-resource-pool".
Username and password can be set by environment variables:
"VSPHERE_USERNAME" and "VSPHERE_PASSWORD".
2017-04-20 23:32:59 -07:00
andrewsykim 440976074d Move cluster delete files to pkg/resources 2017-04-08 10:14:15 -04:00