Commit Graph

4334 Commits

Author SHA1 Message Date
chrislovecnm 30acda868a updating to bazel 0.0.7 and adding verify scripts 2017-11-04 20:59:01 -06:00
Kubernetes Submit Queue 40a94a7c98
Merge pull request #2954 from chrislovecnm/create-yaml-or-json
Automatic merge from submit-queue.

Create YAML or JSON Clusterspec without creating the cluster

Allowing a user to create a YAML or JSON cluster or instance group without creating the object.  Some of the new methods will be used to fix the problems we are having with JSON output as well.  Reading an array of JSON objects is not yet supported by `kops create -f`, but a single JSON object is supported.

This implements

`kops create cluster --dry-run -oyaml`

TODOs

- [x] init or create
- [x] update cobra docs
- [x] figure out what is going on with unit tests
- [ ] figure out was issue(s) this closes
2017-11-04 17:05:04 -07:00
chrislovecnm 4c82a6d5d4 Fixing YAML and JSON output across multiple cli functions. Also
Added --dry-run for create_ig and create_cluster
2017-11-04 17:04:44 -06:00
Kubernetes Submit Queue 88984d4b47
Merge pull request #3764 from chrislovecnm/goimports-cleanup
Automatic merge from submit-queue.

goimports cleanup && basel files

This is a dry PR.  Only goimports updates and gazelle fixes.
2017-11-04 11:04:47 -07:00
Kubernetes Submit Queue 4d424a473f
Merge pull request #3700 from justinsb/dummy_change
Automatic merge from submit-queue.

Spelling fixes

Really checking whether e2e is working.
2017-11-04 10:16:05 -07:00
chrislovecnm b6b2c74fec updating bazel files 2017-11-04 10:08:50 -06:00
chrislovecnm 1e418c3e13 more goimport updates 2017-11-04 10:03:02 -06:00
Kubernetes Submit Queue 2b3ac16350
Merge pull request #3708 from zengchen1024/openstack_vfs
Automatic merge from submit-queue.

Implement vfs with openstack swift

Add a new implementation of VFS to store the state of cluster in order to support deploying k8s on openstack.
Which issue this PR fixes: #3676
2017-11-04 00:24:21 -07:00
Kubernetes Submit Queue 4317a3c667
Merge pull request #3743 from thoslin/FeatRBACforEFK
Automatic merge from submit-queue.

Add service account for elasticsearch and fluentd

Fix issue https://github.com/kubernetes/kops/issues/3729
2017-11-03 23:58:10 -07:00
Kubernetes Submit Queue 49cc8fed5c
Merge pull request #3758 from aledbf/check-links
Automatic merge from submit-queue.

Add makefile target to check markdown links

fixes #771

Running `make check-markdown-links` we get (just the summary)

```console
Summary
                                                          CONTRIBUTING.md: ✓
                                          addons/route53-mapper/README.md: ✓
                                                         addons/README.md: ✓
                                    addons/kubernetes-dashboard/README.md: ✓
                                           addons/ingress-nginx/README.md: Issues
                                      addons/cluster-autoscaler/README.md: ✓
                                   addons/monitoring-standalone/README.md: ✓
                                                                README.md: ✓
                                                 dns-controller/README.md: ✓
                                             dns-controller/docs/flags.md: ✓
                                                       examples/README.md: ✓
                                                      protokube/README.md: ✓
                                                .github/ISSUE_TEMPLATE.md: ✓
                                                         docker/README.md: ✓
                                                               ROADMAP.md: ✓
                                                     permalinks/README.md: ✓
                                               permalinks/upgrade_kops.md: ✓
                                                permalinks/upgrade_k8s.md: ✓
                                        pkg/apis/kops/v1alpha2/CHANGES.md: ✓
                                        pkg/apis/kops/v1alpha2/upgrade.md: ✓
                                                          upup/DEVELOP.md: ✓
upup/models/cloudup/resources/addons/external-dns.addons.k8s.io/README.md: ✓
                                             upup/pkg/fi/nodeup/README.md: ✓
                                upup/pkg/fi/cloudup/gcetasks/QUESTIONS.md: ✓
                                docs/manifests_and_customizing_via_api.md: ✓
                                              docs/upgrade_from_k8s_12.md: ✓
                                                       docs/http_proxy.md: ✓
                                                  docs/instance_groups.md: ✓
                                                           docs/README.md: ✓
                                                      docs/etcd_backup.md: ✓
                                                         docs/security.md: ✓
                                                              docs/mfa.md: ✓
                                                    docs/boot-sequence.md: ✓
                                                              docs/aws.md: ✓
                                        docs/cli/kops_describe_secrets.md: ✓
                                docs/cli/kops_toolbox_convert-imported.md: ✓
                                  docs/cli/kops_rolling-update_cluster.md: ✓
                                          docs/cli/kops_delete_cluster.md: ✓
                                    docs/cli/kops_delete_instancegroup.md: ✓
                                                 docs/cli/kops_replace.md: ✓
                              docs/cli/kops_create_secret_dockerconfig.md: ✓
                                                  docs/cli/kops_create.md: ✓
                                                  docs/cli/kops_update.md: ✓
                                         docs/cli/kops_edit_federation.md: ✓
                                                 docs/cli/kops_version.md: ✓
                                           docs/cli/kops_delete_secret.md: ✓
                                          docs/cli/kops_update_cluster.md: ✓
                                                  docs/cli/kops_delete.md: ✓
                                              docs/cli/kops_completion.md: ✓
                                    docs/cli/kops_create_instancegroup.md: ✓
                                          docs/cli/kops_rolling-update.md: ✓
                                                 docs/cli/kops_upgrade.md: ✓
                                                docs/cli/kops_describe.md: ✓
                                                docs/cli/kops_validate.md: ✓
                                                 docs/cli/kops_toolbox.md: ✓
                                        docs/cli/kops_toolbox_template.md: ✓
                                        docs/cli/kops_validate_cluster.md: ✓
                                         docs/cli/kops_get_federations.md: ✓
                                                         docs/cli/kops.md: ✓
                                          docs/cli/kops_export_kubecfg.md: ✓
                                          docs/cli/kops_create_cluster.md: ✓
                                      docs/cli/kops_edit_instancegroup.md: ✓
                                            docs/cli/kops_toolbox_dump.md: ✓
                                      docs/cli/kops_get_instancegroups.md: ✓
                                             docs/cli/kops_get_secrets.md: ✓
                                                     docs/cli/kops_get.md: ✓
                                            docs/cli/kops_edit_cluster.md: ✓
                          docs/cli/kops_create_secret_encryptionconfig.md: ✓
                              docs/cli/kops_create_secret_sshpublickey.md: ✓
                                                  docs/cli/kops_import.md: ✓
                                                  docs/cli/kops_export.md: ✓
                                           docs/cli/kops_create_secret.md: ✓
                                            docs/cli/kops_get_clusters.md: ✓
                                         docs/cli/kops_upgrade_cluster.md: ✓
                                          docs/cli/kops_import_cluster.md: ✓
                                                    docs/cli/kops_edit.md: ✓
                                       docs/cli/kops_update_federation.md: ✓
                                                      docs/update_kops.md: ✓
                                                        docs/iam_roles.md: ✓
                                                     docs/cluster_spec.md: Issues
                                                           docs/images.md: ✓
                                              docs/upgrade_from_kubeup.md: ✓
                                                       docs/networking.md: ✓
                                                         docs/commands.md: ✓
                                                   docs/rotate-secrets.md: ✓
                                                        docs/aws-china.md: Issues
                                                  docs/examples/README.md: ✓
                     docs/examples/kops-tests-private-net-bastion-host.md: Issues
                           docs/examples/coreos-kops-tests-multimaster.md: Issues
                             docs/examples/kops-test-route53-subdomain.md: ✓
                                      docs/examples/basic-requirements.md: Issues
                                                               docs/ns.md: ✓
                                                  docs/download_config.md: ✓
                                                       docs/philosophy.md: ✓
                                                          docs/upgrade.md: ✓
                                       docs/vsphere-development-status.md: Issues
                                                           docs/labels.md: ✓
                                                           docs/addons.md: Issues
                                        docs/development/documentation.md: ✓
                                         docs/development/dependencies.md: ✓
                                             docs/development/building.md: ✓
                                               docs/development/gossip.md: ✓
                                          docs/development/api_updates.md: Issues
                                             docs/development/homebrew.md: ✓
                                     docs/development/adding_a_feature.md: ✓
                                               docs/development/Docker.md: ✓
                                        docs/development/instancesizes.md: ✓
                                       docs/development/rolling_update.md: ✓
                                              docs/development/testing.md: Issues
                                                 docs/development/hack.md: ✓
                                         docs/development/how_it_works.md: ✓
                                                docs/development/bazel.md: ✓
                                              docs/development/release.md: ✓
                                                          docs/bastion.md: ✓
                                                     docs/experimental.md: ✓
                                           docs/node_resource_handling.md: ✓
                                                          docs/kubectl.md: ✓
                                                          docs/install.md: Issues
                                           docs/single-to-multi-master.md: Issues
                                                 docs/cluster_template.md: ✓
                                              docs/run_in_existing_vpc.md: ✓
                                                docs/api-server/README.md: ✓
                                                            docs/state.md: ✓
                                                         docs/topology.md: ✓
                                                   docs/releases/1.7.1.md: ✓
                                           docs/releases/1.6.0-alpha.1.md: ✓
                                               docs/releases/1.8-NOTES.md: ✓
                                          docs/releases/legacy-changes.md: ✓
                                               docs/releases/1.7-NOTES.md: ✓
                                                   docs/releases/1.6.2.md: ✓
                                               docs/releases/1.6-NOTES.md: ✓
                                                   docs/releases/1.6.1.md: ✓
                                               docs/creating_subdomain.md: ✓
                                           docs/etcd_volume_encryption.md: ✓
                                                      docs/vsphere-dev.md: Issues
                                  docs/cluster_upgrades_and_migrations.md: Issues
               docs/upgrade_from_kops_1.6_to_1.7_calico_cidr_migration.md: ✓
                                                    docs/addon_manager.md: Issues
                                        docs/advisories/cve_2017_14491.md: ✓
               docs/work_in_progress/pushing_updates_without_rebooting.md: ✓
                                                        docs/arguments.md: ✓
                                                docs/high_availability.md: ✓
                                                         docs/releases.md: ✓
                                              docs/apireference/README.md: ✓
                                        docs/apireference/build/README.md: ✓
                       docs/apireference/build/node_modules/ejs/README.md: ✓
              docs/apireference/build/node_modules/highlight.js/README.md: ✓
                    docs/apireference/build/node_modules/jquery/README.md: ✓
              docs/apireference/build/node_modules/font-awesome/README.md: Issues
                    docs/apireference/build/node_modules/colors/ReadMe.md: ✓
                    docs/apireference/build/node_modules/marked/README.md: ✓
                docs/apireference/build/node_modules/marked/doc/broken.md: ✓
                  docs/apireference/build/node_modules/marked/doc/todo.md: ✓
           docs/apireference/build/node_modules/jquery.scrollto/README.md: ✓
        docs/apireference/build/node_modules/jquery.scrollto/CHANGELOG.md: ✓
                 docs/apireference/build/node_modules/bootstrap/README.md: Issues
              docs/apireference/build/node_modules/bootstrap/CHANGELOG.md: ✓
                      docs/apireference/build/node_modules/mime/README.md: ✓
               docs/apireference/build/node_modules/node-static/README.md: Issues
                        docs/apireference/static_includes/_oldversions.md: ✓
                           docs/apireference/static_includes/_overview.md: ✓
                               docs/apireference/static_includes/_kops.md: ✓
                        docs/apireference/static_includes/_definitions.md: ✓
                                           docs/changing_configuration.md: ✓
                                                              docs/gpu.md: ✓
                                                          docs/secrets.md: ✓
                                                        docs/terraform.md: ✓
                             docs/tutorial/working-with-instancegroups.md: ✓
                                                     docs/tutorial/gce.md: ✓
                                    docs/tutorial/upgrading-kubernetes.md: ✓
                                         hooks/nvidia-bootstrap/README.md: ✓
                                           hooks/prepull-images/README.md: ✓
                                                       code-of-conduct.md: ✓
                                           images/utils-builder/README.md: ✓
                                                             CHANGELOG.md: ✓
Makefile:600: recipe for target 'check-markdown-links' failed
```
2017-11-03 23:30:54 -07:00
Kubernetes Submit Queue b7611a396c
Merge pull request #3653 from tuannvm/tuan-add-kube-state-metrics-addon
Automatic merge from submit-queue.

[Add-on] Add kube-state-metrics add-on

## Why?
- Add [kube-state-metrics](https://github.com/kubernetes/kube-state-metrics) as default add-on.
2017-11-03 22:59:36 -07:00
Kubernetes Submit Queue 2dbdb79368
Merge pull request #3761 from KashifSaadat/default-enable-ecr
Automatic merge from submit-queue.

Enable IAM Container Registry permissions by default when creating a cluster (#3760).

Fixes #3760 .
2017-11-03 22:05:55 -07:00
Kashif Saadat b30606ffda Enable IAM Container Registry permissions by default when creating a cluster (#3760). 2017-11-03 17:26:51 +00:00
Kubernetes Submit Queue f3affcb0d3
Merge pull request #3730 from iterion/add-ipip-to-kuberouter
Automatic merge from submit-queue.

Add node-to-master IPIP to kuberouter

Like Calico and Romana, Kube Router needs IPIP traffic from nodes to masters to be allowed. This adds that firewall rule for all clusters set up with Kube Router.

See:
https://github.com/cloudnativelabs/kube-router/issues/208
2017-11-03 08:40:20 -07:00
Kubernetes Submit Queue aadc2e1427
Merge pull request #3731 from gambol99/template_fix
Automatic merge from submit-queue.

Template Fixes

- fixing an issue in the way it handled inline yaml documents
- cleaning it up somewhat, the prior version was a little cryptic to read; it's easier to just split into docs, format if required and rejoin at the end.

Apologizes @justinsb ... the prior PR didn't handle YAML separators correctly; I've find it somewhat simpler by a split and join rather than using indexes and such
2017-11-03 08:10:23 -07:00
Manuel de Brito Fontes 236cb0f188 Add makefile target to check markdown links 2017-11-02 19:19:15 -03:00
Kubernetes Submit Queue 3d0c46f45d
Merge pull request #3756 from reactiveops/erics_back
Automatic merge from submit-queue.

Adding back to the approvers

So the bot will merge and I can get back in game :)
2017-11-02 11:39:52 -07:00
Eric Hole be360c327b So I can approve again :) 2017-11-02 10:32:16 -07:00
Rohith fad62c284f Template Fixes
- fixing an issue in the way it handled inline yaml documents
- cleaning it up somewhat, the prior version was a little cryptic to read; it's easier to just split into docs, format and rejoin at the end
2017-11-02 14:26:39 +00:00
zengchen1024 bbfd1e18a3 implement vfs with openstack swift 2017-11-02 17:08:16 +08:00
Kubernetes Submit Queue cdad519c66
Merge pull request #3752 from chrislovecnm/goimports-cleanup
Automatic merge from submit-queue.

updating files for goimports - and fixed a unit test

/assign @andrewsykim 

This is a dry PR.  Just go imports update.  Gogland is not running go imports by default, so eh, maybe we should just clean house.

Fixed a broken unit test on master as well.
2017-11-01 18:35:23 -07:00
Tom Lin fb811fd892 Add a separate manifest for v1.6.0 2017-11-02 09:04:43 +08:00
Tom Lin 5bd540ccfa Revert "Bump the version of logging-elasticsearch addon to v1.6.0"
This reverts commit 3059689
2017-11-02 08:27:38 +08:00
chrislovecnm 2ee0a4d5d5 removing tip as we are not passing because of an upstream issue 2017-11-01 14:55:54 -06:00
chrislovecnm 4fd4bb8d0e subnet test not correct, not sure now 2017-11-01 13:48:12 -06:00
chrislovecnm 8d1ee1fa16 updating files for goimports 2017-11-01 12:51:43 -06:00
Kubernetes Submit Queue ed2f269b5b
Merge pull request #3748 from justinsb/log_google_application_credentials_path
Automatic merge from submit-queue.

GCE: log when loading from GOOGLE_APPLICATION_CREDENTIALS
2017-11-01 08:55:26 -07:00
Kubernetes Submit Queue 08c34b6eb4
Merge pull request #3184 from justinsb/test_does_not_change_tags
Automatic merge from submit-queue.

Fix shared subnet/vpc tags
2017-11-01 08:23:29 -07:00
Tom Lin 3059689ae6 Bump the version of logging-elasticsearch addon to v1.6.0 2017-11-01 13:39:03 +08:00
Kubernetes Submit Queue ed575a2a6f
Merge pull request #3744 from zengchen1024/update_gophercloud
Automatic merge from submit-queue.

update gophercloud to the newest version

The current version of 'gophercloud' may not work well to parse the identity endpoint such as 'https://${ip}/identity', and will be broken when creating a new client of 'ProviderClient' by passing an endpoint like that. However, the newest version of 'gophcloud' works well. 
Which issue this PR fixes: #3676
2017-10-31 18:48:57 -07:00
Justin Santa Barbara ba9ec6aebc GCE: log when loading from GOOGLE_APPLICATION_CREDENTIALS 2017-10-31 20:31:21 -04:00
Kubernetes Submit Queue 2842ed1410
Merge pull request #3747 from gambol99/docs
Automatic merge from submit-queue.

Audit Policy Docs
2017-10-31 17:20:01 -07:00
Rohith b3d4dd9911 Audit Policy Docs
- adding some documentation on the audit policy
2017-10-31 22:57:23 +00:00
Kubernetes Submit Queue 0545c88886
Merge pull request #3736 from justinsb/gce_wider_scope
Automatic merge from submit-queue.

GCE: Use CloudPlatformScope when requesting a token
2017-10-31 15:45:12 -07:00
Kubernetes Submit Queue 72bb83c150
Merge pull request #3739 from justinsb/spelling_1
Automatic merge from submit-queue.

fix typo in comment: mananging
2017-10-31 15:12:10 -07:00
Kubernetes Submit Queue 611780ccd2
Merge pull request #3740 from justinsb/comment_vfs_readtree
Automatic merge from submit-queue.

Clarify comment on ReadTree
2017-10-31 14:39:01 -07:00
Justin Santa Barbara 9c005d785b GCE: Use CloudPlatformScope when requesting a token 2017-10-31 17:26:56 -04:00
Kubernetes Submit Queue e469376660
Merge pull request #3738 from justinsb/update_gazelle
Automatic merge from submit-queue.

Generate gazelle
2017-10-31 14:06:50 -07:00
Kubernetes Submit Queue 101e6e03f3
Merge pull request #3737 from justinsb/storageacl_comments
Automatic merge from submit-queue.

Fix log messages from storage acl tasks
2017-10-31 13:20:30 -07:00
Kubernetes Submit Queue af003d9eaa
Merge pull request #3741 from justinsb/kops_keypair
Automatic merge from submit-queue.

Add comment on purpose of kops keypair
2017-10-31 12:47:31 -07:00
Kubernetes Submit Queue dbed1284c9
Merge pull request #3742 from justinsb/gce_log_token
Automatic merge from submit-queue.

GCE: log the service account & scopes in use
2017-10-31 12:16:36 -07:00
zengchen1024 41b8f21ce5 update gophercloud to newest version 2017-10-31 14:55:46 +08:00
Tom Lin e57c0c37da Add service account for elasticsearch and fluentd 2017-10-31 14:03:08 +08:00
Justin Santa Barbara fa419d9510 Add comment on purpose of kops keypair
Otherwise it's tricky to track down where it is used.
2017-10-30 23:49:19 -04:00
Justin Santa Barbara 2de6538692 Clarify comment on ReadTree
Make it clearer that it needs to fetch all the files recursively
2017-10-30 23:48:40 -04:00
Justin Santa Barbara 6a7c109f43 fix typo in comment: mananging 2017-10-30 23:47:59 -04:00
Justin Santa Barbara 53de6ff255 Generate gazelle 2017-10-30 23:47:00 -04:00
Justin Santa Barbara 95fa47b9a9 Fix log messages from storage acl tasks
The messages were ambiguous at best, wrong at worst.
2017-10-30 23:46:06 -04:00
Justin Santa Barbara bfe3766de3 GCE: log the service account & scopes in use
Once we figure out why e2e is failing we can likely make this optional
(e.g. only with v=2 or above)
2017-10-30 23:45:23 -04:00
Kubernetes Submit Queue c1c1d6bbcc
Merge pull request #3732 from KashifSaadat/iam-roles-documentation
Automatic merge from submit-queue.

Update IAM roles documentation based on recent changes.

The [IAM Roles documentation](https://github.com/kubernetes/kops/blob/master/docs/iam_roles.md) has been updated to reflect recent hardening on the policies generated for Master & Compute nodes.

Fixes #3557.
2017-10-30 17:55:20 -07:00