Commit Graph

214 Commits

Author SHA1 Message Date
chrislovecnm 4e989bccfb Updating verify scripts so that output is highlighted
When a verify script fails we now output the word 'FAIL' at the start of the message
so that it is highlighted in the build logs.
2018-03-09 14:39:06 -07:00
chrislovecnm f785d2bd12 patching with PR 4598, need to remove this commit 2018-03-09 14:22:12 -07:00
k8s-ci-robot 5c1518dbda
Merge pull request #4561 from chrislovecnm/new-bazel-version
Bumping gazelle version on bazel scripts
2018-03-02 14:27:54 -08:00
chrislovecnm 07b1ae9e66 Bumping gazelle version on bazel scripts 2018-03-02 13:03:41 -07:00
chrislovecnm 2e0d7fb92b Adding script to test that apimachinery is up to date
Added a bash script to run a make target that tests that apimachinery is
up to date.  I updated the existing make target so that we can pass in a
flag which enables validation only, and not generation.
2018-03-01 18:25:20 -07:00
chrislovecnm 0efb600c72 Updating gazelle sha in bazel scripts 2018-02-26 13:03:19 -07:00
k8s-ci-robot e317a5ab00
Merge pull request #4381 from justinsb/kops_set_cluster_1
Experimental kops set cluster command
2018-02-26 10:58:45 -08:00
Mike Splain 45a57915e2 Fix bazel deprecation notice 2018-02-26 09:36:13 -05:00
Justin Santa Barbara 6f52996c2a Experimental kops set cluster command
Introduce an experimental kops set cluster command, for setting
individual fields in the same style as the kops create cluster
--override flags.

For now, feature flag gated by the same SpecOverrideFlag feature flag.

Also split out pkg/commands package to facilitate testing.
2018-02-26 09:33:16 -05:00
chrislovecnm fe790df0ce fixing bazel files to pass CI 2018-02-23 17:36:43 -07:00
chrislovecnm 798d40b4a2 updating functionality to verify bazel build files 2018-02-23 17:36:42 -07:00
Justin Santa Barbara e4fafa6065 Use legacy image registry gcr.io/google_containers for <= 1.9
The k8s.gcr.io prefix is an alias, but for CI builds we run from a
docker load, and we only double-tag from 1.10 onwards.  For versions
prior to 1.10, remap k8s.gcr.io to the old name.  This also means that
we won't start using the aliased names on existing clusters, which could
otherwise be surprising to users.
2018-02-22 21:42:33 -08:00
k8s-ci-robot c37eab74ca
Merge pull request #4435 from chrislovecnm/remove-submodules
Remove submodules
2018-02-19 14:54:38 -08:00
chrislovecnm 0ccd413f82 Fixing problems in dev build script example 2018-02-13 10:22:38 -07:00
chrislovecnm 6a7d80a49a removing old python file for updating submodules 2018-02-12 21:45:13 -07:00
k8s-ci-robot 27c8ddc09d
Merge pull request #4382 from justinsb/try_dep
Use dep to maintain vendor directory
2018-02-12 16:24:49 -08:00
Kashif Saadat ac25853cd5 - Add etcdClusterSpec Image & Version in bootstrap data for Master nodes
- Reuse execWithTee fn for ETCD Command (tee & mkfifo in different path for newer image versions)
2018-02-10 12:14:36 +00:00
Justin Santa Barbara 9fbbbcb76a Add hack/dep.py to check dep status against k8s Godeps.json 2018-02-04 21:52:34 -05:00
Justin Santa Barbara 7dfca05c09 Remove federation support
As it has been removed from upstream kubernetes, in favor of the
multicluster revamp.
2018-02-03 16:53:39 -05:00
Kashif Saadat e315c350be Implement ability to update Load Balancer subnets 2018-01-17 11:57:29 +00:00
k8s-ci-robot 48365c3883
Merge pull request #4194 from justinsb/kubedisco
Add experimental kube-discovery
2018-01-04 18:08:12 -08:00
Justin Santa Barbara ec8db8b78c Initial implementation of bundle command
The bundle command will support enrollment of a machine via SSH.
2018-01-04 18:55:28 -05:00
Justin Santa Barbara b8b426b800 Add experimental kube-discovery
To split off master discovery from protokube.
2018-01-04 13:29:43 -05:00
Justin Santa Barbara bf24a6443c Avoid ListSecrets call in nodeup
This helps up with GCE permissions, but also helps us get rid of auth
tokens.
2017-12-19 11:45:04 -05:00
Kubernetes Submit Queue dd49d69399
Merge pull request #3254 from chrislovecnm/file-assets
Automatic merge from submit-queue.

work on using files assets

Basic MVP for file assests.

- using file assest builder
- able to upload files
- using URL structs instead of strings everywhere
2017-12-17 16:10:23 -08:00
Kubernetes Submit Queue 7768729cf2
Merge pull request #3832 from justinsb/cleanup_ssh
Automatic merge from submit-queue.

Refactor: separate out SSHCredentials from Keyset stores
2017-12-17 15:05:09 -08:00
chrislovecnm 7057aaf1bb Enabling the file assets
File assets and the SHA files are uploaded to the new location. Files
when are users uses s3 are upload public read only. The copyfile task
uses only the existing SHA value.

This PR include major refactoring of the use of URLs.  Strings are no
longer categnated, but converted into a URL struct and path.Join is
utlilized.

A new values.go file is included so that we can start refactoring more
code out of the "fi" package.

A
2017-12-17 15:26:57 -07:00
Kubernetes Submit Queue b44d894813
Merge pull request #3860 from justinsb/batching
Automatic merge from submit-queue.

Copy dnsprovider into our code, implement route53 batching

Fixes #3121
2017-12-15 15:44:12 -08:00
Justin Santa Barbara 6d166a41dd Refactor protokube hosts file into its own package
So we can bring this in without our gossip layer

This supports an imminent implementation that uses DNS-SD
2017-12-15 01:22:51 -05:00
Justin Santa Barbara 1cceb8ed9e Update hack/.packages 2017-12-13 21:32:21 -05:00
Justin Santa Barbara 509b83ac7a Refactor: separate out SSHCredentials from Keyset stores
We've done this in the API already, but we had a single CAStore
interface that did Keysets and SSHCredentials.  Separate out
SSHCredentials into SSHCredentialStore, and start using API objects as
our primary representation.
2017-12-13 20:16:59 -05:00
Arto Jantunen 53669b8217 Make ELB somewhat mockable 2017-11-28 11:48:57 +02:00
zengchen1024 0949d597b7 build volume task 2017-11-20 11:52:19 +08:00
zengchen1024 76b9aebafb update hack/.package 2017-11-13 17:03:30 +08:00
chrislovecnm 30acda868a updating to bazel 0.0.7 and adding verify scripts 2017-11-04 20:59:01 -06:00
Kubernetes Submit Queue b02c3a269c
Merge pull request #3726 from justinsb/storage_acls
Automatic merge from submit-queue.

GCS: Use ACLs for GCE permissions

This needs less permissions, but also allows for more granular control over
access to files than whole-bucket permissions that IAM gives us.
2017-10-29 20:18:51 -07:00
Justin Santa Barbara b2bcba4a6d GCE: Use object-level permissions for files in GCS
This lets us configure cross-project permissions while ourselves needing
minimal permissions, but also gives us a nice hook for future lockdown
of object-level permissions.
2017-10-29 19:17:00 -04:00
Justin Santa Barbara 1f0601126c Refactor gce resources into pkg/resources/gce
Should be a no-op refactor
2017-10-29 18:37:23 -04:00
Justin Santa Barbara 66e74fac6a Rename pkg/resources/utils -> pkg/resources/ops
That seems to be what utils really is.
2017-10-29 16:32:48 -04:00
Justin Santa Barbara a18363f059 Refactor toolbox dump & dump structured instances
This will enable log collection even if nodes don't register.

AWS: Dumps ids & addresses
GCE: Dumps names - addresses to follow
Others: Not yet!
2017-10-28 14:46:28 -04:00
Kubernetes Submit Queue a4d6895472 Merge pull request #3707 from andrewsykim/droplet
Automatic merge from submit-queue.

Implement DigitalOcean Droplet FI Task

Implements cloudup fi tasks for DigitalOcean droplets. It makes a few assumptions to reduce the size of this PR, those will be addressed in future PRs. 

Also does some cleanup in the DigitalOcean `dns` package.
2017-10-27 08:30:57 -07:00
andrewsykim 45bf2cb3a7 Implement DigitalOcean Droplet FI Task 2017-10-27 09:48:42 -04:00
Justin Santa Barbara ed2dab1af5 kops-server: ig short-name
Also cleanup the shared REST subclass
2017-10-23 00:55:55 -04:00
Justin Santa Barbara 56ecd4ac14 Add missing hack/make-gendocs.sh script 2017-10-09 01:29:54 -04:00
Justin Santa Barbara 38ea16a4ae GCE: Fix subnets vs zones formatting of instance groups 2017-10-03 13:42:14 -04:00
Justin Santa Barbara 544990842a More fixes for 1.8 API changes 2017-10-01 23:02:32 -04:00
Justin Santa Barbara 2205e26257 Updates for new apimachinery 2017-10-01 13:53:26 -04:00
Kubernetes Submit Queue 0905e71741 Merge pull request #3411 from justinsb/mirror_stores
Automatic merge from submit-queue.

Mirror keystore & secretstore
2017-09-30 23:08:33 -07:00
Justin Santa Barbara 7fd1196708 Add Zones field to InstanceGroup
The Zones field can specify zones where they are not specified on a
Subnet, for example on GCE where we have regional subnets.
2017-09-30 19:44:35 -04:00
Kubernetes Submit Queue eb110f5b6c Merge pull request #3478 from chrislovecnm/using-same-disk-size-gce
Automatic merge from submit-queue.

using same disk sizes for gce

Using the same disk size for gce and aws.  We need to override the disk sizes in the e2e tests, but that is another PR.

Closes: https://github.com/kubernetes/kops/issues/3294
2017-09-30 16:01:38 -07:00
chrislovecnm c4c63b2b0c using same disk sizes for gce 2017-09-29 16:07:38 -06:00
chrislovecnm a431eb3e43 refactoring to use cloud based GetGroups 2017-09-29 12:29:07 -06:00
Justin Santa Barbara 559d885480 Mirror keystore & secretstore
This allows us to have our API objects in kops-server, but our
configuration on S3 or GCS.
2017-09-24 00:09:02 -04:00
Justin Santa Barbara e730e043ab Add function to get etcd status
This will allow us to permit changing the etcd configuration only if
etcd has not yet been configured.
2017-09-22 23:27:26 -04:00
Kubernetes Submit Queue 9ebe302939 Merge pull request #3291 from justinsb/baremetal_1
Automatic merge from submit-queue

Skeleton bare-metal provider
2017-09-14 15:55:59 -07:00
Rohith aaf6143a98 Toolbox Templating
Extending the current implementation of toolbox template to include multiple files and snippets. Note, i've removed the requirements for defaults as I think people should be forced to specifically pass them.

- fixing the vetting iseues to the method YamlToJson -> YAMLToJSON
- adding a safety check to ensure templates don't reference an unknown value
- extending the unit test to ensure the above works on main and snippets
- include the ability to specify multiple configuration files, useful for common.yaml and prod.yaml etc

Requested Changes - Toolbox Templating

Added the requested changes

- moved the templater into it's own package rather than using base util
- moved to using the sprig library for additional template function
- @note: i couldn't find a native way in sprig to do snippets, also the i've overloaded the indent as it appears to do the indent on all lines rather than on the newline, meaning i'd have to shift my first line back by the indent to get it to work, which seems ugly
2017-09-08 20:30:21 +01:00
Kubernetes Submit Queue 05cf84dc3d Merge pull request #3299 from justinsb/extract_userdata
Automatic merge from submit-queue

Extract UserData from CloudFormation output during testing
2017-09-06 10:05:39 -07:00
andrewsykim d9fa618de6 refactor resource tracker to be usable across packages 2017-09-02 17:37:21 -04:00
Justin Santa Barbara 8e68be7932 Skeleton bare-metal provider
Just creating the provider, it isn't wired in yet.
2017-08-30 21:10:46 -04:00
Justin Santa Barbara e793562ee6 Extract UserData from CloudFormation output during testing
This gives us some sanity, so we can peek inside the base64 blob
2017-08-29 09:47:11 -04:00
Justin Santa Barbara a16c8b1500 Refactor PKI classes into their own package
This will support generation of keys on the node.
2017-08-27 08:14:55 -04:00
andrewsykim 525fde3609 implement digitalocean volumes task 2017-08-21 09:50:36 -04:00
chrislovecnm ee17e6567c starting work on file assets builder 2017-08-18 13:04:12 -06:00
Mike Splain 4331c12f73 Update image
To make it more copy and paste friendly
2017-08-16 09:59:40 -04:00
Mike Splain f6018df43e Fix quote typo 2017-08-16 09:36:42 -04:00
andrewsykim 1f0d0bbc75 initial cloud interface for DigitalOcean 2017-08-11 19:33:17 -04:00
Kubernetes Submit Queue ac887ce290 Merge pull request #3016 from justinsb/upload_taskify_2
Automatic merge from submit-queue

Copy docker images when they are redirected
2017-07-21 12:10:47 -07:00
Justin Santa Barbara 76743e64de Copy docker images when they are redirected 2017-07-20 23:40:46 -04:00
Phillip Wittrock 6a020bcd59 Check in generated openapi for the kops apiserver.
- Note the openapi will not be regenerated on each change.  This needs to done in a follow up.
2017-07-19 18:42:09 -07:00
Justin Santa Barbara d21d81dc5b Initial experimental kops-apiserver 2017-07-17 00:51:20 -04:00
Justin Santa Barbara 7a870f65b9 Example of how to do bash in our CLI help
* Use the pretty.LongDesc function (which doesn't pipe it through
markdown -> ascii)
* Use pretty.Bash helper to avoid problems with backticks in
go-backtick-quoted-strings
* Make sure indentation is consistent
2017-07-15 22:09:48 -04:00
andrewsykim a866f70e1e digitalocean support -- dns provider 2017-07-14 09:00:15 -04:00
Justin Santa Barbara 1965a4be49 Updates to fix unit tests 2017-07-08 18:46:01 -04:00
Justin Santa Barbara e945322cab Support generated clientset as alternative to vfs clientset
We modelled our VFS clientset (for API objects backed by a VFS path)
after the "real" clientsets, so now it is relatively easy to add a
second implementation that will be backed by a real clientset.

The snafu here is that we weren't really using namespaces previously.
Namespaces do seem to be the primary RBAC scoping mechanism though, so
we start using them with the real clientset.

The namespace is currently inferred from the cluster name.  We map dots
to dashes, because of namespace limitations, which could yield
collisions, but we'll deal with this by simply preventing users from
creating conflicting cluster names - i.e. you simply won't be able to
create a.b.example.com and a-b.example.com
2017-06-20 22:29:37 -04:00
Justin Santa Barbara 9d40b0e6ca Support internal (gossip) names for AWS also 2017-06-19 14:16:35 -04:00
Chris Love 0c1fd6b272 Merge pull request #2617 from WillemMali/move-verify-gendocs-to-makefile
Move verify-gendocs into Makefile and tighten Makefile safety
2017-06-14 09:45:27 -06:00
Willem Mali 60ad299075 moved verify-gendocs into Makefile and tightened Makefile safety (enabled noclobber, errexit and errunset) 2017-06-12 22:25:14 +02:00
andrewsykim e8c99ee72e removes cluster delete code in upup/pkg/kutil duplicated in pkg/resources and puts instancegroup and rollingupdate code into its own packges 2017-06-10 15:21:06 -04:00
Willem Mali cc7fdf91f4 Implemented a Git hook for the CI tests and related installer in the Makefile.
Funnily enough, while trying to commit the hook code it rejected my commit because the hook was missing the standardized script header.
2017-05-14 18:25:38 +02:00
chrislovecnm 7487b0d756 updating docs, adding verify-gendocs and more build tweaks 2017-05-04 18:58:10 -06:00
Justin Santa Barbara eddd73549c Use LB IP address for private dns 2017-04-25 01:32:27 -04:00
Justin Santa Barbara c8b18be9dd Gossip backed DNS 2017-04-25 01:32:21 -04:00
Miao Luo aed9f154ad Fix minor errors due to rebase. 2017-04-21 11:03:13 -07:00
Miao Luo de72c50a0d Change the default image name for vsphere provider and other minor fix. 2017-04-20 23:38:33 -07:00
Miao Luo 58197e6dab Support user-defined s3 endpoint.
When Environment variable S3_ENDPOINT is not empty, kops will use
the bucket on this specific s3 endpoint, instead of using AWS S3
by default.
2017-04-20 23:38:32 -07:00
Miao Luo b15014f9a3 Address review comments and add installing instructions. 2017-04-20 23:37:41 -07:00
prashima 5c92bc6a2d Added featureflag for vSphere cloud. Fixes #26. (#29) 2017-04-20 23:37:40 -07:00
prashima fc8faea2c8 Fixed environment variable setting process for vSphere. (#16) 2017-04-20 23:37:19 -07:00
prashima bc3e8c3734 Added code to enable nodeup and protokube building and execution for vSphere VM (#11)
* Added code to enable nodeup and protokube building and execution for vSphere VM.

* Fixed nodeup template for vSphere.
2017-04-20 23:37:19 -07:00
SandeepPissay 3ed60bd708 Fixed the formatting and added copyright headers to new files 2017-04-20 23:31:49 -07:00
Justin Santa Barbara 30361eef68 Merge pull request #2328 from andrewsykim/2310
Move cluster delete files to pkg/resources
2017-04-19 21:31:38 -04:00
Justin Santa Barbara a7c2c554e1 channels: support targeting kubernetes versions 2017-04-08 11:08:03 -04:00
andrewsykim fe1dc540d1 add k8s.io/kops/pkg/resources to pkg/resources 2017-04-08 10:52:06 -04:00
Chris Love e28c7beb2a Merge pull request #2316 from justinsb/add_fix_for_hack_update_header
Add fix for hack/update-header.sh
2017-04-07 11:00:49 -06:00
Justin Santa Barbara 38d4d69a1d Add fix for hack/update-header.sh
Without this verify-boilerplate.sh gave an exit code of 1 and the script
exited.
2017-04-07 00:24:44 -04:00
chrislovecnm a3a97c665e updating CI in hack script 2017-04-06 16:59:54 -04:00
Kris Nova c0e88558f0 Getting deps up to speed for the server
Protobuf and etcd updates - yey
2017-03-28 11:10:21 +02:00
Justin Santa Barbara b6401a384c Merge pull request #2127 from justinsb/godeps_sync_tool
Script to sync our submodules from Godeps
2017-03-27 21:26:00 -04:00
Justin Santa Barbara bdf0d04b0a Merge pull request #2104 from justinsb/container_optimized_os
Initial Container-Optimized OS support
2017-03-27 10:21:39 -04:00
Justin Santa Barbara b595a88a18 Merge pull request #2140 from justinsb/goimports
Script to call goimports
2017-03-26 00:04:03 -04:00