k8s-ci-robot
dd3381dc89
Merge pull request #5194 from chrisz100/feature/s3_bucket_encryption
...
Feature/s3 bucket encryption - Implements PR #4235
2018-06-10 15:32:01 -07:00
Justin Santa Barbara
4cea00ea75
Use HomeDir from client-go to get home directory
...
Works on windows & linux
Fixes #4523
2018-06-02 15:17:23 -04:00
Christian Jantz
6fba37ea63
Merge branch 'master' of github.com:gekart/kops into feature/s3_bucket_encryption
2018-05-23 10:49:21 +02:00
xh4n3
d25878f82f
add String method for OSSFS to fix go vet issue
2018-04-04 15:24:33 +08:00
andrewsykim
c82e3cf81a
fix go vet error from util/pkg/vfs/ossfs.go
2018-04-03 18:00:19 -04:00
andrewsykim
54bee09f47
digitalocean: add kubelet hostname override
2018-04-03 01:16:50 -04:00
Xiao An
4aa68d2de9
a few updates based on suggestions
...
Signed-off-by: Xiao An <hac@zju.edu.cn>
2018-04-02 15:29:18 +08:00
xh4n3
49dd170eea
include aliyun sdk
2018-04-02 15:24:22 +08:00
Xiao An
18e160748e
add VFS implementation with Aliyun OSS
...
Signed-off-by: Xiao An <hac@zju.edu.cn>
2018-04-02 15:23:36 +08:00
andrewsykim
6fa37bf005
add digitalocean VFS
2018-04-01 23:05:46 -04:00
andrewsykim
2947bb1b9e
allow s3 vfs scheme and sse to be configurable
2018-04-01 23:05:11 -04:00
Grischa Ekart
7c41e35bbc
Implement AWS Default Bucket Encryption PR #4235
2018-03-07 23:26:28 +01:00
k8s-ci-robot
0ab8b57c2a
Merge pull request #4493 from justinsb/vfs_streaming
...
VFS: WriteFile takes an io.ReadSeeker
2018-02-26 15:50:45 -08:00
Mike Splain
45a57915e2
Fix bazel deprecation notice
2018-02-26 09:36:13 -05:00
Justin Santa Barbara
412cf377c2
VFS: WriteFile takes an io.ReadSeeker
...
Means we don't have to buffer big files in memory, in combination with
WriteTo for reading.
2018-02-26 09:09:17 -05:00
Justin Santa Barbara
8ef705353e
Update gazelle
2018-02-03 13:27:23 -05:00
k8s-ci-robot
cc67497776
Merge pull request #4246 from ottoyiu/s3_vfs
...
Improve S3 url parsing for vfsPath to support more naming conventions
2018-01-29 05:34:34 -08:00
Justin Santa Barbara
82b9a54332
VFS: Recognize file:// paths
2018-01-27 15:03:05 -08:00
Justin Santa Barbara
d92bd77ccf
VFS: Fix bug in CopyTree when dest does not exist
...
This particularly happened with a filesystem destination file
2018-01-25 10:08:08 -05:00
Justin Santa Barbara
e2f91917d9
ReadTree: clarify that returns only files
...
Because the primary use-case is S3-style stores, we haven't really used
directories. If we have a use-case, we can always pass a boolean
parameter or create an alternative function.
2018-01-23 23:42:00 -05:00
Otto Yiu
e4427e9672
improve S3 url parsing for vfsPath to support more naming conventions
2018-01-12 16:07:18 -08:00
Justin Santa Barbara
6f6bafb65e
VFS: Support io.WriterTo interface
...
Allows us to handle much bigger files (no need to buffer in-memory)
2018-01-08 22:34:27 -05:00
Justin Santa Barbara
ec8db8b78c
Initial implementation of bundle command
...
The bundle command will support enrollment of a machine via SSH.
2018-01-04 18:55:28 -05:00
k8s-ci-robot
fcc904f468
Merge pull request #4170 from chrislovecnm/bazel-improvements
...
Improving bazel make targets, adding a target for kops cli, bumping go_rules version
2018-01-04 08:48:31 -08:00
Justin Santa Barbara
8c23031561
Add roundtrip tests for certs & private keys
...
Travis should cover all our supported go versions.
2017-12-29 21:18:29 -05:00
chrislovecnm
4dd3bb1dea
Updating bazel BUILD files with new go_rules version
2017-12-29 15:03:14 -07:00
chrislovecnm
7057aaf1bb
Enabling the file assets
...
File assets and the SHA files are uploaded to the new location. Files
when are users uses s3 are upload public read only. The copyfile task
uses only the existing SHA value.
This PR include major refactoring of the use of URLs. Strings are no
longer categnated, but converted into a URL struct and path.Join is
utlilized.
A new values.go file is included so that we can start refactoring more
code out of the "fi" package.
A
2017-12-17 15:26:57 -07:00
chrislovecnm
609e268a1d
gazelle updates with new bazel version
2017-11-05 17:41:53 -07:00
chrislovecnm
b6b2c74fec
updating bazel files
2017-11-04 10:08:50 -06:00
zengchen1024
bbfd1e18a3
implement vfs with openstack swift
2017-11-02 17:08:16 +08:00
chrislovecnm
8d1ee1fa16
updating files for goimports
2017-11-01 12:51:43 -06:00
Justin Santa Barbara
2de6538692
Clarify comment on ReadTree
...
Make it clearer that it needs to fetch all the files recursively
2017-10-30 23:48:40 -04:00
Justin Santa Barbara
b2bcba4a6d
GCE: Use object-level permissions for files in GCS
...
This lets us configure cross-project permissions while ourselves needing
minimal permissions, but also gives us a nice hook for future lockdown
of object-level permissions.
2017-10-29 19:17:00 -04:00
Justin Santa Barbara
d1ee8026ac
GCE: Tasks for object & bucket level permissions
...
We also switch to setting a bucket-level ACL permission, as this
requires less permissions.
2017-10-29 18:08:08 -04:00
Justin Santa Barbara
dbbe3f373b
GCE: Set up permissions for cross-project configurations
...
This ensures that the cluster can read the kops state store files, even
if the GCS bucket is in a different project.
We automatically set up an IAM access policy that grants access.
2017-10-28 03:24:18 -04:00
Kubernetes Submit Queue
4d345d18d8
Merge pull request #3461 from justinsb/gcs_retry_on_error
...
Automatic merge from submit-queue.
GCS paths; retry on error
2017-10-08 14:18:59 -07:00
Justin Santa Barbara
0143be7c4f
autogen: BUILD and BUILD.bazel
2017-10-02 14:27:21 -04:00
Justin Santa Barbara
83300fc39f
GCS paths; retry on error
...
The AWS SDK does this for us, I think, the GS SDK does not.
2017-09-27 09:31:33 -04:00
Justin Santa Barbara
559d885480
Mirror keystore & secretstore
...
This allows us to have our API objects in kops-server, but our
configuration on S3 or GCS.
2017-09-24 00:09:02 -04:00
Justin Santa Barbara
d257e73b1c
GCS: Don't reuse same error message
...
We had exactly the same error message for two code paths, which made
figuring out the cause harder.
2017-09-16 21:39:14 -04:00
Justin Santa Barbara
106875115d
Support for deleting tokens & keypairs
...
This now allows for deleting all secrets, which means we can have a
procedure for rotating all keys.
2017-09-09 01:04:45 -04:00
Justin Santa Barbara
1ac08b5cf1
Add missed error handling on session.NewSession
2017-08-28 07:52:11 -04:00
Justin Santa Barbara
a26b28576e
AWS: Always use verbose errors
...
As otherwise very difficult to diagnose errors
2017-08-25 23:08:39 -04:00
Lars Lehtonen
a9bbe3af24
Wrap AWS NewSession() errors in vfs package
2017-08-25 13:25:04 -07:00
Lars Lehtonen
afea9d05c5
Replace deprecated aws session.New() with session.NewSession()
2017-08-22 17:28:55 -07:00
Lars Lehtonen
4e847ce020
Fix swallowed err variable in vfs package
2017-07-18 18:09:39 -07:00
Justin Santa Barbara
e945322cab
Support generated clientset as alternative to vfs clientset
...
We modelled our VFS clientset (for API objects backed by a VFS path)
after the "real" clientsets, so now it is relatively easy to add a
second implementation that will be backed by a real clientset.
The snafu here is that we weren't really using namespaces previously.
Namespaces do seem to be the primary RBAC scoping mechanism though, so
we start using them with the real clientset.
The namespace is currently inferred from the cluster name. We map dots
to dashes, because of namespace limitations, which could yield
collisions, but we'll deal with this by simply preventing users from
creating conflicting cluster names - i.e. you simply won't be able to
create a.b.example.com and a-b.example.com
2017-06-20 22:29:37 -04:00
Miao Luo
22c49e76cb
Fix user-defined s3 endpoint support.
...
Address review feedbacks and remove unintended space.
2017-04-19 23:46:05 -07:00
Miao Luo
76437a77d4
Support user-defined s3 endpoint.
2017-04-18 11:27:07 -07:00
yissachar
5b03f36b27
Merge pull request #2125 from justinsb/issue_2108
...
More logging around errors in s3 write path
2017-03-20 01:15:27 -04:00