65 Commits

Author	SHA1	Message	Date
chrislovecnm	7057aaf1bb	Enabling the file assets ... File assets and the SHA files are uploaded to the new location. Files when are users uses s3 are upload public read only. The copyfile task uses only the existing SHA value. This PR include major refactoring of the use of URLs. Strings are no longer categnated, but converted into a URL struct and path.Join is utlilized. A new values.go file is included so that we can start refactoring more code out of the "fi" package. A	2017-12-17 15:26:57 -07:00
chrislovecnm	8d1ee1fa16	updating files for goimports	2017-11-01 12:51:43 -06:00
Justin Santa Barbara	b2bcba4a6d	GCE: Use object-level permissions for files in GCS ... This lets us configure cross-project permissions while ourselves needing minimal permissions, but also gives us a nice hook for future lockdown of object-level permissions.	2017-10-29 19:17:00 -04:00
Justin Santa Barbara	106875115d	Support for deleting tokens & keypairs ... This now allows for deleting all secrets, which means we can have a procedure for rotating all keys.	2017-09-09 01:04:45 -04:00
Miao Luo	22c49e76cb	Fix user-defined s3 endpoint support. ... Address review feedbacks and remove unintended space.	2017-04-19 23:46:05 -07:00
Miao Luo	76437a77d4	Support user-defined s3 endpoint.	2017-04-18 11:27:07 -07:00
Justin Santa Barbara	8104ba2cea	More logging around errors in s3 write path ... Hopefully to shed some light on issues like #2108	2017-03-15 09:52:32 -04:00
Justin Santa Barbara	45a62a02aa	s3 path: apply suffix to ReadTree also ... Otherwise we were matching directories with the same prefix.	2017-01-29 21:35:26 -05:00
Vincent Ambo	3b6e3bda56	chore: Run gofmt on new VFS code	2017-01-26 12:30:04 +01:00
Vincent Ambo	db0155b5b5	feat s3fs: Allow bucket object ACL override ... When sharing S3 buckets across accounts it may be necessary to override ACLs per object to avoid locking out different accounts. This commit lets users specify a `KOPS_STATE_S3_ACL` environment variable which (if specified) overrides the ACL in the PutObject request. Fixes #907	2017-01-26 11:47:09 +01:00
Justin Santa Barbara	0a56d3d2e1	Raise an error on an invalid s3 path ... Fix #902	2017-01-08 14:37:46 -05:00
chrislovecnm	8fa2aac99f	fixing more headers	2016-10-15 19:20:56 -06:00
Justin Santa Barbara	767c9a6416	Fix tests; don't hit s3 until we need to	2016-10-07 01:38:44 -04:00
Justin Santa Barbara	39c3c85262	Skip directory objects in S3 when listing files ... Issue #520 Issue #548	2016-09-30 10:07:15 -04:00
Justin Santa Barbara	5f8d68ec85	Refactor shared packages into util directory	2016-09-25 18:27:09 -04:00