Peter Rifel
0df5f6c24d
Fix file not found error detection in fs://
2021-01-12 20:57:33 -06:00
Kenji Kaneda
40c944aa5c
Fix a typo in an error message returned from buildAzureBlobPath
...
invalid Azure Blob schem -> invalid Azure Blob scheme
2020-11-23 08:16:39 -08:00
Kenji Kaneda
4555c0b2df
Add support of Azure Blob storage to VFS
...
The schema is "azureblob".
azureClient provides two ways to set up credential. One approach is to
use an account key stored in env var. This approach is used when
accessing Blob from kops CLI. The second approach is to retrieve
credentials from Instance Metadata Service. This works only when
azureClient is created on a VM that has sufficient privilege to access
a specified blob. This approach is used from nodeup, etcd-manager,
etc.
2020-11-19 10:47:03 -08:00
Jesse Haka
67d69f16a9
allow reauth for openstack client
2020-10-30 08:57:49 +02:00
Ole Markus With
f6ce70e5c3
Minor fixes to swiftfs.go
2020-10-08 20:32:29 +02:00
Ciprian Hacman
0c6f1c733c
Use all kops mirrors to determine artifacts hashes
2020-09-18 09:44:37 +03:00
Kubernetes Prow Robot
a5fc8895dc
Merge pull request #9857 from hakman/detect-aws-region
...
Detect AWS region for S3 inside containers
2020-09-09 23:17:44 -07:00
John Gardiner Myers
1e92c7740c
Map ENOENT to ErrNotExist in FSPath
2020-09-05 21:46:57 -07:00
Ciprian Hacman
32e6da7576
Detect AWS region for S3 inside containers
2020-09-02 06:41:12 +03:00
Justin SB
d4480e4721
Always use OpenStack Swift reauthentication
...
If we were using credentials from env vars, we would not do
reauthentication with Swift.
2020-08-29 08:25:59 -04:00
Peter Rifel
4d9f0128a3
Upgrade to klog2
...
This splits up the kubernetes 1.19 PR to make it easier to keep up to date until we get it sorted out.
2020-08-16 20:56:48 -05:00
Ole Markus With
a708a96c05
Adds support for using OS application credentials
...
Application credentials allows you to export a purpose-specific set of
credentials for a user instead of exposing user login credentials.
Especially useful when using LDAP or similar for Openstack users.
Also lets you rotate credentials more easily since multiple application
credentials can be provisioned per user.
Update pkg/model/bootstrapscript.go
Co-authored-by: Ciprian Hacman <ciprianhacman@gmail.com>
2020-08-07 14:26:47 +02:00
Ole Markus With
d1479fb666
Add support for reading openstack metadata in vfs
2020-08-04 08:22:00 +02:00
John Gardiner Myers
fed5587d77
Improve locking in memfs
2020-07-19 16:01:47 -07:00
Zhou Hao
d6695b822f
Add err judgment to os.RemoveAll
...
Signed-off-by: Zhou Hao <zhouhao@cn.fujitsu.com>
2020-07-09 16:48:35 +08:00
Zhou Hao
34931ed930
Add err judgment to ioutil.TempDir
...
Signed-off-by: Zhou Hao <zhouhao@cn.fujitsu.com>
2020-07-09 16:45:12 +08:00
Li Zhijian
c3fc293ede
cleanup tempfiles for fs_test
...
Signed-off-by: Li Zhijian <lizhijian@cn.fujitsu.com>
2020-07-02 10:09:34 +08:00
Xiaoyu Zhong
98c35cd220
Rename accessKeyId to accessKeyID
2020-06-22 09:32:20 +08:00
Ole Markus With
acaa1e1dfc
Implement VFS for vault
2020-06-18 13:02:37 +02:00
Kubernetes Prow Robot
5e27f74dd8
Merge pull request #9228 from justinsb/paginate_delete_all_versions
...
S3 DeleteAllVersions: use pagination
2020-05-31 15:59:54 -07:00
Justin SB
319ddcc333
S3 DeleteAllVersions: use pagination
...
This way we're not limited to one page of versions. This is likely a
purely theoretical concern, at least as we're using it today.
2020-05-31 18:21:05 -04:00
Justin SB
7d7b8969ea
Use AWS SDK to fetch metadata
...
Previously the EC2 metadata service was straightforward HTTP, but IMDS
v2 now requires managing a session token (and is more secure for it).
We now use the AWS SDK when retrieving metadata; it automatically
supports IMDS v2.
2020-05-31 17:23:01 -04:00
Ciprian Hacman
d54aadc89c
Fix nits for removal of S3 file versions
2020-05-28 06:50:32 +03:00
Kubernetes Prow Robot
92f8e22002
Merge pull request #9174 from johngmyers/remove-vfsscan
...
Remove unused VFSScan
2020-05-27 09:24:48 -07:00
Ciprian Hacman
9675692b84
Implement RemoveAll() for S3 paths
2020-05-25 07:46:32 +03:00
John Gardiner Myers
62ebbc5a5d
Remove unused VFSScan
2020-05-24 21:27:28 -07:00
Ciprian Hacman
b565122875
Remove delete markers also from S3 bucket
2020-05-24 17:42:02 +03:00
Ciprian Hacman
a48ccfa06c
Return warning instead of error to hide issues during cluster teardown
2020-05-24 15:20:20 +03:00
Ciprian Hacman
1a38a3feaa
Return os.ErrNotExist when no versions are found
2020-05-24 11:42:18 +03:00
Ciprian Hacman
56af880c53
Remove TODO that was not addressed for a long time
2020-05-24 10:11:56 +03:00
Ciprian Hacman
831e3f0e57
Remove all versions of a file form the S3 bucket
2020-05-24 08:38:46 +03:00
Justin SB
5ed11fd9c7
GCE: don't rely on hostname being correct
...
Distros that use systemd for DHCP often don't have the hostname
correct, due to e.g. the requirement for policy kit.
We don't rely on it being set correctly on other clouds; no real
reason to require it on GCP either!
2020-05-17 15:20:58 -04:00
Kubernetes Prow Robot
5fc7ee69da
Merge pull request #8997 from littleroad/add_unit_test
...
util/pkg/vfs/fs.go: Add Unit Test for WriteTo
2020-05-04 17:29:08 -07:00
Johannes Würbach
b92ef68bd6
Support S3 Virtual Hosted Style
2020-05-03 07:44:44 +02:00
Lu Fengqi
f7990cad35
util/pkg/vfs/fs.go: Add Unit Test for WriteTo
...
Signed-off-by: Lu Fengqi <lufq.fnst@cn.fujitsu.com>
2020-04-27 17:46:07 +08:00
Justin Santa Barbara
108d1eee5d
Replace deprecated x/net/context with context
...
It's not x-perimental any more!
2020-04-09 23:58:19 -04:00
Dao Cong Tien
af6ff9b50d
Add UT for util/pkg/vfs/memfs.go
...
Signed-off-by: Dao Cong Tien <tiendc@vn.fujitsu.com>
2020-03-12 19:04:24 +07:00
tiendc
ce134f71b9
Update fs_test.go
2020-03-09 15:45:12 +07:00
tiendc
293233248c
Update fs_test.go
...
Update fs_test.go
2020-03-09 15:32:03 +07:00
Dao Cong Tien
b95a24d43e
Add UT for util/pkg/vfs/fs.go
...
Signed-off-by: Dao Cong Tien <tiendc@vn.fujitsu.com>
2020-03-06 13:43:24 +07:00
Kubernetes Prow Robot
a34ad252ff
Merge pull request #8496 from justinsb/log_acls
...
GCS: Log ACLs if we're writing them
2020-02-06 22:49:43 -08:00
Justin SB
9fb80f9048
GCS: Log ACLs if we're writing them
...
We log at V(4) because they are fairly verbose.
2020-02-06 14:46:41 -05:00
Justin SB
9e7a026332
GCS: Fix bug where around retry on GCS
...
We were recomputing the MD5, but we would need to rewind the stream first.
2020-02-06 14:45:39 -05:00
Kubernetes Prow Robot
b356bd4dc7
Merge pull request #6465 from ari-becker/bugfix/allow-local-filesystem-state-store
...
Allow local filesystem state stores (to aid CI pull-request workflows)
2020-01-17 10:52:26 -08:00
Justin Santa Barbara
5ebbfc96b9
Replace deprecated method calls to google cloud libraries
...
Required for static-check to pass.
2020-01-17 06:38:43 -05:00
Ari Becker
3236ba135b
Allow local filesystem state stores
2019-12-29 09:12:51 +02:00
Kubernetes Prow Robot
be6e8a83e2
Merge pull request #8194 from bittopaz/ali-patch-2
...
Alicloud: refine Alicloud RAM role policy
2019-12-27 09:30:23 -08:00
Xiaoyu Zhong
5287f6d024
Refine Alicloud RAM role policy
2019-12-25 11:02:41 +08:00
tanjunchen
3f9400a588
util/pkg/vfs/:staticcheck
2019-12-23 10:20:56 +08:00
Xiaoyu Zhong
e580c5fff7
Alicloud: allow use RAM role for OSS client
2019-12-04 10:44:41 +08:00