Container Storage Library
Go to file
Nalin Dahyabhai 6d787b262b checkDirectory.headers: always process hard links last
When we use diff headers to build a structure that represents what we
expect to find when we look at a layer, make sure we process hard links
last, so that we can refer to metadata about copies of the linked-to
file from the layer whose diffs we're processing, instead of potentially
metadata about versions of those files which came from earlier layers.

Signed-off-by: Nalin Dahyabhai <nalin@redhat.com>
2023-06-13 14:14:56 -04:00
.github Add renovate.json 2023-01-30 10:52:55 -05:00
cmd/containers-storage Format sources with gofumpt 2023-05-26 16:17:31 -07:00
contrib/cirrus Fix datasets held open after tests 2023-04-04 14:20:46 -04:00
docs options: enable Remap-User/Group setting 2023-05-26 15:42:26 +09:00
drivers check: suppress certain errors when pull_options might cause them 2023-06-13 14:14:55 -04:00
hack ci: use gofumpt, rm hack/gofmt.sh 2023-05-26 16:19:32 -07:00
internal/opts Format sources with gofumpt 2023-05-26 16:17:31 -07:00
pkg Embed Regexp.once directly into the owner again 2023-06-09 01:25:23 +02:00
tests tests/tools/Makefile: simplify golangci-lint installation 2023-05-23 18:51:06 -07:00
types types/options: check prior drivers using readdir 2023-06-12 17:48:51 +05:30
vendor build(deps): bump github.com/klauspost/compress from 1.16.5 to 1.16.6 2023-06-13 11:57:59 +00:00
.cirrus.yml chore(deps): update dependency containers/automation_images to v20230601 2023-06-06 12:55:16 +00:00
.dockerignore Add vendor/pkg to .dockerignore 2015-12-04 17:03:24 -08:00
.gitignore Fixes: https://github.com/containers/podman/issues/7790 2020-10-06 11:39:51 +08:00
.golangci.yml ci: use gofumpt, rm hack/gofmt.sh 2023-05-26 16:19:32 -07:00
.mailmap Fix double entry in authors 2016-06-03 12:40:36 +02:00
AUTHORS Inherit system storage driver in rootless configurations 2021-03-02 10:28:53 -06:00
CODE-OF-CONDUCT.md [CI:DOCS] Fix docs links due to branch rename 2021-06-10 11:37:44 -04:00
CONTRIBUTING.md Change cri-o IRC channel to container-projects in CONTRIBUTING.md 2017-10-26 17:02:34 -04:00
LICENSE Update LICENSE date 2015-12-31 13:07:35 +00:00
Makefile ci: use gofumpt, rm hack/gofmt.sh 2023-05-26 16:19:32 -07:00
NOTICE Update LICENSE date 2015-12-31 13:07:35 +00:00
README.md make: clean up .PHONY targets list 2018-10-31 19:03:59 +01:00
SECURITY.md [CI:DOCS] Fix docs links due to branch rename 2021-06-10 11:37:44 -04:00
VERSION Move to v0.47.0-dev 2023-04-07 23:07:04 -04:00
check.go checkDirectory.headers: always process hard links last 2023-06-13 14:14:56 -04:00
check_test.go Use generics in readAllImageStores 2023-04-18 21:25:04 +02:00
containers.go Format sources with gofumpt 2023-05-26 16:17:31 -07:00
deprecated.go Make all the various *Store interfaces, apart from storage.Store, private 2022-10-11 19:25:19 +02:00
errors.go store: add independent AddNames and RemoveNames for images,layers,containers 2022-03-01 01:33:35 +05:30
go.mod build(deps): bump github.com/klauspost/compress from 1.16.5 to 1.16.6 2023-06-13 11:57:59 +00:00
go.sum build(deps): bump github.com/klauspost/compress from 1.16.5 to 1.16.6 2023-06-13 11:57:59 +00:00
idset.go Define error type for ErrNoAvailableIDs 2023-01-03 14:24:35 -05:00
idset_test.go Format sources with gofumpt 2023-05-26 16:17:31 -07:00
images.go Format sources with gofumpt 2023-05-26 16:17:31 -07:00
images_test.go Complete "pulling up" of images in updateNames() 2023-03-31 10:36:30 -04:00
jsoniter.go Use json-iterator instead of encoding/json 2021-05-06 12:24:24 -04:00
layers.go Ensure compressor.Close() is called on error paths 2023-06-13 02:17:30 +02:00
lockfile_compat.go Convert all c/storage users of Locker to *lockfile.LockFile 2022-11-29 18:12:43 +01:00
storage.conf options: enable Remap-User/Group setting 2023-05-26 15:42:26 +09:00
storage.conf-freebsd Change default location for storage.conf to... 2022-05-03 16:39:32 +01:00
store.go Format sources with gofumpt 2023-05-26 16:17:31 -07:00
store_test.go store: add support to split ImageStore 2023-04-14 17:34:27 +05:30
userns.go Complete "pulling up" of images in updateNames() 2023-03-31 10:36:30 -04:00
userns_test.go Rework autons ID mapping generation. 2021-04-03 13:22:23 -07:00
utils.go "pull up" images when creating them, too 2023-04-06 18:21:11 -04:00

README.md

storage is a Go library which aims to provide methods for storing filesystem layers, container images, and containers. A containers-storage CLI wrapper is also included for manual and scripting use.

To build the CLI wrapper, use 'make binary'.

Operations which use VMs expect to launch them using 'vagrant', defaulting to using its 'libvirt' provider. The boxes used are also available for the 'virtualbox' provider, and can be selected by setting $VAGRANT_PROVIDER to 'virtualbox' before kicking off the build.

The library manages three types of items: layers, images, and containers.

A layer is a copy-on-write filesystem which is notionally stored as a set of changes relative to its parent layer, if it has one. A given layer can only have one parent, but any layer can be the parent of multiple layers. Layers which are parents of other layers should be treated as read-only.

An image is a reference to a particular layer (its top layer), along with other information which the library can manage for the convenience of its caller. This information typically includes configuration templates for running a binary contained within the image's layers, and may include cryptographic signatures. Multiple images can reference the same layer, as the differences between two images may not be in their layer contents.

A container is a read-write layer which is a child of an image's top layer, along with information which the library can manage for the convenience of its caller. This information typically includes configuration information for running the specific container. Multiple containers can be derived from a single image.

Layers, images, and containers are represented primarily by 32 character hexadecimal IDs, but items of each kind can also have one or more arbitrary names attached to them, which the library will automatically resolve to IDs when they are passed in to API calls which expect IDs.

The library can store what it calls metadata for each of these types of items. This is expected to be a small piece of data, since it is cached in memory and stored along with the library's own bookkeeping information.

Additionally, the library can store one or more of what it calls big data for images and containers. This is a named chunk of larger data, which is only in memory when it is being read from or being written to its own disk file.

Contributing Information about contributing to this project.