automation-tests/storage
Miloslav Trmač 41e2fb4e9b Split pkg/chunked.ZstdCompressor into a separate subpackage
containers/image/pkg/compression depends on that function, so it's
highly undesirable for it to drag in all of containers/storage.

So, move it into a separate subpackage, along with its exclusive
dependency tree.

Code that is called both from the new pkg/chunked/compressor
and the original pkg/chunked has been moved into pkg/chunked/internal ,
so that we don't expose any new public API. That move was made
purely mechanically without any concern for conceptual consistency,
to minimize the size of the dependency (and not to spend time on
that until the concept is proven to be useful).

Signed-off-by: Miloslav Trmač <mitr@redhat.com>
2021-07-23 21:43:52 +02:00
..
.github Add dependabot.yml configuration file 2021-03-03 11:43:22 +01:00
cmd/containers-storage containers-storage: add --volatile to container create 2021-03-01 21:11:40 +01:00
contrib/cirrus Cirrus: Fix references to master branch 2021-06-10 11:41:21 -04:00
docs Added support for CONTAINERS_STORAGE_CONF override 2021-06-09 10:17:09 +02:00
drivers overlay: check if we can mknod() kernel whiteout 2021-07-20 14:54:07 -04:00
hack Update to F34 and U2104 2021-05-11 14:25:24 -04:00
internal/opts Fix problems found by codespell 2020-09-11 10:49:59 -04:00
pkg Split pkg/chunked.ZstdCompressor into a separate subpackage 2021-07-23 21:43:52 +02:00
tests Vendor in opencontainers/runc v1.0.0 2021-06-22 08:41:17 -04:00
types Revert #952, we don't want to use /run/user on non systemd systems 2021-07-12 14:00:58 -04:00
vagrant Use `bash` binary from env instead of /bin/bash for scripts 2020-08-17 11:23:44 +02:00
vendor build(deps): bump github.com/opencontainers/runc from 1.0.0 to 1.0.1 2021-07-19 11:23:06 +00:00
.cirrus.yml Cirrus: Fix references to master branch 2021-06-10 11:41:21 -04:00
.dockerignore
.gitignore Fixes: https://github.com/containers/podman/issues/7790 2020-10-06 11:39:51 +08:00
.golangci.yml Enable all linters and selectively disable them 2020-01-28 16:09:15 +01:00
.mailmap Fix double entry in authors 2016-06-03 12:40:36 +02:00
AUTHORS Inherit system storage driver in rootless configurations 2021-03-02 10:28:53 -06:00
CODE-OF-CONDUCT.md [CI:DOCS] Fix docs links due to branch rename 2021-06-10 11:37:44 -04:00
CONTRIBUTING.md Change cri-o IRC channel to container-projects in CONTRIBUTING.md 2017-10-26 17:02:34 -04:00
LICENSE
Makefile Remove dependencies on ffjson 2021-05-06 12:04:23 -04:00
NOTICE
README.md make: clean up .PHONY targets list 2018-10-31 19:03:59 +01:00
SECURITY.md [CI:DOCS] Fix docs links due to branch rename 2021-06-10 11:37:44 -04:00
VERSION Move to v1.32.7-dev 2021-07-09 13:42:20 -04:00
Vagrantfile Vagrantfile: update to Fedora 28 2018-06-29 18:47:10 +02:00
containers.go store: ReloadIfChanged propagates errors from Modified() 2021-05-27 14:55:42 +02:00
errors.go drivers: add interface to directly write diff 2021-05-07 11:29:25 +02:00
go.mod build(deps): bump github.com/opencontainers/runc from 1.0.0 to 1.0.1 2021-07-19 11:23:06 +00:00
go.sum build(deps): bump github.com/opencontainers/runc from 1.0.0 to 1.0.1 2021-07-19 11:23:06 +00:00
idset.go Rework autons ID mapping generation. 2021-04-03 13:22:23 -07:00
idset_test.go Rework autons ID mapping generation. 2021-04-03 13:22:23 -07:00
images.go store: ReloadIfChanged propagates errors from Modified() 2021-05-27 14:55:42 +02:00
images_test.go Add names-history support 2019-11-11 10:21:14 +01:00
jsoniter.go Use json-iterator instead of encoding/json 2021-05-06 12:24:24 -04:00
layers.go Reload layer storage if layers.json got externally modified 2021-06-17 13:16:48 +02:00
lockfile_compat.go Move lockfiles to their own package 2019-07-02 11:14:04 -04:00
storage.conf Set default to overlay from storage.conf 2021-04-02 05:59:10 -04:00
store.go canUseShifting can segfault 2021-06-08 13:43:43 -04:00
store_test.go new interface Free for deleting Store object 2020-06-29 13:01:33 -04:00
userns.go Rework autons ID mapping generation. 2021-04-03 13:22:23 -07:00
userns_test.go Rework autons ID mapping generation. 2021-04-03 13:22:23 -07:00
utils.go Move storageOpts structures into types subdir to shrink bindings. 2021-02-26 05:34:09 -05:00

README.md

storage is a Go library which aims to provide methods for storing filesystem layers, container images, and containers. A containers-storage CLI wrapper is also included for manual and scripting use.

To build the CLI wrapper, use 'make binary'.

Operations which use VMs expect to launch them using 'vagrant', defaulting to using its 'libvirt' provider. The boxes used are also available for the 'virtualbox' provider, and can be selected by setting $VAGRANT_PROVIDER to 'virtualbox' before kicking off the build.

The library manages three types of items: layers, images, and containers.

A layer is a copy-on-write filesystem which is notionally stored as a set of changes relative to its parent layer, if it has one. A given layer can only have one parent, but any layer can be the parent of multiple layers. Layers which are parents of other layers should be treated as read-only.

An image is a reference to a particular layer (its top layer), along with other information which the library can manage for the convenience of its caller. This information typically includes configuration templates for running a binary contained within the image's layers, and may include cryptographic signatures. Multiple images can reference the same layer, as the differences between two images may not be in their layer contents.

A container is a read-write layer which is a child of an image's top layer, along with information which the library can manage for the convenience of its caller. This information typically includes configuration information for running the specific container. Multiple containers can be derived from a single image.

Layers, images, and containers are represented primarily by 32 character hexadecimal IDs, but items of each kind can also have one or more arbitrary names attached to them, which the library will automatically resolve to IDs when they are passed in to API calls which expect IDs.

The library can store what it calls metadata for each of these types of items. This is expected to be a small piece of data, since it is cached in memory and stored along with the library's own bookkeeping information.

Additionally, the library can store one or more of what it calls big data for images and containers. This is a named chunk of larger data, which is only in memory when it is being read from or being written to its own disk file.

Contributing Information about contributing to this project.