Container Storage Library
Go to file
Miloslav Trmač ffeaed8fa4 Optimize the "no changes" case of layerStore.startReading further
In that case, we can just get read locks, confirm that nothing has changed,
and continue; no need for any serialization on exclusively holding
loadMut / inProcessLock.

Signed-off-by: Miloslav Trmač <mitr@redhat.com>
2023-01-04 00:29:39 +01:00
.github Add dependabot.yml configuration file 2021-03-03 11:43:22 +01:00
cmd/containers-storage Add test for transient mode 2022-11-14 16:36:30 +01:00
contrib/cirrus Add test for transient mode 2022-11-14 16:36:30 +01:00
docs Fix minor typo on containers-storage.conf.5.md 2022-11-28 18:04:24 +01:00
drivers fix: workaround field rename in btrfs-progs 6.1 2022-12-29 16:28:21 -05:00
hack fix hack/git-validation.sh script 2022-11-02 20:51:36 +01:00
internal/opts fix inconsitent go build tags 2022-11-02 20:51:27 +01:00
pkg docs: fix fcn name ref for `AssertLockedForWriting` 2023-01-02 16:49:16 -05:00
tests tests: Add a better default value for STORAGE_TRANSIENT 2022-12-13 11:37:55 +00:00
types Add new storage.conf option "transient_store" 2022-11-14 16:36:30 +01:00
vendor build(deps): bump github.com/klauspost/compress from 1.15.13 to 1.15.14 2023-01-03 08:15:08 -05:00
.cirrus.yml Add test for transient mode 2022-11-14 16:36:30 +01:00
.dockerignore Add vendor/pkg to .dockerignore 2015-12-04 17:03:24 -08:00
.gitignore Fixes: https://github.com/containers/podman/issues/7790 2020-10-06 11:39:51 +08:00
.golangci.yml Enable all linters and selectively disable them 2020-01-28 16:09:15 +01:00
.mailmap Fix double entry in authors 2016-06-03 12:40:36 +02:00
AUTHORS Inherit system storage driver in rootless configurations 2021-03-02 10:28:53 -06:00
CODE-OF-CONDUCT.md [CI:DOCS] Fix docs links due to branch rename 2021-06-10 11:37:44 -04:00
CONTRIBUTING.md Change cri-o IRC channel to container-projects in CONTRIBUTING.md 2017-10-26 17:02:34 -04:00
LICENSE Update LICENSE date 2015-12-31 13:07:35 +00:00
Makefile Merge pull request #1431 from containers/dependabot/go_modules/github.com/containerd/stargz-snapshotter/estargz-0.13.0 2022-11-15 09:27:29 -05:00
NOTICE Update LICENSE date 2015-12-31 13:07:35 +00:00
README.md make: clean up .PHONY targets list 2018-10-31 19:03:59 +01:00
SECURITY.md [CI:DOCS] Fix docs links due to branch rename 2021-06-10 11:37:44 -04:00
VERSION Move to v1.44.1-dev 2022-11-08 13:21:16 -05:00
containers.go Optimize the "no changes" case of containerStore.startReading further 2023-01-04 00:29:27 +01:00
deprecated.go Make all the various *Store interfaces, apart from storage.Store, private 2022-10-11 19:25:19 +02:00
errors.go store: add independent AddNames and RemoveNames for images,layers,containers 2022-03-01 01:33:35 +05:30
go.mod build(deps): bump github.com/klauspost/compress from 1.15.13 to 1.15.14 2023-01-03 08:15:08 -05:00
go.sum build(deps): bump github.com/klauspost/compress from 1.15.13 to 1.15.14 2023-01-03 08:15:08 -05:00
idset.go Switch to golang native error wrapping 2022-07-07 13:22:46 +02:00
idset_test.go Misc. warning cleanups 2022-10-01 02:53:06 +02:00
images.go Optimize the "no changes" case of imageStore.startReading further 2023-01-04 00:29:28 +01:00
images_test.go Replace imageStore.{Lock,Unlock} with {startWriting,stopWriting} 2022-10-17 21:39:19 +02:00
jsoniter.go Use json-iterator instead of encoding/json 2021-05-06 12:24:24 -04:00
layers.go Optimize the "no changes" case of layerStore.startReading further 2023-01-04 00:29:39 +01:00
lockfile_compat.go Convert all c/storage users of Locker to *lockfile.LockFile 2022-11-29 18:12:43 +01:00
storage.conf Add new storage.conf option "transient_store" 2022-11-14 16:36:30 +01:00
storage.conf-freebsd Change default location for storage.conf to... 2022-05-03 16:39:32 +01:00
store.go Don't reload the mount data in ParentOwners and Mounted 2023-01-04 00:29:26 +01:00
store_test.go test: use `T.TempDir` to create temporary test directory 2022-08-30 01:21:37 +08:00
userns.go Eliminate racy uses of Layer.MountCount 2023-01-03 23:47:16 +01:00
userns_test.go Rework autons ID mapping generation. 2021-04-03 13:22:23 -07:00
utils.go Add Store.GarbageCollect() method 2022-11-14 16:36:30 +01:00

README.md

storage is a Go library which aims to provide methods for storing filesystem layers, container images, and containers. A containers-storage CLI wrapper is also included for manual and scripting use.

To build the CLI wrapper, use 'make binary'.

Operations which use VMs expect to launch them using 'vagrant', defaulting to using its 'libvirt' provider. The boxes used are also available for the 'virtualbox' provider, and can be selected by setting $VAGRANT_PROVIDER to 'virtualbox' before kicking off the build.

The library manages three types of items: layers, images, and containers.

A layer is a copy-on-write filesystem which is notionally stored as a set of changes relative to its parent layer, if it has one. A given layer can only have one parent, but any layer can be the parent of multiple layers. Layers which are parents of other layers should be treated as read-only.

An image is a reference to a particular layer (its top layer), along with other information which the library can manage for the convenience of its caller. This information typically includes configuration templates for running a binary contained within the image's layers, and may include cryptographic signatures. Multiple images can reference the same layer, as the differences between two images may not be in their layer contents.

A container is a read-write layer which is a child of an image's top layer, along with information which the library can manage for the convenience of its caller. This information typically includes configuration information for running the specific container. Multiple containers can be derived from a single image.

Layers, images, and containers are represented primarily by 32 character hexadecimal IDs, but items of each kind can also have one or more arbitrary names attached to them, which the library will automatically resolve to IDs when they are passed in to API calls which expect IDs.

The library can store what it calls metadata for each of these types of items. This is expected to be a small piece of data, since it is cached in memory and stored along with the library's own bookkeeping information.

Additionally, the library can store one or more of what it calls big data for images and containers. This is a named chunk of larger data, which is only in memory when it is being read from or being written to its own disk file.

Contributing Information about contributing to this project.