podman/test/apiv2
Ed Santiago dbfa201c9a new testimage and systemd-image
Simply because it's been a while since the last testimage
build, and I want to confirm that our image build process
still works.

Added /home/podman/healthcheck. This saves us having to
podman-build on each healthcheck test. Removed now-
unneeded _build_health_check_image helper.

testimage: bump alpine 3.16.2 to 3.19.0

systemd-image: f38 to f39
  - tzdata now requires dnf **install**, not reinstall
    (this is exactly the sort of thing I was looking for)

PROBLEMS DISCOVERED:
  - in e2e, fedoraMinimal is now == SYSTEMD_IMAGE. This
    screws up some of the image-count tests (CACHE_IMAGES).

  - "alter tarball" system test now barfs with tar < 1.35.

TODO: completely replace fedoraMinimal with SYSTEMD_IMAGE
in all tests.

Signed-off-by: Ed Santiago <santiago@redhat.com>
2024-02-09 05:26:07 -07:00
..
python Update dependency setuptools to v69 2023-11-20 18:13:43 +00:00
00-TEMPLATE Tests for API v2 2020-01-17 09:59:22 -07:00
01-basic.at Bump to v5.0.0-dev 2023-11-20 15:10:17 -05:00
10-images.at new testimage and systemd-image 2024-02-09 05:26:07 -07:00
12-imagesMore.at Fix push endpoint stream 2023-12-13 13:01:21 -05:00
14-commit.at Accept a config blob alongside the "changes" slice when committing 2023-11-30 09:00:52 -05:00
15-manifest.at Add support for podman-remote manifest annotate 2022-11-24 14:11:08 +09:00
19-stats.at Send container stats over API on a per-interface basis 2024-02-06 17:05:07 -05:00
20-containers.at new testimage and systemd-image 2024-02-09 05:26:07 -07:00
22-stop.at Add support for passing container stop timeout as -1 (infinite) 2023-08-04 08:36:45 -04:00
23-containersArchive.at APIv2 test cleanup, part 2 of 2 2022-08-25 11:07:11 -06:00
25-containersMore.at test/apiv2: adapt apiv2 test on cgroups v1 environment 2023-10-24 11:52:03 +09:00
26-containersWait.at remote wait: fix "removed" condition 2023-06-16 11:55:53 +02:00
27-containersEvents.at apiv2 tests: fix race 2023-12-04 09:18:25 -07:00
30-volumes.at Add until filter to volume ls filters list 2021-07-22 00:01:07 +02:00
35-networks.at Update module github.com/docker/docker to v25 2024-01-24 13:21:28 +01:00
40-pods.at test/apiv2: adapt apiv2 test on cgroups v1 environment 2023-10-24 11:52:03 +09:00
44-mounts.at System test cleanup 2021-03-15 15:27:06 -06:00
45-system.at Vendor c/image after https://github.com/containers/image/pull/1816 2023-02-08 22:37:38 +01:00
50-secrets.at Add support for secret exists 2023-04-03 15:33:50 +03:00
60-auth.at test/apiv2/60-auth.at: use `doesnotexists.podman.io` 2023-08-24 16:22:02 +02:00
70-short-names.at compat API push: fix error handling 2023-06-21 16:35:55 +02:00
80-kube.at If API calls for kube play --replace, then replace pod 2023-11-22 13:31:24 -05:00
README.md APIv2 test cleanup, part 2 of 2 2022-08-25 11:07:11 -06:00
containers.conf compat API: allow enforcing short-names resolution to Docker Hub 2021-11-30 14:22:52 +01:00
containers.host-netns.conf [docker compat] Don't overwrite the NetworkMode if containers.conf overrides netns. 2023-01-11 17:44:09 +00:00
containers.no_hosts.conf API: use no_hosts from containers.conf 2022-04-11 18:41:19 +02:00
test-apiv2 add new libpod/images/$name/resolve endpoint 2024-01-31 16:20:16 +01:00

README.md

API v2 tests

This directory contains tests for the podman version 2 API (HTTP).

Tests themselves are in files of the form 'NN-NAME.at' where NN is a two-digit number, NAME is a descriptive name, and '.at' is just an extension I picked.

Running Tests

The main test runner is test-apiv2. Usage is:

$ sudo ./test-apiv2 [NAME [...]]

...where NAME is one or more optional test names, e.g. 'image' or 'pod' or both. By default, test-apiv2 will invoke all *.at tests.

test-apiv2 connects to localhost only and via TCP. There is no support here for remote hosts or for UNIX sockets. This is a framework for testing the API, not all possible protocols.

test-apiv2 will start the service if it isn't already running.

Writing Tests

The main test function is t. It runs curl against the server, with POST parameters if present, and compares return status and (optionally) string results from the server:

t GET /_ping 200 OK
  ^^^ ^^^^^^ ^^^ ^^
  |   |      |   +--- expected string result
  |   |      +------- expected return code
  |   +-------------- endpoint to access
  +------------------ method (GET, POST, DELETE, HEAD)


t POST libpod/volumes/create name=foo 201 .ID~[0-9a-f]\\{12\\}
       ^^^^^^^^^^^^^^^^^^^^^ ^^^^^^^^ ^^^ ^^^^^^^^^^^^^^^^^^^^
       |                     |        |   JSON '.ID': expect 12-char hex
       |                     |        +-- expected code
       |                     +----------- POST params
       +--------------------------------- note the missing slash

Never, ever, ever, seriously EVER exit from a test. Just don't. That skips cleanup, and leaves the system in a broken state.

Notes:

  • If the endpoint has a leading slash (/_ping), t leaves it unchanged. If there's no leading slash, t prepends /v1.40. This is a simple convenience for simplicity of writing tests.

  • When method is POST, the argument(s) after the endpoint may be a series of POST parameters in the form 'key=value', separated by spaces: t POST myentrypoint 200 ! no params t POST myentrypoint id=$id 200 ! just one t POST myentrypoint id=$id filter='{"foo":"bar"}' 200 ! two, with json t POST myentrypoint name=$name badparam='["foo","bar"]' 500 ! etc... t will convert the param list to JSON form for passing to the server. A numeric status code terminates processing of POST parameters. ** As a special case, when one POST argument is a string ending in .tar, .yaml, or .json, t will invoke curl with --data-binary @PATH and set Content-type as appropriate. This is useful for build endpoints. (To override Content-type, simply pass along an extra string argument matching application/*): t POST myentrypoint /mytmpdir/myfile.tar application/foo 400 ** Like above, when using PUT, t does --upload-time instead of --data-binary

  • The final arguments are one or more expected string results. If an argument starts with a dot, t will invoke jq on the output to fetch that field, and will compare it to the right-hand side of the argument. If the separator is = (equals), t will require an exact match; if ~ (tilde), t will use expr to compare.

  • If your test expects curl to time out: APIV2_TEST_EXPECT_TIMEOUT=5 t POST /foo 999