podman/test/system
Toshiki Sonoda 6f821634ad libpod: Podman info output more network information
podman info prints the network information about binary path,
package version, program version and DNS information.

Fixes: #18443

Signed-off-by: Toshiki Sonoda <sonoda.toshiki@fujitsu.com>
2023-06-13 11:19:29 +09:00
..
000-TEMPLATE system tests: add assert(), and start using it 2022-04-20 16:14:42 -06:00
001-basic.bats podman: added the --out option for capturing formatted output emitted by various commands 2023-04-11 10:41:13 -05:00
005-info.bats libpod: Podman info output more network information 2023-06-13 11:19:29 +09:00
010-images.bats system tests: instrument, to try to catch unlinkat-ebusy 2023-05-10 14:53:11 -06:00
011-image.bats --authfile command line argument for image sign command. 2021-11-11 15:11:19 -05:00
012-manifest.bats Add hidden podman manifest inspect -v option 2022-11-11 15:22:31 -05:00
015-help.bats Cleanup: fix problems reported by shell lint 2022-09-15 20:10:34 -06:00
020-tag.bats system tests: prevent leading tabs 2023-02-15 13:50:17 -07:00
030-run.bats Merge pull request #18657 from arizvisa/GH-18120 2023-06-05 14:34:21 -04:00
032-sig-proxy.bats pkg/rootless: correctly handle proxy signals on reexec 2023-05-25 16:48:15 +02:00
035-logs.bats systests: minimize race-condition window 2023-05-31 06:38:17 -06:00
037-runlabel.bats system tests: runlabel: use podman-under-test 2022-10-26 05:35:10 -06:00
040-ps.bats filters: better handling of id= 2023-06-07 05:29:06 -06:00
045-start.bats set max ulimits for rootless on each start 2023-05-31 09:20:31 +00:00
050-stop.bats Output messages display rawInput 2022-08-02 18:28:37 +09:00
055-rm.bats system tests: prevent leading tabs 2023-02-15 13:50:17 -07:00
060-mount.bats systests: fixes for coping with extra systemd image 2023-06-01 11:04:31 +02:00
065-cp.bats system tests: prevent leading tabs 2023-02-15 13:50:17 -07:00
070-build.bats system tests: add precision timestamps 2023-05-16 09:34:33 -06:00
075-exec.bats system tests: safer container-stop signaling 2023-04-24 11:35:49 -06:00
080-pause.bats Revamp Libpod state strings for Docker compat 2022-01-17 13:56:07 -05:00
090-events.bats fix: podman event --filter volume=vol-name should compare the event name with volume name 2023-05-22 19:11:15 +05:30
110-history.bats history: correctly set tags 2023-05-02 16:21:09 +02:00
120-load.bats systests: fixes for coping with extra systemd image 2023-06-01 11:04:31 +02:00
125-import.bats
130-kill.bats system tests: safer container-stop signaling 2023-04-24 11:35:49 -06:00
140-diff.bats Replace egrep/fgrep with grep -E/-F 2023-05-03 07:32:42 -06:00
150-login.bats Run make codespell 2023-03-21 16:00:54 -04:00
160-volumes.bats More cleanup: volumes: do not export to stdout 2023-05-02 08:36:26 -06:00
170-run-userns.bats system tests: instrument, to try to catch unlinkat-ebusy 2023-05-10 14:53:11 -06:00
180-blkio.bats system tests: add assert(), and start using it 2022-04-20 16:14:42 -06:00
190-run-ipcns.bats Correct output when inspecting containers created with --ipc 2023-01-24 12:18:39 -05:00
195-run-namesapces.bats rootless: support joining contianers that use host ns 2023-04-25 15:21:31 +02:00
200-pod.bats filters: better handling of id= 2023-06-07 05:29:06 -06:00
220-healthcheck.bats fix --health-on-failure=restart in transient unit 2023-03-20 13:56:00 +01:00
250-systemd.bats 250-systemd.bats: remove outdated comment 2023-06-12 13:18:50 +02:00
251-system-service.bats test: fix typo 2023-04-27 22:07:56 +02:00
252-quadlet.bats test/system: quadlet use correct systemd restart policy 2023-05-31 18:50:16 +02:00
255-auto-update.bats Revert "test/system/255-auto-update.bats: add debug logs" 2023-05-24 07:41:57 -06:00
260-sdnotify.bats kube play: exit-code propagation 2023-05-25 14:46:34 +02:00
270-socket-activation.bats testimage: add iproute2 & socat, for pasta networking 2022-10-18 11:50:48 -06:00
271-tcp-cors-server.bats systests: fix improper backgrounding of run_podman 2023-05-31 06:20:35 -06:00
272-system-connection.bats test/system: fix wait_for_port() to wait for bind 2023-03-14 14:24:04 +01:00
280-update.bats System tests for podman-update 2022-09-01 15:42:35 -06:00
300-cli-parsing.bats provide better error on invalid flag 2022-02-21 19:12:12 +01:00
320-system-df.bats libpod/Container.rootFsSize(): use recorded image sizes 2023-05-09 09:33:37 -04:00
330-corrupt-images.bats speed up image listing 2023-03-30 09:45:44 +02:00
400-unprivileged-access.bats System tests: teardown: clean up volumes 2022-10-26 09:56:58 -06:00
410-selinux.bats system tests: instrument, to try to catch unlinkat-ebusy 2023-05-10 14:53:11 -06:00
420-cgroups.bats System tests: fix three races 2022-09-14 10:49:18 -06:00
450-interactive.bats replace golint with revive linter 2022-04-22 15:12:33 +02:00
500-networking.bats source code comments and docs: fix typos, language, Markdown layout 2023-05-22 07:52:16 +02:00
505-networking-pasta.bats pasta: Test handling of unknown protocols 2023-06-05 19:32:54 +10:00
520-checkpoint.bats system tests: safer container-stop signaling 2023-04-24 11:35:49 -06:00
550-pause-process.bats pkg/rootless: correctly handle proxy signals on reexec 2023-05-25 16:48:15 +02:00
600-completion.bats completion: fix panic in simplePathJoinUnix() 2023-05-30 16:09:19 +02:00
610-format.bats Add podman system events alias to podman events 2022-11-11 12:57:49 -05:00
620-option-conflicts.bats New system tests for conflicting options 2022-12-21 06:23:29 -05:00
700-play.bats source code comments and docs: fix typos, language, Markdown layout 2023-05-22 07:52:16 +02:00
710-kube.bats Replace egrep/fgrep with grep -E/-F 2023-05-03 07:32:42 -06:00
750-trust.bats system tests: add assert(), and start using it 2022-04-20 16:14:42 -06:00
800-config.bats system tests: use CONTAINERS_CONF_OVERRIDE 2023-03-27 15:18:09 -06:00
900-ssh.bats ssh system test: skip until it becomes a test 2022-11-21 08:02:00 -07:00
950-preexec-hooks.bats Add file swith for pre-exec 2023-04-26 10:20:10 -04:00
README.md Cirrus: Add netavark/aardvark system test task 2022-02-03 13:07:56 -05:00
TODO.md docs: update the podman logo 2022-08-07 09:11:53 +08:00
build-systemd-image libpod: fix timezone handling 2023-06-01 11:04:13 +02:00
build-testimage testimage: add iproute2 & socat, for pasta networking 2022-10-18 11:50:48 -06:00
helpers.bash libpod: fix timezone handling 2023-06-01 11:04:13 +02:00
helpers.network.bash Replace egrep/fgrep with grep -E/-F 2023-05-03 07:32:42 -06:00
helpers.sig-proxy.bash pkg/rootless: correctly handle proxy signals on reexec 2023-05-25 16:48:15 +02:00
helpers.systemd.bash system tests: timeoutize quadlet, systemd 2023-05-09 07:46:12 -06:00
helpers.t System tests: assert(): friendlier failure messages 2023-02-16 17:47:10 -07:00

README.md

Quick overview of podman system tests. The idea is to use BATS, but with a framework for making it easy to add new tests and to debug failures.

Quick Start

Look at 030-run.bats for a simple but packed example. This introduces the basic set of helper functions:

  • setup (implicit) - resets container storage so there's one and only one (standard) image, and no running containers.

  • parse_table - you can define tables of inputs and expected results, then read those in a while loop. This makes it easy to add new tests. Because bash is not a programming language, the caller of parse_table sometimes needs to massage the returned values; 015-run.bats offers examples of how to deal with the more typical such issues.

  • run_podman - runs command defined in $PODMAN (default: 'podman' but could also be './bin/podman' or 'podman-remote'), with a timeout. Checks its exit status.

  • is - compare actual vs expected output. Emits a useful diagnostic on failure.

  • die - output a properly-formatted message to stderr, and fail test

  • skip_if_rootless - if rootless, skip this test with a helpful message.

  • skip_if_remote - like the above, but skip if testing podman-remote

  • random_string - returns a pseudorandom alphanumeric string

Test files are of the form NNN-name.bats where NNN is a three-digit number. Please preserve this convention, it simplifies viewing the directory and understanding test order. In particular, 00x tests should be reserved for a first-pass fail-fast subset of tests:

bats test/system/00*.bats || exit 1
bats test/system

...the goal being to provide quick feedback on catastrophic failures without having to wait for the entire test suite.

Running tests

To run the tests locally in your sandbox, you can use one of these methods:

  • make;PODMAN=./bin/podman bats ./test/system/070-build.bats # runs just the specified test
  • make;PODMAN=./bin/podman bats ./test/system # runs all
  • make;PODMAN=./bin/podman NETWORK_BACKEND=netavark bats ./test/system # Assert & enable netavark testing

To test as root:

  • $ PODMAN=./bin/podman sudo --preserve-env=PODMAN bats test/system

Analyzing test failures

The top priority for this scheme is to make it easy to diagnose what went wrong. To that end, podman_run always logs all invoked commands, their output and exit codes. In a normal run you will never see this, but BATS will display it on failure. The goal here is to give you everything you need to diagnose without having to rerun tests.

The is comparison function is designed to emit useful diagnostics, in particular, the actual and expected strings. Please do not use the horrible BATS standard of [ x = y ]; that's nearly useless for tracking down failures.

If the above are not enough to help you track down a failure:

Debugging tests

Some functions have dprint statements. To see the output of these, set PODMAN_TEST_DEBUG="funcname" where funcname is the name of the function or perhaps just a substring.

Requirements

The jq tool is needed for parsing JSON output.

Further Details

TBD. For now, look in helpers.bash; each helper function has (what are intended to be) helpful header comments. For even more examples, see and/or run helpers.t; that's a regression test and provides a thorough set of examples of how the helpers work.