Debug ci timed out, do not merge

[TristanCacqueray]

No description provided.

[gemini-code-assist]

Code Review

This pull request updates the playbooks/system-test-commands-options.yaml playbook to include additional flags (--show-output-of-passing-tests, --timing, and --trace) for the bats command when running the commands-options system tests. No review comments were provided, and there is no feedback to address.

Important

The consumer version of Gemini Code Assist on GitHub is being sunset. Starting June 18, 2026, new organization installations will be blocked, and all code review activity will officially cease on July 17, 2026.
For more details on the timeline and next steps, please review the Help Documentation.

[centosinfra-prod-github-app]

Build failed.
https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/local/buildset/a428282564314caf8df44f784676a98e

✔️ unit-test SUCCESS in 2m 20s
✔️ unit-test-migration-path-for-coreos-toolbox SUCCESS in 2m 59s
✔️ unit-test-restricted SUCCESS in 2m 25s
❌ system-test-fedora-rawhide-commands-options TIMED_OUT in 2h 00m 28s
✔️ system-test-fedora-rawhide-runtime-environment-arch-fedora SUCCESS in 27m 19s
✔️ system-test-fedora-rawhide-runtime-environment-ubuntu SUCCESS in 7m 18s
❌ system-test-fedora-44-commands-options TIMED_OUT in 1h 45m 32s
✔️ system-test-fedora-44-runtime-environment-arch-fedora SUCCESS in 22m 38s
✔️ system-test-fedora-44-runtime-environment-ubuntu SUCCESS in 6m 24s
✔️ system-test-fedora-43-commands-options SUCCESS in 32m 35s
✔️ system-test-fedora-43-runtime-environment-arch-fedora SUCCESS in 23m 20s
✔️ system-test-fedora-43-runtime-environment-ubuntu SUCCESS in 6m 38s
✔️ system-test-fedora-42-commands-options SUCCESS in 33m 16s
✔️ system-test-fedora-42-runtime-environment-arch-fedora SUCCESS in 23m 15s
✔️ system-test-fedora-42-runtime-environment-ubuntu SUCCESS in 6m 28s

[debarshiray]

This is where it gets stuck:

fedora-rawhide | ...
fedora-rawhide | $ _setup_docker_registry
fedora-rawhide | ...
fedora-rawhide | $$ run podman --root "${DOCKER_REG_ROOT}" run --detach --env REGISTRY_AUTH=htpasswd --env REGISTRY_AUTH_HTPASSWD_PATH="/auth/htpasswd" --env REGISTRY_AUTH_HTPASSWD_REALM="Registry Realm" --env REGISTRY_HTTP_TLS_CERTIFICATE=/certs/domain.crt --env REGISTRY_HTTP_TLS_KEY=/certs/domain.key --name "${DOCKER_REG_NAME}" --privileged --publish 50000:5000 --rm --volume "${DOCKER_REG_AUTH_DIR}":/auth --volume "${DOCKER_REG_CERTS_DIR}":/certs "${IMAGES[docker-reg]}"
fedora-rawhide | ...
fedora-rawhide | $$ run podman login --authfile "${BATS_SUITE_TMPDIR}/authfile.json" --username user --password user "${DOCKER_REG_URI}"
fedora-rawhide | ...
fedora-rawhide | $$ run skopeo copy --dest-authfile "${BATS_SUITE_TMPDIR}/authfile.json" dir:"${IMAGE_CACHE_DIR}"/fedora-toolbox-34 docker://"${DOCKER_REG_URI}"/fedora-toolbox:34

The test suite runs its own Docker registry using podman ... run ..., and populates it with an old fedora-toolbox:34 image using skopeo copy .... The old image is already downloaded to disk in $IMAGE_CACHE_DIR, so it should be a local operation.

[debarshiray]

I added --show-output-of-passing-tests --timing --trace to playbooks/system-test-runtime-environment-arch-fedora.yaml and playbooks/system-test-runtime-environment-ubuntu.yaml to see why the other jobs aren't getting stuck.

[centosinfra-prod-github-app]

Build failed.
https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/local/buildset/cd25827a44ea4ebf843c8ae3e2fdd479

✔️ unit-test SUCCESS in 2m 21s
✔️ unit-test-migration-path-for-coreos-toolbox SUCCESS in 3m 10s
✔️ unit-test-restricted SUCCESS in 2m 21s
❌ system-test-fedora-rawhide-commands-options TIMED_OUT in 2h 00m 35s
✔️ system-test-fedora-rawhide-runtime-environment-arch-fedora SUCCESS in 28m 17s
✔️ system-test-fedora-rawhide-runtime-environment-ubuntu SUCCESS in 7m 34s
❌ system-test-fedora-44-commands-options TIMED_OUT in 1h 45m 28s
✔️ system-test-fedora-44-runtime-environment-arch-fedora SUCCESS in 23m 36s
✔️ system-test-fedora-44-runtime-environment-ubuntu SUCCESS in 6m 31s
✔️ system-test-fedora-43-commands-options SUCCESS in 31m 58s
✔️ system-test-fedora-43-runtime-environment-arch-fedora SUCCESS in 23m 01s
✔️ system-test-fedora-43-runtime-environment-ubuntu SUCCESS in 6m 32s
✔️ system-test-fedora-42-commands-options SUCCESS in 33m 11s
✔️ system-test-fedora-42-runtime-environment-arch-fedora SUCCESS in 23m 38s
✔️ system-test-fedora-42-runtime-environment-ubuntu SUCCESS in 6m 30s

[centosinfra-prod-github-app]

Build failed.
https://gateway-cloud-softwarefactory.apps.ocp.cloud.ci.centos.org/zuul/t/local/buildset/e4a149d8cf6d471ab2bb886305088204

✔️ unit-test SUCCESS in 2m 17s
✔️ unit-test-migration-path-for-coreos-toolbox SUCCESS in 3m 02s
✔️ unit-test-restricted SUCCESS in 2m 17s
❌ system-test-fedora-rawhide-commands-options TIMED_OUT in 2h 00m 34s
✔️ system-test-fedora-rawhide-runtime-environment-arch-fedora SUCCESS in 28m 27s
✔️ system-test-fedora-rawhide-runtime-environment-ubuntu SUCCESS in 7m 22s
❌ system-test-fedora-44-commands-options TIMED_OUT in 1h 45m 34s
✔️ system-test-fedora-44-runtime-environment-arch-fedora SUCCESS in 23m 02s
✔️ system-test-fedora-44-runtime-environment-ubuntu SUCCESS in 6m 38s
❌ system-test-fedora-43-commands-options TIMED_OUT in 1h 45m 35s
✔️ system-test-fedora-43-runtime-environment-arch-fedora SUCCESS in 23m 09s
✔️ system-test-fedora-43-runtime-environment-ubuntu SUCCESS in 6m 24s
✔️ system-test-fedora-42-commands-options SUCCESS in 33m 20s
✔️ system-test-fedora-42-runtime-environment-arch-fedora SUCCESS in 23m 32s
✔️ system-test-fedora-42-runtime-environment-ubuntu SUCCESS in 6m 30s