Skip to content

mantle/kola: remove --allow-rerun-success feature, keep flag as no-op#4559

Open
nikita-dubrovskii wants to merge 1 commit into
coreos:mainfrom
nikita-dubrovskii:fix_rerun_logic
Open

mantle/kola: remove --allow-rerun-success feature, keep flag as no-op#4559
nikita-dubrovskii wants to merge 1 commit into
coreos:mainfrom
nikita-dubrovskii:fix_rerun_logic

Conversation

@nikita-dubrovskii

@nikita-dubrovskii nikita-dubrovskii commented May 13, 2026

Copy link
Copy Markdown
Contributor

Remove all code implementing the --allow-rerun-success feature while keeping the flag
for backward compatibility (it now does nothing).

With this change, --rerun now always succeeds if failed tests pass on retry, effectively
behaving as the old --rerun --allow-rerun-success tags=all combination.

Issue: #4546

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the test rerun logic in mantle/kola/harness.go to explicitly handle four scenarios based on rerun results and success tags. The feedback suggests adding a log message for the scenario where a rerun passes but the original failure is preserved due to missing tags, which helps avoid user confusion when seeing a 'PASS' followed by an overall 'FAIL'.

Comment thread mantle/kola/harness.go Outdated
Comment thread mantle/kola/harness.go Outdated
Remove all code implementing the --allow-rerun-success feature while
keeping the flag for backward compatibility (it now does nothing).

With this change, --rerun now always succeeds if failed tests pass on
retry, effectively behaving as the old '--rerun --allow-rerun-success
tags=all' combination.

Issue: coreos#4546
@nikita-dubrovskii nikita-dubrovskii changed the title kola/harness: fix rerun success logic mantle/kola: remove --allow-rerun-success feature, keep flag as no-op Jun 15, 2026

@dustymabe dustymabe left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM - one question.

Comment thread mantle/kola/harness.go
Comment on lines -186 to -196
{
// For this one we see it sometimes when I/O is really slow, which is often
// more of an indication of a problem with resources in our pipeline rather
// than a problem with the software we are testing. We'll mark it as warnOnly
// so it's non-fatal and also allow for a rerun of a test that goes on to
// fail that had this problem to ultimately result in success.
desc: "kernel soft lockup",
match: regexp.MustCompile("watchdog: BUG: soft lockup - CPU"),
warnOnly: true,
allowRerunSuccess: true,
},

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it safe to remove this one entirely?

we probably just want to remove line 195 ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants