[audit-workflows] 🔍 Agentic Workflow Audit — 2026-06-15 (86.5% success, 5 fails / 3 recurring)

[github-actions[bot]]

🔍 Agentic Workflow Audit — 2026-06-15

Window: 17:29–22:01Z (~4.5h evening cluster). A ~19.5h gap (06-14 22:02 → 06-15 17:29) is unobserved because the logs tool timed out before paginating older runs — treat counts as a partial daily sample.

Overview

Metric	Value
Completed runs	37 (32 ✅ / 5 ❌) → 86.5% success
In-progress / queued	4 (incl. this audit agent)
Tokens	33.4M · AIC 9,963
Turns / action-min	685 / 647
Engines	copilot 29 · claude 10 · codex 2
missing_tools / missing_data / mcp_failures	0 / 0 / 0
Firewall blocked	37 / 3,283 (1.1%) — all by-design

Success rate (86.5%) is steady vs the prior day (06-14: 87.0%) and well above the 06-13 dip (68.4%). No genuine shared incident this window — the 5 failures span distinct classes across all three engines, and 3 of 5 are already-tracked recurring issues.

📊 Trend Charts

Workflow Health (30 days)

Success rate has held in an 85–90% band for the past week after recovering from the 06-13 trough (68%). Today's 86.5% continues that stabilization; failure volume per window remains low (5) and dominated by known classes rather than new regressions.

Token Usage (30 days)

The 7-day moving average sits near 54M tokens/day, pulled up by the 06-12 spike (~127M) which has since fallen out of the short window. Today's 33.4M reflects the partial window; per-run consumption is unremarkable with no runaway-token outliers detected.

Failures (5)

Per-failure root cause & recurrence

Workflow	Engine	Class	Root cause	Status
Repository Tree Map Generator	copilot	harness-action-timeout	Execute Copilot CLI timed out after 5 min; did partial work (tok≈580k)	🔁 RECUR (quiet since 06-10)
Daily Safe Output Integrator	copilot	sdk tool-perm-lockout	14 permission-denied hits looped 20 min → hit action timeout	🔁 RECUR day 9 (same wf as 06-14)
Daily Security Observability Report	copilot	agent-artifact-missing (0-tok)	setup OK (gh-aw v0.79.8) but agent emitted no output; conclusion failed Artifact not found for name: agent	🆕 NEW
Daily Cache Strategy Analyzer	codex	gh-aw-binary-not-found-for-mcp	exit 1 Failed to find gh-aw binary for MCP server despite binary being built (go build) + copied to /usr/local/bin/gh-aw	🆕 NEW signature (prior chronic fail was model-not-found)
Documentation Unbloat	claude	cache-memory-git-integrity	git exit code 2 in check_cache_memory_git_integrity.sh — refines the prior generic "empty-output" root cause	🔁 RECUR day 3

Note on the digest-mismatch: error line seen in conclusion logs: this is the actions/cache input echo (fail-on-cache-miss: false), not a failure cause — disregarded to avoid a false signal.

Observability insights (from logs tool)

• 🔴 cache-strategy 100% fail-rate — chronically broken; today a new binary-path signature.
• 🔴 slide-deck-maintainer highest firewall pressure (27/82 blocked, github-cloud.githubusercontent.com asset pulls) — by-design.
• 🔴 6 events with anomaly score > 0.6 across 42 runs.
• 🟡 contribution-check turn drift (30–41 turns, avg 35.5) — unstable task shape.

Recommended actions

1. [high] Fix Daily Cache Strategy Analyzer (codex): align the MCP-helper binary lookup path with where the build step places gh-aw. wf is at 100% fail-rate → highest ROI.
2. [high] Resolve copilot-SDK tool-permission lockout on Daily Safe Output Integrator (day 9; ~20 min wasted compute/run with zero output). Grant required tool perms or fix the SDK allowlist plumbing.
3. [medium] Documentation Unbloat: harden check_cache_memory_git_integrity.sh against the cache-memory git exit-2 (day 3 consecutive).
4. [watch] Daily Security Observability Report 0-tok agent-artifact-missing — first occurrence; monitor for recurrence (possible startup-failure family).

Coverage caveat

This is a partial ~4.5h sample; the mid-window gap was not retrievable within the logs-tool timeout. Recurrence/persistence counters in repo memory were incremented for the 3 recurring classes; 2 new issues registered.

References: §27564209286 · §27572285541 · §27571281247

Generated by 🔍 Agentic Workflow Audit Agent · 384.7 AIC · ⌖ 30.7 AIC · ⊞ 7.4K · ◷

• expires on Jun 16, 2026, 2:16 PM UTC-08:00