Add deterministic failure fingerprinting and retry suppression to eliminate repeated Playwright reruns for known setup failures - PR_26146_036-deterministic-failure-fingerprints-and-retry-suppression

ToolboxAid · ToolboxAid · commit dabc08b584c3 · 2026-05-26T16:41:51.000-04:00
diff --git a/docs/dev/reports/dependency_gating_report.md b/docs/dev/reports/dependency_gating_report.md
@@ -1,6 +1,6 @@
 # Dependency Gating Report
 
-Generated: 2026-05-26T20:22:17.979Z
+Generated: 2026-05-26T20:35:58.938Z
 Status: PASS
 
 ## Gate Order
diff --git a/docs/dev/reports/dependency_hydration_reuse_report.md b/docs/dev/reports/dependency_hydration_reuse_report.md
@@ -1,6 +1,6 @@
 # Dependency Hydration Reuse Report
 
-Generated: 2026-05-26T20:22:17.979Z
+Generated: 2026-05-26T20:35:58.939Z
 Status: PASS
 
 ## Summary
diff --git a/docs/dev/reports/failure_fingerprint_report.md b/docs/dev/reports/failure_fingerprint_report.md
@@ -0,0 +1,38 @@
+# Failure Fingerprint Report
+
+Generated: 2026-05-26T20:38:01.099Z
+Status: WARN
+
+## Summary
+
+Deterministic setup failures: 0
+Runtime failures: 1
+Flaky/transient failures: 0
+Infrastructure failures: 0
+
+## Observed Failure Fingerprints
+
+| Fingerprint | Category | Rule | Lane | Source | Retry Allowed | Diagnostic |
+| --- | --- | --- | --- | --- | --- | --- |
+| be91dab881d6a076 | runtime failure | runtime-failure | game-runtime | runtime command | Yes | game-runtime command failed: C:\nvm4w\nodejs\node.exe C:\Users\davidq\Documents\GitHub\HTML-JavaScript-Gaming\node_modules\@playwright\test\cli.js test tests/playwright/games/AsteroidsBackgroundAssetResolution.spec.mjs tests/playwright/games/AsteroidsBeatTiming.spec.mjs tests/playwright/games/AsteroidsGameSceneCleanup.spec.mjs tests/playwright/games/AsteroidsShipStateVisuals.spec.mjs --project=playwright --workers=1 --reporter=list |
+
+## Known Deterministic Fingerprint Rules
+
+| Rule | Fingerprint | Source | Classification | Matches |
+| --- | --- | --- | --- | --- |
+| windows-quoting-issues | 723dd9796680da60 | runner preflight | deterministic setup failure | Windows quoting issues |
+| invalid-grep-patterns | b797167c43bfbb0a | runner preflight | deterministic setup failure | Invalid grep patterns |
+| ownership-violations | 056e19c830d32f2b | ownership validation | deterministic setup failure | Ownership violations |
+| lane-compilation-failures | 2c78d5924d8213d9 | lane compilation | deterministic setup failure | Lane compilation failures |
+| unresolved-fixtures-imports | 9694ec5c7f0974ed | fixture/import validation | deterministic setup failure | Unresolved fixtures/imports |
+| invalid-manifest-lane-metadata | 2170af541ee92d01 | manifest validation | deterministic setup failure | Invalid manifest/lane metadata |
+| invalid-dependency-graph | 5b2d112898b630c4 | dependency validation | deterministic setup failure | Invalid dependency graph |
+| misplaced-test-helper-ownership | 48903803d56149b3 | structure audit | deterministic setup failure | Misplaced test/helper ownership |
+
+## Classification Contract
+
+- Deterministic setup failures block runtime before Playwright/browser startup.
+- Runtime failures belong to the targeted lane that executed the failing command.
+- Flaky/transient failures require explicit classification before any targeted retry is allowed.
+- Infrastructure failures are not retried automatically until the infrastructure issue is corrected.
+- Failure fingerprints are based on lane, source, rule, category, command, and diagnostic text.
diff --git a/docs/dev/reports/filesystem_scan_reduction_report.md b/docs/dev/reports/filesystem_scan_reduction_report.md
@@ -1,6 +1,6 @@
 # Filesystem Scan Reduction Report
 
-Generated: 2026-05-26T20:22:17.964Z
+Generated: 2026-05-26T20:35:58.913Z
 Status: PASS
 
 ## Scan Enforcement
diff --git a/docs/dev/reports/incremental_validation_report.md b/docs/dev/reports/incremental_validation_report.md
@@ -1,6 +1,6 @@
 # Incremental Validation Report
 
-Generated: 2026-05-26T20:22:17.980Z
+Generated: 2026-05-26T20:35:58.941Z
 Status: PASS
 
 ## Reuse Summary
diff --git a/docs/dev/reports/lane_compilation_report.md b/docs/dev/reports/lane_compilation_report.md
@@ -1,6 +1,6 @@
 # Lane Compilation Report
 
-Generated: 2026-05-26T20:22:17.979Z
+Generated: 2026-05-26T20:35:58.938Z
 Status: PASS
 
 ## Lane Graph
diff --git a/docs/dev/reports/lane_deduplication_report.md b/docs/dev/reports/lane_deduplication_report.md
@@ -1,6 +1,6 @@
 # Lane Deduplication Report
 
-Generated: 2026-05-26T20:22:17.979Z
+Generated: 2026-05-26T20:35:58.938Z
 Status: PASS
 
 ## Summary
diff --git a/docs/dev/reports/lane_input_validation_report.md b/docs/dev/reports/lane_input_validation_report.md
@@ -1,6 +1,6 @@
 # Lane Input Validation Report
 
-Generated: 2026-05-26T20:22:17.980Z
+Generated: 2026-05-26T20:35:58.941Z
 Status: PASS
 
 ## Input Files
diff --git a/docs/dev/reports/lane_runtime_optimization_report.md b/docs/dev/reports/lane_runtime_optimization_report.md
@@ -1,6 +1,6 @@
 # Lane Runtime Optimization Report
 
-Generated: 2026-05-26T20:22:17.979Z
+Generated: 2026-05-26T20:35:58.939Z
 Status: PASS
 
 ## Runtime Cost Summary
diff --git a/docs/dev/reports/lane_warm_start_report.md b/docs/dev/reports/lane_warm_start_report.md
@@ -1,6 +1,6 @@
 # Lane Warm-Start Report
 
-Generated: 2026-05-26T20:22:17.979Z
+Generated: 2026-05-26T20:35:58.939Z
 Status: PASS
 Warm-start directory: docs/dev/reports/lane_warm_starts
 
diff --git a/docs/dev/reports/persistent_lane_manifest_report.md b/docs/dev/reports/persistent_lane_manifest_report.md
@@ -1,6 +1,6 @@
 # Persistent Lane Manifest Report
 
-Generated: 2026-05-26T20:22:17.980Z
+Generated: 2026-05-26T20:35:58.941Z
 Status: PASS
 Manifest directory: docs/dev/reports/lane_manifests
 
diff --git a/docs/dev/reports/playwright_discovery_ownership_report.md b/docs/dev/reports/playwright_discovery_ownership_report.md
@@ -1,6 +1,6 @@
 # Playwright Discovery Ownership Report
 
-Generated: 2026-05-26T20:22:17.960Z
+Generated: 2026-05-26T20:35:58.905Z
 Status: PASS
 
 ## Discovery-Time Ownership
diff --git a/docs/dev/reports/playwright_discovery_scope_report.md b/docs/dev/reports/playwright_discovery_scope_report.md
@@ -1,6 +1,6 @@
 # Playwright Discovery Scope Report
 
-Generated: 2026-05-26T20:22:17.962Z
+Generated: 2026-05-26T20:35:58.909Z
 Status: PASS
 Scoped discovery: Yes
 
diff --git a/docs/dev/reports/playwright_structure_audit.md b/docs/dev/reports/playwright_structure_audit.md
@@ -1,6 +1,6 @@
 # Playwright Structure Audit
 
-Generated: 2026-05-26T20:22:17.944Z
+Generated: 2026-05-26T20:35:58.891Z
 Status: PASS
 
 ## Lane Directories
diff --git a/docs/dev/reports/retry_suppression_report.md b/docs/dev/reports/retry_suppression_report.md
@@ -0,0 +1,33 @@
+# Retry Suppression Report
+
+Generated: 2026-05-26T20:38:01.099Z
+Status: WARN
+
+## Summary
+
+Deterministic failures suppressed: 0
+Prevented reruns: 0
+Prevented browser launches: 0
+Prevented broad lane escalation: 0
+Prevented repeated lane hydration: 0
+
+## Retry Decisions
+
+| Fingerprint | Lane | Category | Retry Decision | Reason |
+| --- | --- | --- | --- | --- |
+| be91dab881d6a076 | game-runtime | runtime failure | Allowed only on explicit targeted retry | Retry is allowed only when explicitly requested and must preserve the same targeted lane scope. |
+
+## Enforcement Rules
+
+- Deterministic setup failures never trigger automatic reruns.
+- Deterministic targeted-lane failures never escalate into broad lanes.
+- Deterministic preflight failures prevent repeated browser startup.
+- Targeted retries may run only for explicitly classified runtime or flaky/transient failures.
+- Targeted retries must preserve the affected lane scope and must not rerun unaffected lanes.
+
+## Runtime Savings Observations
+
+- Suppressed setup failures avoid repeated Playwright/browser initialization.
+- Suppressed setup failures avoid repeated Workspace/global lane startup.
+- Suppressed setup failures avoid repeated lane hydration after deterministic validation failure.
+- Runtime failures are reported without broad fallback execution.
diff --git a/docs/dev/reports/static_validation_report.md b/docs/dev/reports/static_validation_report.md
@@ -1,6 +1,6 @@
 # Static Validation Report
 
-Generated: 2026-05-26T20:22:17.977Z
+Generated: 2026-05-26T20:35:58.934Z
 Status: PASS
 Static only: No
 Dry run: No
diff --git a/docs/dev/reports/targeted_file_manifest_report.md b/docs/dev/reports/targeted_file_manifest_report.md
@@ -1,6 +1,6 @@
 # Targeted File Manifest Report
 
-Generated: 2026-05-26T20:22:17.979Z
+Generated: 2026-05-26T20:35:58.940Z
 Status: PASS
 
 ## Manifest-Generated Lane Inputs
diff --git a/docs/dev/reports/testing_lane_execution_report.md b/docs/dev/reports/testing_lane_execution_report.md
@@ -1,6 +1,6 @@
 # Testing Lane Execution Report
 
-Generated: 2026-05-26T20:24:06.715Z
+Generated: 2026-05-26T20:38:01.110Z
 Dry run: No
 
 ## Summary
@@ -43,6 +43,17 @@ Prevented redundant lane execution: 2
 Cached validations reused: 15
 Validation computations: 9
 
+## Failure Fingerprints
+
+Status: WARN
+Deterministic setup failures: 0
+Runtime failures: 1
+Flaky/transient failures: 0
+Infrastructure failures: 0
+Prevented reruns: 0
+Prevented browser launches: 0
+Prevented broad lane escalation: 0
+
 ## Discovery Scope
 
 Status: PASS
@@ -112,4 +123,4 @@ Prevented Workspace lane reruns: 0
 
 - `tests/playwright/games/AsteroidsShipStateVisuals.spec.mjs:14:1` - `validates Asteroids ship visual states from manifest runtime rendering`; expected ship visual states to include `destroyed`, received `idle` and `move`.
 
-Discovery ownership validation, manifest validation, warm-start validation, dependency hydration reuse, tool-runtime validation, integration validation, and engine/src node validation passed before this game-runtime assertion failed.
+Failure fingerprint `be91dab881d6a076` classified the failing `game-runtime` command as a targeted runtime failure. No deterministic setup failures were found, no automatic retry was attempted, and no broad lane escalation or full samples smoke was run.
diff --git a/docs/dev/reports/validation_cache_report.md b/docs/dev/reports/validation_cache_report.md
@@ -1,6 +1,6 @@
 # Validation Cache Report
 
-Generated: 2026-05-26T20:22:17.982Z
+Generated: 2026-05-26T20:35:58.943Z
 Status: PASS
 
 ## Cache Summary
diff --git a/docs/dev/reports/zero_browser_preflight_report.md b/docs/dev/reports/zero_browser_preflight_report.md
@@ -1,6 +1,6 @@
 # Zero-Browser Preflight Report
 
-Generated: 2026-05-26T20:22:17.980Z
+Generated: 2026-05-26T20:35:58.941Z
 Status: PASS
 
 ## Prevented Browser Launches
diff --git a/scripts/run-targeted-test-lanes.mjs b/scripts/run-targeted-test-lanes.mjs
