Skip to content

DO NOT MERGE: A/B control - reusable-quality pin stays @v1 - #104

Closed
Prekzursil wants to merge 1 commit into
mainfrom
evidence/ab-v1-control
Closed

DO NOT MERGE: A/B control - reusable-quality pin stays @v1#104
Prekzursil wants to merge 1 commit into
mainfrom
evidence/ab-v1-control

Conversation

@Prekzursil

Copy link
Copy Markdown
Owner

DO NOT MERGE: A/B control arm (pin stays @v1)

Evidence artifact for the "is it safe to move the v1 tag in
quality-zero-platform" decision. This branch changes NOTHING behavioural: it
adds one comment line to .github/workflows/quality.yml so a PR can exist, and
KEEPS the reusable-quality.yml pin at @v1.

Its sibling probe branch carries the identical comment line plus the single
pin change @v1 -> @main, so the two runs differ by exactly one variable.

Not for merge. Close when the tag decision is recorded.

Evidence artifact for the "is it safe to move the v1 tag in
quality-zero-platform" decision. This branch changes NOTHING behavioural: it
adds one comment line to .github/workflows/quality.yml so a PR can exist, and
KEEPS the reusable-quality.yml pin at @v1.

Its sibling probe branch carries the identical comment line plus the single
pin change @v1 -> @main, so the two runs differ by exactly one variable.

Not for merge. Close when the tag decision is recorded.
@Prekzursil

Copy link
Copy Markdown
Owner Author

Closing: deliberate A/B evidence artifact; the decision it informed is executed.

Purpose was to measure whether moving the quality-zero-platform v1 tag was safe, using paired control (@v1) and probe (@main) arms on the same tree with one variable. Across 4 consumer pairs: 24 of 24 step names and conclusions byte-identical. The only differences were the gate-deps fix behaving as designed - a real finding at exit 1 still blocks, so it is fail-closed, not fail-open.

Outcome: v1 moved from b9503300 to b4fbe384, then independently verified on a live consumer where a run that had failed twice under the old tag passed under the new one. Never intended to merge; evidence and CI links stay readable here.

Reopen if the tag move needs re-litigating.

@Prekzursil Prekzursil closed this Jul 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant