Skip to content

fix(dependabot): use openai/gpt-4.1 for the AI gate (gpt-5 unavailable on Models)#7

Merged
bbkrr merged 1 commit into
mainfrom
fix/2229-model-gpt41
Jul 10, 2026
Merged

fix(dependabot): use openai/gpt-4.1 for the AI gate (gpt-5 unavailable on Models)#7
bbkrr merged 1 commit into
mainfrom
fix/2229-model-gpt41

Conversation

@bbkrr

@bbkrr bbkrr commented Jul 10, 2026

Copy link
Copy Markdown
Collaborator

While validating the gate before enforcement, I found openai/gpt-5 (set in #6) returns unavailable_model from the GitHub Models inference endpoint — the gpt-5 family is in the catalog but not servable. That made every verdict fail and fall back to manual review (safe, but the gate would never actually work).

Fix: switch MODEL_ID to openai/gpt-4.1, the strongest model actually available for GitHub Models inference (probed live: gpt-4o, gpt-4o-mini, gpt-4.1, gpt-4.1-mini work; gpt-5* do not).

Validated locally against real GitHub Models with gpt-4.1:

input verdict
docker/metadata-action v4→v6 (real PR #2226) auto / low ✅
synthetic breaking changelog (removed/required inputs, changed defaults) human / high ✅
benign Node-runtime-only bump auto / low ✅

Still dry-run. Next: recreate a real major github-actions Dependabot PR (#2223, actions/checkout v4→v7) to observe the verdict in CI, then flip AIGATE_DRY_RUN.

🤖 Generated with Claude Code

…e on Models)

The GitHub Models inference endpoint returns `unavailable_model` for the gpt-5
family (they are in the catalog but not servable), which made the gate fail
every call and silently fall back to manual review. Switch to `openai/gpt-4.1`,
the strongest model actually available for GitHub Models inference.

Verified locally against real + fixture changelogs via GitHub Models:
- docker/metadata-action v4->v6 (real PR #2226) -> auto / low
- synthetic breaking changelog (removed/required inputs, changed defaults) -> human / high
- benign Node-runtime-only bump -> auto / low

Ref RealRate-Private#2229.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@bbkrr bbkrr merged commit bedd39f into main Jul 10, 2026
1 check passed
@bbkrr bbkrr deleted the fix/2229-model-gpt41 branch July 10, 2026 09:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant