Skip to content

test: expand sanitized evaluation corpus - #30

Merged
utkarshp845 merged 1 commit into
mainfrom
codex/week-6-day-2-corpus-expansion
Jul 29, 2026
Merged

test: expand sanitized evaluation corpus#30
utkarshp845 merged 1 commit into
mainfrom
codex/week-6-day-2-corpus-expansion

Conversation

@utkarshp845

Copy link
Copy Markdown
Owner

Summary

  • add three fully synthetic evaluation fixtures: generic HTTP 503 failures, mixed latency/memory-warning signals, and client-only HTTP 404s
  • add the corresponding strict deterministic corpus cases
  • bump the versioned corpus contract from 2026.07.1 to 2026.07.2
  • document the new coverage and mark Week 6 Day 2 complete

Learning-path fit

This broadens evaluation coverage before Week 6 introduces adversarial and incorrect-confidence scenarios. It does not change the assistant rules or add provider dependencies.

Testing

  • python -m pytest -q (41 passed)
  • python -m ruff check app cli evals tests
  • python -m evals.run_evals --json (10/10 cases, 50/50 checks, all hard gates pass)
  • git diff --check

Privacy boundary

All new fixtures are synthetic. They contain no real user data, hostnames, identifiers, credentials, or copied production logs.

@utkarshp845
utkarshp845 merged commit eec1183 into main Jul 29, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant