Skip to content

Week 5 Day 4: provider evaluation cost report - #27

Merged
utkarshp845 merged 3 commits into
mainfrom
codex/week-5-day-4-evaluation-costs
Jul 24, 2026
Merged

Week 5 Day 4: provider evaluation cost report#27
utkarshp845 merged 3 commits into
mainfrom
codex/week-5-day-4-evaluation-costs

Conversation

@utkarshp845

Copy link
Copy Markdown
Owner

Summary

  • add an opt-in provider evaluation report that joins rubric outcomes, bounded telemetry, and estimated costs
  • calculate cost per successful evaluated analysis only with complete cost data
  • document the Day 4 workflow while keeping CI offline and cost-free

Validation

  • python -m pytest -q
  • python -m ruff check app cli tests
  • python -m evals.run_evals

@utkarshp845
utkarshp845 merged commit c8e6fb7 into main Jul 24, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant