Benchmarking
PRs run through alternative models — right-sized, over-provisioned, or under-provisioned
Right-Sized
92 PRs
43%
Over-Provisioned
78 PRs
36%
Under-Provisioned
44 PRs
21%
Benchmarking Results by Team
Monthly Savings Opportunity
Based on this month's benchmarks: $10,200 in savings from over-provisioned workloads. $4,600 in quality value from upgrading under-provisioned workloads.
Detailed Results
| PR | Team | Current Model | Current Cost | Recommended | Projected Cost | Quality | Status | |
|---|---|---|---|---|---|---|---|---|
| #1247 Add JWT auth | Platform | Opus | $14.20 | Sonnet | $2.80 | Tests Pass | over provisioned | |
| #1251 Refactor payment service | Platform | Opus | $22.40 | Opus | $22.40 | Equivalent | right sized | |
| #1253 Update landing page copy | Frontend | Opus | $8.60 | Haiku | $0.40 | Tests Pass | over provisioned | |
| #1260 ML pipeline optimization | ML/AI | Sonnet | $6.20 | Opus | $18.80 | Quality Improvement | under provisioned | |
| #1262 Fix auth token refresh | Mobile | GPT-4o | $11.30 | Sonnet | $3.10 | Tests Pass | over provisioned | |
| #1248 Add rate limiting middleware | Platform | Sonnet | $2.80 | Sonnet | $2.80 | Equivalent | right sized | |
| #1254 Component accessibility fixes | Frontend | Haiku | $0.40 | Haiku | $0.40 | Equivalent | right sized | |
| #1261 TensorFlow model export | ML/AI | Opus | $18.80 | Opus | $18.80 | Equivalent | right sized | |
| #1258 Data pipeline schema migration | Data | Sonnet | $4.20 | Opus | $12.10 | Quality Improvement | under provisioned | |
| #1263 API response caching | Mobile | Sonnet | $3.10 | Sonnet | $3.10 | Equivalent | right sized |