Compare models
Pick up to 4 models for a side-by-side spec sheet. Hover any dotted metric name for what the test measures. Best value in each row is highlighted.
Claude Sonnet 5o3 (batch)
| Claude Sonnet 5 Anthropic | o3 (batch) OpenAI | |
|---|---|---|
| Pricing | ||
| Input $/1M | $2.00 | $1.00 |
| Output $/1M | $10.00 | $4.00 |
| Blended $/1M (3:1) | $4.00 | $1.75 |
| Cache read $/1M | $0.20 | $0.25 |
| Cache write $/1M | $2.50 | — |
| Quality indices | ||
| Intelligence Index | 38.2 | 20.2 |
| Coding Index | 71.5 | — |
| Math Index | — | 88.3 |
| Agentic Index | 43.6 | — |
| Speed & latency | ||
| Output speed (tok/s) | 82 | 136 |
| Time to first token | 118.14s | 4.98s |
| Time to first answer token | 118.14s | 4.98s |
| Benchmarks (Artificial Analysis) | ||
| MMLU-Pro | — | 85.3% |
| GPQA Diamond | 91.1% | 82.7% |
| Humanity's Last Exam | 41.3% | 20.1% |
| LiveCodeBench | — | 80.8% |
| SciCode | 54.3% | — |
| MATH-500 | — | 99.2% |
| AIME | — | 90.3% |
| AIME 2025 | — | 88.3% |
| IFBench | — | 71.4% |
| AA-LCR (Long Context Reasoning) | 82.0% | 74.7% |
| Terminal-Bench Hard | — | 37.1% |
| Terminal-Bench 2.1 | 80.5% | — |
| τ²-Bench (Telecom) | — | 80.7% |
| τ³-Bench Banking | 37.3% | — |
| Design Arena (Elo) | ||
| Website | 1,288 | 1,048 |
| Web apps | 1,260 | — |
| Full-stack | 1,260 | — |
| Mobile apps | 1,249 | — |
| Android native | 1,240 | — |
| UI components | 1,299 | 1,032 |
| Data viz | 1,260 | 1,200 |
| SVG | 1,212 | — |
| 3D | 1,289 | — |
| Game dev | 1,313 | 1,058 |
| Agentic game dev | 1,227 | — |
| Godot game dev | 1,238 | — |
| HTML slides | 1,220 | — |
| Python→PPTX slides | 1,216 | — |
| Code categories | 1,293 | 1,035 |
| ASCII art | 1,226 | — |
| Specs | ||
| Context window | 1M | 200K |
| Max output tokens | 128K | 100K |
| Input modalities | text, image, file | image, text, file |
| Tokenizer | Claude | GPT |