Compare models
Pick up to 4 models for a side-by-side spec sheet. Hover any dotted metric name for what the test measures. Best value in each row is highlighted.
Claude Haiku 4.5Gemma 3 27B
| Claude Haiku 4.5 Anthropic | Gemma 3 27B | |
|---|---|---|
| Pricing | ||
| Input $/1M | $1.00 | $0.10 |
| Output $/1M | $5.00 | $0.30 |
| Blended $/1M (3:1) | $2.00 | $0.15 |
| Cache read $/1M | $0.10 | — |
| Cache write $/1M | $1.25 | — |
| Quality indices | ||
| Intelligence Index | 29.6 | 7.4 |
| Coding Index | 43.9 | 10.1 |
| Math Index | — | 20.7 |
| Agentic Index | 16.4 | 0.3 |
| Speed & latency | ||
| Output speed (tok/s) | — | 0 |
| Time to first token | — | 0s |
| Time to first answer token | — | 0s |
| Benchmarks (Artificial Analysis) | ||
| MMLU-Pro | — | 66.9% |
| GPQA Diamond | — | 42.8% |
| Humanity's Last Exam | — | 4.7% |
| LiveCodeBench | — | 13.7% |
| SciCode | — | 21.2% |
| MATH-500 | — | 88.3% |
| AIME | — | 25.3% |
| AIME 2025 | — | 20.7% |
| IFBench | — | 31.8% |
| AA-LCR (Long Context Reasoning) | — | 5.7% |
| Terminal-Bench Hard | — | 3.8% |
| Terminal-Bench 2.1 | — | 4.5% |
| τ²-Bench (Telecom) | — | 10.5% |
| τ³-Bench Banking | — | 0.8% |
| Design Arena (Elo) | ||
| Website | 1,149 | — |
| UI components | 1,142 | — |
| Data viz | 1,160 | — |
| SVG | 1,072 | — |
| 3D | 1,131 | — |
| Game dev | 1,155 | — |
| Code categories | 1,148 | — |
| ASCII art | 1,182 | — |
| Specs | ||
| Context window | 200K | 262K |
| Max output tokens | 64K | — |
| Input modalities | text, image, file | text, image |
| Tokenizer | Claude | Gemini |