AiCostCompare

Compare models

Pick up to 4 models for a side-by-side spec sheet. Hover any dotted metric name for what the test measures. Best value in each row is highlighted.

Claude Sonnet 5o3
Claude Sonnet 5

Anthropic

o3

OpenAI

Pricing
Input $/1M$2.00$2.00
Output $/1M$10.00$8.00
Blended $/1M (3:1)$4.00$3.50
Cache read $/1M$0.20$0.50
Cache write $/1M$2.50
Quality indices
Intelligence Index53.430.4
Coding Index71.5
Math Index88.3
Agentic Index46.7
Speed & latency
Output speed (tok/s)88159
Time to first token93.55s4.84s
Time to first answer token93.55s4.84s
Benchmarks (Artificial Analysis)
MMLU-Pro85.3%
GPQA Diamond91.1%82.7%
Humanity's Last Exam39.6%20.0%
LiveCodeBench80.8%
SciCode53.6%41.0%
MATH-50099.2%
AIME90.3%
AIME 202588.3%
IFBench71.4%
AA-LCR (Long Context Reasoning)70.7%69.3%
Terminal-Bench Hard37.1%
Terminal-Bench 2.180.5%
τ²-Bench (Telecom)80.7%
τ³-Bench Banking28.2%
Design Arena (Elo)
Website1,3141,064
Web apps1,305
Full-stack1,292
Android native1,255
UI components1,3171,060
Data viz1,2811,200
SVG1,239
3D1,321
Game dev1,3451,093
Agentic game dev1,241
Godot game dev1,257
HTML slides1,233
Python→PPTX slides1,252
Code categories1,3121,053
ASCII art1,230
Specs
Context window1M200K
Max output tokens128K100K
Input modalitiestext, image, fileimage, text, file
TokenizerClaudeGPT