AiCostCompare

Compare models

Pick up to 4 models for a side-by-side spec sheet. Hover any dotted metric name for what the test measures. Best value in each row is highlighted.

Claude Sonnet 5Mistral Medium 3.1
Claude Sonnet 5

Anthropic

Mistral Medium 3.1

Mistral

Pricing
Input $/1M$2.00$0.40
Output $/1M$10.00$2.00
Blended $/1M (3:1)$4.00$0.80
Cache read $/1M$0.20$0.04
Cache write $/1M$2.50
Quality indices
Intelligence Index53.414.7
Coding Index71.520.5
Math Index38.3
Agentic Index46.76.2
Speed & latency
Output speed (tok/s)8684
Time to first token93.73s0.51s
Time to first answer token93.73s0.51s
Benchmarks (Artificial Analysis)
MMLU-Pro68.3%
GPQA Diamond91.1%58.8%
Humanity's Last Exam39.6%4.4%
LiveCodeBench40.6%
SciCode53.6%33.8%
AIME 202538.3%
IFBench39.8%
AA-LCR (Long Context Reasoning)70.7%19.7%
Terminal-Bench Hard10.6%
Terminal-Bench 2.180.5%13.9%
τ²-Bench (Telecom)40.6%
τ³-Bench Banking28.2%8.5%
Design Arena (Elo)
Website1,3141,160
Web apps1,305
Full-stack1,292
Android native1,255
UI components1,3171,140
Data viz1,2811,184
SVG1,2391,039
3D1,3211,140
Game dev1,3451,132
Agentic game dev1,241
Godot game dev1,257
HTML slides1,233
Python→PPTX slides1,252
Code categories1,3121,154
ASCII art1,2301,040
Specs
Context window1M131K
Max output tokens128K
Input modalitiestext, image, filetext, image, file
TokenizerClaudeMistral