GPT-5.1 Thinking: benchmarks, price and rank
GPT-5.1 Thinking from OpenAI is 74th of 123 rated AI models on Spezia's leaderboard. It costs $1.25 in, $10 out per million tokens.
- 74th of 123 rated models
- Rating 1,107
- Rated on 7 benchmarks
- Closed
- Released Nov 12, 2025
- 400,000 tokens of context
Where it is strongest
Not in the top tenth on any benchmark in use.
Where it falls behind
- 50th of 60 on Vending-Bench 2
- 52nd of 68 on SimpleBench
- 72nd of 98 on LMArena WebDev
Price: $1.25 in, $10 out per million tokens.
Its headline results
The benchmarks that count most in the rating, with its place among the models measured the same way, and where each number came from.
- Humanity's Last Exam23.7%
About 2,500 questions written by experts in more than a hundred fields to be as hard as they could make them, many needing a diagram or image.
Independent result from Epoch AI.
- Vending-Bench 2$1,473
The model runs a simulated vending machine business for a year on its own: finding suppliers, ordering stock, setting prices and paying the daily fees.
50th of 60. Independent result from Epoch AI.
- SimpleBench53.2%
Multiple-choice puzzles about everyday situations, space, time and people, written to trip up models that pattern-match instead of think. Ordinary adults do well on them.
52nd of 68. Independent result from Epoch AI.
- SimpleQA Verified48%
Short factual questions with one checked answer, asked without web search.
35th of 78. Independent result from Epoch AI.
- LMArena text1,443
People put a question to two anonymous models and vote for the better answer.
47th of 107. Independent result from LMArena.
- LMArena WebDev1,397
People ask two anonymous models to build the same web page or app and vote for the better one.
72nd of 98. Independent result from LMArena.
- SWE-bench Verified68.0%
Real bug reports and feature requests from popular open-source Python projects. The model has to change the code so the project's hidden tests pass.
Independent result from Epoch AI.
- GPQA Diamond87.6%
Graduate-level questions in biology, physics and chemistry, written by PhDs so that searching the web does not give the answer away.
63rd of 103. Independent result from Epoch AI.
- ARC-AGI-217.6%
Visual puzzles of colored grids, each with a new rule to work out from a few examples.
49th of 69. Independent result from Epoch AI.
- Epoch Capabilities Index150.9
One score built from dozens of benchmarks, set on a common scale so that models tested on different benchmarks can still be compared.
60th of 94. Independent result from Epoch AI.
2 more results in its full profile.
Every result with its source, what it costs per task, what jumped with its release, side by side with any other model, and answers to your questions about when to use it.
Models ranked near it
How the rating works, and every benchmark it uses: the model leaderboard.