Claude Sonnet 5 vs GPT-6.1 Sol
GPT-6.1 Sol leads Claude Sonnet 5 by 17.6 points on the Shogo Agent Index. Claude Sonnet 5 wins 1 and GPT-6.1 Sol wins 16 of 17 shared benchmarks. GPT-6.1 Sol is cheaper for agent workloads.
Add more models to this comparison →Pillars
| Pillar | Claude Sonnet 5 | GPT-6.1 Sol |
|---|---|---|
| Agentic coding | 57 | 80 |
| Long-horizon autonomy | 65 | 78 |
| Knowledge-work agents | 43 | 54 |
| Computer use | 40 | 66 |
| Security & context learning | 51 | 62 |
Shared benchmarks
| Benchmark | Claude Sonnet 5 | GPT-6.1 Sol |
|---|---|---|
| APEX-Agentsindex | 54.5% | 60.0% |
| Vending-Bench 2index | $6,378 | $12,861 |
| Chess Puzzles | 45.0% | 68.0% |
| CritPt | 16.9% | 31.7% |
| DTBench | 92.5% | 96.5% |
| FrontierCode | 42.7% | 50.2% |
| FrontierMath Tier 4 | 29.3% | 100.0% |
| FrontierMath Tiers 1-3 | 65.6% | 93.7% |
| GPQA Diamond | 90.5% | 95.4% |
| LMCA | 50.0% | 62.8% |
| MirrorCode | 63.3% | 61.1% |
| OTIS Mock AIME | 94.7% | 100.0% |
| ProofBench | 77.0% | 99.0% |
| SciCode | 54.3% | 55.8% |
| SimpleBench | 60.6% | 82.9% |
| SimpleQA Verified | 33.7% | 73.9% |
| WebDev Arena | 1537 | 1759 |
Specs and price
| Claude Sonnet 5 | GPT-6.1 Sol | |
|---|---|---|
| Agent Index | 52.4 (#32) | 70 (#5) |
| Agent $/M | $0.92 | $0.84 |
| Input / output $/M | $2.00 / $10.00 | $2.00 / $10.00 |
| Context | 1M | 1.1M |
| Released | Jun 30, 2026 | Sep 29, 2026 |
| Weights | Closed | Closed |
| API hosts | 5 | 6 |
Don’t pick one. Route.
Shogo can run Claude Sonnet 5 and GPT-6.1 Sol side by side and send each step of an agent to the one that’s cheaper for it.
Try both in Shogo