GPT-6.1 Sol vs Grok 4.5
GPT-6.1 Sol leads Grok 4.5 by 20.6 points on the Shogo Agent Index. GPT-6.1 Sol wins 19 and Grok 4.5 wins 0 of 20 shared benchmarks. Grok 4.5 is cheaper for agent workloads.
Add more models to this comparison →Pillars
| Pillar | GPT-6.1 Sol | Grok 4.5 |
|---|---|---|
| Agentic coding | 80 | 54 |
| Long-horizon autonomy | 78 | 59 |
| Knowledge-work agents | 54 | 42 |
| Computer use | 66 | 36 |
| Security & context learning | 62 | 48 |
Shared benchmarks
| Benchmark | GPT-6.1 Sol | Grok 4.5 |
|---|---|---|
| APEX-Agentsindex | 60.0% | 56.2% |
| Vending-Bench 2index | $12,861 | $3,887 |
| PostTrainBenchindex | 38.8% | 22.6% |
| ARC-AGI | 98.5% | 87.2% |
| ARC-AGI-2 | 94.2% | 52.6% |
| Chess Puzzles | 68.0% | 35.0% |
| CritPt | 31.7% | 15.4% |
| DTBench | 96.5% | 96.5% |
| FrontierCode | 50.2% | 42.4% |
| FrontierMath Tier 4 | 100.0% | 24.4% |
| FrontierMath Tiers 1-3 | 93.7% | 57.2% |
| GPQA Diamond | 95.4% | 93.4% |
| LMCA | 62.8% | 45.2% |
| MirrorCode | 61.1% | 32.2% |
| OTIS Mock AIME | 100.0% | 97.8% |
| ProofBench | 99.0% | 31.0% |
| SciCode | 55.8% | 55.0% |
| SimpleBench | 82.9% | 70.0% |
| SimpleQA Verified | 73.9% | 48.3% |
| WebDev Arena | 1759 | 1555 |
Specs and price
| GPT-6.1 Sol | Grok 4.5 | |
|---|---|---|
| Agent Index | 70 (#5) | 49.4 (#36) |
| Agent $/M | $0.84 | $0.81 |
| Input / output $/M | $2.00 / $10.00 | $2.00 / $6.00 |
| Context | 1.1M | 500K |
| Released | Sep 29, 2026 | Jul 8, 2026 |
| Weights | Closed | Closed |
| API hosts | 6 | 4 |
Don’t pick one. Route.
Shogo can run GPT-6.1 Sol and Grok 4.5 side by side and send each step of an agent to the one that’s cheaper for it.
Try both in Shogo