SShogo Bench

GPT-6.1 Sol vs GPT-6 Astra

GPT-6 Astra leads GPT-6.1 Sol by 0.9 points on the Shogo Agent Index, but their ranges overlap, so treat it as close. GPT-6.1 Sol wins 2 and GPT-6 Astra wins 14 of 21 shared benchmarks. GPT-6.1 Sol is cheaper for agent workloads.

Add more models to this comparison →

Pillars

PillarGPT-6.1 SolGPT-6 Astra
Agentic coding8080
Long-horizon autonomy7880
Knowledge-work agents5456
Computer use6667
Security & context learning6263

Shared benchmarks

BenchmarkGPT-6.1 SolGPT-6 Astra
APEX-Agentsindex60.0%64.7%
Vending-Bench 2index$12,861$15,515
PostTrainBenchindex38.8%41.9%
ARC-AGI98.5%98.5%
ARC-AGI-294.2%95.0%
Chess Puzzles68.0%76.0%
CritPt31.7%31.7%
DTBench96.5%97.3%
FrontierCode50.2%53.3%
FrontierMath Tier 4100.0%97.6%
FrontierMath Tiers 1-393.7%93.7%
GPQA Diamond95.4%95.8%
LMCA62.8%64.4%
MirrorCode61.1%60.0%
OTIS Mock AIME100.0%100.0%
ProofBench99.0%99.0%
SciCode55.8%56.5%
SimpleBench82.9%86.5%
SimpleQA Verified73.9%75.6%
WebDev Arena17591800
WeirdML v338.3%42.2%

Specs and price

GPT-6.1 SolGPT-6 Astra
Agent Index70 (#5)70.9 (#4)
Agent $/M$0.84$4.62
Input / output $/M$2.00 / $10.00$10.00 / $50.00
Context1.1M1.1M
ReleasedSep 29, 2026Sep 4, 2026
WeightsClosedClosed
API hosts66

Don’t pick one. Route.

Shogo can run GPT-6.1 Sol and GPT-6 Astra side by side and send each step of an agent to the one that’s cheaper for it.

Try both in Shogo