SShogo Bench

GPT-6 Sol

OpenAI model for complex coding and agentic workflows

Shogo Agent Index

Estimated#13 of 92
63.6range 54.2–73 · 14% of weight measured
Agentic coding
72
estimated
Long-horizon autonomy
76
30% measured
Knowledge-work agents
48
32% measured
Computer use
54
estimated
Security & context learning
59
estimated

Price

Input
$2.00/M
Output
$10.00/M
Cache read
$0.20/M
3:1 blend
$4.00/M
Agent-effective
$0.92/M

Cheapest host for agents: OpenAI at $0.46/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verifiedest.8%predicted 86
Terminal-Bench 2.0est.8%predicted 92
DeepSWEest.6%predicted 72
FrontierSWEest.5%predicted 43
CursorBenchest.4%predicted 49
GSO-Benchest.4%predicted 62
METR Time Horizonsest.10%predicted 83
Vending-Bench 2$14,4286%source
PostTrainBenchest.4%predicted 34
APEX-Agents54.3%8%source
GDPvalest.7%predicted 64
Remote Labor Indexest.5%predicted 12
DeepResearch Benchest.5%predicted 51
OSWorld 2.0est.6%predicted 29
OSWorldest.4%predicted 92
Cybenchest.5%predicted 90
CL-benchest.5%predicted 27

Other benchmarks

BenchmarkCategoryScoreSource
ARC-AGIReasoning95.5%source
ARC-AGI-2Reasoning89.6%source
Chess PuzzlesReasoning56.0%source
CritPtReasoning30.9%source
DTBenchKnowledge97.3%source
FrontierCodeCoding49.3%codex
FrontierMath Tiers 1-3Math89.8%source
FrontierMath Tier 4Math90.0%source
GPQA DiamondReasoning94.3%source
LMCAKnowledge59.1%source
MirrorCodeCoding48.9%source
OTIS Mock AIMEMath100.0%source
ProofBenchMath83.0%source
SciCodeCoding57.6%source
SimpleBenchReasoning73.1%source
SimpleQA VerifiedKnowledge60.7%source
WebDev ArenaCoding1689source
WeirdML v3Coding19.7%codex_cli

API hosts

Live prices and uptime for every host serving GPT-6 Sol via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
OpenAI$1.00$5.00$0.10$0.46100.0%—
Amazon Bedrock$2.00$10.00$0.20$0.9298.8%—
Azure$2.00$10.00$0.20$0.92100.0%—
OpenAI$2.00$10.00$0.20$0.92100.0%—
OpenAI$4.00$20.00$0.40$1.85100.0%—