SShogo Bench

GPT-5.6 Sol

Alias for flagship general-purpose models with safeguards for defensive cybersecurity work

Shogo Agent Index

Supported#14 of 92
61.8range 57.1–66.5 · 43% of weight measured
Agentic coding
71
54% measured
Long-horizon autonomy
72
50% measured
Knowledge-work agents
46
32% measured
Computer use
53
60% measured
Security & context learning
58
estimated

Price

Input
$4.00/M
Output
$20.00/M
Cache read
$0.40/M
3:1 blend
$8.00/M
Agent-effective
$1.85/M

Cheapest host for agents: OpenAI at $0.92/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verifiedest.8%predicted 86
Terminal-Bench 2.0est.8%predicted 91
DeepSWE72.7%6%mini-swe-agent · $8.39/task
FrontierSWE32.2%5%proximus · $179.64/task
CursorBench41.7%4%source · $8.23/task
GSO-Bench76.5%4%OpenHands
METR Time Horizonsest.10%predicted 83
Vending-Bench 2$9,6196%source
PostTrainBench31.0%4%Codex CLI
APEX-Agents51.4%8%source
GDPvalest.7%predicted 62
Remote Labor Indexest.5%predicted 11
DeepResearch Benchest.5%predicted 51
OSWorld 2.027.3%6%source
OSWorldest.4%predicted 91
Cybenchest.5%predicted 89
CL-benchest.5%predicted 27

Other benchmarks

BenchmarkCategoryScoreSource
ARC-AGIReasoning97.5%source
ARC-AGI-2Reasoning92.5%source
BALROGLong-horizon60.0%source
Chess PuzzlesReasoning68.0%source
CritPtReasoning32.3%source
DTBenchKnowledge96.0%source
FrontierCodeCoding47.5%codex
FrontierMath Tiers 1-3Math89.1%source
FrontierMath Tier 4Math82.9%source
GeoBenchMultimodal73.0%source
GPQA DiamondReasoning93.5%source
LMCAKnowledge59.2%source
MirrorCodeCoding20.0%source
OTIS Mock AIMEMath100.0%source
ProofBenchMath83.0%source
SciCodeCoding57.8%source
SimpleBenchReasoning71.7%source
SimpleQA VerifiedKnowledge69.7%source
WebDev ArenaCoding1617source
WeirdML v3Coding15.0%codex_cli

API hosts

Live prices and uptime for every host serving GPT-5.6 Sol via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
OpenAI$2.00$10.00$0.20$0.92100.0%—
Amazon Bedrock$4.00$20.00$0.40$1.85100.0%—
Azure$4.00$20.00$0.40$1.85100.0%—
OpenAI$4.00$20.00$0.40$1.85100.0%—
OpenAI$8.00$40.00$0.80$3.70100.0%—