SShogo Bench

GPT-5

Original GPT-5 workhorse for reasoning, coding, writing, and tool workflows

Shogo Agent Index

Supported#60 of 92
37.8range 27.8–47.8 · 47% of weight measured
Agentic coding
40
57% measured
Long-horizon autonomy
47
50% measured
Knowledge-work agents
31
68% measured
Computer use
27
estimated
Security & context learning
40
estimated

Price

Input
$1.25/M
Output
$10.00/M
Cache read
$0.13/M
3:1 blend
$3.44/M
Agent-effective
$0.76/M

Cheapest host for agents: Azure at $0.76/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verified73.6%8%source
Terminal-Bench 2.049.6%8%Codex CLI
DeepSWEest.6%predicted 36
FrontierSWEest.5%predicted 8
CursorBenchest.4%predicted 32
GSO-Bench6.9%4%OpenHands
METR Time Horizons69.6%10%source
Vending-Bench 2est.6%predicted 27
PostTrainBenchest.4%predicted 21
APEX-Agentsest.8%predicted 34
GDPval34.8%7%source
Remote Labor Index1.7%5%source
DeepResearch Bench49.6%5%source
OSWorld 2.0est.6%predicted 5
OSWorldest.4%predicted 61
Cybenchest.5%predicted 62
CL-benchest.5%predicted 19

Other benchmarks

BenchmarkCategoryScoreSource
Aider PolyglotCoding88.0%source
AlgoTuneCoding1.67×source
ARC-AGIReasoning65.7%source
ARC-AGI-2Reasoning9.9%source
BALROGLong-horizon32.8%source
Chess PuzzlesReasoning36.0%source
CritPtReasoning12.6%source
DTBenchKnowledge90.7%source
Fiction.LiveBenchLong context97.2%source
FrontierMath Tiers 1-3Math55.4%source
FrontierMath Tier 4Math22.0%source
GeoBenchMultimodal81.0%source
GPQA DiamondReasoning86.2%source
Humanity's Last ExamReasoning25.3%source
LMCAKnowledge40.0%source
MATH Level 5Math98.1%source
MirrorCodeCoding4.4%source
OTIS Mock AIMEMath91.4%source
ProofBenchMath18.0%source
SciCodeCoding42.9%source
SimpleBenchReasoning56.7%source
SimpleQA VerifiedKnowledge50.1%source
VPCTMultimodal66.0%source
WebDev ArenaCoding1420source

API hosts

Live prices and uptime for every host serving GPT-5 via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
Azure$1.25$10.00$0.13$0.76100.0%—
OpenAI$1.25$10.00$0.13$0.76100.0%—