SShogo Bench

GPT-6.1 Sol

Near-Astra performance for complex coding, computer use, and professional work at a lower cost.

Shogo Agent Index

Estimated#5 of 92
70.0range 62.2–77.7 · 18% of weight measured
Agentic coding
80
estimated
Long-horizon autonomy
78
50% measured
Knowledge-work agents
54
32% measured
Computer use
66
estimated
Security & context learning
62
estimated

Price

Input
$2.00/M
Output
$10.00/M
Cache read
$0.10/M
3:1 blend
$4.00/M
Agent-effective
$0.84/M

Cheapest host for agents: OpenAI at $0.42/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verifiedest.8%predicted 89
Terminal-Bench 2.0est.8%predicted 96
DeepSWEest.6%predicted 82
FrontierSWEest.5%predicted 62
CursorBenchest.4%predicted 56
GSO-Benchest.4%predicted 77
METR Time Horizonsest.10%predicted 87
Vending-Bench 2$12,8616%source
PostTrainBench38.8%4%Codex CLI
APEX-Agents60.0%8%source
GDPvalest.7%predicted 71
Remote Labor Indexest.5%predicted 21
DeepResearch Benchest.5%predicted 53
OSWorld 2.0est.6%predicted 45
OSWorldest.4%predicted 96
Cybenchest.5%predicted 94
CL-benchest.5%predicted 31

Other benchmarks

BenchmarkCategoryScoreSource
ARC-AGIReasoning98.5%source
ARC-AGI-2Reasoning94.2%source
Chess PuzzlesReasoning68.0%source
CritPtReasoning31.7%source
DTBenchKnowledge96.5%source
FrontierCodeCoding50.2%codex
FrontierMath Tiers 1-3Math93.7%source
FrontierMath Tier 4Math100.0%source
GPQA DiamondReasoning95.4%source
LMCAKnowledge62.8%source
MirrorCodeCoding61.1%source
OTIS Mock AIMEMath100.0%source
ProofBenchMath99.0%source
SciCodeCoding55.8%source
SimpleBenchReasoning82.9%source
SimpleQA VerifiedKnowledge73.9%source
WebDev ArenaCoding1759source
WeirdML v3Coding38.3%codex_cli

API hosts

Live prices and uptime for every host serving GPT-6.1 Sol via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
OpenAI$1.00$5.00$0.050$0.42100.0%—
Amazon Bedrock$2.00$10.00$0.10$0.8498.5%—
Azure$2.00$10.00$0.10$0.8499.0%—
OpenAI$2.00$10.00$0.10$0.84100.0%—
OpenAI$4.00$20.00$0.20$1.69100.0%—
OpenAI$12.00$60.00$0.60$5.06100.0%—