SShogo Bench

Gemini 3.1 Pro Preview

Reasoning-first Gemini preview for agentic coding and complex problem solving

Shogo Agent Index

Supported#45 of 92
46.0range 41.6–50.5 · 64% of weight measured
Agentic coding
47
74% measured
Long-horizon autonomy
59
100% measured
Knowledge-work agents
36
52% measured
Computer use
39
estimated
Security & context learning
49
50% measured

Price

Input
$2.00/M
Output
$12.00/M
Cache read
$0.20/M
3:1 blend
$4.50/M
Agent-effective
$1.02/M

Cheapest host for agents: Google at $0.51/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verified75.6%8%source
Terminal-Bench 2.080.2%8%TongAgents
DeepSWE11.7%6%mini-swe-agent · $2.14/task
FrontierSWEest.5%predicted 19
CursorBenchest.4%predicted 39
GSO-Bench22.6%4%OpenHands
METR Time Horizons77.0%10%source
Vending-Bench 2$3,7746%source
PostTrainBench18.1%4%OpenCode
APEX-Agents35.1%8%source
GDPvalest.7%predicted 50
Remote Labor Indexest.5%predicted 5
DeepResearch Bench47.8%5%source
OSWorld 2.0est.6%predicted 12
OSWorldest.4%predicted 79
Cybenchest.5%predicted 78
CL-bench20.8%5%source

Other benchmarks

BenchmarkCategoryScoreSource
AlgoTuneCoding2.02×source
ARC-AGIReasoning98.0%source
ARC-AGI-2Reasoning77.1%source
BALROGLong-horizon57.0%source
Chess PuzzlesReasoning51.0%source
CritPtReasoning17.7%source
DTBenchKnowledge97.1%source
ExploitBenchSecurity & context26.1%source
FrontierMath Tiers 1-3Math59.6%source
FrontierMath Tier 4Math26.8%source
GeoBenchMultimodal84.0%source
GPQA DiamondReasoning94.4%source
Humanity's Last ExamReasoning46.4%source
LMCAKnowledge53.8%source
MirrorCodeCoding8.9%source
OTIS Mock AIMEMath95.6%source
ProofBenchMath26.0%source
SciCodeCoding58.7%source
SimpleBenchReasoning79.6%source
SimpleQA VerifiedKnowledge73.5%source
WebDev ArenaCoding1447source

API hosts

Live prices and uptime for every host serving Gemini 3.1 Pro Preview via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
Google$1.00$6.00$0.10$0.510.0%—
Google AI Studio$1.00$6.00$0.10$0.5199.9%—
Google$2.00$12.00$0.20$1.02100.0%—
Google AI Studio$2.00$12.00$0.20$1.0299.1%—
Google$3.60$21.60$0.36$1.83100.0%—
Google AI Studio$3.60$21.60$0.36$1.83——