SShogo Bench

GPT OSS 20B

Open-weight GPT model for self-hosted reasoning and instruction-following workloads

Shogo Agent Index

Unranked

Not ranked yet: 1 agentic benchmark measured, and we need at least 2 plus an overall capability score. It will be ranked as results are published.

Agentic coding
16
23% measured
Long-horizon autonomy
28
estimated
Knowledge-work agents
16
estimated
Computer use
7
estimated
Security & context learning
16
estimated

Price

Input
$0.20/M
Output
$0.30/M
Cache read
—/M
3:1 blend
$0.23/M
Agent-effective
$0.20/M

Cheapest host for agents: AkashML at $0.010/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verifiedest.8%predicted 50
Terminal-Bench 2.03.4%8% Mini-SWE-Agent
DeepSWEest.6%predicted 9
FrontierSWEest.5%predicted 1
CursorBenchest.4%predicted 17
GSO-Benchest.4%predicted 2
METR Time Horizonsest.10%predicted 50
Vending-Bench 2est.6%predicted 2
PostTrainBenchest.4%predicted 11
APEX-Agentsest.8%predicted 11
GDPvalest.7%predicted 17
Remote Labor Indexest.5%predicted 0
DeepResearch Benchest.5%predicted 41
OSWorld 2.0est.6%predicted 1
OSWorldest.4%predicted 15
Cybenchest.5%predicted 20
CL-benchest.5%predicted 12

Other benchmarks

BenchmarkCategoryScoreSource
CritPtReasoning1.4%source
DTBenchKnowledge68.0%source
GPQA DiamondReasoning60.8%source
LMCAKnowledge14.5%source
OTIS Mock AIMEMath65.3%source
SciCodeCoding38.9%source

API hosts

Live prices and uptime for every host serving GPT OSS 20B via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
AkashML$0.018$0.090$0.009$0.010100.0%fp4
Darkbloom$0.018$0.090$0.009$0.010100.0%fp8
DeepInfra$0.024$0.11$0.012$0.02098.1%bf16
DeepInfra$0.030$0.14$0.015$0.02099.6%bf16
CoreWeave$0.030$0.13$0.030$0.03099.6%fp4
DekaLLM$0.029$0.14$0.029$0.03095.5%bf16
Parasail$0.030$0.15$0.020$0.03099.8%fp4
SiliconFlow$0.040$0.18—$0.05093.1%fp8
Groq$0.075$0.30$0.037$0.060100.0%—
Amazon Bedrock$0.070$0.15—$0.07099.9%—
Amazon Bedrock$0.070$0.15—$0.07099.9%—
PrimeIntellect$0.20$0.30$0.18$0.1999.1%fp4