SShogo Bench

Qwen3.5 27B

Qwen vision-language model for visual reasoning, documents, and agent tasks

Shogo Agent Index

Unranked

Not ranked yet: 1 agentic benchmark measured, and we need at least 2 plus an overall capability score. It will be ranked as results are published.

Agentic coding
28
estimated
Long-horizon autonomy
34
30% measured
Knowledge-work agents
23
estimated
Computer use
16
estimated
Security & context learning
28
estimated

Price

Input
$0.30/M
Output
$2.40/M
Cache read
—/M
3:1 blend
$0.83/M
Agent-effective
$0.40/M

Cheapest host for agents: Chutes at $0.13/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verifiedest.8%predicted 63
Terminal-Bench 2.0est.8%predicted 27
DeepSWEest.6%predicted 21
FrontierSWEest.5%predicted 3
CursorBenchest.4%predicted 24
GSO-Benchest.4%predicted 6
METR Time Horizonsest.10%predicted 61
Vending-Bench 2$2026%source
PostTrainBenchest.4%predicted 16
APEX-Agentsest.8%predicted 21
GDPvalest.7%predicted 27
Remote Labor Indexest.5%predicted 1
DeepResearch Benchest.5%predicted 44
OSWorld 2.0est.6%predicted 2
OSWorldest.4%predicted 38
Cybenchest.5%predicted 41
CL-benchest.5%predicted 16

Other benchmarks

BenchmarkCategoryScoreSource
DTBenchKnowledge82.4%source
LMCAKnowledge34.0%source
WebDev ArenaCoding1357source

API hosts

Live prices and uptime for every host serving Qwen3.5 27B via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
Chutes$0.20$1.75$0.020$0.1392.7%fp8
Alibaba$0.20$1.56—$0.2674.9%—
SiliconFlow$0.25$2.00—$0.3395.5%fp8
AtlasCloud$0.27$2.16$0.27$0.36100.0%fp8
DeepInfra$0.26$2.60—$0.3799.6%fp8
Novita$0.30$2.40—$0.40100.0%bf16