SShogo Bench

DeepSeek V4.1 Flash 1017

October 17 update of DeepSeek V4.1 Flash with improved reasoning, coding, agentic tasks, and visual understanding

Shogo Agent Index

Estimated#17 of 92
57.6range 44.4–70.8 · 12% of weight measured
Agentic coding
63
11% measured
Long-horizon autonomy
66
estimated
Knowledge-work agents
49
32% measured
Computer use
45
estimated
Security & context learning
54
estimated

Price

Input
$0.15/M
Output
$0.60/M
Cache read
$0.003/M
3:1 blend
$0.26/M
Agent-effective
$0.050/M

Cheapest host for agents: Ambient at $0.020/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verifiedest.8%predicted 82
Terminal-Bench 2.0est.8%predicted 85
DeepSWEest.6%predicted 61
FrontierSWEest.5%predicted 28
CursorBench47.7%4%source · $0.98/task
GSO-Benchest.4%predicted 45
METR Time Horizonsest.10%predicted 80
Vending-Bench 2est.6%predicted 69
PostTrainBenchest.4%predicted 29
APEX-Agents69.8%8%source
GDPvalest.7%predicted 56
Remote Labor Indexest.5%predicted 7
DeepResearch Benchest.5%predicted 50
OSWorld 2.0est.6%predicted 17
OSWorldest.4%predicted 86
Cybenchest.5%predicted 84
CL-benchest.5%predicted 24

Other benchmarks

BenchmarkCategoryScoreSource
ARC-AGIReasoning94.5%source
ARC-AGI-2Reasoning78.1%source
Chess PuzzlesReasoning46.0%source
CritPtReasoning24.0%source
FrontierMath Tiers 1-3Math71.2%source
FrontierMath Tier 4Math46.3%source
GPQA DiamondReasoning93.2%source
OTIS Mock AIMEMath99.4%source
SciCodeCoding55.9%source
SimpleQA VerifiedKnowledge42.5%source
WeirdML v3Coding9.1%codex_cli

API hosts

Live prices and uptime for every host serving DeepSeek V4.1 Flash 1017 via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
Ambient$0.045$0.25$0.003$0.02083.8%fp4
DeepInfra$0.078$0.24$0.002$0.02094.7%fp8
Particle AI$0.030$0.25$0.003$0.02099.7%—
Pearl Research$0.050$0.30$0.003$0.02094.3%fp8
DeepInfra$0.098$0.29$0.003$0.03099.9%fp8
Ant Digital$0.12$0.48$0.002$0.040100.0%fp8
Morph$0.059$0.52$0.005$0.04099.7%fp8
Particle AI$0.060$0.50$0.006$0.040100.0%—
PrimeIntellect$0.044$0.70$0.002$0.04099.9%—
Relace$0.12$0.50$0.003$0.040100.0%fp4
River$0.12$0.48$0.002$0.040100.0%—
StepFun$0.10$0.42$0.002$0.040100.0%fp8
StreamLake$0.11$0.44$0.002$0.040100.0%fp8
Tenstorrent$0.10$0.40$0.003$0.040100.0%fp8
Wafer$0.036$0.50$0.010$0.040100.0%mxfp4
Wafer$0.066$0.50$0.006$0.040100.0%mxfp4
Cloudflare$0.10$0.60$0.003$0.050100.0%—
Cohere$0.15$0.50$0.003$0.050100.0%fp8
DeepInfra$0.15$0.44$0.004$0.05099.9%fp8
DekaLLM$0.10$0.60$0.003$0.050100.0%—
Fireworks$0.15$0.60$0.003$0.05087.9%—
Inceptron$0.10$0.60$0.006$0.05098.1%fp4
InferenceNet$0.080$0.67$0.008$0.050100.0%fp8
InferenceNet$0.080$0.67$0.008$0.050100.0%fp8
OpenInference$0.060$0.90$0.002$0.05099.9%fp4
SiliconFlow$0.15$0.60$0.003$0.050100.0%fp8
Alibaba$0.18$0.72$0.004$0.060100.0%—
DigitalOcean$0.18$0.72$0.004$0.06099.8%—
GMICloud$0.18$0.72$0.004$0.060100.0%fp8
Makora$0.15$0.80$0.006$0.06097.1%fp8
ModelRun$0.17$0.67$0.006$0.060100.0%fp4
Nebius$0.18$0.72$0.004$0.060100.0%fp4
Novita$0.17$0.66$0.003$0.060100.0%fp8
AtlasCloud$0.20$0.78$0.004$0.070100.0%fp8
Ionstream$0.21$0.62$0.011$0.07098.7%—
PrimaLabs$0.24$0.96$0.005$0.08099.4%—
Modal$0.25$1.00$0.005$0.090100.0%—
Baidu$0.28$1.13$0.006$0.1099.9%fp8
CoreWeave$0.30$1.20$0.006$0.10100.0%fp8
Crusoe$0.29$1.20$0.007$0.1098.2%fp8
DeepSeek$0.30$1.20$0.006$0.10100.0%—
Fireworks$0.30$1.20$0.006$0.10100.0%—
Near AI$0.30$1.20$0.006$0.1099.3%—
Parasail$0.30$1.20$0.006$0.10100.0%fp8
Together$0.30$1.20$0.006$0.10100.0%—
BaseTen$0.30$1.20$0.007$0.11100.0%—
Mistral$0.30$1.20$0.007$0.1199.7%fp8
Venice$0.30$1.20$0.007$0.11100.0%fp8
Fireworks$0.45$1.80$0.009$0.16100.0%—
BaseTen$0.60$2.40$0.014$0.21100.0%—
Morph$0.60$2.40$0.014$0.21100.0%fp8