SShogo Bench

GPT-6.1 Sol vs Qwen3.8 Max Preview

GPT-6.1 Sol leads Qwen3.8 Max Preview by 16.4 points on the Shogo Agent Index, but their ranges overlap, so treat it as close. GPT-6.1 Sol wins 13 and Qwen3.8 Max Preview wins 1 of 14 shared benchmarks. Qwen3.8 Max Preview is cheaper for agent workloads.

Add more models to this comparison →

Pillars

PillarGPT-6.1 SolQwen3.8 Max Preview
Agentic coding8058
Long-horizon autonomy7863
Knowledge-work agents5446
Computer use6641
Security & context learning6252

Shared benchmarks

BenchmarkGPT-6.1 SolQwen3.8 Max Preview
APEX-Agentsindex60.0%63.3%
Chess Puzzles68.0%46.0%
CritPt31.7%20.0%
DTBench96.5%92.0%
FrontierMath Tier 4100.0%46.3%
FrontierMath Tiers 1-393.7%74.7%
GPQA Diamond95.4%92.7%
LMCA62.8%46.2%
MirrorCode61.1%52.2%
OTIS Mock AIME100.0%99.4%
ProofBench99.0%58.0%
SciCode55.8%53.2%
SimpleQA Verified73.9%45.8%
WebDev Arena17591671

Specs and price

GPT-6.1 SolQwen3.8 Max Preview
Agent Index70 (#5)53.6 (#30)
Agent $/M$0.84Free
Input / output $/M$2.00 / $10.00Free / Free
Context1.1M1M
ReleasedSep 29, 2026Jul 19, 2026
WeightsClosedClosed
API hosts61

Don’t pick one. Route.

Shogo can run GPT-6.1 Sol and Qwen3.8 Max Preview side by side and send each step of an agent to the one that’s cheaper for it.

Try both in Shogo