SShogo Bench

Sources & licences

Every score links back to where it was published. These are the datasets we pull from.

Epoch AI citation: Epoch AI, ‘Capabilities & benchmarking’. Published online at epoch.ai. Retrieved from https://epoch.ai/benchmarks.

Benchmark origins

BenchmarkResults come fromModelsOfficial site
SWE-bench VerifiedRun by Epoch AI32www.swebench.com
Terminal-Bench 2.0Benchmark leaderboard, collected by Epoch AI44www.tbench.ai
DeepSWEBenchmark leaderboard, collected by Epoch AI26epoch.ai
FrontierSWEBenchmark leaderboard, collected by Epoch AI25epoch.ai
CursorBenchBenchmark leaderboard, collected by Epoch AI22cursor.com
GSO-BenchBenchmark leaderboard, collected by Epoch AI30gso-bench.github.io
METR Time HorizonsBenchmark leaderboard, collected by Epoch AI35metr.org
Vending-Bench 2Benchmark leaderboard, collected by Epoch AI68andonlabs.com
PostTrainBenchBenchmark leaderboard, collected by Epoch AI21epoch.ai
APEX-AgentsBenchmark leaderboard, collected by Epoch AI62www.mercor.com
GDPvalBenchmark leaderboard, collected by Epoch AI11openai.com
Remote Labor IndexBenchmark leaderboard, collected by Epoch AI18www.remotelabor.ai
DeepResearch BenchBenchmark leaderboard, collected by Epoch AI24deepresearch-bench.github.io
OSWorld 2.0Benchmark leaderboard, collected by Epoch AI9os-world.github.io
OSWorldBenchmark leaderboard, collected by Epoch AI9os-world.github.io
CybenchBenchmark leaderboard, collected by Epoch AI21cybench.github.io
CL-benchBenchmark leaderboard, collected by Epoch AI19epoch.ai
TheAgentCompanyBenchmark leaderboard, collected by Epoch AI14the-agent-company.com
ExploitBenchBenchmark leaderboard, collected by Epoch AI9epoch.ai
BALROGBenchmark leaderboard, collected by Epoch AI37balrogai.com
Aider PolyglotBenchmark leaderboard, collected by Epoch AI45aider.chat
MirrorCodeRun by Epoch AI41epoch.ai
FrontierCodeBenchmark leaderboard, collected by Epoch AI46epoch.ai
WebDev ArenaBenchmark leaderboard, collected by Epoch AI104web.lmarena.ai
SciCodeBenchmark leaderboard, collected by Epoch AI139scicode-bench.github.io
WeirdML v3Benchmark leaderboard, collected by Epoch AI27htihle.github.io
AlgoTuneBenchmark leaderboard, collected by Epoch AI18algotune.io
GPQA DiamondRun by Epoch AI216arxiv.org
Humanity's Last ExamBenchmark leaderboard, collected by Epoch AI43lastexam.ai
ARC-AGI-2Benchmark leaderboard, collected by Epoch AI96arcprize.org
ARC-AGIBenchmark leaderboard, collected by Epoch AI95arcprize.org
SimpleBenchBenchmark leaderboard, collected by Epoch AI100simple-bench.com
Chess PuzzlesRun by Epoch AI94epoch.ai
CritPtBenchmark leaderboard, collected by Epoch AI162epoch.ai
FrontierMath Tiers 1-3Run by Epoch AI94epoch.ai
FrontierMath Tier 4Run by Epoch AI76epoch.ai
OTIS Mock AIMERun by Epoch AI202epoch.ai
MATH Level 5Run by Epoch AI83github.com
ProofBenchBenchmark leaderboard, collected by Epoch AI84epoch.ai
SimpleQA VerifiedRun by Epoch AI95epoch.ai
MMLUBenchmark leaderboard, collected by Epoch AI116arxiv.org
LMCABenchmark leaderboard, collected by Epoch AI140epoch.ai
DTBenchBenchmark leaderboard, collected by Epoch AI172epoch.ai
Fiction.LiveBenchBenchmark leaderboard, collected by Epoch AI51fiction.live
VPCTBenchmark leaderboard, collected by Epoch AI24epoch.ai
GeoBenchBenchmark leaderboard, collected by Epoch AI42epoch.ai