SShogo Bench

GPQA Diamond

Graduate-level science questions written to be Google-proof.

Agent Index weight
0%
shown for context only
Models tested
216
run by Epoch AI on a shared harness
Normalised for the index
0.25 → 0, 1 → 100
Official site

Results

#ModelScoreNormalisedHarnessCost/taskDate
1GPT-6.2 Astra
OpenAI
96.8%source—Oct 27, 2026
2Gemini 4 Hydrogen Estimated
Google
96.8%source—Nov 13, 2026
3Gemini 4 Carbon Supported
Google
96.5%source—Nov 2, 2026
4Gemini 4 Argon Supported
Google
96.4%source—Oct 13, 2026
5Claude Fable 5.2 Supported
Anthropic
96.0%source—Nov 6, 2026
6GPT-6 Astra Supported
OpenAI
95.8%source—Aug 30, 2026
7Claude Sonnet 5.5 Estimated
Anthropic
95.6%source—Sep 29, 2026
8Gemini 3.8 Flash Supported
Google
95.4%source—Sep 2, 2026
9GPT-6.1 Sol Estimated
OpenAI
95.4%source—Sep 29, 2026
10Gemini 3.7 Flash Estimated
Google
94.8%source—Aug 14, 2026
11GPT-5.4 Pro
OpenAI
94.6%source—Mar 20, 2026
12Gemini 3.1 Pro Preview Supported
Google
94.4%source—Aug 6, 2026
13GPT-6.1 Terra Estimated
OpenAI
94.3%source—Oct 26, 2026
14GPT-6 Sol Estimated
OpenAI
94.3%source—Sep 22, 2026
15Kimi K3.1 Pro
Moonshot AI
94.2%source—Nov 6, 2026
16Gemini 3.6 Flash Estimated
Google
94.1%source—Aug 2, 2026
17Claude Opus 5.5 Supported
Anthropic
94.1%source—Sep 22, 2026
18GPT-5.5 Supported
OpenAI
94.0%source—Apr 24, 2026
19Grok 4.6 Supported
xAI
94.0%source—Aug 12, 2026
20GPT-5.5 Pro
OpenAI
93.9%source—Apr 24, 2026
21Claude Fable 5 Supported
Anthropic
93.9%source—Aug 6, 2026
22Claude Opus 5 Supported
Anthropic
93.9%source—Jul 24, 2026
23GPT-5.6 Sol Supported
OpenAI
93.5%source—Jul 9, 2026
24Grok 4.5 Estimated
xAI
93.4%source—Jul 8, 2026
25GPT-5.6 Terra Estimated
OpenAI
93.3%source—Jul 9, 2026
26GPT-5.4 Supported
OpenAI
93.3%source—Mar 6, 2026
27DeepSeek V4.1 Flash 1017 Estimated
DeepSeek
93.2%source—Oct 19, 2026
28Doubao Seed Evolving (Nov 2026)
ByteDance Seed
93.1%source—Nov 2, 2026
29Kimi K3 Supported
Moonshot AI
93.1%source—Jul 16, 2026
30Gemini 3.5 Flash Supported
Google
92.8%source—May 22, 2026
31Grok 4.7 Estimated
xAI
92.7%source—Sep 22, 2026
32Qwen3.8 Max Preview Estimated
Alibaba (Qwen)
92.7%source—Aug 4, 2026
33Gemini 3 Pro Preview Supported
Google
92.6%source—Nov 19, 2025
34Qwen3.8 Max 0902
Alibaba (Qwen)
92.3%source—Sep 2, 2026
35GLM-5.2 Supported
Z.ai (Zhipu)
91.9%source—Jun 24, 2026
36DeepSeek V4 Pro 0813
DeepSeek
91.7%source—Aug 18, 2026
37GPT-5.6 Luna Estimated
OpenAI
91.6%source—Jul 9, 2026
38GPT-5.2 Supported
OpenAI
91.4%source—Dec 13, 2025
39Claude Opus 4.8 Supported
Anthropic
91.0%source—Jun 7, 2026
40DeepSeek V4 Flash 0731
DeepSeek
91.0%source—Aug 2, 2026
41DeepSeek V4 Pro Estimated
DeepSeek
90.9%source—Aug 6, 2026
42GLM-5.3 Supported
Z.ai (Zhipu)
90.9%source—Aug 24, 2026
43MiniMax-M3 Estimated
MiniMax
90.9%source—Aug 10, 2026
44Qwen3.7 Max
Alibaba (Qwen)
90.9%source—Aug 7, 2026
45Kimi K2.6 Estimated
Moonshot AI
90.8%source—May 1, 2026
46Claude Opus 4.6 Supported
Anthropic
90.5%source—Feb 6, 2026
47Claude Sonnet 5 Supported
Anthropic
90.5%source—Jul 1, 2026
48GPT-6 Luna
OpenAI
90.5%source—Sep 22, 2026
49Claude Opus 4.7 Supported
Anthropic
90.2%source—Apr 17, 2026
50GLM-5.3-Flash Supported
Z.ai (Zhipu)
90.2%source—Aug 26, 2026
51Mistral Large 4
Mistral
90.2%source—Nov 2, 2026
52GLM-5.1 Estimated
Z.ai (Zhipu)
89.9%source—Aug 10, 2026
53DeepSeek V4.1 Flash Estimated
DeepSeek
89.8%source—Oct 9, 2026
54Muse Spark
Meta
89.8%source—Apr 8, 2026
55Claude Haiku 5.5 Estimated
Anthropic
89.6%source—Oct 9, 2026
56Doubao Seed 2.1 Turbo
ByteDance Seed
89.6%source—Oct 30, 2026
57Gemini 3 Flash Preview Supported
Google
89.4%source—Aug 6, 2026
58Doubao Seed 2.1 Pro
ByteDance Seed
89.3%source—Oct 28, 2026
59Grok 4.20 (Non-Reasoning) Estimated
xAI
89.3%source—Jul 13, 2026
60Grok 4.3 Beta
xAI
88.8%source—Jun 17, 2026
61Muse Spark Open
Meta
88.6%source—Oct 15, 2026
62Inkling Small
thinkingmachines
88.5%source—Aug 14, 2026
63Qwen3.6 Plus Estimated
Alibaba (Qwen)
88.4%source—Aug 7, 2026
64Inkling Estimated
thinkingmachines
88.3%source—Aug 5, 2026
65Doubao-Seed-2.0 Pro
ByteDance Seed
88.2%source—Oct 28, 2026
66Doubao Seed 2.0 Lite (Apr 2026)
ByteDance Seed
88.1%source—Oct 28, 2026
67Kimi K2.7 Code Estimated
Moonshot AI
87.9%source—Aug 7, 2026
68Qwen3.7 Plus
Alibaba (Qwen)
87.9%source—Aug 7, 2026
69GLM-5 Supported
Z.ai (Zhipu)
87.8%source—Feb 12, 2026
70GPT-5.1 Supported
OpenAI
87.6%source—Nov 13, 2025
71Kimi K2.5 Supported
Moonshot AI
87.6%source—Feb 2, 2026
72Claude Sonnet 4.6 Supported
Anthropic
87.4%source—Feb 20, 2026
73Qwen3.6 Max Preview Estimated
Alibaba (Qwen)
87.4%source—Aug 7, 2026
74Grok 4 Supported
xAI
87.0%source——
75GPT-5.4 mini
OpenAI
86.9%source—Aug 7, 2026
76Qwen3.5 397B-A17B
Alibaba (Qwen)
86.4%source—Aug 7, 2026
77GPT-5 Supported
OpenAI
86.2%source—Oct 29, 2025
78Claude Opus 4.5 (latest) Supported
Anthropic
86.0%source—Nov 24, 2025
79Qwen3.6 27B
Alibaba (Qwen)
85.9%source—Aug 7, 2026
80Nemotron 3 Ultra
NVIDIA
85.4%source—Aug 10, 2026
81Gemini 2.5 Pro Supported
Google
85.3%source—Nov 16, 2025
82Qwen3.5 Plus Estimated
Alibaba (Qwen)
84.8%source—Aug 7, 2026
83Qwen3.6 35B-A3B
Alibaba (Qwen)
84.8%source—Aug 7, 2026
84Kimi K2 Thinking Estimated
Moonshot AI
84.2%source—Nov 11, 2025
85Qwen3.5 35B-A3B
Alibaba (Qwen)
83.5%source—Aug 28, 2026
86DeepSeek V3.2 Supported
DeepSeek
83.4%source—Dec 16, 2025
87Gemini 3.5 Flash Lite
Google
83.3%source—Aug 6, 2026
88GLM-4.7 Estimated
Z.ai (Zhipu)
83.3%source—Jan 29, 2026
89Qwen3.6 Flash
Alibaba (Qwen)
83.3%source—Aug 7, 2026
90GPT Chat Latest
OpenAI
82.5%source—Aug 2, 2026
91Claude Sonnet 4.5 (latest) Supported
Anthropic
82.3%source—Oct 28, 2025
92Qwen3.5 Flash
Alibaba (Qwen)
82.3%source—Aug 7, 2026
93Qwen3.7 Flash
Alibaba (Qwen)
82.3%source—Aug 7, 2026
94Gemini 3.1 Flash Lite
Google
81.8%source—Aug 6, 2026
95o3 Supported
OpenAI
81.8%source—Apr 16, 2025
96Qwen3 235B A22B Thinking 2507
Alibaba (Qwen)
80.1%source—Dec 11, 2025
97Claude 3.7 Sonnet Supported
Anthropic
79.7%source—May 26, 2025
98o4-mini Estimated
OpenAI
79.6%source—Apr 16, 2025
99Claude Sonnet 4 Supported
Anthropic
79.2%source—May 26, 2025
100Qwen3.5 9B
Alibaba (Qwen)
79.0%source—Aug 27, 2026
101GPT-5.4 nano
OpenAI
78.5%source—Apr 14, 2026
102Doubao-Seed 1.6
ByteDance Seed
77.6%source—Oct 30, 2026
103Claude Opus 4.1 (latest) Supported
Anthropic
77.3%source—Aug 5, 2025
104o3-mini Estimated
OpenAI
77.0%source—Feb 13, 2025
105o1 Estimated
OpenAI
76.8%source—Feb 13, 2025
106DeepSeek-R1 Estimated
DeepSeek
76.3%source—May 29, 2025
107Claude-Opus-4 Supported
Anthropic
76.3%source—May 22, 2025
108Grok-3 mini
xAI
76.3%source—Apr 10, 2025
109Gemma 4 31B IT
Google
75.8%source—Aug 6, 2026
110GPT OSS 120B Supported
OpenAI
75.8%source—Dec 11, 2025
111Grok 3
xAI
75.8%source—May 26, 2025
112GPT-5 Mini Estimated
OpenAI
75.0%source—Oct 30, 2025
113Gemma 4 26B A4B
Google
73.2%source—Aug 6, 2026
114Qwen3 Max Estimated
Alibaba (Qwen)
72.6%source—Oct 6, 2025
115seed-oss-36b-instruct
Unknown
71.5%source—Aug 30, 2026
116Claude Haiku 4.5 Estimated
Anthropic
71.2%source—Oct 22, 2025
117Qwen3 235B A22B
Alibaba (Qwen)
70.7%source—Jun 3, 2025
118Qwen3-30B-A3B-Thinking (Jul 2025)
Alibaba (Qwen)
70.1%source—Aug 30, 2026
119GPT-5 Nano
OpenAI
69.4%source—Oct 30, 2025
120GPT-4.5
OpenAI
68.7%source—Feb 28, 2025
121DeepSeek V3 0324
DeepSeek
67.6%source—Apr 1, 2025
122Llama 4 Maverick
Meta
67.0%source—Apr 8, 2025
123GPT-4.1
OpenAI
66.9%source—Apr 14, 2025
124GPT-4.1 mini
OpenAI
65.8%source—Apr 14, 2025
125Qwen3 32B
Alibaba (Qwen)
65.7%source—Aug 28, 2026
126Gemini 2.0 Pro
Google
65.7%source—Feb 7, 2025
127QWQ-Plus
Alibaba (Qwen)
65.4%source—Apr 11, 2025
128Qwq 32B
Alibaba (Qwen)
65.3%source—Aug 28, 2026
129DeepSeek-R1-Distill-Qwen-32B
DeepSeek
64.1%source—Aug 28, 2026
130Gemini-2.0-Flash
Google
64.1%source—Feb 6, 2025
131Qwen3 14B
Alibaba (Qwen)
63.8%source—Aug 28, 2026
132o1-mini
OpenAI
62.4%source—Feb 13, 2025
133Qwen3 30B A3B
Alibaba (Qwen)
61.7%source—Aug 30, 2026
134GPT OSS 20B
OpenAI
60.8%source—Aug 27, 2026
135GLM-4.7-Flash
Z.ai (Zhipu)
60.5%source—Aug 30, 2026
136Mistral Medium 3
Mistral
59.5%source—May 7, 2025
137Gemini 1.5 Pro (Feb 2024)
Google
57.2%source—Jan 27, 2025
138Gemini 2.0 Flash Thinking (Jan 2025)
Google
57.1%source—Feb 6, 2025
139Qwen3 8B
Alibaba (Qwen)
56.8%source—Aug 27, 2026
140DeepSeek-V3
DeepSeek
56.5%source—Jan 27, 2025
141Qwen2.5-Max
Alibaba (Qwen)
56.1%source—Apr 1, 2025
142Magistral Small 1.0
Mistral
56.1%source—Aug 6, 2026
143Phi 4
Microsoft
56.1%source—Jan 31, 2025
144DeepSeek-R1-Distill-Llama-70B
DeepSeek
55.7%source—Mar 10, 2025
145Qwen3 30B A3B Instruct 2507
Alibaba (Qwen)
55.6%source—Aug 30, 2026
146Claude-Sonnet-3.5 Estimated
Anthropic
55.3%source—Jan 27, 2025
147Grok-2 (Dec 2024)
xAI
53.8%source—Jan 27, 2025
148Qwen3-4B
Alibaba (Qwen)
52.3%source—Aug 28, 2026
149Llama 4 Scout
Meta
51.8%source—Apr 8, 2025
150Mistral Large 2 (Nov 2024)
Mistral
51.3%source—Feb 25, 2025
151Llama 3.1-405B
Meta
50.9%source—Jan 27, 2025
152GPT-4o (2024-08-06) Supported
OpenAI
49.2%source—Jan 27, 2025
153Qwen2.5-72B Estimated
Alibaba (Qwen)
49.1%source—Jan 27, 2025
154Mistral Small 3.2
Mistral
49.1%source—Aug 28, 2026
155GPT-4.1 nano
OpenAI
48.9%source—Apr 14, 2025
156Qwen Plus
Alibaba (Qwen)
48.1%source—Apr 7, 2025
157Gemma 3 27B
Google
47.7%source—Aug 27, 2026
158Magistral Small 1.2
Mistral
47.6%source—Aug 30, 2026
159Mistral Small 3.1
Mistral
47.5%source—Mar 18, 2025
160Llama 3.3 70B
Meta
47.4%source—Jan 27, 2025
161Gemini 1.5 Flash (Sep 2024)
Google
47.3%source—Jan 27, 2025
162Mistral Small 3
Mistral
47.3%source—Aug 30, 2026
163Claude 3 Opus Estimated
Anthropic
47.2%source—Jan 27, 2025
164GPT-4 Turbo
OpenAI
46.6%source—Feb 27, 2025
165Tulu 3 (Tülu 3) 70B
Allen Institute for AI
46.3%source—Jan 27, 2025
166Qwen2.5-32B
Alibaba (Qwen)
46.1%source—Jan 30, 2025
167qwen3-4b-instruct-2507
Unknown
45.8%source—Aug 28, 2026
168DeepSeek-R1-Distill-Qwen-14B
DeepSeek
44.7%source—Mar 10, 2025
169Llama 3.1-70B
Meta
44.2%source—Jan 27, 2025
170WizardLM-2 8x22B
Microsoft
43.4%source—Jan 27, 2025
171Qwen Turbo
Alibaba (Qwen)
41.8%source—Apr 7, 2025
172Llama 3.2 90B
Meta
41.0%source—Jan 27, 2025
173Qwen2-72B
Alibaba (Qwen)
40.8%source—Jan 27, 2025
174Claude 3 Sonnet
Anthropic
40.6%source—Jan 27, 2025
175Llama 3-70B
Meta
40.6%source—Jan 27, 2025
176Gemma 3 12B
Google
39.5%source—Aug 28, 2026
177Mistral Large
Mistral
38.8%source—Jan 27, 2025
178Claude 3.5 Haiku
Anthropic
38.1%source—Mar 12, 2025
179Qwen3-1.7B
Alibaba (Qwen)
38.0%source—Aug 28, 2026
180GPT-4o mini
OpenAI
37.7%source—Jan 27, 2025
181Hermes 2 Theta Llama-3 70B
Nous Research
37.5%source—Jan 27, 2025
182Gemma 2 27B
Google
36.5%source—Jan 27, 2025
183Claude-Haiku-3
Anthropic
36.3%source—Jan 27, 2025
184GPT-4
OpenAI
35.7%source—Oct 23, 2025
185Qwen2.5-7B
Alibaba (Qwen)
35.5%source—Aug 30, 2026
186Claude 2
Anthropic
34.7%source—Jan 27, 2025
187Mixtral 8x22B
Mistral
34.1%source—Jan 27, 2025
188Gemini 1.0 Pro
Google
34.0%source—Jan 27, 2025
189Eurus-2-7B-PRIME
Tsinghua University
33.9%source—Jan 27, 2025
190DeepSeek-R1-Distill-Qwen-1.5B
DeepSeek
33.6%source—Aug 28, 2026
191Claude 2.1
Anthropic
33.0%source—Jan 27, 2025
192Gemini 1.5 Flash 8B
Google
33.0%source—Mar 12, 2025
193DBRX
Databricks
32.9%source—Jan 27, 2025
194Yi-1.5-34B
01.AI
32.0%source—Jan 27, 2025
195Qwen1.5-32B
Alibaba (Qwen)
30.7%source—Jan 27, 2025
196Mixtral 8x7B
Mistral
30.6%source—Jan 27, 2025
197Mistral Nemo
Mistral
29.9%source—Jan 27, 2025
198Qwen1.5-72B
Alibaba (Qwen)
28.8%source—Jan 27, 2025
199granite-4.0-micro
Unknown
28.3%source—Aug 30, 2026
200GPT-3.5-turbo
OpenAI
28.0%source—Jan 27, 2025
201phi-3-medium 14B
Microsoft
27.6%source—Jan 31, 2025
202Gemma 2 9B
Google
27.5%source—Jan 27, 2025
203Ministral 3 8B 2512
Mistral
27.1%source—Jan 27, 2025
204Llama 3.1-8B
Meta
27.0%source—Aug 27, 2026
205Llama 2-70B
Meta
26.3%source—Jan 27, 2025
206Llama 3-8B
Meta
26.1%source—Jan 27, 2025
207Ministral 3B
Mistral
25.3%source—Jan 27, 2025
208DeepSeek LLM 67B
DeepSeek
24.6%source—Jan 27, 2025
209DeepSeek R1 0528 Qwen3 8B
DeepSeek
9.3%source—Aug 28, 2026
210Gemma 3 1B
Google
19.9%source—Aug 28, 2026
211Gemma 3 4B
Google
23.2%source—Aug 28, 2026
212granite-4.0-1b
Unknown
24.0%source—Aug 28, 2026
213granite-4.0-350m
Unknown
11.2%source—Aug 28, 2026
214Llama 3.2 1B Instruct
Meta
23.9%source—Aug 30, 2026
215Mistral 7B v0.3
Mistral
15.2%source—Jan 27, 2025
216Yi-34B
01.AI
14.7%source—Jan 27, 2025