SShogo Bench

Gemini 4 Hydrogen vs Kimi K3

Gemini 4 Hydrogen leads Kimi K3 by 14.5 points on the Shogo Agent Index, but their ranges overlap, so treat it as close. Gemini 4 Hydrogen wins 9 and Kimi K3 wins 0 of 9 shared benchmarks. Gemini 4 Hydrogen is cheaper for agent workloads.

Add more models to this comparison →

Pillars

PillarGemini 4 HydrogenKimi K3
Agentic coding7863
Long-horizon autonomy7865
Knowledge-work agents5842
Computer use6143
Security & context learning6153

Shared benchmarks

BenchmarkGemini 4 HydrogenKimi K3
APEX-Agentsindex78.0%47.8%
Vending-Bench 2index$14,549$5,165
FrontierSWEindex53.1%25.9%
Chess Puzzles60.0%37.0%
FrontierMath Tier 487.8%39.0%
FrontierMath Tiers 1-388.1%72.2%
GPQA Diamond96.8%93.1%
OTIS Mock AIME100.0%97.2%
SimpleQA Verified70.9%50.6%

Specs and price

Gemini 4 HydrogenKimi K3
Agent Index69.4 (#7)54.9 (#26)
Agent $/M$0.63$1.39
Input / output $/M$1.50 / $7.50$3.00 / $15.00
Context1M1M
ReleasedNov 12, 2026Jul 16, 2026
WeightsClosedOpen
API hosts529

Don’t pick one. Route.

Shogo can run Gemini 4 Hydrogen and Kimi K3 side by side and send each step of an agent to the one that’s cheaper for it.

Try both in Shogo