Median tokens (solved only)
Kimi-K3
10 tok
GLM-5.2
31 tok
MiniMax-M3
21 tok
Gemma-4-31B
13 tok
gpt-oss-120b
14 tok
Mistral-Med
15 tok
MiMo-V2.5
28.5 tok
Solve rate
Kimi-K3
90%
GLM-5.2
90%
MiniMax-M3
87.5%
Gemma-4-31B
70%
gpt-oss-120b
70%
Mistral-Med
40%
MiMo-V2.5
40%
ModelnSolvedSolve %MedianMeanNote
Kimi-K310990%1012best full-grid: solve + speed
GLM-5.210990%3134.1solves, but slowest median
MiniMax-M38787.5%2123.62 missing cells
Gemma-4-31B10770%1310.9fast when it hits (+20pp vs v2)
gpt-oss-120b10770%1415full grid now; morphology kills 3
Mistral-Med10440%1515.2doubled solve rate vs v2
MiMo-V2.510440%28.531synonym + morph collapses