LLM Benchmarks

Source-backed measurements

Compare 100 AI models across overall capability, knowledge, coding and agents—with sources, test dates and transparent comparison rules.

Page updated
EN
♡ Support
New

First-of-its-kind Local GPU Benchmarks: We run compact open-weight models (4B–35B) across full benchmark datasets on our own hardware (2× RTX 5060 Ti, 32 GB VRAM) — measuring real runtime, speed (tok/s), and time efficiency with & without thinking.

Explore local GPU benchmarks →
Benchmarks
Models
Filters
Models
Cell view
Data quality
Compare models
Available models: 100
100 of 100 models · 16 benchmarks
Read the table
Find a model · Click a header to sort · Click a score for its source Line: green newest · blue current · ochre after 6 months≡ Shared rank: the lead is smaller than a single solved task#3/13 Window place: ranked only inside its own task windowDate Date label = date basisS·A+ Source authority: A+ highest · A strong · B solid · C limitedT·Max Highest measured thinking16 16 benchmarks: four per area. Choose a category to see all its tests.Ranks and shades use all rankable models in each benchmark, including hidden models. Five bands are used from ten results; smaller cohorts remain neutral. These ranks are derived, not source measurements.ORG Benchmark organizer · PROV Model provider · 3P Official cross-provider comparison credible sources disagree for the same disclosed protocol directly comparable under the same protocol, with possible benchmark contamination different protocolMeasured quality targetsComparable cells: 81% · target ≥85%Fresh essential cells: 96.6% · target ≥90%Essential columns with ≥60 models: 4/16
Share & export

For each test setup, we show the highest disclosed thinking level. It may not produce the highest score. Levels are not equal compute budgets across providers.

Latest verified refresh Models +0/−0 · Measurements +766 · updated 636 · −766 · 331 visible table cells changedOpen machine-readable change feed
Cell view
Top 10%Top 25%MiddleBottom quarterBottomRanks and colors refer to all models per benchmark. Model filters only hide rows.Highest measured thinking
Current, source-attributed results for 100 language models. Columns are sortable. Comparable values are ranked; SWE-Pro can also rank clearly labelled official system reports, with differing protocols marked ≈.
OverviewKnowledge and reasoningCodingAgents and tools
⁨ECI⁩ rank ↓ · ModelECI, Overview, Epoch Capabilities Index: 87/100 measured models; 87 comparable, 1 sharing a place. Canonical protocol: Epoch ECI snapshot 2026-10-28 · official-composite-fit · Epoch Capabilities Index. Best comparable first.InfoAA Index, Overview, Artificial Analysis Intelligence Index: 39/100 measured models; 0 comparable, 39 with a different protocol. Canonical protocol: Not reported. Sort.InfoArena, Overview, Arena Text: 80/100 measured models; 80 comparable, 29 sharing a place. Canonical protocol: 2026-10-22 · overall-style-control · Arena Text. Sort.InfoLiveBench, Overview, LiveBench: 57/100 measured models; 57 comparable. Canonical protocol: 2026-06-25 · overall-seven-category · LiveBench. Sort.InfoHLE Full, Knowledge and reasoning, Humanity's Last Exam · Full multimodal: 55/100 measured models; 18 comparable, 37 with a different protocol, 1 sharing a place. Canonical protocol: HLE finalized 2,500 · Scale protocol 2025-04-03 · full-multimodal-2500-no-tools · Scale AI Labs · Humanity's Last Exam Full. Sort.InfoGPQA, Knowledge and reasoning, GPQA Diamond: 92/100 measured models; 54 comparable, 38 with a different protocol, 26 sharing a place. Canonical protocol: GPQA Diamond v1 · Vals dual-prompt · diamond-198-zero-and-five-shot-cot · Vals AI GPQA Diamond. Sort.InfoMMLU-Pro, Knowledge and reasoning, MMLU-Pro: 64/100 measured models; 55 comparable, 9 with a different protocol, 14 sharing a place. Canonical protocol: Vals MMLU-Pro v1 · vals-mmlu-pro-overall · Vals AI · MMLU-Pro. Sort.InfoFrontierMath T1–3, Knowledge and reasoning, FrontierMath T1–3: 68/100 measured models; 68 comparable, 19 sharing a place. Canonical protocol: 2.0.0 · private-285-of-295-problem-tiers-1-3-set · Epoch AI · FrontierMath Tiers 1–3 v2. Sort.InfoSWE-bench, Coding, SWE-bench Verified: 57/100 measured models; 57 comparable, 18 sharing a place. Canonical protocol: SWE-bench Verified v1 · verified-500-vals-mini-swe-agent · Vals AI SWE-bench Verified. Shows only Vals AI's uniform 500-task mini-swe-agent/Bash evaluation. This is the default directly comparable view. Sort.InfoSWE-rebench, Coding, SWE-rebench v2: 36/100 measured models; 13 comparable, 8 directly comparable with a contamination warning, 23 with a different protocol. Canonical protocol: rolling-v2 · 2026-05-15/2026-07-01 · SWE-rebench. Shows the latest shared SWE-rebench task window. Contamination warnings remain visible and do not change the task-window match. 2026-05-15/2026-07-01 Sort.InfoLiveCodeBench, Coding, LiveCodeBench: 62/100 measured models; 54 comparable, 8 with a different protocol, 7 sharing a place. Canonical protocol: Vals LiveCodeBench v1 · vals-livecodebench-overall · Vals AI · LiveCodeBench. Sort.InfoSciCode, Coding, SciCode: 82/100 measured models; 75 comparable, 7 with a different protocol, 10 sharing a place. Canonical protocol: SciCode current leaderboard · scientific-research-coding-subproblems · Epoch AI mirror · SciCode. Sort.InfoTerminal 2.1, Agents and tools, Terminal-Bench 2.1: 70/100 measured models; 58 comparable, 12 with a different protocol, 13 sharing a place. Canonical protocol: Vals Terminal-Bench 2.1 v2.1 · vals-terminal-bench-2-1-overall · Vals AI · Terminal-Bench 2.1. Sort.InfoMCP-Atlas, Agents and tools, MCP-Atlas · Scale: 25/100 measured models; 24 comparable, 1 with a different protocol, 2 sharing a place. Canonical protocol: MCP-Atlas April 2026 rescored protocol · all-1000-public-500-private-500 · Scale AI Labs · MCP-Atlas. Sort.InfoAPEX, Agents and tools, APEX-Agents: 59/100 measured models; 59 comparable, 9 sharing a place. Canonical protocol: APEX-Agents current leaderboard · 480-professional-tasks-33-worlds · Epoch AI mirror · APEX-Agents. Sort.InfoGDPval-AA v2.1, Agents and tools, GDPval-AA v2.1: 76/100 measured models; 0 comparable, 76 with a different protocol. Canonical protocol: Not reported. Sort.Info
Rank 1Claude Opus 5.5Anthropic10/16 measured · 7 comparable
Rank 2GPT 6 astraOpenAI11/16 measured · 8 comparable
Rank 3GPT 6.1 SolOpenAI9/16 measured · 6 comparable
Rank 4Claude Fable 5.1Anthropic14/16 measured · 12 comparable
Rank 5Gemini 4 ArgonGoogle9/16 measured · 6 comparable
Rank 6Claude Sonnet 5.5Anthropic11/16 measured · 8 comparable
Rank 7Claude Opus 5Anthropic15/16 measured · 13 comparable
Rank 8GPT 6 SolOpenAI9/16 measured · 7 comparable
Rank 9Claude Fable 5Anthropic14/16 measured · 13 comparable
Rank 10GPT 5.5 ProOpenAI3/16 measured · 2 comparable
Rank 11GPT 5.6 SolOpenAI14/16 measured · 13 comparable
Rank 12Muse wonderMeta5/16 measured · 2 comparable
Rank 13GPT 5.6 TerraOpenAI13/16 measured · 11 comparable
Rank 14GPT 5.5OpenAI15/16 measured · 12 comparable
Rank 15GPT 5.4 ProOpenAI4/16 measured · 3 comparable
Rank 16Claude haiku 5.5Anthropic10/16 measured · 7 comparable
Rank 17Claude Opus 4.8Anthropic15/16 measured · 12 comparable
Rank 18Gemini 3.7 FlashGoogle12/16 measured · 11 comparable
Rank 19Kimi K3Moonshot AI15/16 measured · 12 comparable
Rank 20Gemini 3.8 FlashGoogle14/16 measured · 12 comparable
Rank 21Qwen 3.8 MaxAlibaba12/16 measured · 11 comparable
Rank 22GPT 5.4OpenAI14/16 measured · 12 comparable
Rank 23Muse Spark 1.3Meta10/16 measured · 7 comparable
Rank 24GPT 5.3 CodexOpenAI7/16 measured · 4 comparable
Rank 25Claude Sonnet 5Anthropic14/16 measured · 12 comparable
Rank 26Claude Opus 4.7Anthropic15/16 measured · 13 comparable
Rank 27GPT 6 LunaOpenAI10/16 measured · 7 comparable
Rank 28Grok 4.6xAI12/16 measured · 11 comparable
Rank 29GPT 5.6 LunaOpenAI12/16 measured · 11 comparable
Rank 30GPT 5.2 ProOpenAI2/16 measured · 2 comparable
Rank 31GLM 5.3Z.ai15/16 measured · 12 comparable
Rank 32DeepSeek V4.1 FlashDeepSeek10/16 measured · 6 comparable
Rank 33Claude Opus 4.6Anthropic12/16 measured · 11 comparable
Rank 34DeepSeek V4 Pro (2026-08-13)DeepSeek14/16 measured · 11 comparable
Rank 35Gemini 3.1 ProGoogle16/16 measured · 13 comparable
Rank 36Muse Spark openMeta6/16 measured · 1 comparable
Rank 37Qwen 3.8 Max (0902)Alibaba7/16 measured · 3 comparable
Rank 38Muse Spark 1.2Meta10/16 measured · 8 comparable
Rank 39Gemini 3.5 FlashGoogle15/16 measured · 12 comparable
Rank 40DeepSeek V4 Flash (0731)DeepSeek11/16 measured · 9 comparable
Rank 41Gemini 3.6 FlashGoogle12/16 measured · 11 comparable
Rank 42Grok 4.7xAI10/16 measured · 7 comparable
Rank 43Grok 4.5xAI13/16 measured · 12 comparable
Rank 44Muse Spark 1.1Meta13/16 measured · 11 comparable
Rank 45Qwen 3.7 MaxAlibaba11/16 measured · 10 comparable
Rank 46GPT 5.2OpenAI11/16 measured · 10 comparable
Rank 47GLM 5.3 FlashZ.ai14/16 measured · 11 comparable
Rank 48Gemini 3 ProGoogle10/16 measured · 9 comparable
Rank 49Claude Sonnet 4.6Anthropic14/16 measured · 11 comparable
Rank 50Grok 4.20xAI8/16 measured · 8 comparable
Rank 51Muse SparkMeta9/16 measured · 8 comparable
Rank 52GLM 5.2Z.ai744B · 40B active15/16 measured · 13 comparable
Rank 53Gemini 3 FlashGoogle11/16 measured · 9 comparable
Rank 54Qwen 3.8 27BAlibaba27B13/16 measured · 10 comparable
Rank 55Kimi K2.6Moonshot AI1T · 32B active14/16 measured · 11 comparable
Rank 56GPT 5 ProOpenAI3/16 measured · 3 comparable
Rank 57Inkling SmallThinking Machines Lab276B · 12B active13/16 measured · 10 comparable
Rank 58Claude Opus 4.5Anthropic11/16 measured · 10 comparable
Rank 58Kimi K2.7 CodeMoonshot AI1T · 32B active11/16 measured · 8 comparable
Rank 60Mistral Large 4Mistral AI5/16 measured · 4 comparable
Rank 61GLM 5.1Z.ai744B · 40B active14/16 measured · 11 comparable
Rank 62GPT 5.1OpenAI10/16 measured · 9 comparable
Rank 63Qwen 3.6 Max PreviewAlibaba4/16 measured · 3 comparable
Rank 64DeepSeek V4 Pro (2026-04-22)DeepSeek1.6T · 49B active13/16 measured · 11 comparable
Rank 65Grok 4.3xAI12/16 measured · 10 comparable
Rank 66GPT 5.4 MiniOpenAI12/16 measured · 11 comparable
Rank 67InklingThinking Machines Lab975B · 41B active15/16 measured · 12 comparable
Rank 68Kimi K2.5Moonshot AI1T · 32B active12/16 measured · 10 comparable
Rank 69Qwen 3.6 PlusAlibaba11/16 measured · 10 comparable
Rank 70Qwen 3.7 PlusAlibaba9/16 measured · 5 comparable
Rank 71MiniMax M3MiniMax14/16 measured · 11 comparable
Rank 72Qwen 3.5 397B-A17BAlibaba397B · 17B active12/16 measured · 4 comparable
Rank 73Claude Sonnet 4.5Anthropic11/16 measured · 9 comparable
Rank 74Qwen 3.6 27BAlibaba27B12/16 measured · 6 comparable
Rank 75DeepSeek V4 Flash (2026-04-22)DeepSeek284B · 13B active8/16 measured · 4 comparable
Rank 76GPT 5.4 NanoOpenAI12/16 measured · 11 comparable
Rank 77GLM 5Z.ai9/16 measured · 7 comparable
Rank 78Gemini 3.5 Flash LiteGoogle13/16 measured · 11 comparable
Rank 79Gemini 3.1 Flash LiteGoogle11/16 measured · 11 comparable
Rank 80Claude Opus 4.1Anthropic7/16 measured · 6 comparable
Rank 81Qwen 3.6 35B-A3BAlibaba35B · 3B active11/16 measured · 4 comparable
Rank 82Gemma 4 31B ITGoogle30.7B6/16 measured · 2 comparable
Rank 83Qwen 3.5 35B-A3BAlibaba35B · 3B active10/16 measured · 4 comparable
Rank 84GPT 5.5 InstantOpenAI5/16 measured · 4 comparable
Rank 85Qwen 3.5 9BAlibaba9B8/16 measured · 2 comparable
Rank 86Qwen 3 32BAlibaba32.8B5/16 measured · 3 comparable
Rank 87Qwen 3 14BAlibaba14.8B4/16 measured · 2 comparable
13 models without a directly comparable ECI score
No rankMiMo V2.6 ProXiaomi6/16 measured · 4 comparable
No rankMuse wonder 1.0Meta3/16 measured · 3 comparable
No rankMiMo V2.5 ProXiaomi10/16 measured · 8 comparable
No rankMiMo V2.6 FlashXiaomi5/16 measured · 3 comparable
No rankstep 5 PreviewStepFun4/16 measured · 2 comparable
No rankHY3Tencent7/16 measured · 1 comparable
No rankGrok 4.1xAI2/16 measured · 2 comparable
No rankQwen 3.5 27BAlibaba27B6/16 measured · 1 comparable
No rankQwen 3.8 Flash NextAlibaba125B · 6B active7/16 measured · 1 comparable
No rankGemma 4 12B ITGoogle12B4/16 measured · 0 comparable
No rankGemma 4 26B-A4B ITGoogle25.2B · 3.8B active4/16 measured · 0 comparable
No rankQwen 3.8 2.4T-A95BAlibaba2.4T · 95B active7/16 measured · 1 comparable
No rankGemma 4 31BGoogle7/16 measured · 1 comparable