Home/Methodology

Methodology & sources

This site exists for one reason: to give "which model is better" an answer you can actually check.

Where the data comes from

Scorescome entirely from published evaluations. We run no tests of our own, accept no vendor-submitted scores and adjust no ranking for commercial relationships. Sources:

Intelligence index
Artificial Analysis Intelligence Index v5 / v4.3.2
Science reasoning
GPQA Diamond (collected by Epoch AI and Metatext)
Terminal agents
Terminal-Bench 4.0(Stanford / Laude Institute)
Document generation
LiveBench Design (the LiveBench project)
Professional tasks
Vals Index (run independently by Vals AI)
Prices
Official vendor pricing pages (OpenAI, Anthropic, Google, DeepSeek and others)
Speed
Artificial Analysis measurements of median throughput and time to first token
Specs
Hugging Face model cards and vendor technical documentation
This is an aggregator, not an evaluation lab. What we can guarantee is accurate citation, traceable sources and no mixing of methodologies. What we cannot guarantee is that every upstream evaluation is itself unbiased. For a major purchasing decision, run a small A/B on your own traffic first.

Three easy mistakes

Comparing across versions

The AA Intelligence Index moved from v4.3.2 to v5 on 2026-10-27. The same model, DeepSeek V4.1 Flash, went from 45.1 to 32.5 — not a regression, just harder questions. The column header carries the version so the two sets are never mixed.

Reading a dash as zero

Missing data does not mean zero capability. New models, open models and models for minority languages are less well covered, so sorting on the composite alone systematically underrates them.

Budgeting on unit price

Two models at $2/$10 can differ 3× in the output tokens one task needs. Opus 5.5 costs twice Sonnet 5.5 per token yet only 10% more per task, because it writes less. Budget on cost per task, not price per token.

Changelog

2026-11-03
First release: 28 models and 6 benchmarks, adding GPT-6.1 Terra (10-26), Gemini 4 Carbon (10-28), MiniMax M3.1 Flash (10-26) and Kimi K3.1 Pro (10-23).
2026-10-27
Artificial Analysis enabled Intelligence Index v5; this site switched its primary sort to match, keeping the old scores as a reference column.

Corrections

If a price, a score or a model spec looks wrong, tell us. Once verified, the correction is recorded in the changelog — nothing is changed silently.

Contact: jiaoliudao@qq.com