Anurag answers Is there a taxonomy & catalog of AI evals?

[Anurag]

Tried to map the some of the AI Evaluation Taxonomy sources using the AI Verify Catalog as the backbone, absorbing all evaluation categories encountered. The nodes are annotated by the risk/​impact of the evaluated dimension.

Outer Alignment

Inner Alignment

Mindmaps generated using ChatGPT 5.1, visualised using MarkMap in VSCode

Source attribution

• AIVF – AI Verify Foundation – Cataloguing LLM Evaluations (2024)

• AISA – AI Safety Atlas – Chapter 5: Individual Capabilities & Propensities

• ADELE – ADELE – A Cognitive Assessment for Foundation Models (Kinds of Intelligence, 2024)

• Justitia25 – Justitia – Mapping LLM Evaluation Landscape (2025)

• Align23 – Frontier Alignment Benchmarking Survey – (arXiv 2310.19852, Sec 4.1.2)

Risk Categorization

Level	Meaning	Derived from
L – Low stakes	Failures cause inconvenience, not harm	ADELE “General Capability”
M – Medium safety-relevant	Misalignment causes harm but not systemic risk	AIVF catalogue—safety dimension
H – High safety risk	Model failures can lead to misuse or exploitation	AI Safety Atlas—propensities for harm
X – Extreme/​catastrophic risk	Failure could scale, self-direct, or escape supervision	2310.19852 Section 4.1.2