Artificial Analysis released Capability Indices v1.1, updating domain-specific AI model evaluations across finance, legal, healthcare, engineering, and other sectors. The update incorporates stronger evaluations from Intelligence Index v4.3, adds agentic tool use benchmarks, and removes customer interaction metrics across most domains.
Artificial Analysis's Intelligence Index, a widely-used AI model leaderboard, compresses diverse evaluation choices into a single intelligence score that obscures methodological trade-offs. The index weights agentic workloads heavily (34%), relies on saturated benchmarks like GPQA that cannot distinguish frontier models, lacks genuine coding benchmarks despite a 24% coding category, and features half its components using similar agent-execution patterns that may over-represent certain capabilities.