Shows current AI models remain weak at automating chip design, setting a baseline for progress.
Nvidia and ChipAgents released a benchmark measuring how AI models perform at chip design tasks. Anthropic's Fable 5.1 powered the best agent, scoring only 16.6%.