Neural Networks

Researchers at AI startup Goodfire.ai have found that language models store memorization and logical reasoning in separate neural pathways. Their preprint paper, released in late October, shows that removing memorization circuits eliminates 97 percent of verbatim recall while preserving nearly all reasoning abilities. Surprisingly, arithmetic tasks rely on memorization pathways, explaining AI's math struggles.