Researchers isolate memorization from problem solving in AI neural networks
Math operations and closed-book data retrieval shared paths with memorization, dropping from 66 to 86 percent of performance after editing. The researchers found that arithmetic was particularly fragile. Even when the models generated identical chains of reasoning, they failed in the calculation step after low-curvature components were removed. Figure 3 from the article “From memorization…