AI researchers at Apple have discovered serious logical faults in the reasoning abilities of advanced language models when it comes to basic grade school math.
A recent study shows that slight alterations in the phrasing of math problems can lead to significant drops in performance for these models.
Language models rely on pattern matching rather than true understanding of problem statements, limiting their ability to solve math problems.
This highlights the current limitations of AI in terms of high-level reasoning and symbol manipulation, suggesting that current AI chatbots are not capable of true logical reasoning.