Skip to main content
The homepageThe VergeThe Verge logo.
The homepageThe VergeThe Verge logo.

From ChatGPT to Gemini: how AI is rewriting the internet

See all Stories

Posted
H
Hayden Field
Apple’s new research paper says AI reasoning isn’t all it’s cracked up to be.

Right before WWDC 2025, Apple researchers published a paper called The Illusion of Thinking (PDF) that made waves. The researchers wrote that popular and buzzy AI models “face a complete accuracy collapse beyond certain complexities,” especially with things they’ve never seen before.

They presented models from OpenAI, Anthropic, and DeepSeek with new and complex puzzle games and found their reasoning ability “increases with problem complexity up to a point, then declines.”

Recent generations of frontier language models have introduced Large Reasoning Models (LRMs) that generate detailed thinking processes before providing answers. While these models demonstrate improved performance on reasoning benchmarks, their fundamental capabilities, scaling properties, and limitations remain insufficiently understood. Current evaluations primarily focus on established mathematical and coding benchmarks, emphasizing final answer accuracy. However, this evaluation paradigm often suffers from data contamination and does not provide insights into the reasoning traces’ structure and quality. In this work, we systematically investigate these gaps with the help of controllable puzzle environments that allow precise manipulation of compositional complexity while maintaining consistent logical structures.
Image: Apple
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
Comments
Loading comments
Getting the conversation ready...

Most Popular

Most Popular
  1. Our long national sunscreen nightmare is almost over
  2. Kaleidescape’s movie player blows streaming, and your wallet, away
  3. Barret Zoph is out at OpenAI again after just five months
  4. Midjourney goes from generating cat images to full-body ultrasound scans
  5. Hue’s wired wall modules bring non-smart lights into its ecosystem

More in AI

The film about Sam Altman has been dropped by Amazon MGMThe film about Sam Altman has been dropped by Amazon MGM
Barret Zoph is out at OpenAI again after just five monthsBarret Zoph is out at OpenAI again after just five months
Amazon employees say they’re facing termination for backing data center limitsAmazon employees say they’re facing termination for backing data center limits
Who decides when AI is too dangerous?Who decides when AI is too dangerous?
Play
Adobe’s redesigned AI studio remembers what your creations look likeAdobe’s redesigned AI studio remembers what your creations look like
Photoshop and Premiere now have AI assistantsPhotoshop and Premiere now have AI assistants

Top Stories