Skip to main content
The homepageThe VergeThe Verge logo.
The homepageThe VergeThe Verge logo.
Posted
W
External Link
Wes Davis
Apple AI paper details how its multi-modal ‘Ferret-UI’ LLM can interpret phone UIs.

The company has been steadily releasing research papers on its AI work for years. With Ferret-UI, the company seems to be looking at how AI can help with smartphone navigation:

Automating this process of perception and interaction has the potential to help users achieve their goals with relative ease. Moreover, it is also a valuable building block for accessibility, multi-step UI navigation, app testing, usability studies, and many others.

Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
Comments
Loading comments
Getting the conversation ready...

Most Popular

Most Popular
  1. Our long national sunscreen nightmare is almost over
  2. Kaleidescape’s movie player blows streaming, and your wallet, away
  3. Barret Zoph is out at OpenAI again after just five months
  4. Midjourney goes from generating cat images to full-body ultrasound scans
  5. Hue’s wired wall modules bring non-smart lights into its ecosystem

More in News

NASA selects Eric Schmidt’s rocket company for a 2028 mission to MarsNASA selects Eric Schmidt’s rocket company for a 2028 mission to Mars
Hue’s wired wall modules bring non-smart lights into its ecosystemHue’s wired wall modules bring non-smart lights into its ecosystem
The NTS Radio Player brings the best of internet radio to your hi-fiThe NTS Radio Player brings the best of internet radio to your hi-fi
The film about Sam Altman has been dropped by Amazon MGMThe film about Sam Altman has been dropped by Amazon MGM
Valve is so behind on Steam Controller orders that some won’t ship until 2027Valve is so behind on Steam Controller orders that some won’t ship until 2027
You can now use the Game Boy Camera with your phoneYou can now use the Game Boy Camera with your phone

Top Stories