Skip to content
Sign in Subscribe
apple / AI / tokens

Apple found a way to sharply cut token use

“Sonata” proposes a "reliable proxy for thinking necessity"

The Stack
By  The Stack
Updated / Published 2 min read
apple cut token use AI sonata
Apple's HQ. Image credit; Avi Richards, via Unsplash.com

Machine learning engineers at Apple quietly created a way to cut AI token use by up to 60%, without undermining model performance. 

This content is for members only

Subscribe
Add The Stack on Google
  • The Stack

    The Stack

    Stories with a "The Stack" byline could be from junior members of the team, with shared authors, or are sometimes simply Ed logging in under the wrong profile.

More in apple