Stability AI optimized its audio generation model to run on Arm chips

AI startup Stability AI has teamed up with chipmaker Arm to bring Stability’s Stable Audio Open, an AI model that can generate audio including sound effects, to mobile devices running Arm chips. While a number of AI-powered apps can generate audio, like Suno and Udio, most rely on cloud processing, meaning that they can’t be used offline. Moreover, some audio generation models were trained on copyrighted content — posing an IP risk. Stability claims Stable Audio Open’s training set is made up entirely of royalty-free audio and songs. Stable Audio Open running on Arm chips, which will be demoed at the Mobile World Congress conference in Barcelona this week, can generate a sound from a text description like, “Gentle ocean waves at sunset.” Stability says that it worked with Arm to optimize and “distill” Stable Audio Open, speeding up generation times by 30x. Generating a single 11-second audio sample takes around 8 seconds on an Armv9 CPU. To be clear, the optimized Stable Audio Open ... Read full article.