Skip to content
Tech News
← Back to articles

Apple details how Apple Watch’s new Audio Intelligence features work in privacy paper

read original get Apple Watch Ultra 2 → more articles
Why This Matters

Apple is introducing Audio Intelligence on Apple Watch Series 12 and Ultra 4, using always-available microphones plus on-device and cloud AI for sound, music, and speech features. Because ambient listening on a wrist-worn device is inherently sensitive, Apple published a privacy paper explaining that every feature is opt-in and tightly scoped. It's a test of whether ambient AI can be normalized without triggering a surveillance backlash.

Key Takeaways
Worth a Look

Apple Watch Ultra 2 — If the new Audio Intelligence features have you eyeing an Apple Watch, the Ultra line is the flagship pick with its big bright display, rugged titanium build and long battery life for all-day listening and workouts. It's the same family of watches Apple is building these on-device audio and Siri features for, plus Shazam music recognition right on your wrist.

See Apple Watch Ultra 2 on Amazon → Affiliate link — we may earn a commission on purchases, at no extra cost to you. Product picked by AI based on this article; it is not a tested recommendation.

Apple is launching an all-new set of features called Audio Intelligence, starting with today’s new Apple Watch Series 12 and Apple Watch Ultra 4. The company details how the new feature works, especially around privacy, in a new paper.

Audio Intelligence on Apple Watch covers four features, including Live Rewind and Siri Recap

“Audio Intelligence is a brand-new class of Apple Intelligence features that use the microphones of Apple Watch, the power of Apple silicon, and on-device and cloud-based AI models to help you detect sounds, identify music, and stay present and engaged — all while protecting your privacy at every step,” Apple explains.

Audio Intelligence includes four specific features to start: Sound Recognition, automatic Music Recognition with Shazam, Live Rewind, and Siri Recap. The company says that both Live Rewind and Siri Recap will arrive in beta with English support later this year, adding that “more details will be available at launch.”

Each Audio Intelligence feature is opt-in, Apple says. Live Rewind and Siri Recap also let you easily enable or disable the feature as needed.

Here’s more on Live Rewind from Apple:

Live Rewind only activates when you deliberately double-press the Digital Crown. It only shows the last 15 seconds of speech as a text snippet on your display. It doesn’t continue to transcribe in the background, nor does it save the text unless you choose to ask Siri about the content or save it to the Siri app. You can turn it on through the Watch app on iPhone — just open the Watch app, tap Siri, then tap Live Rewind and turn on “Double Click Digital Crown”.

And here’s more on Siri Recap from Apple:

Siri Recap runs only when you choose. You can turn on Siri Recap in the Watch app on iPhone. When you turn it on, you can set a schedule based on time and/or location (for example, “only at work” or “never at night”), or you can manually turn it on and off. Across all these options, you can always turn it on or off at any time from Control Center.

Audio Intelligence doesn’t attribute speech to speakers, and Siri Recap is designed to omit potentially harmful content and sensitive information. Live Rewind alerts nearby people with an audible chime and visual indicators, Apple says.

... continue reading