In the first developer betas of iOS 27.3 and watchOS 27.3 released on Tuesday, Apple enabled four new Audio Intelligence features. The updates target Apple Watch Series 12 users and add capabilities to detect important sounds, identify songs, rewind recent audio, and automatically create spoken-word summaries.
The four features
- Sound detection: notifies the user about important ambient sounds such as alarms or doorbells, a feature intended to assist deaf and hard-of-hearing users.
- Song identification: uses Shazam technology to recognize songs playing in the environment, a capability iPhone users have had for many years.
- Live Rewind: allows users to go back and review roughly the last 15 seconds of what was said nearby.
- Siri Recaps: summarizes audio captured throughout the day and saves notes of key items mentioned in conversations.
Privacy safeguards
Apple says it processes audio and runs AI models on-device where possible, avoids identifying individual speakers, does not store raw audio files, and redacts sensitive information such as government ID numbers or personal account details from summaries. Those design choices are intended to limit privacy risks.
Despite these protections, Live Rewind and Siri Recaps have prompted concerns because they record, transcribe or summarize conversations occurring with and around the Apple Watch owner — an idea some critics see as normalizing always-on listening by consumer devices.
A day of testing: practical benefits and annoyances
The article’s author tested Siri Recaps on an Apple Watch over a single day and found both clear usefulness and areas for improvement. During errands to drop a teen’s car off for repairs and to pick up a rental vehicle, staff spoke aloud about time frames, prices and policies too quickly to write down. Later, Siri Recaps had captured several key details the author wanted to remember, including the deductible, the expected repair timeframe, and the amount of gas in the rental at pickup.
However, Siri Recaps mixed those car-related details with other family conversation topics that occurred later at home — errands to run, babysitting times and plans to watch midterm coverage on TV. Because the author had configured Siri Recaps to run continuously, the feature also recorded non-essential items such as TV plans, which underscored how the function can capture everyday chatter and feel invasive in certain contexts.
The author considered turning off Recaps during evenings at home to prevent routine family conversations from being added to the notes.
Requested controls and workflow improvements
Based on the experience, the author suggests several refinements that would improve usability and privacy control:
- Topic-based separation: save unrelated subjects (for example, car repairs vs. family schedule) into separate notes or at least separate sections within a note.
- Quick deletion: allow removing an individual bullet or line with a simple swipe action rather than entering edit mode and manually deleting text.
- Automatic export: provide a setting to automatically export saved Siri Recaps to the Apple Notes app, optionally into a dedicated folder, to make notes easier to manage.
The author acknowledges why automatic export might not be a default given the diverse ways people use Notes, but argues it would help users who rely on Notes as their central repository for reminders and to-dos.
Conclusion
While the author was initially uneasy about the notion of the watch constantly listening, the practical benefit of automated, on-device note-taking is clear in some everyday scenarios. Apple's on-device processing and redaction measures aim to address privacy concerns, but Live Rewind and Siri Recaps will likely require additional user controls and interface improvements before they feel comfortable and well-tailored for broader use.
