Apple has put always-on AI listening into developer testing. The new watchOS 27.3 developer beta adds Audio Intelligence, which lets Siri tune into the Apple Watch’s mic, The Verge AI reports. It launches with two features: Siri Recap and Live Rewind.
That’s a big ask for a device you wear all day, and Apple knows it. It has also published an Audio Intelligence Privacy Overview that explains how it plans to protect users while the watch listens around the clock.
What Apple is testing
1. Siri Recap summarizes your conversations
Recap uses what Apple calls “ambient listening” to generate summaries of your conversation. Think of it as a note-taker who’s always in the room. It could help after a doctor’s visit or a hallway chat you’d otherwise half remember, though those examples are mine, since the report doesn’t list specific use cases.
2. Live Rewind turns 15 seconds of audio into text
Live Rewind generates a text transcript of the last 15 seconds of audio your watch’s mic detected. If someone rattles off a phone number and you miss it, you can check your wrist instead of asking them to repeat it. The short window also makes this feel more like a quick memory jog than a record of your day.
3. Apple says raw audio stays walled off
This is the claim the whole feature rests on. According to Apple’s overview, raw audio “is handled within dedicated hardware, is not saved as a file, and is not accessible to the operating system, apps, or Apple.”
4. Saved text gets end-to-end encryption, with conditions
Apple says any Recap summary or Live Rewind snippet you choose to save “syncs across your devices end-to-end encrypted in the Siri app.” That only applies if you use iCloud with two-factor authentication and have a device passcode, so it’s worth checking your settings if you test this.
5. The redesigned Health app is in testing too
Apple also released its new Health app in the iOS 27.3 developer beta, and announced expanded language support. The redesign includes:
- An Insights tab, with summaries of heart, sleep, fitness, and other data that pop up during the day
- A For You section with personalized recommendations
- Health content, including educational videos and articles
- Support for global English, Chinese (Simplified and Traditional), French, Japanese, Korean, Norwegian, Portuguese, Spanish, Turkish, and Vietnamese
Why this matters
Ambient AI wearables have mostly been a startup game so far. Bee and Limitless both built around recording and summarizing your day, and Amazon and Meta ended up buying them.
Apple comes at this from a different angle. Nobody has to buy and charge a new gadget if the feature lands on a watch they already wear. Owning the hardware also lets Apple build its privacy pitch into the device itself, which is hard for an app maker to copy.
What stands out to me is how much of this launch is about trust. Apple is testing two modest features, but it’s asking people to accept a mic that’s listening all day. If that trade feels creepy, the features won’t matter much.
The caveats
- It’s a developer beta. The report doesn’t give a public release date, pricing, or a list of supported Apple Watch models.
- The privacy protections are Apple’s own claims. The Verge AI describes them that way, and its report doesn’t cite any independent verification.
- Other people didn’t sign up for this. A conversation summary includes whoever you’re talking to. The report doesn’t say whether they’d get any signal that the feature is on.
- Text can be as sensitive as audio. Protecting raw audio is one thing, but a summary of a private chat can reveal just as much. That’s why the rules around generated text deserve as much scrutiny as the audio promises.
What comes next
Developers now get the first hands-on look, and their tests should show whether Recap’s summaries are accurate enough to rely on. Security researchers will likely want to test Apple’s hardware claims too. You can find more details in The Verge AI’s original report, which also points to Apple’s privacy overview.