Apple Watch Beta Adds Siri Recap and Live Rewind Audio Intelligence

Apple Expands Audio Intelligence Capabilities in Latest Beta

Apple has released the first developer beta of watchOS 27.3, introducing two new Audio Intelligence features designed for the Apple Watch Series 12 and Apple Watch Ultra 4. The update brings Siri Recap and Live Rewind to the platform, features initially previewed during Apple's September special event. These tools leverage the S11 chip to process audio data locally, aiming to enhance user interaction through ambient listening capabilities.

Siri Recap operates by continuously monitoring audio in the background to generate high-level summaries of conversations. When enabled, the system creates a title and key points from the dialogue, allowing users to jog their memory later without needing to be present during the initial exchange. The summaries are designed to capture essential information such as important dates, times, prices, and action items, rather than providing a full transcript. If a user does not save a summary, it is automatically deleted after seven days.

Live Rewind offers a different approach by focusing on immediate recall. This feature buffers audio continuously, enabling users to access a text transcript of the last 15 seconds of conversation. To activate Live Rewind, users must double-press the Digital Crown on the watch. The resulting text snippet appears on the screen, allowing the wearer to catch details they may have missed, such as a waiter stating the daily specials. Users can ask Siri about the content of the transcript or save it to the Siri app for future reference.

Privacy and user control are central to the implementation of these features. Both Siri Recap and Live Rewind are opt-in, meaning they are not enabled by default. Users must manually activate the features through the Watch app on their iPhone or via the Control Center on the Apple Watch. Apple emphasizes that transcription does not continue beyond the specific 15-second window for Live Rewind, and Siri Recap does not store full transcripts. This opt-in structure is intended to address potential privacy concerns associated with always-listening devices.

The rollout of watchOS 27.3 also includes updates to the iOS 27.3 developer beta. Apple has introduced a redesigned Health app, featuring a new Insights tab that provides summaries for heart, sleep, and fitness data. Additionally, a For You section offers personalized recommendations, and the app now includes educational health content. These changes aim to provide users with a more comprehensive view of their health metrics throughout the day.

Global Availability and Hardware Requirements

Apple has expanded language support for these Audio Intelligence features to include global English, Simplified and Traditional Chinese, French, Japanese, Korean, Norwegian, Portuguese, Spanish, Turkish, and Vietnamese. The features are exclusive to the Apple Watch Series 12 and Apple Watch Ultra 4, which are equipped with the necessary S11 chip to handle the computational demands of Apple Intelligence. Earlier features such as Sound Recognition and Shazam Music Recognition are already available on these devices but are not part of this specific beta update.

Initial impressions from testers suggest that the features function as intended within the beta environment. However, Apple notes that the software is still under development, and the final public release may include significant changes. The developer beta allows users to test the features in day-to-day scenarios, providing feedback that could shape the final product. As with any beta software, users should expect potential bugs or performance issues.

Key takeaways

• Apple released the watchOS 27.3 developer beta, introducing Siri Recap and Live Rewind for Apple Watch Series 12 and Ultra 4.
• Siri Recap generates high-level conversation summaries that auto-delete after seven days unless saved by the user.
• Live Rewind transcribes the last 15 seconds of audio, accessible by double-pressing the Digital Crown.
• Both features are opt-in and require manual activation via the iPhone Watch app or Apple Watch Control Center.
• The update supports multiple languages and is powered by the S11 chip in compatible Apple Watch models.
• iOS 27.3 beta also includes a redesigned Health app with new Insights and For You sections.