Apple TV 4K for AI-enhanced subtitles, Amazon X-Ray style information while watching, and clearer dialogue in tvOS 18
Apple has announced a series of improvements for tvOS 18, the next version of its Apple TV 4K operating system. WWDC 2024 (you can see all the information as we learn it on our WWDC 2024 live blog). The new features are available to Apple developers today in a beta version of tvOS 18, and will launch in an official version later this fall.
The announcements started with InSight for the Apple TV app. Similar to Amazon Prime Video’s X-Ray feature, this shows on-screen information about characters, actors, and even background music tracks for Apple TV Plus movies and shows. The data can be accessed in real time and is also available when you use an iPhone as a remote control to control the Apple TV 4K.
The Apple TV 4K Enhance Dialogue feature gets an AI-powered boost in tvOS 18 to improve the clarity of voices over background noise and music when watching movies and TV shows. According to Apple, Enhance Dialogue can now be used with a TV’s built-in speakers, HomePod or HDMI-connected speakers, AirPods, and other Bluetooth devices.
Subtitles are also being updated in tvOS 18, with on-screen text now automatically appearing when you mute the volume or scan back while watching shows. Subtitles are also generated if the language does not match the selected language for the device, so viewers never have to worry about missing a line of dialogue.
The best 4K projectors can be used to display images in the ultra-wide 21:9 aspect ratio, and new updates to tvOS 18 will bring 21:9 format support to the Apple TV 4K. This allows images to be displayed on 21:9 aspect ratio screens, without horizontal black bars at the top or bottom, just like in a movie theater.
Screensavers, FaceTime and Apple Fitness Plus
Other improvements in tvOS 18 will make the Apple TV 4K more fun to watch in screensaver mode, and make FaceTime calls more accessible.
Screen saver options now include a portrait mode that uses photos from your library that can be customized with text, color and images. This is accompanied by a TV and Movie option with select scenes from content on Apple TV Plus, as well as a Snoopy and Woodstock animation for Peanuts fans.
FaceTime calls in tvOS 18 can be made on the big screen with live captions automatically generated in English when you make FaceTime calls. The feature, which is only available in the US and Canada, will improve the accessibility of the Apple TV 4K by allowing users to both read and listen to conversations.
Finally, the Apple Fitness Plus app gets a new design in tvOS 18, adding new features that offer a personalized “For You” space, improved rewards, and expanded search features.
Apple hasn’t yet specified which Apple TV devices will get these upgrades, although it’s safe to assume the latest Apple TV 4K (2022) will benefit.