Google is reportedly working on implementing several customization features for the Live Caption accessibility feature on mobile devices. Evidence of this update was discovered by software deeper Assemble Debug after searching the Android System Intelligence app. According to an image given to Android Authority, there are four options in total. We don’t know much, but there is some explanation for it.
The first allows Android phones to display “emoji icons” in a closed caption transcript; perhaps to better convey the emotions the voices express. The other three are not so clear. The second feature will “highlight the emotional intensity in (the) transcription,” while the third includes “word duration (effects)” and the ability to display “emotional tags.”
Feature breakdown
As you can see, the wording is quite vague, but there’s enough to paint a picture. It looks like Live Caption will get better at replicating emotions in the voices it transcribes. For example, suppose you are watching a movie and someone shouts angrily. Live Caption may capitalize text to indicate shouting.
The feature can also italicize words in a line to indicate when someone is being sarcastic or trying to imply something. The word duration effect may refer to the software displaying drawn out letters in a series of captions. Maybe someone is singing along and starts to hold a note. This switch allows the sound that is being held to be reproduced.
Emotional tags are admittedly more difficult to imagine. Android Authority mentions that the tags will be shown and included in a transcript. This could mean that the tool will add clear indicators to transcripts of what a subject is currently expressing. Users may see the word “Angry” appear when someone is angry about something, or “Sad” when someone is crying.
Greater utility
That’s our best guess. If these rumored features work as described, Live Caption would have even more utility than what it already has. The tool was introduced in 2019 as an accessibility tool to help people enjoy content if they are hearing impaired or can’t turn on the sound for any reason.
The current captions are quite basic, but with an update, emotions could be added to Google’s tool for a better immersive experience.
Android Authority claims the features were found in a “variant of the Android System Intelligence app.” We think this means they were on a special version of the app intended for first-party hardware like the Google Pixel. So the customization tools could be exclusive to the Pixel 8 or a future model. It’s too early to tell at this point. Hopefully the upgraded Live Captions will see a much wider release.
Until we know more, check out Ny Breaking’s list of the best Android phones for 2024.