Expressive Captions are a part of Dwell Caption, in order that they’re constructed into the working system and obtainable throughout apps in your telephone. This implies you should utilize Expressive Captions with most stuff you watch, like livestreams on social platforms, recollections in your Google Images reel and video messages from family and friends. When enabled, captions will happen in actual time and on system, so you should utilize them even whilst you’re on airplane mode.
Bringing Expressive Captions to life
To construct Expressive Captions, our Android and Google DeepMind groups labored to know how we have interaction with content material on our gadgets with out sound. Utilizing a number of AI fashions, Expressive Captions not solely captures spoken phrases but in addition interprets them into stylized captions, whereas offering labels for a fair wider vary of background sounds. This makes captions simply as vibrant as listening to audio. It’s only one manner we’re constructing for the actual lived experiences of individuals with disabilities and utilizing AI to construct for everybody.
Beginning immediately, Expressive Captions will likely be obtainable within the U.S. in English on any Android system operating Android 14 and above that has Dwell Caption. That is a part of our work to search out much more methods to deliver emotional expression and context to captions.
