Android has launched new AI features designed to bring authenticity, creativity, and real-world experiences to your digital life.
With advancements like AI-powered audio captions that capture every nuance, image descriptions enhanced by Gemini for richer context, and sharper document scanning in Google Drive, let’s check out these latest updates built for better connection and engagement.
- Say HELLO to better captions
Expressive Captions automatically capture the intensity and emotion of how someone is speaking — from volume and tone to sounds that say more than words. You’ll see things like the [whispering] of a juicy secret, the [cheers and applause] of a big win and the [groaning] after a dad joke. These will appear across your phone’s apps on everything from streaming to social to video messages, only on Android [APPLAUSE]. Read more about Expressive Captions here.
- Hear image descriptions read aloud, enhanced by Gemini models
Designed with people in blind and low-vision communities, Image Q&A in Lookout now uses Gemini 1.5 Pro to provide even richer, more helpful image descriptions compared to previous versions. Simply take, upload or open a photo in the app to hear the caption read aloud in a natural-sounding voice. You can then gain a deeper understanding of the image by asking follow-up questions, now available globally.
- Grab a slice of the new sticker combos and keyboard
Is pizza night coming up? Remix your favourite emoji into new pizza-themed sticker combos 🍕+❤️ and share them with friends using Emoji Kitchen in Gboard. And while you’re there, try Gboard’s new glide typing keyboard Clearflow, optimized for speed and accuracy.
- Share pictures, videos and more with a QR code
Your best photos are meant to be shared. QR codes in Quick Share make it easier to transfer pictures, videos and documents. Simply select the media file you want to share, tap the QR code and have others scan it for a secure transfer — no need to add them as a contact, verify devices or change your sharing settings.
- Snap, save and share high-quality document scans
Your scans are now crisper and clearer with auto-enhancements in Google Drive. From receipts to documents to ID cards, your scans are optimized to improve contrast and white balance, and remove shadows and blurring — with no manual editing needed. Simply snap an image of physical documents and receipts and save the clear digital version in the format you want.
Caption: Easily scan and save your documents in high quality.
- Get help from Gemini across more of your favourite apps
Gemini on Android is getting a boost with new Extensions that connect to your favourite apps and services. With the new Spotify extension, you can play your favourite songs and discover playlists for any mood.
You can also call contacts and send messages with your default phone and messaging apps, set alarms and control device settings and your camera. Soon, you’ll also be able to use Gemini to control your smart home devices that your Google Account can access, and get more information about places on Maps.
Check out the latest Android AI features now. If you’re a Pixel user, take a look at these new Pixel features that are also available to you.
