Top AI Android 15 Features Revealed at Google I/O 2024

Circle to Search – Search for anything you see on your phone using a simple gesture – Enhanced to aid students with homework – Step-by-step instructions to solve physics and math word problems

Activate Circle to Search: – On phones with 3-button navigation: Long press the Home button. – On phones with gesture navigation: Long press the navigation bar at the bottom. Select the Problem: – Once Circle to Search activates, draw a circle around the specific math or physics word problem you need help with on your screen. Search for Solutions: – Google will analyze the circled text and use its AI to find relevant information.

– For math and physics word problems, you'll now see step-by-step instructions displayed directly on your phone or tablet to help you solve the problem. (Optional) Refine Your Search (if needed): – In the search bar that appears below the circled text, you can add keywords or rephrase your question for more specific results.

Gemini AI Assistant with Contextual Understanding – Understands the context of what’s on the screen and what app the user is using. In-App Actions: Perform tasks directly within apps, including: – Drag and Drop: Drag and drop images generated by Gemini into other apps (e.g., Gmail). – "Ask this video": Tap a button to ask questions about a specific YouTube video you're watching – Rolling out to hundreds of millions of devices over the next few month

Gemini Nano-powered Accessibility Features – TalkBack receives clearer descriptions thanks to Gemini Nano’s multimodal capabilities – Provides more detailed descriptions of images encountered daily

Gemini Nano-powered Scam Detection – Protects users from scams during phone calls – Real-time alerts for conversation patterns associated with scams – Alerts if a caller requests: – Urgent fund transfers – Payments with gift cards – Personal information (PINs, passwords)ords) – On-device processing for privacy