Android's New Feature Drop: Gemini Tracks Items, Messages Get Themes

Google has unveiled its latest Android Drop, bringing a suite of new features to a wide range of devices, not just Pixel phones. The September update enhances the Gemini AI assistant, streamlines communication in Google Messages, and officially introduces Motion Assist, a feature designed to combat motion sickness. These updates aim to make Android devices more helpful and personalized for users.

A significant addition is the integration of Gemini with the Find Hub application. Starting with Android 16 and higher, users can instruct Gemini to log the location of items that don't have dedicated tracker tags. For instance, one can tell the AI, 'I put my keys in the blue drawer,' and optionally include a photograph. This information is then stored in Find Hub, a tool previously used for locating devices and trackers. Users can query Gemini to recall these manually logged items or check Find Hub directly if they've forgotten where something was placed.

Gemini's utility is further expanded with the introduction of 'Guided Vision,' a new feature within Gemini Live designed to aid accessibility. This function assists users in identifying objects within their camera's view or deciphering difficult-to-read text, such as a menu in a dimly lit restaurant. Gemini analyzes the live camera feed to help users locate items and even estimate distances, for example, how far their hand is from an object. Guided Vision will be accessible through the system's Accessibility shortcuts and the TalkBack menu, functioning on most Android phones running Android 9 Pie or later.

Enhancements for Google Messages and Motion Assist

Google Messages, the default texting application on most Android phones, is also receiving notable updates. Users can now directly access Google Keep from within a conversation to create shared notes instantly. The Keep integration appears in the '+' menu alongside options for sending images, locations, or stickers. Messages may also suggest using Keep on Gemini-powered devices. The Keep notes function operates as an overlay, allowing users to stay within the Messages app while creating or sharing notes with conversation participants.

Furthermore, message threads are becoming more visually appealing with the introduction of chat themes. Each conversation can be customized with a unique theme, allowing users to select a system wallpaper or a personal photo from their gallery. The app automatically adjusts the color of text bubbles to complement the chosen image, or users can manually select specific colors. Both the Google Keep integration and the chat theme feature are available to all Android phones equipped with the Messages app.

The final element of this Android Drop is the official rollout of Motion Assist. This feature, which helps mitigate motion sickness during travel, began appearing on select devices last week and is now a standard part of Android 17. While not exclusive to Pixel devices, its availability is still somewhat limited. Motion Assist utilizes floating dots on the screen that move in response to the vehicle's motion, aiming to reduce the sensory conflict that causes nausea. Users can find Motion Assist in the Google Services settings, enable it via a Quick Settings tile, or configure it to activate automatically when the phone detects it is in a moving vehicle.

Google indicates that these features are rolling out globally and will be available to users over the coming days and weeks, depending on device and network conditions. The comprehensive update underscores Google's commitment to enhancing the core Android experience through both AI-driven innovations and practical user-centric improvements.