Summary

Google has launched Guided Vision in Gemini Live on compatible Android devices. It provides spoken descriptions, answers to follow-up questions and verbal cues to help users adjust their camera view.

Google launched Guided Vision in Gemini Live for compatible Android devices on October 1, 2026. The feature uses a phone’s camera to provide conversational, real-time descriptions and spoken guidance for people who are blind or have low vision, as well as others seeking visual assistance.

A camera view users can adjust by voice

With Guided Vision enabled during a Gemini Live session, users can share their camera and ask about what it sees. Google says the feature can describe surroundings, answer detailed follow-up questions and offer spoken cues when the camera is pointed too high, too close or off to one side. Prompts such as panning right or tilting down are intended to help the system get a clearer view of the subject.

The feature is designed for practical visual tasks: reading small print on food packaging, interpreting appliance dials, locating an object in a cluttered space, identifying colours or patterns, and getting an overview of an unfamiliar room. Google also says it supports conversations in multiple languages.

Google developed Guided Vision with input from blind and low-vision communities. The company says it worked with Aira to visually interpret data for tens of thousands of hours, and that more than 1,000 members of Aira’s Trusted Tester network helped stress-test and refine the model. Aira specialists also worked with Google on safety guardrails. The company says feedback and testing included communities in India, Brazil, Singapore, Indonesia and Japan, among other countries.

Availability and safety

Guided Vision is available on Android devices running Android 9 and above in regions and languages where Gemini Live is supported. Users can enable it in the Gemini app’s profile settings, then share their camera in Gemini Live. Google also describes Android accessibility shortcuts for launching the feature, including a floating accessibility button, a two-finger swipe or pressing both volume keys. TalkBack users can select Guided Vision from the TalkBack menu.

Google cautions that, like other generative AI features, Guided Vision can make mistakes. It is an assistive utility, not a medical device, mobility aid or replacement for a white cane. The company says it is not intended for navigation, safe-travel guidance or obstacle detection; users should continue to rely on established mobility aids and safe-travel practices.

Sources