A screen reader that can take a follow-up question.
Google announced a rollout that let Android TalkBack users ask Gemini follow-up questions about images and about the whole screen, extending beyond one-shot image descriptions.
Original sources ↓ · Revision history ↓
Deployed · source published 2025-05-15
The human problem
Images without alt text and visually structured app screens can block blind and low-vision users from getting the details they need.
The prior constraint
A basic image description can name an object but may not answer the user's own question about material, color, price, or surrounding context.
AI’s actual role
Gemini generated descriptions and answered user follow-up questions about images and screen contents inside Android's TalkBack screen reader.
The documented result
Google stated that the expanded Gemini integration was rolling out on May 15, 2025, allowing descriptions and questions about images and the entire screen. The same announcement said a new English Expressive Captions version was rolling out for Android 15+ in the United States, United Kingdom, Canada, and Australia.
Why it may matter
The interface gives the person asking the question more control over what information is relevant in the moment.
Limitations
This is a product announcement, not an independent accuracy or user-outcome study.
Availability depends on device, operating-system version, language, and region.
Generated visual descriptions and answers can be incorrect or unsuitable for sensitive content.
Unresolved questions
How accurate and useful are answers in high-stakes tasks such as shopping, travel, or reading personal documents?
How do users want privacy and data handling explained when asking about their screens?
Which languages and device classes remain excluded?
Source history & evidence assessment
- Maturity
- Deployed
- Claim confidence
- unassessed
- Event date
- Not recorded
- Source published
- 2025-05-15
- Captured
- 2026-09-07
- Last source review
- 2026-09-07
- Editorial method
- AI-assisted source review
- Place / relevance
- Not recorded
AI-assisted editorial comparison with the cited primary source; result, setting, source date and limitations retained. Independently checked within the research team. Publication authorized by the site owner; no human source review is claimed.
Maturity describes the tested or operational setting. Confidence describes support for the particular claim; one does not determine the other.
Original sources
New AI and accessibility updates across Android, Chrome and more ↗ · institution
Institutions: Google · Project Euphonia · University College London Centre for Digital Language Inclusion
Explore the underlying question
Revision & correction history
2026-09-07 · The interface gives the person asking the question more control over what information is relevant in the moment.
No corrections recorded.