Joe Maring / Android Authority
TL;DR Gemini is getting smarter about analyzing your device’s screen.
A new screen context feature allows Gemini to automatically look at what’s on your display, without needing to manually prompt it.
Users with privacy concerns can disable this automatic functionality.
Isn’t it great when Google’s able to use context to recognize what we were trying to do, and jumps in with a helping hand? Maybe you were about to send an email where you mention an attachment but never actually selected any file — Gmail is happy to prevent that embarrassment by offering a helpful reminder. A few months back we spotted Gemini working on a similar trick, and now it’s starting to enter public testing.
Don’t want to miss the best from Android Authority? Set us as a favorite source in Google Discover to never miss our latest exclusive reports, expert analysis, and much more.
to never miss our latest exclusive reports, expert analysis, and much more. You can also set us as a preferred source in Google Search by clicking the button below.
Like Gmail, Gemini handles all sorts of attachments — maybe you want to edit an image, or ask it a question about a video. That extends to screenshots of what you’re actively working on, and to streamline that support, Gemini introduced its “Ask about screen” button.
So far, that’s all well and good. But back in September we identified early work on a new “Screen Context” option that wouldn’t even require you to hit that button and explicitly tell Gemini to start looking at your screen. Instead, the system would attempt to recognize when you were asking Gemini about something on your screen, and then automatically take a screenshot to analyze — no further interaction from you required.
This week, we’re finally starting to see access to this tool roll out, and it has started appearing on some of our devices (Thanks: Diego).
... continue reading