Gemini for Android is getting two new options that can permit customers to ask questions on their smartphone’s present display. Dubbed ‘Ask about this display’ and ‘Ask about this video’, these instruments seize a screenshot and course of the content material of the display. Then, when prompted by the person, it could reply with related data that the person is in search of. The video characteristic, which solely seems to be suitable with YouTube, also can present video summaries supplied there are captions added to the video.
Gemini Now Lets Customers Ask Queries About Their Display
Devices 360 employees members noticed the options within the Google app model 15.33.38.28.arm64 and later in a number of completely different smartphones. These seem on the highest of the Gemini floating window when a person summons the AI assistant. Those that have entry to the characteristic will see a separate rectangular strip with the textual content “Ask about this display” and a screenshot icon. If Gemini was activated whereas enjoying a video on YouTube, the textual content is changed with “Ask about this video” and the YouTube icon.
Tapping the icon for ‘Ask about this display’ captures a short lived screenshot inside Gemini, after which the person can ask any question concerning the display. The responses will solely be based mostly on what the AI can see within the screenshot, nonetheless, customers also can immediate Gemini to entry the Web to search out extra data. Considered one of its use circumstances could possibly be asking for a brief abstract of a information article.
To ask a follow-up query, customers can simply faucet the microphone icon or the keyboard icon on the backside of the floating window. Notably, the captured screenshot is just not saved on the gadget. Moreover, lengthy screenshots should not supported with this characteristic.
The ‘Ask about this video’ characteristic solely works for a YouTube video the place captions have been added. In our testing, we discovered that no different video platform, regardless of the standing of captions, was suitable with the characteristic. Nonetheless, on a YouTube video, utilizing the characteristic permits customers to ask questions concerning the video. The solutions are generated based mostly on the captions, and the video itself is just not analysed.