Google may roll out new Gemini features that understands your phone screen and camera view

Gemini's new features could give the AI chatbot a much needed advantage over the competition.

The new Gemini features is part of Project Astra, which the company announced last year. (Image Source: Google)

Google is currently rolling out new features for Gemini, its generative AI powered chatbot. Part of the company’s Project Astra, which tech giant demoed last year, Gemini Live can see what’s on your phone screen and camera viewfinder and give answers about in real-time.

First spotted by 9to5Google, the news comes from a Reddit user for whom the new feature showed up on their Xiaomi device. This means Gemini Live can now read and analyse what’s on the screen and answer questions about it.

The other feature that also happens to be part of Project Astra is the ability to use the camera to answer questions about things in the real world. This can be accessed by opening the fullscreen Gemini Live interface and starting a video stream. You can check it out in the video below.

Story continues below this ad

Also Read | How to schedule messages on Android and iPhone the easy way

This is particularly handy as you can simply point Gemini to an object or animal or anything and get answers about it. However, it looks like the two new Gemini features are only available for a handful of users with Google One AI Premium subscription, which starts from Rs 1,950 per month.

Google also said that these features will initially be available to Pixel devices, but it looks like the tech giant is now rolling them out on a random basis, so you will have to wait some time before the aforementioned functionalities make it to the free version of Gemini.