Google's Gemini Live Can Now Read Phone Screens, Camera Feeds And Answer Queries
Google's conversational AI chatbot application, Gemini Live, now has the ability to read phone screens and camera feeds and answers questions on them in real time, according to a report by the Verge.
This feature is currently only available to a select number of subscribers of Google's Gemini Advanced, as a part of its Google One AI Premium plan.
According to a report by 9to5Google, the feature was made available to a user who saw a 'Share screen with Live' prompt appear above their 'Ask about you screen' option, presented by Gemini Live. The user also reported that they had access to the 'Live with video' feature that enabled them to start a video stream by opening the full application. The AI can then scan the environment and answers questions on what it's seeing in the camera feed.
These features were developed by Google's 'Project Astra' an intiative headed by Demis Hassabis, the chief executive officer and co-founder of Google Deepmind. Project Astra's goal is to develop a multi modal AI that can act as an assistant in real time by analysing the physical world, according to the Verge.
It was expected to be able to process audio, video, images and text, while simultaneously answering questions and providing suggestions to users on the same.
Googe first unveiled these capabilities at the Mobile World Congress 2025 in Barcelona, having interactive demonstrations for attendees.
The tech company also released videos on YouTube ,featuring these capabilities.
The videos displayed the conversational aspect of Gemini Live, where the users asked it questions on aesthetics and design choices for clothing and pottery in each of the videos. The AI showcased the ability to have organic conversations, building on previous answers and adapting to new questions.
-
High US Salaries, No Green Card Certainty: The Financial Calculation Facing Indian H-1B Families
The suspension of PERM processing at eight technology employers does not cancel existing H-1B visas. What it does is force a question many Indian families have been avoiding: is the US salary worth tying your career and family plans to one employer?
-
Swiggy vs Eternal: Food Delivery's Two Rivals Are No Longer In The Same Race
Eternal is building a private AI assistant, dark.ai. Swiggy is still working out how to make Instamart pay, with an operating loss of Rs 895 crore in the July-September quarter while Blinkit stayed profitable.
-
Where You Live Shapes How You Get To Work | The Reason Why
Two-wheelers are the most popular way to get to work in India, accounting for nearly 43% of workplace commutes.
-
Unhedged Position: Can India See An Indonesia-Style Time Correction?
The Nifty is trading below levels it first clocked in 2024. Is there, then, as I have suggested in the headline, potential that the current time correction drags on painfully for the next three-five, even ten years?
-
Navigating Friction And Energy Realities: An Analysis Of Marco Rubio's October Visit To India
Occurring at a critical juncture marked by stalled trade negotiations and escalating geopolitical pressures over global energy supplies, the visit offers a profound window into modern US-India relations.
-
India Exports Capital. Why Not Export Trusteeship?
The big question, then, is whether India can build an institution that global borrowers, investors, banks, and lawyers can trust, even without an Indian connection.
-
France's Economy & Politics Are In Crisis | The Reason Why
Let's look at how the French economy and politics evolved under Nicolas Sarkozy, Franois Hollande and Emmanuel Macron.
-
You May Inherit The Business. You Must Earn Its Credibility.
Succession tests the founder's ability to share authority as much as it tests the next generation's readiness to assume it.
-
Signing Deals Is One Thing; Making Them Work Is Another | The Week In Whys
Sometimes, things don't turn out as planned. Indian companies have lost some bids to rivals, some projects won't produce until 2030.
-
FOMC Wall, PERM Suspension, Hospital Stocks | Talking Points This Week
A PERM suspension would directly affect green-card sponsorship rather than H-1B visas, so the near-term earnings impact could remain relatively limited. The key question is whether this marks a new phase in US scrutiny of Indian IT.
