Google's conversational AI chatbot application, Gemini Live, now has the ability to read phone screens and camera feeds and answers questions on them in real time.
This feature is currently only available to a select number of subscribers of Google's Gemini Advanced, as a part of its Google One AI Premium plan.
These features were developed by Google's 'Project Astra' an initiative headed by Demis Hassabis, the chief executive officer and co-founder of Google Deepmind.
Project Astra's goal is to develop a multi-modal AI that can act as an assistant in real-time by analyzing the physical world.