Google Launches Live Video and Screen-Sharing for Gemini

Google has officially begun rolling out two significant features for its Gemini AI platform: live video and screen-sharing. First introduced at Google I/O 2024, these capabilities are designed to enhance user interaction by allowing real-time queries about the user’s environment. Currently, these features are exclusively available to Gemini Advanced subscribers on mobile applications, with a broader rollout expected in the future.

New Features Enhance User Interaction

The rollout of the live video and screen-sharing features was first reported by 9to5Google, following a Reddit post by user Kien_PS. This user shared a screenshot showcasing the “Share-screen with live” functionality, along with a demo video that illustrates how the feature operates. According to Google spokesperson Alex Joseph, these enhancements are part of the Gemini Live initiative, which aims to make the AI more responsive to real-time situations. With the new screen-sharing capability, users can receive assistance from Gemini while navigating their smartphone screens. This feature builds on the existing “Talk about the screen” function, allowing for a more interactive experience. Additionally, Gemini can now access the user’s device camera, enabling it to answer questions based on what the user sees. For instance, users can ask for outfit suggestions by showing their wardrobe or request information about landmarks while outdoors.

Real-Time Data Processing Capabilities

The introduction of these features marks a significant advancement in real-time data processing for AI applications. Users can engage with Gemini in a more dynamic way, asking questions that require immediate visual context. This capability aligns with Google’s goal of making Gemini more useful in everyday situations, enhancing the overall user experience. Furthermore, the live video feature is comparable to OpenAI’s Advanced Voice Mode with Vision for ChatGPT and the real-time video functionality found in Ray-Ban Meta Smart Glasses. As technology continues to evolve, these advancements in AI and cloud infrastructure enable faster processing and more effective real-time applications.

Availability and Subscription Details

Currently, the live video and screen-sharing features are limited to Gemini Advanced subscribers, who can access them through the Google One AI Premium plan priced at Rs. 1,950. Google has not provided any information regarding the potential expansion of these features to free-tier users. As the company continues to innovate, it remains to be seen when or if these capabilities will become available to a wider audience.

Observer Voice is the one stop site for National, International news, Sports, Editor’s Choice, Art/culture contents, Quotes and much more. We also cover historical contents. Historical contents includes World History, Indian History, and what happened today. The website also covers Entertainment across the India and World.

Follow Us on Twitter, Instagram, Facebook, & LinkedIn