Your Android Device May Soon Enable Hands-Free Ordering and Ride Booking
Google is on the verge of enhancing its Gemini assistant with a new feature that could revolutionize how users interact with their Android devices. According to findings from a beta version of the Google app, Gemini may soon be able to perform tasks directly within apps, such as placing orders or booking rides. This capability, referred to as “screen automation,” aims to make the assistant more proactive, allowing it to act on behalf of users in various applications.
Understanding Screen Automation
The beta version 17.4 of the Google app reveals a feature dubbed “Get tasks done with Gemini,” internally referred to as “bonobo.” This functionality is designed to enable Gemini to assist users by automating tasks within supported applications on their devices. Unlike traditional voice commands, screen automation allows the assistant to perform actions such as selecting options, confirming actions, or filling out forms directly within apps.
However, Google has indicated that this feature will only be available for certain applications, meaning not all Android apps will support it at launch. This limitation suggests that the company is selectively rolling out the feature to ensure a smooth user experience. Additionally, Google has included warnings about the potential for errors, emphasizing that users will retain control over the process and can intervene at any time if necessary.
Privacy Considerations
As part of the beta testing, Google has implemented privacy notices to inform users about how screen automation will function. When Gemini interacts with apps, it may generate screenshots of these interactions, which could be reviewed by trained personnel if the user has activity tracking enabled. This review process is intended to enhance the service’s performance. However, Google advises users against sharing sensitive information, such as login credentials or payment details, during Gemini interactions. The company also recommends that users refrain from using screen automation for critical tasks or emergencies.
These privacy measures highlight Google’s commitment to user security while also indicating the potential complexities involved in automating tasks through an AI assistant.
Additional Features in Development
In addition to screen automation, the beta version of the Google app includes references to another feature codenamed “wasabi,” which appears to be associated with “Likeness.” This feature may allow users to create and manage 3D avatars, similar to those already used in Google Meet calls. Text strings suggest that users could interact with their avatars through Gemini prompts, adding a new dimension to user engagement.
These developments indicate that Google is positioning Gemini for a more dynamic role within the Android ecosystem. If successfully launched, screen automation could significantly alter how users engage with their apps, shifting the assistant’s role from merely providing guidance to actively executing tasks. However, as of now, Google has not confirmed when these features will be available to the general public, leaving users eager for updates.
Observer Voice is the one stop site for National, International news, Sports, Editor’s Choice, Art/culture contents, Quotes and much more. We also cover historical contents. Historical contents includes World History, Indian History, and what happened today. The website also covers Entertainment across the India and World.
