Google Gemini Gains Screen Automation to Control Android Apps Directly
Google is taking Gemini to the next level by enabling it to control apps on Android directly. Recent beta discoveries reveal a new feature called Get tasks done with Gemini, internally codenamed bonobo, which allows users to instruct AI to perform tasks such as booking rides via Uber or ordering food from Uber Eats just by giving commands on the Gemini interface.
How Screen Automation Works
This functionality operates through Screen Automation, which lets Gemini interact with app interfaces like a human would, tapping buttons and entering text. Initially, the feature will support a limited set of partner apps along with Google’s own apps. Despite early restrictions, this marks a significant step toward turning smartphones into fully agentic AI assistants capable of multi-step actions on behalf of the user.
Requirements and Launch
Screen Automation requires Android 16 QPR3, which lays the foundation for secure AI interaction with app interfaces. Google is expected to officially launch the feature around March, alongside the Pixel 10a, potentially restricting access to AI Pro or AI Ultra subscription tiers.
Privacy Considerations
Google warns users that Screen Automation may capture screenshots during operation for internal review, improving the service’s accuracy. Users are advised not to enter payment information or passwords during automated sessions, and not to rely on the feature in emergency situations as AI errors may occur.
Subscription Packages
For reference, the Google AI Pro 2TB plan currently costs 750 THB per month, while the top-tier AI Ultra 30TB plan is priced at 9,400 THB per month (approx. $250 USD). With the addition of automation, these high-tier subscriptions may offer greater convenience than other devices can match.
The Future of Mobile AI
With Screen Automation, Google Gemini is evolving from a chat assistant into a full-service mobile agent, streamlining daily tasks without the need to manually switch between apps. Pixel users with the latest hardware can anticipate updates next month, signaling a potential new era of AI-assisted smartphone use.
