Google Confirms Gemini Upgrade: AI Can Now Control Your Computer
Google Gemini Computer Use lets AI control your screen, but the privacy risks are entirely on you.
- Google’s Gemini Computer Use feature streams the user’s entire screen to the AI, which can then control the mouse and keyboard via a Chrome extension.
- The rollout begins June 2026 in the US for Gemini Advanced subscribers, with EU and Asian markets following in August 2026.
- Google explicitly warns that users bear full responsibility for any data the AI accesses, including sensitive information like passwords and financial records.
- Early testers reported the AI successfully completed multi-step tasks such as scheduling meetings and ordering groceries, but also accidentally opened confidential documents.
- Privacy advocates and cybersecurity experts have called for federal investigations, comparing the feature to a self-driving car with no liability protections.
Google's announcement marks a significant leap in AI agent capabilities, following similar moves by OpenAI and Anthropic in 2025 and 2026. The feature is designed to automate repetitive tasks like filing reports, booking travel, or managing spreadsheets, positioning Gemini as a direct competitor to Microsoft's Copilot and other desktop AI assistants. However, the lack of built-in privacy safeguards has drawn sharp criticism from cybersecurity experts and consumer groups.
According to Google's official blog post, Gemini Computer Use works by streaming your screen to the AI, which then issues commands to control the mouse and keyboard via a Chrome extension. The system can handle multi-step workflows, such as logging into accounts, copying data between apps, and submitting web forms. Early testers reported that the AI could accurately complete tasks like ordering groceries or scheduling meetings with minimal errors, but also noted that it occasionally accessed unintended files or exposed sensitive information.
Named individuals include Google CEO Sundar Pichai, who called the feature 'a new era of personal productivity,' and Gemini product lead Claire Liu, who acknowledged the privacy trade-offs. The rollout begins next week in the US for Gemini Advanced subscribers, with EU and Asian markets following in August. Google also released a 30-page safety whitepaper that lists potential risks — from accidental data leaks to malicious exploitation — but offers no concrete technical protections beyond user-discretion warnings.
Analysts warn that the 'user responsibility' model is a dangerous abdication. 'This is like selling a self-driving car and telling the buyer they're liable for all crashes, even software failures,' said Dr. Elena Rossi, a Stanford cybersecurity researcher. The broader implication is that AI agents may outpace safety regulations, forcing regulators to scramble for oversight frameworks. Google's approach contrasts with Apple's, which has limited on-device AI to sandboxed environments.
The outlook is uncertain. While Gemini Computer Use could transform how millions interact with computers, privacy watchdogs are already calling for federal investigations. Google promises regular updates and an opt-in transparency dashboard, but critics say these measures fall short. The next milestone to watch is the EU's response under the AI Act, which could force Google to implement mandatory data filters. For now, users face a stark choice: productivity gains or data autonomy.
"the privacy risks are entirely on you"
Frequently Asked Questions
Gemini computer use is a Google AI feature that lets the Gemini agent see and control your computer screen through a Chrome extension. It can navigate applications, click buttons, fill forms, and perform multi-step tasks.
Gemini computer use works by streaming your screen to the AI, which then sends commands to control the mouse and keyboard via a browser extension. The AI can open windows, type text, and interact with any visible element.
The main privacy risk is that the AI has full access to everything displayed on your screen, including passwords, financial data, and personal messages. Google places sole responsibility on users to prevent accidental data exposure.
Google warns that Gemini computer use is not inherently safe and that users must be cautious. The AI may access unintended sensitive information, and there are no automatic privacy filters or sandboxing protections.
To protect privacy, avoid using the feature when handling sensitive data, close unrelated tabs, and review the transparency dashboard Google plans to release. However, Google has not provided built-in privacy tools.
Topics
Original source
www.forbes.com
Discussion
Join the discussion
Sign in to post a comment or reply.
No comments yet. Be the first to share your thoughts!