This post is also available in:
עברית (Hebrew)
Web browsers are increasingly becoming more than tools for viewing websites. As artificial intelligence becomes more deeply integrated into everyday computing, browsers are evolving into interactive assistants capable of understanding what users are reading, answering questions about it, and eventually helping perform tasks directly on their behalf.
Google has taken another step in that direction with a new Chrome capability that allows users to send selected portions of their screen directly to Gemini for analysis.
The feature, called “Select from screen,” appears within the AI assistant’s interface and functions similarly to a built-in screenshot tool. Rather than describing a webpage manually, users can simply highlight text, images, or a specific section of the screen and submit it to the assistant. The additional visual context enables the AI to provide more accurate and relevant responses.
According to Cyber News, instead of processing only typed prompts, the assistant can now analyze exactly what the user has selected. This reduces ambiguity and makes it easier to ask questions about complex diagrams, images, documents, or web content.
The feature operates with user permission. The company says users must explicitly authorize the move before it can access on-screen information. Once permission is granted, the AI can use the selected content to generate responses without requiring users to repeatedly explain what they are viewing.
The update is part of a broader effort to transform Chrome into an AI-centric platform. The AI assistant already supports contextual understanding of the current webpage, can work across multiple browser tabs with permission, and can access inputs such as location and microphone when authorized.
The latest capabilities also complement the assistant’s emerging “computer use” functions, which allow AI systems to interpret on-screen content and interact with applications in ways that resemble human computer usage.
From a cybersecurity perspective, these capabilities present both opportunities and challenges. Context-aware AI assistants can improve productivity by helping users analyze information more efficiently. However, security specialists also note that software capable of understanding on-screen content could become valuable to attackers if compromised or abused. Strong permission controls and transparent privacy policies therefore remain essential as browsers gain broader access to user activity.
The rollout is expanding across multiple regions, although availability remains limited in some markets. As browser-based AI assistants become more capable, the web browser itself is increasingly evolving into a platform where users interact with artificial intelligence throughout their daily workflows rather than through standalone chat applications.
