AI

Gemini in Chrome Can See Your Screen — But Can It Really Help?

37
Gemini in Chrome (Image: TheVerge)
Gemini in Chrome (Image: TheVerge)

Google has started testing Gemini integration in Chrome, allowing users to access its AI assistant directly from the browser. Instead of visiting a separate page, users can now click the Gemini button in the top-right corner of Chrome to start chatting. What makes this version different is that Gemini can “see” what’s on your screen.

The new feature is currently only available to AI Pro and Ultra subscribers using Chrome Beta, Dev, or Canary versions. Writer Emma Roth tried it out and found both strengths and shortcomings.

Gemini worked well when summarizing news articles, YouTube videos, and Amazon search pages. It could identify tools in DIY videos, pull out recipes from cooking videos, and even find waterproof bags in shopping results. You can also use voice input and hear Gemini’s spoken responses with the “Live” feature.

However, Gemini still feels limited. It can only process visible content on one tab at a time. You have to manually show what you want summarized. Sometimes its answers were too long for the small popup window. And even when asked for concise replies, it often responded with lengthy paragraphs.

Inconsistencies also showed up. In one video, it failed to identify MrBeast’s location, even though the answer was in the description. Gemini also couldn’t link to specific products or place orders, even when prompted — tasks that future “agentic” AIs are expected to handle.

Despite its flaws, the tool shows potential. Google’s upcoming Project Mariner and its Agent Mode could bring smarter task handling and web search, possibly making Gemini in Chrome much more powerful soon.

Right now, it’s a helpful assistant — but not yet the full-on AI agent Google is aiming for.

Source: Verge

Written by
Sazid Kabir

I've loved music and writing all my life. That's why I started this blog. In my spare time, I make music and run this blog for fellow music fans.

Related Articles

Telegram
Apps & UpdatesAI

Telegram and xAI Partner in $300M Deal to Integrate AI Chatbot Grok

Telegram has entered a major partnership with Elon Musk’s AI company, xAI,...

ChatGPT iOS
AI

ChatGPT Answers Not Good Enough? Use This 3-Word Rule

A simple prompt formula called the “3-word rule” is helping users get...

Carl Pei, Nothing CEO
SmartphonesAITech

Nothing CEO Carl Pei Predicts AI-Powered OS Will Replace Apps in 7-10 Years

Carl Pei, the co-founder of Nothing, shared his bold vision for the...

Claude 3.7 Sonnet
AITech

Claude Chatbot Now Talks Back, Anthropic Launches Voice Mode in Beta

Anthropic has started rolling out a new voice mode for its Claude...