Google is expanding Gemini’s capabilities inside Chrome with a new feature called “Select from Screen”, aimed at making AI-powered searches more intuitive and faster. The feature allows users to select a specific portion of a webpage and send it directly to Gemini for analysis, eliminating the need to manually describe what appears on screen.
The new functionality is rolling out as part of Chrome version 149 and builds on the idea behind Google’s popular 'Circle to Search' feature, which lets users search for information directly from content displayed on their screens.
Key Takeaways
Google has been steadily integrating Gemini across its products, and the latest addition focuses on improving how users interact with information on the web. With Select from Screen, users no longer need to copy text, save screenshots, or explain visual elements to Gemini.
Instead, the feature lets them directly highlight the content they want help with and submit it as part of a Gemini prompt. Whether it is a product image, a chart, a diagram, or a specific section of a webpage, Gemini can use that selected content as context when generating responses.
The move mirrors the experience offered by Circle to Search on smartphones, where users can circle or highlight objects on screen to initiate a search. Google appears to be bringing a similar workflow to desktop users through Chrome.
According to Google’s updated support documentation, the feature can be accessed through the “Ask Gemini” button located at the top of the Chrome browser.
Once activated, users can enter selection mode and highlight specific portions of a webpage. The selected area is then attached to a Gemini query, allowing the AI assistant to analyse and respond based on the chosen content.
The process is designed to be straightforward and requires only a few steps. Users can select exactly what they want Gemini to focus on, making queries more precise and reducing the need for lengthy explanations.
The selected area can also be resized or repositioned before submission, offering greater flexibility when choosing content from a webpage.
According to the tech giant, this new tool could be of assistance in countless real-world situations.
An online shopper can take a snippet of text regarding multiple products found on an online shopping page and ask Gemini to suggest what best fits them. Anyone researching the best running shoes can select and paste multiple sneakers to get Gemini’s thoughts on which ones suit one’s style of running.
Students or professionals can cut out portions of complex diagrams on a page to have Gemini simplify and explain what exactly the diagrams represent. - The feature can also come in handy in design and creation work as users select some of the designs found on a page and ask for improvements or redesign tips from the AI. - Lastly, the company adds that the feature can be leveraged to move the needle on concepts, as one can highlight
The introduction of Select from Screen reflects a broader shift toward visual and context-aware AI experiences.
Traditional search often requires users to describe what they see before receiving relevant results. With this new feature, Gemini can directly analyse selected visual content, reducing friction between the user and the AI assistant.
This approach could prove especially useful when dealing with images, layouts, product listings, diagrams, or other content that may be difficult to describe accurately through text alone.
By allowing Gemini to “see” what users are referring to, Google is aiming to make interactions more natural and efficient.
Google has outlined the following steps for using Select from Screen in Chrome:
Users can adjust the selected area by dragging the edges of the selection box or moving it around the screen before sending it to Gemini.
Google says the feature is rolling out with Chrome version 149.
Users who already have the latest version installed may need to restart their browser before the option becomes visible. Those unsure about their Chrome version can check by opening the browser’s settings menu and navigating to About Chrome.
Because the rollout appears to be phased, availability may vary across users and regions initially.
One more aspect demonstrating Google’s efforts to make Gemini permeate further across its offerings is the integration of the Gemini 1.5 Pro to power Google Select from Screen. The search and tech giant has rolled out a raft of product upgrades across its search engines, work tools and other platforms over the past 12 months aimed at helping consumers take the minimum number of steps necessary to accomplish the things they’re doing online - from researching, to comparing, to doing the research. By and large, Google’s product vision has focused on finding new methods that integrate AI functionality seamlessly within existing workflows, rather than requiring users to manually hunt around other tabs to perform or gather certain information through text-based requests.
And through Select from Screen, Chrome browser users are gaining a tool for interacting with the latest iteration of Gemini that uses visual input instead of the traditional text input to guide it.
As smart assistant technologies become woven more prominently into our lives, features such as those above could become even more central to the way we navigate the internet.
1. What is Google’s Select from Screen feature in Gemini?
Select from Screen is a new Chrome feature that allows users to highlight a portion of a webpage and send it directly to Gemini for analysis or assistance.
2. Which Chrome version includes Select from Screen?
Google says the feature is rolling out with Chrome version 149.
3. How is Select from Screen different from a normal Gemini prompt?
Instead of manually describing content, users can directly select part of a webpage and provide Gemini with visual context for more accurate responses.
4. What are some practical uses for the feature?
Users can compare products, understand diagrams, get design suggestions, analyse webpage content, and seek recommendations based on selected on-screen information.
5. Do users need to update Chrome to access the feature?
Yes. The feature is associated with Chrome version 149, and some users may need to update or restart the browser before it becomes available.
- Google is introducing a new Gemini in Chrome feature called Select from Screen
- Users can highlight any part of a webpage and send it directly to Gemini
- The feature is rolling out with Chrome version 149
- It can be used for product comparisons, diagram explanations, design suggestions, and more
- The tool aims to reduce manual typing and speed up AI-assisted searches
Google brings screen-based AI search to Chrome
Instead, the feature lets them directly highlight the content they want help with and submit it as part of a Gemini prompt. Whether it is a product image, a chart, a diagram, or a specific section of a webpage, Gemini can use that selected content as context when generating responses.
The move mirrors the experience offered by Circle to Search on smartphones, where users can circle or highlight objects on screen to initiate a search. Google appears to be bringing a similar workflow to desktop users through Chrome.
How the Select from Screen feature works
Once activated, users can enter selection mode and highlight specific portions of a webpage. The selected area is then attached to a Gemini query, allowing the AI assistant to analyse and respond based on the chosen content.
The process is designed to be straightforward and requires only a few steps. Users can select exactly what they want Gemini to focus on, making queries more precise and reducing the need for lengthy explanations.
The selected area can also be resized or repositioned before submission, offering greater flexibility when choosing content from a webpage.
What users can do with Select from Screen
An online shopper can take a snippet of text regarding multiple products found on an online shopping page and ask Gemini to suggest what best fits them. Anyone researching the best running shoes can select and paste multiple sneakers to get Gemini’s thoughts on which ones suit one’s style of running.
Students or professionals can cut out portions of complex diagrams on a page to have Gemini simplify and explain what exactly the diagrams represent. - The feature can also come in handy in design and creation work as users select some of the designs found on a page and ask for improvements or redesign tips from the AI. - Lastly, the company adds that the feature can be leveraged to move the needle on concepts, as one can highlight
A step toward more visual AI interactions
Traditional search often requires users to describe what they see before receiving relevant results. With this new feature, Gemini can directly analyse selected visual content, reducing friction between the user and the AI assistant.
This approach could prove especially useful when dealing with images, layouts, product listings, diagrams, or other content that may be difficult to describe accurately through text alone.
By allowing Gemini to “see” what users are referring to, Google is aiming to make interactions more natural and efficient.
How to use the feature
- Open Chrome on your computer
- Click Ask Gemini at the top of the browser
- Click the Add menu using the plus (+) icon
- Select Select from Screen
- Draw a box around the part of the webpage you want Gemini to analyse
- Enter your question or request
- Press Esc to exit selection mode
Available with Chrome version 149
Users who already have the latest version installed may need to restart their browser before the option becomes visible. Those unsure about their Chrome version can check by opening the browser’s settings menu and navigating to About Chrome.
Because the rollout appears to be phased, availability may vary across users and regions initially.
Part of Google’s broader AI strategy
And through Select from Screen, Chrome browser users are gaining a tool for interacting with the latest iteration of Gemini that uses visual input instead of the traditional text input to guide it.
As smart assistant technologies become woven more prominently into our lives, features such as those above could become even more central to the way we navigate the internet.
Frequently Asked Questions
Select from Screen is a new Chrome feature that allows users to highlight a portion of a webpage and send it directly to Gemini for analysis or assistance.
2. Which Chrome version includes Select from Screen?
Google says the feature is rolling out with Chrome version 149.
3. How is Select from Screen different from a normal Gemini prompt?
Instead of manually describing content, users can directly select part of a webpage and provide Gemini with visual context for more accurate responses.
4. What are some practical uses for the feature?
Users can compare products, understand diagrams, get design suggestions, analyse webpage content, and seek recommendations based on selected on-screen information.
5. Do users need to update Chrome to access the feature?
Yes. The feature is associated with Chrome version 149, and some users may need to update or restart the browser before it becomes available.