- Microsoft introduces the Vision feature for Copilot Plus subscribers
- Vision lets the AI see what’s on the screen for Edge browser users
- The AI provides contextual advice for shopping, planning trips and other activities
Microsoft’s slow tease of the Vision feature for the Copilot AI assistant is finally over, at least if you subscribe to Copilot Pro. Microsoft AI CEO Mustafa Suleyman announced the rollout in a post on X (formerly Twitter). CoPilot Vision essentially lets the AI assistant view your screen and is embedded in the Microsoft Edge browser.
With your permission, Copilot Vision may analyze the website you are viewing and provide real-time suggestions, insights or explanations. It’s like getting a second pair of eyes; only these are powered by AI and ready to come up with useful tidbits whenever you need them. Instead of getting lost in a sea of text or struggling to find what you need, ask Vision for help.
Vision can help plan a restaurant or cinema trip, highlighting ticket information, menus and everything else. Trying to do some holiday shopping? Vision can scan the page and point out products that fit your style or budget.
Something special is coming this holiday season 🎁 Starting today, Vision is rolling out to our US Copilot Pro subscribers on Windows, so if that’s you too, keep your eyes peeled in Edge! And if you’re still shopping for a Christmas sweater… https://t.co/6nNXD8pw4FDecember 19, 2024
Vision and images
Copilot Vision does not work universally, even for Pro subscribers. The AI can only ‘see’ some websites. But with many third-party publishers helping Microsoft figure out how to make the feature even more useful, its availability will likely expand soon.
This kind of AI-assisted browsing isn’t entirely new. Other browsers such as Google Chrome and Opera have explored similar features. Google’s Search Genative Experience provides AI-generated summaries right in your search results, while Opera’s Aria helps you as you browse. But Microsoft’s take feels a bit more personal, like having a smart assistant that actually understands what you’re looking at and helps you in real time.