- Microsoft is rolling out Vision feature to Copilot Plus subscribers
- Vision allows AI to see what's on the screen for Edge browser users
- AI offers contextual advice for shopping, travel planning and other activities.
Microsoft's slow progress on the Vision feature for the Copilot AI assistant is finally over, at least if you subscribe to Copilot Pro. Microsoft AI CEO Mustafa Suleyman announced the launch in a post on X (formerly Twitter). CoPilot Vision essentially allows the AI assistant to see your screen and is integrated into the Microsoft Edge browser.
With your permission, Copilot Vision may analyze the website you are viewing and offer suggestions, ideas or explanations in real time. It's like having a second pair of eyes; Only these are powered by AI and are ready to give you useful information when you need them. Instead of getting lost in a sea of texts or struggling to find what you need, you can ask Vision for help.
Vision can help you plan a trip to a restaurant or movie theater, highlighting information about tickets, menus, and anything else. Are you trying to get some Christmas shopping done? Vision can scan the page and pinpoint products that match your style or budget.
Something special is coming this holiday season 🎁 Starting today, Vision is rolling out to our US Copilot Pro subscribers on Windows, so if that includes you, keep your eyes peeled on Edge! And if you still have some Christmas sweater shopping to do… https://t.co/6nNXD8pw4FDecember 19, 2024
Vision and visuals
Copilot Vision does not work universally, not even for Pro subscribers. The AI can only “see” some websites. But, as many third-party publishers are helping Microsoft figure out how to make the feature even more useful, its availability is likely to expand quickly.
This type of AI-assisted navigation is not completely new. Other browsers like Google Chrome and Opera have been exploring similar features. Google's generative search experience delivers AI-generated summaries directly into search results, while Opera's Aria helps you while you navigate. But Microsoft's vision seems a little more personal, like having an intelligent assistant that actually understands what you're looking at and helps you in real time.
you may also like
