Microsoft followed at least a part of my desire list for his Copilot event when he announced that Copilot Vision will be integrated in Windows 11 and the mobile application.
Copilot Vision will allow AI to really see what is on its screen and in the world around you. Microsoft played for the first time with the idea on the edge, where the co -pilot could take a look at the browser and offer help. But now it goes throughout the system, through applications, websites and even what the chamber of your smartphone shows on your screen.
The idea is to offer a proactive AI assistant who can scan an Excel sheet, summarize a PDF, suggest how to adjust its configuration or identify the wild berry that is not safe is edible or poisonous.
The appeal is obvious, even compared to tools with similar characteristics such as Chatgpt and Gemini. These tools can be excellent in a laptop desk or computer, but they do not have the luxury of being built directly in their operating system.
Copilot has a starting field advantage in Windows 11. Vision takes advantage of that advantage. You don't have to wait a warning; You can see what you are doing and offer relevant help for the context.
COPILOT VISION CAUTION
Microsoft clearly anticipates some concern about the expansion of Copilot Vision as a function of how anxious the company is to highlight the aspects of privacy of the function. Microsoft says that Copilot Vision only works when it gives access. Even so, the rarity of privacy cannot be denied. The digital equivalent of someone who looks above the shoulder sounds spooky out of context.
Of course, it is not as if we had not been delivering data stripes to the cloud to obtain slightly better movie recommendations or similar benefits. But I can understand why letting your screen literally read while you do the same could feel intimate in a disconcerting way.
Control and trust can make a difference in the success of Copilot Vision. If Microsoft begins to make Co -Vision predetermine or hide the permission configuration in a deeply buried system menu, more people could move away from the co -pilot completely and resort to another option with the same skills, but with the user who controls it more.
I still believe that it will be a really useful addition to co -pilot, especially in the mobile co -ilot application surprisingly well designed. You will want to monitor the permits it gives and when the vision of co -pilot is activated. I would encourage you to try it, but keep your eyes open when IA is doing the same.