Microsoft brings Copilot Vision to Windows and mobile for AI help in the real world

Microsoft is bringing its Copilot Vision feature to Windows and mobile, moving it beyond the web. Copilot Vision was a big part of Microsoft’s Copilot redesign last year, but so far, it has been limited to Edge webpages to help guide you through what you’re seeing.

Copilot Vision will now be able to analyze real-time video from a mobile camera, allowing the AI assistant to offer tips for keeping plants healthy or decorating advice for your home. Microsoft is launching Copilot Vision inside the Copilot app for iOS and Android today, and a similar feature is also coming to Windows soon.

The Copilot app on Windows is being updated to support Copilot Vision across your entire PC. This lets Microsoft’s AI assistant do things like coach you through using Adobe Photoshop features, or analyzing the photos and webpages you’re looking at.

This is different than Microsoft’s Recall feature on Copilot Plus PCs. Recall automatically takes snapshots if you enable the feature, whereas Copilot Vision is more like screen sharing an app or your entire desktop in a Microsoft Teams call.

Copilot Vision on Windows will be available to Windows Insiders next week, and Microsoft says it will roll it out more broadly once testing is complete. The company is also updating Copilot with a host of new features today. The AI assistant now supports memory, personalization, web-based actions, podcast creation, deep research, and more. You can read about all of Copilot’s new features here.