Microsoft starts testing Copilot Vision update that can ‘see’ your screen and apps


Microsoft has started testing a new update to its Copilot app on Windows that will let you share your screen or apps with the AI assistant. Copilot Vision was originally limited to Microsoft’s Edge browser, but it’s now extending to any app on your PC.
Copilot Vision will be able to do things like coach you through using Adobe Photoshop features, or analyze the photos and webpages you’re looking at. I got to see an early version of Copilot Vision on Windows at Microsoft’s 50th anniversary party last week, where the AI assistant guided me through a game of Minecraft and helped to optimize settings in Microsoft’s Clipchamp video editor.
I haven’t been able to fully test Copilot Vision on Windows through the Insider beta because Microsoft is limiting the experience to US testers only. Copilot will be able to highlight parts of your screen to guide you through apps, although this initial beta version won’t have the feature enabled just yet. Copilot Vision might sound similar to Microsoft’s Recall feature that automatically takes snapshots if you allow it, but it’s actually more like screen sharing an app or your entire desktop in a Microsoft Teams call.
Microsoft has also started testing file search in Copilot on Windows, allowing you to ask the AI assistant about the contents of a file on your PC. File search supports .docx, .xlsx, .pptx, .txt, .pdf, .json files, and you can use Copilot to easily find the documents you were working on recently.
Both of these Copilot features just require the Copilot app on Windows, and not a full Copilot Plus PC. You can also use Copilot Vision on iOS and Android. Microsoft has started testing these new Copilot features with Windows Insiders, ahead of a broader rollout to all Windows 11 users in the coming weeks or months.
Microsoft has started testing a new update to its Copilot app on Windows that will let you share your screen or apps with the AI assistant. Copilot Vision was originally limited to Microsoft’s Edge browser, but it’s now extending to any app on your PC. Copilot Vision will be able…
Recent Posts
- The hidden complexities of AI employees
- Microsoft starts testing Copilot Vision update that can ‘see’ your screen and apps
- Trump’s tariffs are officially in effect, including 104 percent on China
- We now have midrange GPUs launching at almost $1000 – PowerColor takes the Radeon RX 9070 XT to an absurd price point, and it’s an ill omen of times to come
- Top TurboTax Discount Codes & Coupons April 2025
Archives
- April 2025
- March 2025
- February 2025
- January 2025
- December 2024
- November 2024
- October 2024
- September 2024
- August 2024
- July 2024
- June 2024
- May 2024
- April 2024
- March 2024
- February 2024
- January 2024
- December 2023
- November 2023
- October 2023
- September 2023
- August 2023
- July 2023
- June 2023
- May 2023
- April 2023
- March 2023
- February 2023
- January 2023
- December 2022
- November 2022
- October 2022
- September 2022
- August 2022
- July 2022
- June 2022
- May 2022
- April 2022
- March 2022
- February 2022
- January 2022
- December 2021
- November 2021
- October 2021
- September 2021
- August 2021
- July 2021
- June 2021
- May 2021
- April 2021
- March 2021
- February 2021
- January 2021
- December 2020
- November 2020
- October 2020
- September 2020
- August 2020
- July 2020
- June 2020
- May 2020
- April 2020
- March 2020
- February 2020
- January 2020
- December 2019
- November 2019
- September 2018
- October 2017
- December 2011
- August 2010