Microsoft Enhances Copilot Integration with Windows Highlights

Microsoft has announced the rollout of its Copilot Vision with Highlights feature for Windows, marking a significant step in the integration of artificial intelligence into everyday computing. Initially available only in the United States, the company plans to expand this innovative tool to other regions in the near future. Copilot Vision, which leverages computer vision to analyze on-screen content, aims to assist users with various queries, enhancing their productivity and user experience.

New Features of Copilot Vision on Windows

The Copilot Vision feature is now accessible on both Windows 10 and Windows 11 devices in the U.S. This expansion is part of Microsoft’s ongoing efforts to enhance its Copilot Labs initiative. The new Highlights feature allows users to interact with the AI in real-time, using voice commands to ask questions about the content displayed on their screens. This capability supports simultaneous interaction with up to two applications, enabling users to pose more complex inquiries. For instance, users can ask, โ€œWhich image from my gallery goes well with the story I’ve written in Word?โ€ This functionality is designed to streamline multitasking and improve overall efficiency.

Practical Applications of Copilot Vision

Microsoft has highlighted several practical applications for the Copilot Vision feature. Users can request assistance while playing games, seek tips for enhancing photo lighting, or ask for help in reviewing travel itineraries. The AI can guide users through various tasks by indicating where to click and how to navigate different options. This interactive support is intended to make technology more accessible and user-friendly, particularly for those who may not be as tech-savvy.

How to Use Copilot Vision

To utilize the Copilot Vision feature, users need to open the Copilot app and click on the new glasses icon located in the composer. From there, they can select the browser window or application they wish to share with the AI chatbot. Once the connection is established, the AI will begin assisting the user. If users wish to stop sharing their screen, they can easily do so by pressing the X button in the composer. Importantly, Microsoft has emphasized that participation in this feature is entirely opt-in, allowing users to choose when and how they engage with the AI.

For those interested in the latest technology updates, Microsoftโ€™s Copilot Vision represents a significant advancement in AI integration, promising to enhance user experience and productivity across various applications.


Observer Voice is the one stop site for National, International news, Sports, Editorโ€™s Choice, Art/culture contents, Quotes and much more. We also cover historical contents. Historical contents includes World History, Indian History, and what happened today. The website also covers Entertainment across the India and World.

Follow Us on Twitter, Instagram, Facebook, & LinkedIn

Back to top button