Microsoft’s new and experimental Copilot features let AI analyze your files

Microsoft is expanding its ongoing effort to make Windows 11 an AI-centric operating system (OS) with several Copilot upgrades, including new Voice and Vision modes, and several experimental new features.

First, Microsoft wants to add a “Hey Copilot” wake word to Windows 11 devices. Users can turn on the wake word in the Copilot app. Once on, users can say “Hey Copilot” to start a conversation with Copilot Voice. When finished, exit the experience by clicking the ‘X’ to close Copilot, or just say “goodbye.”

Next, Microsoft says it will make Copilot Vision available in all markets where Copilot is offered. Vision allows Copilot to view content on your screen. For example, users can share their desktop or applications so Copilot can analyze content, provide relevant insights and more.

Image credit: Microsoft

This extends to apps as well, such as Microsoft’s Office apps, allowing Copilot to analyze your documents or help review a PowerPoint slide deck.

Another part of Vision is a feature called ‘Highlights.’ With Highlights, users can ask Copilot for help doing tasks, and the AI can show users where to click and how to complete the task.

Finally, Microsoft will soon bring text-based Vision interactions to Windows Insiders, giving people another way to interact with Copilot Vision.

AI experiments like a new taskbar experience

Image credit: Microsoft

Speaking of Insiders, Microsoft is also bringing more experimental AI features to Windows Insiders and Copilot Labs. One of the new features Microsoft is testing is a new taskbar experience that puts ‘Ask Copilot’ directly into the taskbar.

There’s also a preview for Copilot Actions for local files, which can help users do things with the files on their PC. Examples Microsoft gave include sorting photos and extracting information from PDF files.

Microsoft said it will start with a narrow set of use cases while optimizing the performance of the model. As always, the company warns that the AI can make mistakes.

Next up is Copilot connectors that let users link external services into Copilot. This includes OneDrive and Outlook, but also Google services like Google Drive, Gmail, Google Calendar, and Google Contacts. Once users connect these services, Copilot can leverage personal information from those services in responses, allowing people to ask about calendar appointments, contact email addresses and more.

Another integration here is Copilot and Windows Settings, enabling users to ask Copilot to help them change PC settings, like turning on focus mode or dark mode. Weirdly, I thought this was already a feature — I’ve asked Copilot to turn on dark before, and it did! But when I tested it again while writing this story, it didn’t work. I’m not sure when this functionality got removed, but I guess it’s good that it’s coming back.

Microsoft announced a new generative AI agent called Manus. It utilizes the agentic platform capabilities of Windows, like Model Context Protocol (MCP), to complete tasks. The company claims Manus can complete complex tasks like building a website using documents stored in a photo on your PC. Manus is currently in private preview.

Wrapping up the experimental features, Windows Insiders with Copilot Plus PCs can use a new Zoom integration with Click to Do that lets them instantly schedule a Zoom meeting just by hovering over an email address.

Image credit: Microsoft

Finally, Microsoft highlighted the beta of Gaming Copilot (pictured above) available on the new ROG Xbox Ally and Ally X gaming handhelds. Gamers can access Gaming Copilot via button shortcuts to ask for help and recommendations without even leaving the game they’re in.

Some of the new features are already available, while many are restricted to Insider testers or private previews for now. Keep an eye on Microsoft’s Windows Insider Blog for updates on when new features will be available.