Windows adding new AI features to Copilot+ PCs including Recall, Magic Eraser copy in Paint, more

Ben Schoon | Oct 1 2024 - 9:15 am PT

Microsoft has just made a host of big Copilot announcements including new AI features for Windows, updated branding and designs, and more.

Starting with Copilot itself, Microsoft has outlined the “next phase” of Copilot which includes an updated design and some new features. “Copilot Voice” is a new experience on mobile devices which works similar to Google’s Gemini Live. Similarly, “Copilot Daily” offers a summary of news and weather using the same voice as “Voice” and pulls from “authorized content sources” while “Personalized Discover” will help be a guide to Copilot features.

“Copilot Vision” will be able to use what you see on your computer’s screen and help you understand what you’re looking at and let you ask questions. Within Microsoft Edge, you’ll also be able to type “@copilot” into the address bar to start using the AI, exactly like you can do with Gemini in Chrome.

On Windows in particular, Microsoft is also starting to leverage AI in more ways, specifically on its new Copilot+ PCs. Including laptops powered by Qualcomm’s Snapdragon X Elite and X Plus chips, Microsoft will launch five new features, starting with the long-awaited rollout of Recall. The feature, which will be launching in “Preview,” was pulled from launch due to privacy concerns, but is now set to launch with new security measures in place.

Microsoft explains:

Following the announcement in May, we listened to our community emphasizing the need for additional default security layers. We have taken the time to make Recall even more secure by default, ensuring our customers feel confident that their data is safe and secure, right from the start. Customers will now have the choice to opt-in to saving snapshots and if they do opt-in, they will use Windows Hello to confirm presence and securely unlock the Recall experience.

Recall will be available starting this month on Snapdragon PCs and will come with Intel and AMD-powered Copilot+ PCs starting in November, but for now this will only apply to Windows Insiders. Broad availability has no specific date in mind just yet.

Other new features coming include “Click to Do,” a feature that uses AI to put actions you might want to do within the right-click menu, changing those options depending on the context. AI will also be enhancing Windows search to be able to do things such as recognize content in photos, while the photo editor in Windows will also be getting the ability to boost the resolution of a photo using AI (up to 8x its original resolution).

Finally, Paint will be getting generative fill for erasing objects from photos, just like Google’s Magic Eraser feature.