• Copilot Vision allows users to analyze and interact with text and images on websites through Microsoft Edge.
  • Copilot Voice, now available in select English-speaking countries, lets users interact with Copilot via voice commands, with spoken responses.

Microsoft has introduced new capabilities for its Copilot AI, making it more accessible across platforms and more intuitive for users. The latest update includes tools that enable Copilot to understand what's on a user's screen, think through complex problems, and speak aloud. Available on iOS, Android, Windows, and the web, Copilot now boasts a more distinct, warm style. It has also expanded to WhatsApp, where users can chat directly with the AI.

One key feature, Copilot Vision, can analyze text and images on websites via Microsoft Edge, helping users with tasks like furniture searches or recipe suggestions.

“Copilot Vision can help you search for furniture, find the right color palette, and suggest ways of arranging what you’re looking at,” Microsoft said.

It emphasizes privacy, claiming processed data isn’t stored or used for AI training.

Another feature, Think Deeper, allows Copilot to work through more complex problems using advanced reasoning models.

“Think Deeper can help with anything from solving tough math problems to weighing up the costs of managing home projects,” Microsoft explained.

Additionally, Copilot Voice now lets users interact via voice commands, with responses spoken aloud. Available in select English-speaking countries, this feature aims to enhance natural, real-time conversations with AI.

Microsoft is also introducing personalization, allowing Copilot to tailor its responses based on user interactions across Microsoft apps. While the EU rollout is delayed due to regulatory concerns, users in other regions can start seeing this feature soon.


Edited by Harshajit Sarmah

ALSO READ:

Microsoft Renames Bing Chat to Copilot, Expands Enterprise Features
* Microsoft rebrands Bing Chat to Copilot for a unified consumer and corporate experience. * Copilot in Bing introduces commercial data protection for user privacy in enterprise settings. * Copilot is now available across Windows, Microsoft.com, and Bing, expanding accessibility and licensing options. Microsoft announces the rebranding of Bing Chat to Copilot