Microsoft Copilot is getting smarter by the day. The Satya Nadella-led company has just announced that its AI assistant now has ‘vision’ capabilities that enable it to browse the internet with users. Source. VentureBeat.
At its annual Ignite conference for IT professionals, Microsoft announced several new AI developments across its 365 ecosystem of software. Most notably, the tech giant unveiled a new lineup of AI agents, capable of taking actions, gathering intelligence, and assisting with work. Consumers will be able to use Microsoft’s ready-made agents or customize their own. INC.
Key features and capabilities of Copilot Vision include:
- Real-time webpage analysis: Copilot Vision can scan, analyze, and offer insights based on the content visible on the user’s screen.
- Interactive assistance: Users can ask questions about text, images, and other content on the page, receiving contextual support.
- Task-specific help: The AI can assist with various tasks such as holiday shopping, travel planning, and even gameplay assistance.
- Integration with Microsoft Edge: Copilot Vision is exclusively available through the Microsoft Edge browser.
- Privacy considerations: Microsoft emphasizes that Copilot Vision operates on an opt-in basis and deletes session data after use.
- Limited website compatibility: Initially, the feature will work with a select number of pre-approved websites.
Potential applications of Copilot Vision include:
- Enhancing online shopping experiences by highlighting relevant products
- Assisting with research and information gathering for academic or professional purposes.
- Providing real-time translations and summaries of web content
- Offering personalized recommendations based on user preferences and browsing history.
While Copilot Vision shows promise in streamlining web browsing and decision-making processes, it’s still in its early stages. Microsoft plans to expand its capabilities and website compatibility based on user feedback.
