The PC is on the verge of a significant \u00a0transformation\u00a0 that diverges from its traditional role. Microsoft has been working towards this shift, emphasizing that the fundamental component of this evolution will be \u00a0AI\u00a0, particularly \u00a0Copilot\u00a0. This new \u00a0AI-driven approach\u00a0 aims to enhance user interaction, making the experience more fluid and intuitive.<\/p>\n
The \u00a0integration of Copilot\u00a0 into PCs and Windows 11 has been gradual, yet Microsoft intends to accelerate this change. They believe this transition will revolutionize \u00a0how we interact with our PCs\u00a0 and redefine our work habits\u2014significantly reducing the amount of time we spend \u00a0manipulating devices\u00a0 directly.<\/p>\n
The \u00a0mouse\u00a0 and \u00a0keyboard\u00a0 have been fundamental tools for interacting with computers for decades. However, Microsoft recognizes that this paradigm is shifting. Instead of relying solely on these traditional input devices, \u00a0voice interaction\u00a0 is becoming increasingly prevalent. According to Microsoft, PCs must evolve to achieve three key objectives:<\/p>\n
To support this initiative, Microsoft has introduced the feature that allows users to start a conversation with their PC simply by saying \u00a0“Hey, Copilot.”\u00a0 This voice command, when activated in the Copilot settings, presents an on-screen microphone icon and a sound alert, making it easy for users to engage with their PCs.<\/p>\n
The second component of this interaction comes from \u00a0Copilot Vision\u00a0, a feature that enables the AI to view the desktop and applications as the user does. Announced in previous updates, this capability is set to launch globally wherever Copilot is available. Copilot Vision is designed to assist users by answering queries based on the visible screen content, implementing a concept similar to what OpenAI’s Operator and Anthropic\u2019s Computer Use have proposed.<\/p>\n
Moreover, users can utilize the \u00a0Highlights\u00a0 feature, prompting Copilot with requests such as \u00a0“teach me how to do this in this app.”\u00a0 This functionality extends to popular applications like Word, Excel, and PowerPoint, allowing Copilot to enhance user experience by writing or analyzing tasks.<\/p>\n
While voice input remains central, Microsoft plans to include a chat window option for users who prefer typing their commands. This flexibility is indicative of Microsoft’s ambition to establish Copilot as the core of the user experience within Windows 11. Evidence of this ambition is also present in the new \u00a0“Ask Copilot”\u00a0 button on the taskbar, envisioned as a \u00a0dynamic hub\u00a0 for achieving more with minimal effort. This feature requires proactive activation in the Windows settings.<\/p>\n
Another promising feature on the horizon is \u00a0Copilot Actions\u00a0, where the AI can take control of \u00a0browser activities\u00a0 and manage applications on the computer to fulfill user tasks. Microsoft describes Copilot Actions as an \u00a0AI agent\u00a0 capable of executing tasks by interacting with various applications and files, mimicking human behavior. Users can expect this capability to become fully operational across all desktop applications, shifting Copilot from a passive assistant to a \u00a0proactive aide.\u00a0 Tasks that Copilot will handle include updating documents, organizing files, sending emails, or even booking flights.<\/p>\n
To utilize Copilot Actions, users need to grant permission for the AI agent to access their applications and data. This requirement does raise concerns regarding data security, particularly regarding potential mistakes or improper data handling by the AI. To mitigate these concerns, Microsoft employs rigorous security measures. Each agent operates within a \u00a0contained workspace\u00a0, ensuring limited access to sensitive information. Additionally, agents start their activities with restricted permissions and can only access extra resources upon user approval.<\/p>\n
In the preview version of Copilot Actions, the AI can access specific directories like Documents, Downloads, Desktop, or Pictures, thereby enhancing user collaboration while ensuring privacy. Furthermore, agents must be “signed” by trusted sources, similar to how applications are distributed through renowned app stores. Microsoft\u2019s aspirational goals are commendable; however, users in Spain and the European Union may currently find many Copilot features unavailable. Efforts are underway to clarify these limitations with Microsoft representatives.<\/p>\n