Let an AI agent inspect and control a Hyprland Wayland desktop for automated GUI tasks.
Have an agent read window state and click named controls without relying only on screenshots.
Automate multi-step desktop workflows like launching apps and waiting for window events.
| ilyaskhallouki/hypruse | aclark4life/home-depot-crawl | aetheria-labs1/storefront-skills | |
|---|---|---|---|
| Stars | 6 | 6 | 6 |
| Language | Python | Python | Python |
| Last pushed | — | 2014-08-10 | — |
| Maintenance | — | Dormant | — |
| Setup difficulty | moderate | moderate | easy |
| Complexity | 4/5 | 2/5 | 3/5 |
| Audience | developer | developer | pm founder |
Figures from each repo's GitHub metadata at analysis time.
Requires a Hyprland/Wayland Linux desktop, some tools need optional ImageMagick or wl-clipboard installed.
Hypruse gives an AI agent the ability to actually control a Linux desktop that runs Hyprland, a window manager for the Wayland display system. In plain terms, it lets an AI see your workspaces and open windows, take screenshots, move the mouse, click things, and type text, similar to what companies like Anthropic and Microsoft offer for macOS and Windows through their own computer use features. On Linux, and specifically on Wayland based setups, this kind of capability has been mostly missing, and the few existing attempts often rely on workarounds requiring root access or special permissions. Hypruse works differently by connecting directly to features Hyprland already provides. It follows what the README calls a semantic first approach: instead of only taking screenshots and guessing where things are on screen, it can ask the desktop directly for a structured list of open windows, their titles, and their positions, the same way switching windows normally works, just done programmatically and instantly. When visual information is genuinely needed, it can take screenshots of a whole monitor, a specific window, or a zoomed in region. For actually interacting with the desktop, mouse clicks and scrolling are sent through Wayland's own input system, and typing goes through a tool called wtype that supports proper keyboard layouts and special characters. The project exposes a defined list of tools an agent can call, including getting the desktop state, taking screenshots, reading accessible on screen controls by name, clicking those controls directly, running keyboard shortcuts, launching applications, and waiting for specific desktop events like a window opening or closing. Under the hood, this is an MCP server, meaning it is designed to plug into AI agent systems like Claude Code that support the Model Context Protocol standard. Some advanced features depend on optional external programs being installed, such as ImageMagick for drawing numbered overlays on screenshots. The project's own documentation includes a written explanation of its architecture and a document specifically addressing potential security concerns of giving an agent this level of control.
Hypruse is an MCP server that gives AI agents real control over a Hyprland Wayland desktop: window management, screenshots, mouse, and keyboard, without root or portals.
Mainly Python. The stack also includes Python, MCP, Hyprland.
No license information is stated in the README.
Setup difficulty is rated moderate, with roughly 1h+ to a first successful run.
Mainly developer.
This repo across BitVibe Labs
Verify against the repo before relying on details.