Windows Desktop

Windows desktop control presets via computer_use helpers.

Skill metadata

Source	Bundled (installed by default)
Path	skills/computer-use/windows-desktop
Version	1.0.0
Author	VibeOS
License	MIT
Platforms	windows
Tags	windows, desktop, computer-use, uia, clipboard
Related skills	computer-use, choose-interaction-surface

Reference: full SKILL.md

info

The following is the complete skill definition that VibeOS loads when this skill is triggered. This is what the agent sees as instructions when the skill is active.

Windows Desktop Preset

Safe patterns for driving Windows apps with computer_use (UIA / SoM). Prefer element refs over blind coordinates.

When to Use

• User asks to control Explorer, Notepad, Edge, or other Win32/UWP apps
• Copy/paste between apps after generating text
• Focus an app before typing

Prerequisites

• computer_use toolset enabled (vibeos computer-use doctor)
• Windows UI Automation available to the VibeOS / terminal process
• Prefer MCP (GitHub, Notion, Obsidian) when the task is API-shaped

How to Run

1. Capture UI: computer_use with action=capture, mode=som (or ax/uia).
2. Act on element ids from the capture (click / type / set_value).
3. Clipboard via PowerShell when needed:

Set-Clipboard -Value 'hello'
Get-Clipboard

Quick Reference

Goal	Approach
See UI	computer_use capture som/uia
Click / type	computer_use with element ref
Clipboard	Set-Clipboard / Get-Clipboard
File ops	Prefer terminal + file tools over Explorer GUI

Procedure

1. Ask which app to control if unclear.
2. Capture before acting; never spam clicks.
3. Re-capture after important actions.
4. Stop and ask if UIA permissions / elevation block the target.

Pitfalls

• Do not click through UAC or approve security prompts without the user.
• Avoid banking / password managers unless explicitly requested.
• Elevated apps may be invisible to a non-elevated VibeOS process.

Verification

• Capture shows the expected app foreground.
• Requested text appears in the target field or clipboard paste matches.