Macos App Playbooks

Finder, Notes, Mail, and Preview via computer_use.

Skill metadata

Source	Bundled (installed by default)
Path	skills/desktop/macos-app-playbooks
Version	1.0.0
Author	VibeOS
License	MIT
Platforms	macos
Tags	macos, desktop, computer-use, finder, notes, mail, preview
Related skills	macos-desktop, choose-interaction-surface, computer-use

Reference: full SKILL.md

信息

The following is the complete skill definition that VibeOS loads when this skill is triggered. This is what the agent sees as instructions when the skill is active.

macOS App Playbooks

Repeatable GUI procedures for common Mac apps. Use computer_use after choose-interaction-surface says native GUI is correct. Prefer MCP/API when available (Mail via IMAP skill, notes via Obsidian MCP, etc.).

When to Use

• Open or organize files in Finder without shell paths alone
• Draft or paste into Notes
• Prepare a Mail compose window (user sends)
• Open/export a PDF or image in Preview (light Operate tasks)

Prerequisites

• Accessibility permission for VibeOS / Terminal
• computer_use enabled; load macos-desktop for capture basics

How to Run

1. Confirm surface: native Mac app → computer_use.
2. Capture with mode=som (or ax), then click by element index.
3. Re-capture after each navigation.

Quick Reference

App	Typical first capture target
Finder	Sidebar / toolbar / column view
Notes	Note list + editor
Mail	Mailbox list + Compose
Preview	Toolbar / sidebar thumbnails

Procedure

Finder — open a folder

1. computer_use capture app="Finder" (bring Finder frontmost if needed).
2. Use Go → Go to Folder… when the path is known (Cmd+Shift+G), type path, confirm.
3. Otherwise navigate sidebar → folders via element clicks; re-capture each level.
4. For file copy/move of known paths, prefer terminal / file tools instead.

Notes — paste a draft

1. Capture Notes; click New Note if needed.
2. Click the editor body element; type or paste (clipboard helpers OK).
3. Do not force-sync iCloud; leave title as Notes auto-generates unless asked.

Mail — prepare compose (do not send unless asked)

1. Capture Mail; click Compose / New Message.
2. Fill To / Subject / body via element refs.
3. Stop before Send unless the user explicitly said to send.

Preview — open and export

1. Prefer opening a known path via Finder or open <path> in terminal, then capture Preview.
2. For Export/Save as PDF/PNG: File menu → Export…; re-capture the sheet; choose format; set destination under the task workspace when possible.
3. Markup/annotate only when asked; do not overwrite the original without human approve.
4. If a11y tree is empty, re-capture once; after two stuck tries escalate (desktop-operate scorecard).

Pitfalls

• Do not approve TCC / keychain dialogs for the user.
• Mail Send is irreversible — confirm wording first.
• Full-screen Spaces can hide the target window; capture again after focus.
• Web CAPTCHA in Chrome/Safari: use browser_* + challenge-gate, not computer_use clicks on the puzzle.

Verification

• Finder shows the requested folder contents.
• Notes contains the drafted text.
• Mail compose fields match the request and Send was not pressed unless asked.