Pantheon Vision: Visual Inspection and Multimodal Debugging¶
🇧🇷 Versão em Português disponível: Leia em Português
Pantheon Vision connects multimodal vision models to OpenCode, allowing you to paste screenshots, mockups, and UI layouts directly into chat for effortless implementation, debugging, and inspection.
1. Everyday Workflow¶
To inspect or refine an interface:
1. Capture a screenshot of the target screen, component, or visual bug.
2. In OpenCode (TUI or Desktop), paste the image from clipboard (Ctrl+V / Cmd+V).
3. Type your instructions naturally:
Adjust this layout: build a responsive sidebar navigation matching these metrics
2. Zero Prompt Clutter (Clean Architecture)¶
In legacy versions, pasting an image injected raw comment blocks and temporary file paths directly into your message text:
<!-- pantheon-visual-context -->
[Visual] "clipboard" at "/tmp/pantheon-vision/6ef92982...png" · Q: '...' · relay session_id=...
In modern Pantheon:
* Your message remains clean: The chat only shows the text you typed.
* Silent Context Injection: Image references and metadata are injected directly through the session.context (system) hook. The agent receives full visual context behind the scenes without polluting chat history.
flowchart TD
User(["👤 Developer"]) -->|"Pastes Screenshot (Ctrl+V)"| OpenCode["🖥️ OpenCode Interface"]
OpenCode -->|"Plugin session.context hook"| VisionHook["👁️ Pantheon Vision Subsystem"]
VisionHook --> ModelCheck{"Active Model supports Vision?"}
ModelCheck -->|Yes| NativePass["Pass image directly to model via multimodal API"]
ModelCheck -->|Text-only| FallbackServer["Invoke pantheon_vision MCP (describeImagesNative)"]
FallbackServer --> StructuralDesc["Extract Layout, Text, Colors, and WCAG Metrics"]
StructuralDesc --> SystemContext["Inject Structural Description into System Context"]
NativePass --> SystemContext
SystemContext --> Agent["🎨 @aphrodite (Frontend) / ⚡ @zeus"]
Agent --> Implementation["Implement clean, accessible code with Zero Chat Pollution"]
3. Automatic Fallback for Text-Only Models¶
If your active chat model does not natively support multimodal vision:
* Pantheon does not fail or throw an unsupported model error.
* Pantheon automatically delegates image inspection to the configured vision server (describeImagesNative / Zen Go), extracting layout structure, visible text, buttons, numbers, and color palettes.
* The text model receives this high-fidelity description and implements the requested change seamlessly.
4. Configuring Your Vision Model¶
You can configure which model handles visual inspection:
Option A — Through the TUI¶
- Open the TUI with
pantheon tui. - Go to the Settings tab ➔ Preset sub-tab.
- Select Vision Model (
preset.vision_model). - Choose from supported providers (e.g.,
gemini-2.5-flash,qwen3.7-vl,claude-3-5-sonnet).
Option B — Via CLI¶
Configure the vision model directly from your terminal:
# List available vision-capable models
npx pantheon-opencode vision --list
# Set project-scoped vision model
npx pantheon-opencode vision --set opencode-go/gemini-2.5-flash
# Set globally for all projects
npx pantheon-opencode vision --global --set opencode-go/gemini-2.5-flash
Settings are persisted in .opencode/opencode-vision.json.