setup
Gemini CLI uses MCP for external tools. add screenpipe to your settings file (~/.gemini/settings.json):
usage
once configured, Gemini can search your screen history:available tools
screenpipe provides these MCP tools to Gemini:| tool | description |
|---|---|
search-content | search screen text (accessibility-first, OCR fallback), audio transcriptions, and input |
activity-summary | lightweight overview of app usage, speakers, and recent texts for a time range |
search-elements | search structured UI elements from the accessibility tree |
frame-context | full accessibility tree, URLs, and text for a specific frame |
list-meetings | list detected meetings with duration, app, and attendees |
export-video | export screen recordings as MP4 for a time range |
example workflows
context-aware coding:requirements
- screenpipe running on localhost:3030
- Gemini CLI installed
- Node.js >= 18.0.0
troubleshooting
MCP server not connecting?-
verify screenpipe is running:
you should see
{"status":"healthy"}. if this fails, start screenpipe first. -
check the settings file path:
the config should be in
~/.gemini/settings.json. verify the file exists and contains valid JSON: - restart Gemini CLI: after adding or modifying the config, fully restart Gemini CLI. if it was running in a terminal, exit and reopen it.
- make sure screenpipe has recorded data:
curl "http://localhost:3030/search?limit=1" - if empty, let screenpipe run for a minute and try again
- check screen recording is enabled (macOS: System Settings > Privacy & Security > Screen Recording)