Claude Code - AI coding with screen context

Claude Code is Anthropic’s official CLI for agentic coding. With Screenpipe integration, Claude can reference what you’ve been working on, recall information from your screen, and access meeting transcriptions.

Setup

claude mcp add screenpipe --transport stdio -- npx -y screenpipe-mcp

To make it available across all your projects:

claude mcp add screenpipe --transport stdio --scope user -- npx -y screenpipe-mcp

Verify connection

# list MCP servers
claude mcp list

# or inside Claude Code, use
/mcp

Available tools

Once connected, Claude Code has access to these tools:

Tool	Description
`search-content`	Search screen text (accessibility-first, OCR fallback), audio transcriptions, and input
`activity-summary`	Lightweight overview of app usage, speakers, and recent texts for a time range
`search-elements`	Search structured UI elements from the accessibility tree
`frame-context`	Full accessibility tree, URLs, and text for a specific frame
`list-meetings`	List detected meetings with duration, app, and attendees
`export-video`	Export screen recordings as MP4 for a time range

Usage examples

Ask Claude Code to use Screenpipe naturally:

> what was I looking at in my browser an hour ago?

> find mentions of "kubernetes" from my screen today

> show me audio transcriptions from my last meeting

> what code was I reading in VS Code yesterday about async?

> export a video of my screen from 2-3pm today

> what did I type in Slack today?

> show me my app usage stats for the past 2 hours

> what did I copy to clipboard recently?

> which apps did I switch between most today?

Search parameters

Search-content (vision + audio + input)

Parameter	Description
`q`	Search query (optional - omit to get all content)
`content_type`	`vision`, `audio`, `accessibility`, `input`, or `all` (default: `all`)
`limit`	Max results (default: 10)
`offset`	Pagination offset
`start_time`	ISO 8601 UTC start time
`end_time`	ISO 8601 UTC end time
`app_name`	Filter by app (e.g., “Chrome”, “Slack”)
`window_name`	Filter by window title
`include_frames`	Include base64 screenshots
`speaker_ids`	comma-separated speaker IDs for audio filtering
`speaker_name`	Filter audio by speaker name

Example workflows

Recall context from earlier:

> I was reading a blog post about rust async earlier today,
> search screenpipe and summarize the key points

Reference meeting discussion:

> search my audio transcriptions for what was discussed in standup
> about the API refactor, then help me implement it

Debug with screen history:

> I saw an error message flash on screen, search screenpipe
> to find it and help me fix the issue

Find code examples:

> search screenpipe for the python code I was looking at
> in the browser yesterday about asyncio patterns

Track what you typed:

> what did I write in Notion this morning? search for my
> keyboard input using content_type=input

Recall clipboard history:

> I copied something important earlier, search clipboard
> events to find it

Requirements

Screenpipe running on localhost:3030
Claude Code CLI installed
Node.js >= 18.0.0

Troubleshooting

AI agent crashed with “Error: AI agent crashed — restarting automatically…”? This happens when Claude Code can’t communicate with Screenpipe or Screenpipe encounters an error. Try these steps in order:

Check Screenpipe is running:
curl http://localhost:3030/health
you should see {"status":"healthy"}. If this fails, start Screenpipe first.
Verify MCP is connected:
claude mcp list
you should see screenpipe in the list with status “ready”.
Check Screenpipe has recorded data:
curl "http://localhost:3030/search?limit=1"
if empty, Screenpipe hasn’t recorded anything yet—let it run for a minute and try again.

Restart the MCP connection:

claude mcp remove screenpipe
claude mcp add screenpipe --transport stdio -- npx -y screenpipe-mcp

Check Screenpipe logs:
- macOS/Linux: ~/.screenpipe/screenpipe.log
- Windows: check event viewer or %APPDATA%\screenpipe\logs

MCP not connecting?

Verify Screenpipe is running: curl http://localhost:3030/health
Check MCP status in Claude Code: /mcp
Remove and re-add: claude mcp remove screenpipe && claude mcp add screenpipe --transport stdio -- npx -y screenpipe-mcp

Queries returning empty?

Check Screenpipe has data: curl "http://localhost:3030/search?limit=1"
Ensure screen recording permissions are granted
Verify the time range you’re querying

Permission errors?

macOS: check System Settings > Privacy & Security > Screen Recording
Ensure Screenpipe app is listed and enabled

Still stuck? ask in our Discord.

Get started

Recording and data

Scheduled tasks

Connect

Use cases

Personal and team knowledge

Workflow playbooks

Enterprise guides

Integrations

Reference

Deployment

Compare

Resources

Claude Code - AI coding with screen context

Setup

Verify connection

Available tools

Usage examples

Search parameters

Search-content (vision + audio + input)

Example workflows

Requirements

Troubleshooting

​Setup

​Verify connection

​Available tools

​Usage examples

​Search parameters

​Search-content (vision + audio + input)

​Example workflows

​Requirements

​Troubleshooting

Setup

Verify connection

Available tools

Usage examples

Search parameters

Search-content (vision + audio + input)

Example workflows

Requirements

Troubleshooting