Touchpoint

Give your AI agent eyes and hands on any desktop.

pip install touchpoint-py

AI agent researches data in Chrome, then creates a formatted Excel table — full task completed in ~12 minutes

Touchpoint is a cross-platform Python library for reading and interacting with desktop UI through native accessibility APIs. One import, one API — works on Linux, macOS, and Windows, with built-in support for Chromium and Electron apps via CDP (Chrome DevTools Protocol).

Instead of scraping pixels or running vision models, Touchpoint reads the real accessibility tree — structured names, roles, states, and positions for every element on screen. Fast and reliable, with no vision model required. Ships with an MCP server so LLM agents like Claude, Cursor, or any local model can control any desktop app out of the box.

import touchpoint as tp

elements = tp.find("Send", role=tp.Role.BUTTON, app="Slack")
tp.click(elements[0])

Why Touchpoint?

Table of Contents

• Table of Contents
• Install
  • Platform requirements
• Quick Start
  • Element IDs
  • Output formats
• MCP Server
  • Tools
  • Client setup
  • Environment variables
• Browser & Electron Apps (CDP)
  • Setup
• API Reference
  • Discovery
  • Search & Wait
  • Actions
  • Input
  • Screenshot & Config
• Architecture
• Configuration
• Development
• Status
  • Known limitations
• License

Install

Requires Python 3.10+.

pip install touchpoint-py

Everything is included: your platform's native backend, CDP support for browsers and Electron apps, the MCP server, and screenshot capabilities. Platform-specific dependencies are installed automatically via pip environment markers.

Platform requirements

... View full README on GitHub