AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
Config is the same across clients — only the file and path differ.
{
"mcpServers": {
"io-github-alex-on-ai-webreaper": {
"command": "<see-readme>",
"args": []
}
}
}Are you the author?
Add this badge to your README to show your security score and help users find safe servers.
AI-native web scraper. Single binary with a bundled Claude Code skill.
No automated test available for this server. Check the GitHub README for setup instructions.
Five weighted categories — click any category to see the underlying evidence.
No known CVEs.
No package registry to scan.
Be the first to review
Have you used this server?
Share your experience — it helps other developers decide.
Sign in to write a review.
Others in browser / writing
Browser automation with Puppeteer for web scraping and testing
🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.
Self-hosted URL- and file-to-Markdown service for humans and AI agents - web pages, documents, images, audio, YouTube. PWA + REST + MCP + Claude Code skill, Reddit-aware, refreshable share links.
The Apify MCP server enables your AI agents to extract data from social media, search engines, maps, e-commerce sites, or any other website using thousands of ready-made scrapers, crawlers, and automation tools available on the Apify Store.
MCP Security Weekly
Get CVE alerts and security updates for io.github.alex-on-ai/webreaper and similar servers.
Start a conversation
Ask a question, share a tip, or report an issue.
Sign in to join the discussion.

AI-native web scraper. Single binary with a bundled Claude Code skill.
Built by HighCraft.io.
macOS / Linux (Homebrew):
brew install alex-on-ai/webreaper/webreaper
Any POSIX shell (install.sh):
curl -fsSL https://raw.githubusercontent.com/alex-on-ai/WebReaper/master/scripts/install.sh | sh
.NET library:
dotnet add package WebReaper
Windows binaries are on the GitHub Releases page; winget and Scoop are on the v10.1 roadmap.
Updating: brew upgrade webreaper (Homebrew), or re-run the install.sh line with --upgrade appended (| sh -s -- --upgrade), or dotnet add package WebReaper (library). When a newer release exists, scrape / crawl / map print a one-line upgrade hint on stderr (interactive terminals only, never in a pipe or CI); disable that check with WEBREAPER_NO_UPDATE_CHECK=1.
$ webreaper scrape https://news.ycombinator.com
# Hacker News
- [Show HN: ...](https://news.ycombinator.com/item?id=...)
- [Ask HN: ...](https://news.ycombinator.com/item?id=...)
...
$ webreaper init
Wrote WebReaper Agent Skill to .claude/skills/webreaper/SKILL.md
Try it out:
webreaper scrape https://example.com
webreaper map https://example.com
After webreaper init, the next Claude Code session picks up the skill and routes scraping intents ("give me the markdown of X", "what blog posts are on Y", "scrape the top 5 articles") to webreaper automatically.
| 🪶 Drop on PATH, run. No Docker, no Postgres, no signup. ~12 MB binary. | 🤖 AI-native by composition. Markdown by default. Schema extraction, LLM fallback, self-healing selectors, autonomous agent. Stack with .With…(). | 🔌 Bring any LLM. OpenAI, Anthropic, Ollama, Azure OpenAI, llamafile, via Microsoft.Extensions.AI. |
| 🛡 Bot-checks handled automatically. A blocked page climbs HTTP → browser → stealth on its own, per page and host-sticky. Challenge pages are dropped, never returned as data. No flag needed for the browser fallback. | 📡 Distributed when needed. Swap scheduler, tracker, sink to Redis, MongoDB, SQLite, Azure Service Bus, Cosmos. Same code. | 📜 MIT, not AGPL. Embed in commercial software, fork, modify, redistribute. Firecrawl's AGPL requires open-sourcing your service or paying for a commercial license. |
# One page as Markdown
webreaper scrape https://example.com
# Save Markdown to a file
webreaper scrape https://example.com --output page.md
# Discover URLs
... [View full README on GitHub](https://github.com/alex-on-ai/webreaper#readme)