Web pages to clean Markdown for AI agents, honouring robots.txt and AI opt-outs.
MCPpedia last refreshed this data
io.github.Bytestay/distill-mcp is an MCP server that web pages to clean Markdown for AI agents, honouring robots.txt and AI opt-outs. Its tool list has not been published yet over stdio, sse and http, requires no API key, and scores 57/100 on MCPpedia's security, maintenance and efficiency rubric.
Config is the same across clients - only the file and path differ.
{
"mcpServers": {
"distill": {
"env": {
"RAPIDAPI_KEY": "your-rapidapi-key"
},
"args": [
"--from",
"bytestay-distill-mcp",
"distill-mcp"
],
"command": "uvx"
}
}
}Are you the author?
Add this badge to your README to show your security score and help users find safe servers.
Web pages to clean Markdown for AI agents, honouring robots.txt and AI opt-outs.
This server supports HTTP transport. Be the first to test it - help the community know if it works.
Five weighted categories - click any category to see the underlying evidence.
No known CVEs.
Checked bytestay-distill-mcp against OSV.dev.
Be the first to review
Have you used this server?
Share your experience - it helps other developers decide.
Sign in to write a review.
Others in browser / ai-ml
Open-source web scraper for AI agents with scrape, crawl, and map tools
A cross-platform desktop application for managing AI Agents and MCP Servers. 一款用于管理AI智能体与MCP服务器的跨平台桌面应用程序。
Search-first MCP server for JavaScript reverse engineering: 735 tools across 36 domains.
An open-source AI agent that brings the power of Gemini directly into your terminal.
MCP Security Weekly
Get CVE alerts and security updates for io.github.Bytestay/distill-mcp and similar servers.
Start a conversation
Ask a question, share a tip, or report an issue.
Sign in to join the discussion.
Give your AI agent clean Markdown from any web page: the main content only, without navigation, ads or scripts. Distill honours robots.txt and AI opt-outs.
The server is open source (MIT). It calls the Distill API, which is paid, with a free plan.
| marketplace | |
|---|---|
| RapidAPI | plans |
| api.market | store |
The server runs locally over stdio with uv. Put your key in its environment.
JSON configuration (Claude Desktop, Cursor, VS Code and most clients):
{
"mcpServers": {
"distill": {
"command": "uvx",
"args": ["--from", "bytestay-distill-mcp", "distill-mcp"],
"env": { "RAPIDAPI_KEY": "your-rapidapi-key" }
}
}
}
Claude Code:
claude mcp add distill --env RAPIDAPI_KEY=your-rapidapi-key -- uvx --from bytestay-distill-mcp distill-mcp
| variable | meaning |
|---|---|
RAPIDAPI_KEY | your RapidAPI key |
API_MARKET_KEY | your api.market key, used when RAPIDAPI_KEY is not set |
BYTESTAY_MARKETPLACE | rapidapi or apimarket, when both keys are set |
Up to 0.2.7 the setting was HFL_MARKETPLACE. The old name still works, with a one-line notice on stderr.
Without a key the server still starts. The first tool call then explains where to get one.
Also listed on Glama:
| tool | what it does |
|---|---|
fetch_markdown(url, max_chars=20000, include_links=True, include_images=False, include_tables=True) | fetches the page and returns its main content as Markdown, with the title, author, date and language |
html_to_markdown(html, base_url=None, …) | the same, for HTML you already have; nothing is fetched |
When a site refuses (robots.txt, a noai directive, bot protection), status says so and a note asks the agent to respect it. Don't fetch the page another way: the terms forbid it.
status is ok on success. Other values (robots_txt, opted_out, blocked, not_html, http_error, unreachable) explain why there is no content.
Every tool returns the API's JSON response.