Is io.github.waiky-github/CrawlEyes safe to use?

io.github.waiky-github/CrawlEyes has no known CVEs as of the latest MCPpedia security scan. Authentication requirements were not detected automatically - check the project's documentation before connecting in a shared environment. Licensed under MIT.

How do I install io.github.waiky-github/CrawlEyes?

io.github.waiky-github/CrawlEyes supports copy-paste install configs on its MCPpedia page for Claude Desktop, Cursor, and Claude Code. Scroll to the Quick Install section and select your client.

What can io.github.waiky-github/CrawlEyes do?

io.github.waiky-github/CrawlEyes provides 3 tools: Features, Compliance, License. See the full tools list on the server page for descriptions and parameters.

What AI clients work with io.github.waiky-github/CrawlEyes?

io.github.waiky-github/CrawlEyes is compatible with claude-desktop, cursor, claude-code. It uses stdio and sse and http transport.

Is io.github.waiky-github/CrawlEyes actively maintained?

io.github.waiky-github/CrawlEyes is actively maintained - last commit was 23 days ago. It has 2 GitHub stars.

io.github.waiky-github/CrawlEyes

crawleyes

Web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key.

2 3 tools GitHub PyPI

No known CVEs

MIT license

Actively maintained

Last commit 23d ago

Works with most clients

Transport: stdio, sse, http

3 tools · ~132 tok

Grade A · 0.1% of 200K ctx

MCPpedia last refreshed this data 1d ago

Edit this pageView history

io.github.waiky-github/CrawlEyes is an MCP server that web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key. Its tool list has not been published yet over stdio, sse and http, requires no API key, and scores 85/100 on MCPpedia's security, maintenance and efficiency rubric.

Browser Search

Step 1

Install in your client

Config is the same across clients - only the file and path differ.

Supported in Claude Desktopstdio, sse, http · Node 18+

Paste into ~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "io-github-waiky-github-crawleyes": {
      "args": [
        "crawleyes"
      ],
      "command": "uvx"
    }
  }
}

Are you the author?

Add this badge to your README to show your security score and help users find safe servers.

Embed in your READMEAbout badges →

[![MCPpedia Score](https://mcppedia.org/api/badge/io-github-waiky-github-crawleyes)](https://mcppedia.org/s/io-github-waiky-github-crawleyes)

Read me

What io.github.waiky-github/CrawlEyes does

Web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key.

Test This Server

This server supports HTTP transport. Be the first to test it - help the community know if it works.

Loading README…

Scored, not listed

Why this score

Five weighted categories - click any category to see the underlying evidence.

Score breakdown

85/100across 5 weighted dimensions

How we score →

0255075100

−15

Security

Maintenance

Efficiency

Documentation

Compatibility

Categoriesclick a row to see evidence

Security

OSV.dev

No known CVEs.

Checked crawleyes against OSV.dev.

Inventory

Tools (3)

Click any tool to inspect its schema.

~132 tokens total

Community

Reviews

Be the first to review

Have you used this server?

Share your experience - it helps other developers decide.

How easy was setup?Did it work reliably?How was the documentation?

Frequently Asked Questions

Is io.github.waiky-github/CrawlEyes safe to use?: io.github.waiky-github/CrawlEyes has no known CVEs as of the latest MCPpedia security scan. Authentication requirements were not detected automatically - check the project's documentation before connecting in a shared environment. Licensed under MIT.
How do I install io.github.waiky-github/CrawlEyes?: io.github.waiky-github/CrawlEyes supports copy-paste install configs on its MCPpedia page for Claude Desktop, Cursor, and Claude Code. Scroll to the Quick Install section and select your client.
What can io.github.waiky-github/CrawlEyes do?: io.github.waiky-github/CrawlEyes provides 3 tools: Features, Compliance, License. See the full tools list on the server page for descriptions and parameters.
What AI clients work with io.github.waiky-github/CrawlEyes?: io.github.waiky-github/CrawlEyes is compatible with claude-desktop, cursor, claude-code. It uses stdio and sse and http transport.
Is io.github.waiky-github/CrawlEyes actively maintained?: io.github.waiky-github/CrawlEyes is actively maintained - last commit was 23 days ago. It has 2 GitHub stars.

Similar servers

Others in browser / search

View all →

Crw95

Open-source web scraper for AI agents with scrape, crawl, and map tools

1.3k 3

Apify Mcp Server95

Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡

16.1k 1

io.github.vmoranv/jshookmcp95

Search-first MCP server for JavaScript reverse engineering: 735 tools across 36 domains.

2.1k 2

Tavily Mcp95

MCP server for advanced web search using Tavily

2.5k 4

MCP Security Weekly

Get CVE alerts and security updates for io.github.waiky-github/CrawlEyes and similar servers.

Community

Discussion

Start a conversation

Ask a question, share a tip, or report an issue.

Has anyone used this with Cursor?How do you handle auth?Any alternatives?

Edit this pageView history

Browser Search

Step 1

Install in your client

Config is the same across clients - only the file and path differ.

Supported in Claude Desktopstdio, sse, http · Node 18+

Paste into ~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "io-github-waiky-github-crawleyes": {
      "args": [
        "crawleyes"
      ],
      "command": "uvx"
    }
  }
}

Are you the author?

Add this badge to your README to show your security score and help users find safe servers.

Embed in your READMEAbout badges →

[![MCPpedia Score](https://mcppedia.org/api/badge/io-github-waiky-github-crawleyes)](https://mcppedia.org/s/io-github-waiky-github-crawleyes)

Read me

What io.github.waiky-github/CrawlEyes does

Web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key.

Test This Server

This server supports HTTP transport. Be the first to test it - help the community know if it works.

README

CrawlEyes — Web Scraping & Search Toolkit for AI Agents

English | 中文

CrawlEyes gives AI agents reliable full-text extraction (web_extract) and robust search (web_search) backends — the "eyes" that let agents see and read the web. Built and tested against Hermes Agent.

Also ships as a standard MCP server, so any MCP client (Claude Desktop, Cursor, other agents) can reuse the same search + extraction capabilities.

Why CrawlEyes?

Most agent toolkits cover one slice of the pipeline. CrawlEyes is the rare all-in-one that you can actually run behind the Great Firewall without external accounts.

	Typical agent toolkit	CrawlEyes
🔍 Search	API key required, often blocked in CN	✅ SearXNG (self-hosted) + Tavily keyless fallback — zero config, zero key
📄 Extraction	Separate scraper, or Firecrawl SaaS	✅ Built-in Crawl4AI full-text extract, ~89% noise removal
🧠 Semantic rerank	Rarely included	✅ Local fastembed rerank — no torch, ~50MB model
🔌 MCP server	Often missing	✅ Standard MCP tools (`search` + `extract` + `deep_research` + `sitemap`), any client
🌐 China-friendly	Mostly English/GFW-blocked	✅ Tested on a real mainland China server (baidu + yandex)

Zero API keys. Zero external accounts. One command. CrawlEyes is the only toolkit in this space that combines search + extraction + semantic reranking + MCP in a single, China-friendly, self-hosted package.

Features

Capability	Where	Why it matters
Full-text extraction	`scripts/crawl4ai_cli.py`	Headless-browser scraping → clean Markdown; handles ~80% of JS/dynamic/UA-blocked pages
Content denoising (P1)	`crawl4ai_cli.py --noise-filter`	Prunes nav/ads/comments via Crawl4AI's `PruningContentFilter` — measured 24.6k→2.8k chars (~89% noise removed) on a typical article
Retry with backoff (P3)	`crawl4ai_cli.py --retry N`	Exponential backoff (1s/2s/4s) on transient failures
Browser session reuse (P4)	`crawl4ai_cli.py --session NAME`	Reuses the browser context across scrapes in one process — no cold-start per URL
Keyword-focused extraction	`crawl4ai_cli.py --bm25 KEYWORD`	Keeps only paragraphs relevant to a keyword (experimental — BM25 is English-centric; works best on English docs)
Search (primary)	SearXNG (self-hosted meta-search)	Privacy-friendly search aggregator
Search (fallback)	Tavily keyless API	Zero-config, no-key fallback when SearXNG is down/empty
Search orchestration	`plugins/searxng-tavily/`	Hermes plugin provider: SearXNG first → auto-fallback to Tavily keyless; three-state circuit breaker (3 fails → 60s cooldown → half-open) + shared SQLite cache (TTL 3600s)
Semantic reranking (P2)	`scripts/crawl_search_standalone.py`	Local embedding rerank of search results with `fastembed` + `BAAI/bge-small-zh-v1.5` (512-dim, no torch dependency, ~50MB, cached) — puts relevant results first. Measured: crawler-relevant items 0.817/0.732 float to top, irrelevant 0.302/0.139 sink
MCP server (P5)	`scripts/mcp_crawl_s

... View full README on GitHub

Loading README…

Scored, not listed

Why this score

Five weighted categories - click any category to see the underlying evidence.

Score breakdown

85/100across 5 weighted dimensions

How we score →

0255075100

−15

Security

Maintenance

Efficiency

Documentation

Compatibility

Categoriesclick a row to see evidence

Security

OSV.dev

No known CVEs.

Checked crawleyes against OSV.dev.

Inventory

Tools (3)

Click any tool to inspect its schema.

~132 tokens total

Community

Reviews

Be the first to review

Have you used this server?

Share your experience - it helps other developers decide.

How easy was setup?Did it work reliably?How was the documentation?

Frequently Asked Questions

Is io.github.waiky-github/CrawlEyes safe to use?: io.github.waiky-github/CrawlEyes has no known CVEs as of the latest MCPpedia security scan. Authentication requirements were not detected automatically - check the project's documentation before connecting in a shared environment. Licensed under MIT.
How do I install io.github.waiky-github/CrawlEyes?: io.github.waiky-github/CrawlEyes supports copy-paste install configs on its MCPpedia page for Claude Desktop, Cursor, and Claude Code. Scroll to the Quick Install section and select your client.
What can io.github.waiky-github/CrawlEyes do?: io.github.waiky-github/CrawlEyes provides 3 tools: Features, Compliance, License. See the full tools list on the server page for descriptions and parameters.
What AI clients work with io.github.waiky-github/CrawlEyes?: io.github.waiky-github/CrawlEyes is compatible with claude-desktop, cursor, claude-code. It uses stdio and sse and http transport.
Is io.github.waiky-github/CrawlEyes actively maintained?: io.github.waiky-github/CrawlEyes is actively maintained - last commit was 23 days ago. It has 2 GitHub stars.