43,223 MCP Servers, Scored and Updated Daily

Crawl a site: pages, resources, links, duplicates, tags, Lighthouse and raw HTML.

Can AI crawlers read this site? GPTBot/ClaudeBot verdicts, robots vs edge blocking, 47k-domain index

Extract structured data from a web page, read it as markdown, verify values against the source.

Dated, sourced claims about AI crawlers and agents, offered as MCP tools.

Current pricing, cost estimates and recommendations for web scraping APIs, with official sources.

Statuspage Scraper extracts any company's Atlassian Statuspage as clean JSON — components…

MCP server for 500+ pay-per-call web scraping, search, social, business, and financial data tools.

Web search, URL content extraction to Markdown, site mapping, and recursive web crawler.

AI-search-visibility tools: check crawler access, generate llms.txt, lint robots.txt, census data.

Web scraping runtime for agents: parsers, scrapes, batches, crons, and SQL databases.

Free, no sign-in: favicons, web to Markdown, CSV to chart, text to speech, time zones, passwords.

Summarize and transcribe videos, audio, documents and web pages; subtitles; search your library.

Turn any URL into clean Markdown and structured data. Scrape, crawl, search and extract.

Any web page as clean Markdown for agents. Hosted, no install. Free tier; Pro adds JS rendering.

Free SEO, GEO, and AEO audits: analyze any page or domain, AI-crawler access, agent readiness.

Put an HTML or React artifact online as a web page with its own address, password and stats.

Watch a public web page for changes when your agent cannot stay running. Hourly checks, signed diffs

Shared copies of public web pages for AI agents. Search stored pages or fetch a URL.

I do everything related to Browser Automation & Management

Free HTML parsing; static web context at 0.01 USDC via x402. Paid reads need a wallet adapter.