Search Hacker News, Bluesky, and Substack from a single MCP interface
Config is the same across clients — only the file and path differ.
{
"mcpServers": {
"the-data-collector": {
"url": "https://frog03-20494.wykr.es/.well-known/mcp.json"
}
}
}Are you the author?
Add this badge to your README to show your security score and help users find safe servers.
Web scraping APIs for Bluesky, Substack, and Hacker News with x402 micropayment support. Built with FastAPI.
No automated test available for this server. Check the GitHub README for setup instructions.
Five weighted categories — click any category to see the underlying evidence.
No known CVEs.
No package registry to scan.
Click any tool to inspect its schema.
Be the first to review
Have you used this server?
Share your experience — it helps other developers decide.
Sign in to write a review.
Others in search
Web and local search using Brave Search API
Production ready MCP server with real-time search, extract, map & crawl.
mini cli search engine for your docs, knowledge bases, meeting notes, whatever. Tracking current sota approaches while being all local
Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors
MCP Security Weekly
Get CVE alerts and security updates for io.github.MarcinDudekDev/the-data-collector and similar servers.
Start a conversation
Ask a question, share a tip, or report an issue.
Sign in to join the discussion.
Web scraping APIs for Bluesky, Substack, and Hacker News with x402 micropayment support. Built with FastAPI.
Live: https://frog03-20494.wykr.es
| Method | Endpoint | Description | Price |
|---|---|---|---|
| POST | /api/bluesky/search | Search Bluesky posts by keyword | $0.05 |
| POST | /api/substack/search | Scrape Substack newsletter articles | $0.05 |
| POST | /api/hn/search | Search Hacker News stories | $0.05 |
# Clone
git clone https://github.com/MarcinDudekDev/the-data-collector.git
cd the-data-collector
# Install
python3 -m venv venv && source venv/bin/activate
pip install -r requirements.txt
# Configure
cp .env.example .env
# Edit .env with your APIFY_TOKEN and API_KEY
# Run
uvicorn server:app --host 0.0.0.0 --port 8001
docker build -t the-data-collector .
docker run -p 8001:8001 --env-file .env the-data-collector
| Variable | Required | Description |
|---|---|---|
APIFY_TOKEN | Yes | Apify API token for running scrapers |
API_KEY | No | API key for authenticated access (X-API-Key header) |
BASE_URL | No | Public URL of the server (default: https://frog03-20494.wykr.es) |
PAY_TO | No | Wallet address for x402 payments |
PRICE_ATOMIC | No | Price per call in USDC atomic units (default: 50000 = $0.05) |
Send a POST request without credentials. You'll receive a 402 response with payment requirements. Pay $0.05 USDC on Base — settlement is instant.
# First call returns 402 with payment details
curl -X POST https://frog03-20494.wykr.es/api/hn/search \
-H "Content-Type: application/json" \
-d '{"searchTerms": ["AI agents"]}'
curl -X POST https://frog03-20494.wykr.es/api/hn/search \
-H "Content-Type: application/json" \
-H "X-API-Key: your-key" \
-d '{"searchTerms": ["AI agents"], "maxResults": 5}'
| Endpoint | Protocol |
|---|---|
/.well-known/mcp.json | MCP (Model Context Protocol) |
/.well-known/agent-card.json | A2A (Agent-to-Agent) |
/.well-known/x402 | x402 payment discovery |
/.well-known/openapi.json | OpenAPI 3.1 spec |
/health | Health check |
{
"mcpServers": {
"the-data-collector": {
"url": "https://frog03-20494.wykr.es/.well-known/mcp.json"
}
}
}
MIT