中文

mcp-server-requests

An MCP server that provides HTTP request capabilities, enabling LLMs to fetch and process web content.

Features

• fetch: Web content fetching tool
  • Supports converting web content to Markdown format
  • Supports filtering web content (non-visual elements like script, style, meta)
  • Feeds into LLM context, reducing token consumption through Markdown conversion or filtering non-visual elements
• fetch_to_file: Web content saving tool
  • Web content is not fed into LLM context, avoiding excessive token consumption
• http_request: Generic HTTP request tool
  • Full HTTP method support (GET, POST, PUT, PATCH, DELETE)
  • Supports custom request headers
  • Supports text and JSON request bodies
  • Returns complete HTTP response information (status, headers, body) for LLMs
• Supports custom User-Agent
• Supports random User-Agent generation
• Supports using MCP Root capability, controlled by --use-root, usable with MCP Clients that have root capability

Installation

git clone https://github.com/coucya/mcp-server-requests.git
cd mcp-server-requests
pip install .

Usage

MCP Server Configuration

{
    "mcpServers": {
        "mcp-server-requests": {
            "command": "python",
            "args": [
                "-m",
                "mcp_server_requests"
            ]
        }
    }
}

Command Line

0. Start MCP Server

Start the MCP server directly:

python -m mcp_server_requests

Options

• --user-agent TEXT: Specify custom User-Agent string
• --random-user-agent [browser=xxx;os=xxx]: Use randomly generated User-Agent
• --force-user-agent: Force using command line specified User-Agent, ignoring LLM provided UA
• --list-os-and-browser: List available browsers and OS for random User-Agent generation
• --use-root: Enable workspace root support for file operations (requires MCP Client with root capability support)
• --allow-external-file-access: Allow file operations outside workspace (only with --use-root)

Option Details

• --user-agent and --random-user-agent are mutually exclusive and cannot be used together

• User-Agent setup methods:

  • Custom string: --user-agent "Mozilla/5.0 (...)"
  • Fully random: --random-user-agent
  • Conditional random generation:
    • Specify browser type: --random-user-agent browser=chrome
    • Specify OS: --random-user-agent os=windows
    • Both browser and OS: --random-user-agent browser=chrome;os=windows
    • Note: Browser and OS parameters are case insensitive

• Use --list-os-and-browser to view available browsers and OS for --random-user-agent.

• --force-user-agent option controls User-Agent priority:

  • When --force-user-agent is enabled: Force using command-line specified User-Agent (via --user-agent or --random-user-agent)
  • When --force-user-agent is disabled:
    • If LLM provides User-Agent in headers, use the LLM-provided one
    • Otherwise use command-line specified User-Agent
  • If none specified, use default User-Agent: Mozilla/5.0 (compatible; mcp-server-requests/{version})

• --use-root enables file operations relative to workspace root:

  • Prerequisite: Requires MCP Client with root capability support
  • When enabled: fetch_to_file allows absolute paths or relative paths, relative paths are relative to workspace root
  • When disabled: fetch_to_file must use absolute paths, files are saved to specified absolute path locations

• --allow-external-file-access: Controls whether file operations outside workspace are allowed (only usable with --use-root)

  • Prerequisite: Requires --use-root to be enabled, this option has no effect if --use-root is not enabled
  • When enabled: fetch_to_file can operate on files outside the workspace directory
  • When disabled: fetch_to_file can only operate on files within the workspace directory, even if absolute paths a

... View full README on GitHub