MCP Server for Milvus

The Model Context Protocol (MCP) is an open protocol that enables seamless integration between LLM applications and external data sources and tools. Whether you're building an AI-powered IDE, enhancing a chat interface, or creating custom AI workflows, MCP provides a standardized way to connect LLMs with the context they need.

This repository contains a MCP server that provides access to Milvus vector database functionality.

Prerequisites

Before using this MCP server, ensure you have:

• Python 3.10 or higher
• A running Milvus instance (local or remote)
• uv installed (recommended for running the server)

Usage

The recommended way to use this MCP server is to run it directly with uv without installation. This is how both Claude Desktop and Cursor are configured to use it in the examples below.

If you want to clone the repository:

git clone https://github.com/zilliztech/mcp-server-milvus.git
cd mcp-server-milvus

Then you can run the server directly:

uv run src/mcp_server_milvus/server.py --milvus-uri http://localhost:19530

Alternatively you can change the .env file in the src/mcp_server_milvus/ directory to set the environment variables and run the server with the following command:

uv run src/mcp_server_milvus/server.py

Important: the .env file will have higher priority than the command line arguments.

Running Modes

The server supports two running modes: stdio (default) and SSE (Server-Sent Events).

Stdio Mode (Default)

• Description: Communicates with the client via standard input/output. This is the default mode if no mode is specified.

• Usage:

  uv run src/mcp_server_milvus/server.py --milvus-uri http://localhost:19530
  

SSE Mode

• Description: Uses HTTP Server-Sent Events for communication. This mode allows multiple clients to connect via HTTP and is suitable for web-based applications.

• Usage:

  uv run src/mcp_server_milvus/server.py --sse --milvus-uri http://localhost:19530 --port 8000
  

  • --sse: Enables SSE mode.
  • --port: Specifies the port for the SSE server (default: 8000).

• Debugging in SSE Mode:

  If you want to debug in SSE mode, after starting the SSE service, enter the following command:

  mcp dev src/mcp_server_milvus/server.py
  

  The output will be similar to:

  % mcp dev src/mcp_server_milvus/merged_server.py
  Starting MCP inspector...
  ⚙️ Proxy server listening on port 6277
  🔍 MCP Inspector is up and running at http://127.0.0.1:6274 🚀
  

  You can then access the MCP Inspector at http://127.0.0.1:6274 for testing.

Streamable HTTP Mode

• Description: Uses HTTP with streaming support for communication. This is the recommended transport for production deployments and supports both stateful and stateless operation.

• Usage:

  uv run src/mcp_server_milvus/server.py --streamable-http --milvus-uri http://localhost:19530 --port 8000
  

  • --streamable-http: Enables Streamable HTTP mode.
  • --port: Specifies the port for the server (default: 8000).
  • --stateless: Optional flag for stateless mode (no session persistence).

• Stateless Mode:

  uv run src/mcp_server_milvus/server.py --streamable-http --stateless --milvus-uri http://localhost:19530 --port 8000
  

Supported Applications

This MCP server can be used with various LLM applications that support the Model Context Protocol:

• Claude Desktop: Anthropic's desktop application for Claude
• Cursor: AI-powered code editor with MCP support
• Custom MCP clients: Any application implementing the MCP client specification

Usage with Claude Desktop

Configuration for Different Modes

SSE Mode Configuration

Follow these steps to configure Claude Deskto

... View full README on GitHub