LLM Server Docs
vllm · by varunvasudeva1
End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
No known CVEs
MIT license
Maintained
Last commit 113d ago
Works with most clients
Transport: stdio, sse, http
39 tools
Grade F
MCPpedia last refreshed this data
This server has been archived and is no longer actively maintained.
LLM Server Docs is an MCP server that end-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS. Its tool list has not been published yet over stdio, sse and http, requires no API key, and scores 27/100 on MCPpedia's security, maintenance and efficiency rubric.
Step 1
Install in your client
Config is the same across clients - only the file and path differ.
CD
Supported in Claude Desktopstdio, sse, http · Node 18+
Paste into ~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"llm-server-docs": {
"args": [
"vllm"
],
"command": "uvx"
}
}
}Are you the author?
Add this badge to your README to show your security score and help users find safe servers.
Embed in your READMEAbout badges →
[](https://mcppedia.org/s/llm-server-docs)
Read me
What Llm Server Docs does
TL;DR: End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS, along with steps for configuring SSH, firewall, and secure remote access via Tailscale.
Test This Server
Run this in your terminal to verify the server starts. Then let us know if it worked - your result helps other developers.
uvx 'vllm' 2>&1 | head -1 && echo "✓ Server started successfully"
After testing, let us know if it worked:
Scored, not listed
Why this score
Five weighted categories - click any category to see the underlying evidence.
Score breakdown
27/100across 5 weighted dimensions
0255075100
14
10
−73
Security
Maintenance
Efficiency
Documentation
Compatibility
Categoriesclick a row to see evidence
Security
OSV.dev20 fixed
CVE-2026-94626high · fixed
PYSEC-2026-4008
vLLM through 0.29.0 fails to validate the tp_size parameter in kv_transfer_params on OpenAI-compatible completion endpoints, allowing attackers to allocate unbounded memory. Attackers can supply arbitrary tp_size values in prefill/decode disaggregated deployments to exhaust memory and trigger kernel OOM-kill of the decode worker process.
CVE-2026-94625medium · fixed
PYSEC-2026-4007
vLLM through 0.29.0 contains a resource exhaustion vulnerability in MooncakeConnector where rejected prefill requests create ownerless transfer placeholders that are never reclaimed. Attackers can send rejected requests to exhaust sender task pools, causing valid requests to be delayed by up to 480 seconds while health checks continue returning success.
CVE-2026-94624high · fixed
PYSEC-2026-4006
vLLM through 0.29.0 contains a denial of service vulnerability in P2P KV offloading when OffloadingConnector is configured with TieringOffloadingSpec and a peer-to-peer secondary tier. Attackers can supply arbitrary remote host and port values in kv_transfer_params to create unreachable peer sessions that retain ZeroMQ sockets until the context quota is exhausted, causing an uncaught ZMQError that crashes EngineCore and stops all inference.
CVE-2026-94623high · fixed
PYSEC-2026-4005
vLLM through 0.29.0 contains a denial of service vulnerability in the NIXL connector's prefix caching implementation that fails to properly validate block counts across multi-prompt completion requests in prefill/decode disaggregated deployments. Attackers can trigger an assertion failure in NixlBaseConnectorWorker._apply_prefix_caching by submitting completion requests with multiple prompts of varying lengths, causing the decode worker to terminate and become unavailable until restarted.
CVE-2026-94622high · fixed
PYSEC-2026-4004
vLLM versions through 0.29.0 contain a denial of service vulnerability in the NIXL connector's metadata handling for prefill/decode disaggregated deployments. Attackers can send requests with incomplete kv_transfer_params dictionary entries to trigger an uncaught KeyError in EngineCore scheduling, causing the decode engine to terminate and making all routed requests fail until manual restart.
Inventory
Tools (39)
Click any tool to inspect its schema.
Community
Reviews
Be the first to review
Have you used this server?
Share your experience - it helps other developers decide.
How easy was setup?Did it work reliably?How was the documentation?
Sign in to write a review.
Frequently Asked Questions
- Is Llm Server Docs safe to use?
- Llm Server Docs has 15 known CVEs tracked by MCPpedia. You can verify these on OSV.dev by searching for "vllm". Review the Security section above for details before installing.
- How do I install Llm Server Docs?
- Llm Server Docs supports copy-paste install configs on its MCPpedia page for Claude Desktop, Cursor, and Claude Code. Scroll to the Quick Install section and select your client.
- What can Llm Server Docs do?
- Llm Server Docs provides 39 tools: Simplicity, Stability, Security, Maintainability, Aesthetics and 34 more. See the full tools list on the server page for descriptions and parameters.
- What AI clients work with Llm Server Docs?
- Llm Server Docs is compatible with claude-desktop, cursor, claude-code. It uses stdio and sse and http transport.
- Is Llm Server Docs actively maintained?
- Llm Server Docs is less actively maintained - last commit was 113 days ago. It has 847 GitHub stars.
Related
Similar servers
Others in ai-ml / education
I
io.github.callstack/agent-device96MCP server for mobile app automation: verify, control, and debug iOS, Android, TV, and desktop apps
5.1k 5
I
io.github.HUANGCHIHHUNGLeo/claude-real-video96Let any LLM watch a video locally — and search everything it has ever watched.
2.2k 6
Modelcontextprotocol96The official MCP server implementation for the Perplexity API Platform
2.6k 4
I
io.github.mims-harvard/tooluniverse962,700+ scientific tools for AI scientists: life science, research, literature, and more.
1.8k 4
MCP Security Weekly
Get CVE alerts and security updates for Llm Server Docs and similar servers.
Community
Discussion
Start a conversation
Ask a question, share a tip, or report an issue.
Has anyone used this with Cursor?How do you handle auth?Any alternatives?
Sign in to join the discussion.