Litellm
by BerriAI
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
52.1k GitHub
No known CVEs
No license
Actively maintained
Last commit 3d ago
Works with most clients
Transport: stdio, sse, http
0 tools
Grade F
This server has been archived and is no longer actively maintained.
Step 1
Install in your client
Config is the same across clients — only the file and path differ.
CD
Supported in Claude Desktopstdio, sse, http · Node 18+
Paste into ~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"LiteLLM": {
"url": "http://localhost:4000/mcp/",
"headers": {
"x-litellm-api-key": "Bearer sk-1234"
}
}
}
}Are you the author?
Add this badge to your README to show your security score and help users find safe servers.
Embed in your READMEAbout badges →
[](https://mcppedia.org/s/litellm)
Read me
What Litellm does
All Supported Endpoints - /chat/completions, /responses, /embeddings, /images, /audio, /batches, /rerank, /a2a, /messages and more.
Test This Server
This server supports HTTP transport. Be the first to test it — help the community know if it works.
Loading README…
Scored, not listed
Why this score
Five weighted categories — click any category to see the underlying evidence.
Score breakdown
30/100across 5 weighted dimensions
0255075100
15
10
−70
Security
Maintenance
Efficiency
Documentation
Compatibility
Categoriesclick a row to see evidence
Security
OSV.devNo known CVEs.
No package registry to scan.
Community
Reviews
Be the first to review
Have you used this server?
Share your experience — it helps other developers decide.
How easy was setup?Did it work reliably?How was the documentation?
Sign in to write a review.
Frequently Asked Questions
- Is Litellm safe to use?
- Litellm has no known CVEs as of the latest MCPpedia security scan. It does not require authentication, so any local process can connect — keep this in mind in shared environments.
- How do I install Litellm?
- Litellm supports copy-paste install configs on its MCPpedia page for Claude Desktop, Cursor, and Claude Code. Scroll to the Quick Install section and select your client.
- What AI clients work with Litellm?
- Litellm is compatible with claude-desktop, cursor, claude-code. It uses stdio and sse and http transport.
- Is Litellm actively maintained?
- Litellm is actively maintained — last commit was 3 days ago. It has 52,107 GitHub stars.
Related
Similar servers
Others in ai-ml
Memory MCP Server98Persistent memory using a knowledge graph
87.9k 5
Sequential Thinking MCP Server95Dynamic problem-solving through sequential thought chains
87.9k 1
Gpt Researcher95An autonomous agent that conducts deep research on any data using any LLM providers
28.0k 5
Context Mode95Privacy-first. MCP is the protocol for tool access. We're the virtualization layer for context.
18.4k 6
MCP Security Weekly
Get CVE alerts and security updates for Litellm and similar servers.
Community
Discussion
Start a conversation
Ask a question, share a tip, or report an issue.
Has anyone used this with Cursor?How do you handle auth?Any alternatives?
Sign in to join the discussion.
