Litellm
by BerriAI
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
57.0k GitHub
No known CVEs
No license
Actively maintained
Last commit 0d ago
Works with most clients
Transport: stdio, sse, http
0 tools
Grade F
MCPpedia last refreshed this data
This server has been archived and is no longer actively maintained.
Litellm is an MCP server that python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]. Its tool list has not been published yet over stdio, sse and http, requires no API key, and scores 30/100 on MCPpedia's security, maintenance and efficiency rubric.
Step 1
Install in your client
Config is the same across clients — only the file and path differ.
CD
Supported in Claude Desktopstdio, sse, http · Node 18+
Paste into ~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"LiteLLM": {
"url": "http://localhost:4000/mcp/",
"headers": {
"x-litellm-api-key": "Bearer sk-1234"
}
}
}
}Are you the author?
Add this badge to your README to show your security score and help users find safe servers.
Embed in your READMEAbout badges →
[](https://mcppedia.org/s/litellm)
Read me
What Litellm does
All Supported Endpoints - /chat/completions, /responses, /embeddings, /images, /audio, /batches, /rerank, /a2a, /messages and more.
Test This Server
This server supports HTTP transport. Be the first to test it — help the community know if it works.
Loading README…
Scored, not listed
Why this score
Five weighted categories — click any category to see the underlying evidence.
Score breakdown
30/100across 5 weighted dimensions
0255075100
15
10
−70
Security
Maintenance
Efficiency
Documentation
Compatibility
Categoriesclick a row to see evidence
Security
OSV.devNo known CVEs.
No package registry to scan.
Community
Reviews
Be the first to review
Have you used this server?
Share your experience — it helps other developers decide.
How easy was setup?Did it work reliably?How was the documentation?
Sign in to write a review.
Frequently Asked Questions
- Is Litellm safe to use?
- Litellm has no known CVEs as of the latest MCPpedia security scan. It does not require authentication, so any local process can connect — keep this in mind in shared environments.
- How do I install Litellm?
- Litellm supports copy-paste install configs on its MCPpedia page for Claude Desktop, Cursor, and Claude Code. Scroll to the Quick Install section and select your client.
- What AI clients work with Litellm?
- Litellm is compatible with claude-desktop, cursor, claude-code. It uses stdio and sse and http transport.
- Is Litellm actively maintained?
- Litellm is actively maintained — last commit was 0 days ago. It has 57,035 GitHub stars.
Related
Similar servers
Others in ai-ml
Dsh MCP Client97MCP client bridge: connects to MCP servers and registers their tools on ctx.tools
185.8k 4
Antigravity Workspace Template96Workspace template + MCP server for Claude Code, Codex CLI, Cursor & Windsurf. Multi-agent knowledge engine (ag-refresh / ag-ask) that turns any codebase into a queryable AI assistant.
1.3k 2
Modelcontextprotocol96The official MCP server implementation for the Perplexity API Platform
2.5k 4
Claude Flow95Ruflo - Enterprise AI agent orchestration for Claude Code. Deploy 60+ specialized agents in coordinated swarms with self-learning, fault-tolerant consensus, vector memory, and MCP integration
68.9k 4
MCP Security Weekly
Get CVE alerts and security updates for Litellm and similar servers.
Community
Discussion
Start a conversation
Ask a question, share a tip, or report an issue.
Has anyone used this with Cursor?How do you handle auth?Any alternatives?
Sign in to join the discussion.
