Litellm
by BerriAI
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
No known CVEs
No license
Actively maintained
Last commit 1d ago
Works with most clients
Transport: stdio, sse, http
4 tools · ~108 tok
Grade A · 0.1% of 200K ctx
MCPpedia last refreshed this data
This server has been archived and is no longer actively maintained.
Litellm is an MCP server that python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]. Its tool list has not been published yet over stdio, sse and http, requires no API key, and scores 59/100 on MCPpedia's security, maintenance and efficiency rubric.
Step 1
Install in your client
Config is the same across clients - only the file and path differ.
CD
Supported in Claude Desktopstdio, sse, http · Node 18+
Paste into ~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"LiteLLM": {
"url": "http://localhost:4000/mcp/",
"headers": {
"x-litellm-api-key": "Bearer sk-1234"
}
}
}
}Are you the author?
Add this badge to your README to show your security score and help users find safe servers.
Embed in your READMEAbout badges →
[](https://mcppedia.org/s/litellm)
Read me
What Litellm does
All Supported Endpoints - /chat/completions, /responses, /embeddings, /images, /audio, /batches, /rerank, /a2a, /messages and more.
Test This Server
This server supports HTTP transport. Be the first to test it - help the community know if it works.
Loading README…
Scored, not listed
Why this score
Five weighted categories - click any category to see the underlying evidence.
Score breakdown
59/100across 5 weighted dimensions
0255075100
9
20
15
10
−41
Security
Maintenance
Efficiency
Documentation
Compatibility
Categoriesclick a row to see evidence
Security
OSV.devNo known CVEs.
No package registry to scan.
Inventory
Tools (4)
Click any tool to inspect its schema.
~108 tokens total
Community
Reviews
Be the first to review
Have you used this server?
Share your experience - it helps other developers decide.
How easy was setup?Did it work reliably?How was the documentation?
Sign in to write a review.
Frequently Asked Questions
- Is Litellm safe to use?
- Litellm has no known CVEs as of the latest MCPpedia security scan. Authentication requirements were not detected automatically - check the project's documentation before connecting in a shared environment.
- How do I install Litellm?
- Litellm supports copy-paste install configs on its MCPpedia page for Claude Desktop, Cursor, and Claude Code. Scroll to the Quick Install section and select your client.
- What can Litellm do?
- Litellm provides 4 tools: Features, Services, Backend, Frontend. See the full tools list on the server page for descriptions and parameters.
- What AI clients work with Litellm?
- Litellm is compatible with claude-desktop, cursor, claude-code. It uses stdio and sse and http transport.
- Is Litellm actively maintained?
- Litellm is actively maintained - last commit was 1 day ago. It has 61,573 GitHub stars.
Related
Similar servers
Others in ai-ml
I
io.github.HUANGCHIHHUNGLeo/claude-real-video96Let any LLM watch a video locally — and search everything it has ever watched.
2.2k 6
Modelcontextprotocol96The official MCP server implementation for the Perplexity API Platform
2.6k 4
I
io.github.callstack/agent-device96MCP server for mobile app automation: verify, control, and debug iOS, Android, TV, and desktop apps
5.1k 5
I
io.github.mims-harvard/tooluniverse962,700+ scientific tools for AI scientists: life science, research, literature, and more.
1.8k 4
MCP Security Weekly
Get CVE alerts and security updates for Litellm and similar servers.
Community
Discussion
Start a conversation
Ask a question, share a tip, or report an issue.
Has anyone used this with Cursor?How do you handle auth?Any alternatives?
Sign in to join the discussion.
