Neutral tie-breaks between AI agents and sealed review of an agent's output, with signed receipts.
MCPpedia last refreshed this data
io.github.ccheez34/agent-referee is an MCP server that neutral tie-breaks between AI agents and sealed review of an agent's output, with signed receipts. Its tool list has not been published yet over stdio, sse and http, requires no API key, and scores 89/100 on MCPpedia's security, maintenance and efficiency rubric.
Config is the same across clients - only the file and path differ.
{
"mcpServers": {
"agent-referee": {
"args": [
"-y",
"agent-referee-mcp"
],
"command": "npx"
}
}
}Are you the author?
Add this badge to your README to show your security score and help users find safe servers.
Neutral tie-breaks between AI agents and sealed review of an agent's output, with signed receipts.
This server supports HTTP transport. Be the first to test it - help the community know if it works.
Five weighted categories - click any category to see the underlying evidence.
No known CVEs.
Checked agent-referee-mcp against OSV.dev.
Click any tool to inspect its schema.
Be the first to review
Have you used this server?
Share your experience - it helps other developers decide.
Sign in to write a review.
Others in ai-ml
A cross-platform desktop application for managing AI Agents and MCP Servers. 一款用于管理AI智能体与MCP服务器的跨平台桌面应用程序。
Codebase knowledge graph for AI agents — 162 languages, sub-ms queries, 99% fewer tokens.
An open-source AI agent that brings the power of Gemini directly into your terminal.
🛡️ BLA (Blind LLM Agents) — Adversarial defense shield that protects binaries, Electron apps, JS bundles, Python, and WebAssembly against AI reverse-engineering agents like REA. Poison -> Exhaust -> Hallucinate.
MCP Security Weekly
Get CVE alerts and security updates for io.github.ccheez34/agent-referee and similar servers.
Start a conversation
Ask a question, share a tip, or report an issue.
Sign in to join the discussion.
Let any MCP-capable agent use Agent Referee: a neutral tie-breaker between agents from different owners, and sealed review of one agent's own work, with Ed25519-signed receipts.
Works with Claude Desktop, Claude Code, Cursor, and any other client that runs MCP servers over stdio. The free tools need no wallet and no account.
What it's for: Agent Referee is for technical evaluation of AI agents' work; it isn't for deciding legal claims, contractual disputes or anyone's rights; results are advisory.
Paid use can be paused by the service. While it is, a paid call is refused before any payment, so nothing is charged, and the free tools keep working; the service's front page says when it's paused.
| Tool | What it does | Cost |
|---|---|---|
demo_match | Runs a complete tie-break in one call, playing both seats, so you can see how it works. | Free |
tiebreak | Settles a deadlock with another agent. Both agents call it with the same key and settings; neither side nor the service can steer the result. | Free demo for now (paid tiers next) |
sealed_review | Independent AI reviewers check your agent's output against its task, and return a verdict plus a signed receipt you can hand to whoever receives the work. | Free: 3 reviews and 1 review-3 a day per address (no wallet). Then $0.05, or $0.20 for review-3 (three reviewers from three AI companies). Work in 2 or 3 pieces: $0.60 (review-3x2) or $0.70 (review-3x3), paid only |
verify_receipt | Checks any Agent Referee receipt offline against the pinned signing key. Pass the task and output (or the pieces, for a multi-part review or judge match) to confirm a receipt is about exactly that work. | Free |
review_result | Returns a sealed_review that was still running when its call came back (status: "running", a job_id). | Free |
saved_receipts | Lists the review receipts this server saved on your machine, and today's spend. | Free |
You need Node.js 18 or newer.
Open Settings → Developer → Edit Config and add this to claude_desktop_config.json, then restart Claude Desktop:
{
"mcpServers": {
"agent-referee": {
"command": "npx",
"args": ["-y", "agent-referee-mcp"]
}
}
}
On Windows, if Claude Desktop can't start it, use "command": "cmd" and "args": ["/c", "npx", "-y", "agent-referee-mcp"].
claude mcp add agent-referee -- npx -y agent-referee-mcp
On Windows: claude mcp add agent-referee -- cmd /c npx -y agent-referee-mcp
grok mcp add agent-referee -- npx -y agent-referee-mcp
Restart the Grok session so it loads the server. The first call can take a few extra seconds while npx downloads the package.
Any client that runs local (stdio) MCP servers works the same way: the command is npx with the arguments -y agent-referee-mcp.
Ask your agent: "Use demo_match to run a free Agent Referee demo." It returns the winner, the signed receipt (marked demo), and the checks: the signature, each side's own seed, and the math.
With no wallet set up, sealed_review uses the free daily allowance: 3 single-reviewer reviews and 1 review-3 per day from each address (IP address, or /64 block for IPv6), reset at 00:00 UTC. The operator pays for these, and one daily budget is shared by everyone, so free reviews can run out before the day ends. When they do, the tool says so.
"funding": "free", with no payer.free: true.sealed_review pays per review in USDC on Base over [x402