Is Eval Marketplace safe to use?

Eval Marketplace has no known CVEs as of the latest MCPpedia security scan. It does not require authentication, so any local process can connect — keep this in mind in shared environments.

How do I install Eval Marketplace?

Eval Marketplace can be installed by cloning its GitHub repository and following the setup instructions in the README.

What AI clients work with Eval Marketplace?

Eval Marketplace is compatible with claude-desktop, cursor, claude-code. It uses sse and http transport.

Is Eval Marketplace actively maintained?

Eval Marketplace is less actively maintained — last commit was 106 days ago. It has 22 GitHub stars.

Eval Marketplace

Name: Eval Marketplace
Author: JeredBlu

by JeredBlu

Comprehensive security evaluation tools for agent skills and MCP servers

22 0 tools GitHub

No known CVEs

No license

Maintained

Last commit 106d ago

Works with most clients

Transport: sse, http

0 tools

Grade F

Edit this pageView history

Security

Step 1

Install in your client

Config is the same across clients — only the file and path differ.

Supported in Claude Desktopsse, http · Node 18+

Paste into ~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "eval-marketplace": {
      "command": "<see-readme>",
      "args": []
    }
  }
}

Are you the author?

Add this badge to your README to show your security score and help users find safe servers.

Embed in your READMEAbout badges →

[![MCPpedia Score](https://mcppedia.org/api/badge/eval-marketplace)](https://mcppedia.org/s/eval-marketplace)

Read me

What Eval Marketplace does

⚠️ This marketplace is deprecated. > All skills have been migrated to jeredblu-marketplace, which includes these evaluators plus new tools. > This repo will remain available but won't receive updates.

Test This Server

No automated test available for this server. Check the GitHub README for setup instructions.

Loading README…

Scored, not listed

Why this score

Five weighted categories — click any category to see the underlying evidence.

Score breakdown

29/100across 5 weighted dimensions

How we score →

0255075100

−71

Security

Maintenance

Efficiency

Documentation

Compatibility

Categoriesclick a row to see evidence

Security

OSV.dev

No known CVEs.

No package registry to scan.

Community

Reviews

Be the first to review

Have you used this server?

Share your experience — it helps other developers decide.

How easy was setup?Did it work reliably?How was the documentation?

Frequently Asked Questions

Is Eval Marketplace safe to use?: Eval Marketplace has no known CVEs as of the latest MCPpedia security scan. It does not require authentication, so any local process can connect — keep this in mind in shared environments.
How do I install Eval Marketplace?: Eval Marketplace can be installed by cloning its GitHub repository and following the setup instructions in the README.
What AI clients work with Eval Marketplace?: Eval Marketplace is compatible with claude-desktop, cursor, claude-code. It uses sse and http transport.
Is Eval Marketplace actively maintained?: Eval Marketplace is less actively maintained — last commit was 106 days ago. It has 22 GitHub stars.

Similar servers

Others in security

View all →

Ida Pro Mcp92

AI-powered reverse engineering assistant that bridges IDA Pro with language models through MCP.

8.7k 3

Evil Mcp Server91

An evil MCP server used for redteam testing

30 1

Atomic Red Team Mcp90

MCP server for Atomic Red Team

123 5

io.github.peacprotocol/peac90

Signed receipts for agent, API, and MCP interactions. Portable and offline-verifiable.

11 5

MCP Security Weekly

Get CVE alerts and security updates for Eval Marketplace and similar servers.

Community

Discussion

Start a conversation

Ask a question, share a tip, or report an issue.

Has anyone used this with Cursor?How do you handle auth?Any alternatives?

Edit this pageView history

Security

Step 1

Install in your client

Config is the same across clients — only the file and path differ.

Supported in Claude Desktopsse, http · Node 18+

Paste into ~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "eval-marketplace": {
      "command": "<see-readme>",
      "args": []
    }
  }
}

Are you the author?

Add this badge to your README to show your security score and help users find safe servers.

Embed in your READMEAbout badges →

[![MCPpedia Score](https://mcppedia.org/api/badge/eval-marketplace)](https://mcppedia.org/s/eval-marketplace)

Read me

What Eval Marketplace does

⚠️ This marketplace is deprecated. > All skills have been migrated to jeredblu-marketplace, which includes these evaluators plus new tools. > This repo will remain available but won't receive updates.

Test This Server

No automated test available for this server. Check the GitHub README for setup instructions.

README

⚠️ This marketplace is deprecated.
All skills have been migrated to jeredblu-marketplace, which includes these evaluators plus new tools.
This repo will remain available but won't receive updates.

Eval Marketplace

Comprehensive security evaluation tools for agent skills and MCP servers, powered by GitHub and Bright Data integrations.

Overview

This marketplace provides two specialized evaluation skills that utlize MCP servers:

agent-skill-evaluator: Security and safety evaluation for agent skills (.skill files)
mcp-evaluator: Security and privacy evaluation for MCP servers

Both skills automatically assess security vulnerabilities, privacy risks, community feedback, and provide actionable recommendations with detailed risk scoring.

Installation Options

Option 1: Install via Plugin Marketplace for Claude Code (Recommended)

1. Add Marketplace

/plugin marketplace add /path/to/eval-marketplace

Or from GitHub:

/plugin marketplace add github:jeredblu/eval-marketplace

2. Install Plugin

/plugin install evaluator-tools@eval-marketplace

Option 2: Download Individual Skills (Claude Code or Claude Desktop)

Download skills individually for manual installation:

Agent Skill Evaluator

Download: agent-skill-evaluator.zip
Extract the zip file
Move contents to ~/.claude/skills/agent-skill-evaluator/
Restart Claude Code

MCP Evaluator

Download: mcp-evaluator.zip
Extract the zip file
Move contents to ~/.claude/skills/mcp-evaluator/
Restart Claude Code

Note: These skills function best with recommended MCP servers, you'll need to manually configure the MCP servers (see Configuration section below).

Claude Desktop Installation

For Claude Desktop users:

Download: agent-skill-evaluator.zip or mcp-evaluator.zip
Open Claude Desktop
Go to Settings > Capabilities > Upload Skill
Select the downloaded zip file
Repeat for the second skill if desired

Configuration

The evaluator skills work best with two MCP servers. Both are optional but highly recommended for full functionality.

Recommended MCP Servers

GitHub MCP Server (Recommended)

Enables direct GitHub repository access for analyzing skills and MCP servers
Installation: @modelcontextprotocol/server-github
Requires: GitHub Personal Access Token

Bright Data MCP Server (Recommended)

Enables web scraping and Reddit access for community feedback analysis
Installation: @brightdata/mcp
Requires: Bright Data API token
Note: Enable Pro Mode for Reddit scraping

Install and configure these MCP servers following their official installation instructions.

Usage

Agent Skill Evaluator

Evaluate the security of agent skills from various sources:

Evaluate this skill: https://github.com/username/skill-repo

Is this skill safe? https://example.com/my-skill.skill

Security assessment for this skill please: [attach .skill file]

The evaluator will:

Download and extract the skill
Analyze SKILL.md for prompt injections
Review scripts for malicious code
Search community feedback
Generate comprehensive security report with risk scoring

MCP Server Evaluator

Evaluate the security of MCP servers:

Evaluate this MCP server: https://github.com/username/mcp-server

Is this MCP safe to use? https://github.com/org/mcp-repo

The evaluator will:

Analyze repository metadata and activity
Review code for security vulnerabilities
Search for alternatives and comparisons
Gather community feedback (including Reddit with Pro Mode)
Generate detailed assessment with recommendations

... View full README on GitHub

Loading README…

Scored, not listed

Why this score

Five weighted categories — click any category to see the underlying evidence.

Score breakdown

29/100across 5 weighted dimensions

How we score →

0255075100

−71

Security

Maintenance

Efficiency

Documentation

Compatibility

Categoriesclick a row to see evidence

Security

OSV.dev

No known CVEs.

No package registry to scan.

Community

Reviews

Be the first to review

Have you used this server?

Share your experience — it helps other developers decide.

How easy was setup?Did it work reliably?How was the documentation?

Frequently Asked Questions

Is Eval Marketplace safe to use?: Eval Marketplace has no known CVEs as of the latest MCPpedia security scan. It does not require authentication, so any local process can connect — keep this in mind in shared environments.
How do I install Eval Marketplace?: Eval Marketplace can be installed by cloning its GitHub repository and following the setup instructions in the README.
What AI clients work with Eval Marketplace?: Eval Marketplace is compatible with claude-desktop, cursor, claude-code. It uses sse and http transport.
Is Eval Marketplace actively maintained?: Eval Marketplace is less actively maintained — last commit was 106 days ago. It has 22 GitHub stars.