mcpbr-claude-plugin

> Claude Code plugin for mcpbr - Makes Claude an expert at running MCP benchmarks


This Claude Code plugin provides specialized skills that make Claude an expert at using mcpbr for MCP server benchmarking.

> Note: This package is also available as @greynewell/mcpbr-claude-plugin for those who prefer scoped package names.

What is mcpbr?

Model Context Protocol Benchmark Runner - Benchmark your MCP server against real GitHub issues. Get hard numbers comparing tool-assisted vs. baseline agent performance.

Installation

$3

``bash
git clone https://github.com/greynewell/mcpbr.git
cd mcpbr


Claude Code automatically detects the plugin


`

$3

`bash
npm install -g mcpbr-claude-plugin
`

$3

`bash


In Claude Code, run:


/plugin install github:greynewell/mcpbr
`

What You Get

When using Claude Code in a project with this plugin, Claude automatically gains expertise in:

$3

Expert at running evaluations with proper validation:
- Verifies Docker is running
- Checks for API keys
- Validates configuration files
- Uses correct CLI flags
- Provides actionable error messages

$3

Generates valid mcpbr configuration files:
- Ensures {workdir} placeholder is included
- Validates MCP server commands
- Provides benchmark-specific templates
- Applies best practices

$3

Quick-start command for demonstrations:
- Pre-configured for 5-task evaluation
- Sensible defaults for output files
- Perfect for testing and demos

Example Interactions

Simply ask Claude in natural language:

- "Run the SWE-bench Lite benchmark"
- "Generate a config for my MCP server"
- "Run a quick test with 1 task"

Claude will automatically:
- Verify prerequisites before starting
- Generate valid configurations
- Use correct CLI commands
- Handle errors gracefully

How It Works

The plugin includes:
- plugin.json - Claude Code plugin manifest
- skills/ - Three specialized SKILL.md files

When Claude Code loads this plugin, it injects the skill instructions into Claude's context, making it an expert at mcpbr without you having to explain anything.

Development

This package is part of the mcpbr project:

`bash


Clone the repository

git clone https://github.com/greynewell/mcpbr.git
cd mcpbr

Test the plugin

pytest tests/test_claude_plugin.py -v
`

Related Packages

- mcpbr - Python package (core implementation)
- mcpbr-cli - npm CLI wrapper (also available as @greynewell/mcpbr`)

Documentation

For full documentation, visit:

- Claude Code Plugin Guide
- Installation Guide
- Configuration Reference
- CLI Reference

License

MIT - see LICENSE for details.

Contributing

Contributions welcome! See CONTRIBUTING.md for guidelines.

Support

- Documentation:
- Issues:
- Discussions:

---

Built by Grey Newell