Iris Eval MCP Server
Iris scores every agent run for quality, safety, and cost - on your machine, with no SDK and no account. Most agent projects check quality by running a few remembered prompts and eyeballing the output. Iris replaces that with numbers you can audit: your agent's runs land in a SQLite database on your disk, 20 built-in rules score them deterministically - PII, prompt injection, hallucination markers, cost thresholds…
People who work with agent evaluation, eval and observability and want it reachable from Claude, Cursor, VS Code, or another MCP client. The project is written in TypeScript.
VERIFIED ACTIVE
LAST COMMIT 2026-09-17 · ★ 9 · #19 OF 120 MAINTAINED DEVOPS & MONITORING · VERIFIED 2026-09-18
MIT · TypeScript servers · how we verify → /methodology
01 · Install Iris Eval MCP Server
before you install - you'll need
Set IRIS_ANTHROPIC_API_KEY, IRIS_ALLOW_UNAUTHENTICATED before connecting. IRIS_API_KEY is optional or environment-specific per the README.
Claude Code
claude mcp add iris-eval-mcp-server -- npx -y @iris-eval/mcp-server Claude Desktop / Cursor / VS Code - add to config
{
"mcpServers": {
"iris-eval-mcp-server": {
"command": "npx",
"args": [
"-y",
"@iris-eval/mcp-server"
]
}
}
} Same JSON for Cursor. For VS Code, rename the top-level key from `mcpServers` to `servers`.
Using another client? Same JSON, different key
Claude Desktop · mcpServers
Cursor · mcpServers
VS Code · servers
Windsurf · mcpServers
Zed · context_servers
Cline · mcpServers
Roo Code · mcpServers
Continue · mcpServers
LibreChat · mcpServers
Gemini CLI · mcpServers
Codex CLI · mcp_servers
Full setup guides: every client.
02 · Evidence
Security posture
What to check before giving this server access to your agent - from the registry, GitHub, and our own probes. We don't score safety; we show what's verifiable.
runs as local process (stdio) - runs on your machine with your user's permissions
license MIT - declared in the repository
npm package @iris-eval/mcp-server - published under the repo owner's npm scope (@iris-eval)
registry namespace io.github.iris-eval is GitHub-verified and matches the repo owner
03 · What Iris Eval MCP Server can do
Prose above is summarized from the project's README and registry record - no invented capabilities.
Latest releases
v0.13.0 · 2026-09-08
[0.13.0] - 2026-09-08 · Found and fed. The engine, the proof and the release gate were already held to a higher standard than the doors that introduce the product. This release is the doors: one name on every surface…
v0.12.1 · 2026-09-08
[0.12.1] - 2026-09-07 · Truth patch 3. Words only - no rule, no verdict and no measured number changed. Several public surfaces had stopped being true, and the guard that should have caught the loudest one could not…
v0.12.0 · 2026-09-07
[0.12.0] - 2026-09-07 · Compare. Iris could tell you whether one output was good. It could not tell you whether this week was worse than last week - the question every team actually asks, and the one a single verdict…
04 · Who maintains Iris Eval MCP Server
mcp-server is maintained by iris-eval. It's the only MCP server we track from this author; the repo dates to Mar 2026.
05 · Facts
- repository
- github.com/iris-eval/mcp-server
- category
- DevOps & monitoring - ranked #19 of 120 actively-maintained DevOps & monitoring servers as of 2026-09-18.
- release cadence
- 10+ releases in the last 90 days (latest 2026-09-08)
- registry
- io.github.iris-eval/mcp-server (active, first published 2026-03-15 · 27 versions)
- packages
- npm:@iris-eval/mcp-server
06 · Iris Eval MCP Server FAQ
What is Iris Eval MCP Server?
Iris scores every agent run for quality, safety, and cost - on your machine, with no SDK and no account. Most agent projects check quality by running a few remembered prompts and eyeballing the output. Iris replaces that with numbers you can audit: your agent's runs land in a SQLite database on your disk, 20 built-in rules score them deterministically - PII, prompt injection, hallucination markers, cost thresholds…
Is Iris Eval MCP Server still maintained?
Yes - as of 2026-09-18, its last commit was 2026-09-17 and it shipped 10+ releases in the last 90 days. We re-verify nightly.
How do I install Iris Eval MCP Server?
Run `npx -y @iris-eval/mcp-server`. The README documents 3 environment variables (IRIS_ANTHROPIC_API_KEY, IRIS_API_KEY, IRIS_ALLOW_UNAUTHENTICATED) to set first. Set IRIS_ANTHROPIC_API_KEY, IRIS_ALLOW_UNAUTHENTICATED before connecting. IRIS_API_KEY is optional or environment-specific per the README. You can also paste the ready-made client config above.
Does Iris Eval MCP Server run locally?
Yes - it's a stdio server: it runs on your machine (via npx) with your user's permissions. Your data stays local unless the server itself calls external APIs.
07 · Alternatives to Iris Eval MCP Server
Alternatives to Iris Eval MCP Server
Maintained DevOps & monitoring servers if Iris Eval MCP Server isn't the fit.
- World Monitor Live markets, conflicts, country risk, chokepoints, energy, and China decision signals. 75 tools. ★ 86,725 · 2026-09-17
- Open Metadata Official OpenMetadata MCP: 21 read and write tools for search, lineage, data quality, governance. ★ 15,244 · 2026-09-18
- Kubeshark MCP Server Real-time Kubernetes network traffic visibility and API analysis for HTTP, gRPC, Redis, Kafka, DNS. ★ 12,082 · 2026-09-09
- Grafana An MCP server giving access to Grafana dashboards, data and more. ★ 3,467 · 2026-09-17
- Radar Kubernetes MCP Server Kubernetes MCP server for diagnosis, resource management, GitOps, and RBAC-enforced operations. ★ 3,371 · 2026-09-18
- Testkube MCP MCP server for Testkube - Manage test workflows, executions, and artifacts via AI assistants ★ 1,658 · 2026-09-18
Pairs well with
Servers that cover what Iris Eval MCP Server doesn't - only shown when the pairing reason fits the companion.
More DevOps & monitoring MCP servers · Data Sentry · Marktplaats MCP · Forge Craft · Thoughtbox · Mushi Mushi
More TypeScript MCP servers · Stellaroid Earn · MERN MCP · Forage · A11y Check · Kolada MCP Server · see all