Iris Eval MCP Server

Iris scores every agent run for quality, safety, and cost - on your machine, with no SDK and no account. Most agent projects check quality by running a few remembered prompts and eyeballing the output. Iris replaces that with numbers you can audit: your agent's runs land in a SQLite database on your disk, 20 built-in rules score them deterministically - PII, prompt injection, hallucination markers, cost thresholds…

People who work with agent evaluation, eval and observability and want it reachable from Claude, Cursor, VS Code, or another MCP client. The project is written in TypeScript.

VERIFIED ACTIVE

LAST COMMIT 2026-09-17 · ★ 9 · #19 OF 120 MAINTAINED DEVOPS & MONITORING · VERIFIED 2026-09-18

MIT · TypeScript servers · how we verify → /methodology

01 · Install Iris Eval MCP Server

before you install - you'll need

Set IRIS_ANTHROPIC_API_KEY, IRIS_ALLOW_UNAUTHENTICATED before connecting. IRIS_API_KEY is optional or environment-specific per the README.

Claude Code

claude mcp add iris-eval-mcp-server -- npx -y @iris-eval/mcp-server

Claude Desktop / Cursor / VS Code - add to config

{
  "mcpServers": {
    "iris-eval-mcp-server": {
      "command": "npx",
      "args": [
        "-y",
        "@iris-eval/mcp-server"
      ]
    }
  }
}

Same JSON for Cursor. For VS Code, rename the top-level key from `mcpServers` to `servers`.

Using another client? Same JSON, different key

Claude Desktop · mcpServers

Cursor · mcpServers

VS Code · servers

Windsurf · mcpServers

Zed · context_servers

Cline · mcpServers

Roo Code · mcpServers

Continue · mcpServers

LibreChat · mcpServers

Gemini CLI · mcpServers

Codex CLI · mcp_servers

Full setup guides: every client.

02 · Evidence

Security posture

What to check before giving this server access to your agent - from the registry, GitHub, and our own probes. We don't score safety; we show what's verifiable.

runs as local process (stdio) - runs on your machine with your user's permissions

license MIT - declared in the repository

npm package @iris-eval/mcp-server - published under the repo owner's npm scope (@iris-eval)

registry namespace io.github.iris-eval is GitHub-verified and matches the repo owner

03 · What Iris Eval MCP Server can do

Prose above is summarized from the project's README and registry record - no invented capabilities.

Latest releases

v0.13.0 · 2026-09-08

[0.13.0] - 2026-09-08 · Found and fed. The engine, the proof and the release gate were already held to a higher standard than the doors that introduce the product. This release is the doors: one name on every surface…

v0.12.1 · 2026-09-08

[0.12.1] - 2026-09-07 · Truth patch 3. Words only - no rule, no verdict and no measured number changed. Several public surfaces had stopped being true, and the guard that should have caught the loudest one could not…

v0.12.0 · 2026-09-07

[0.12.0] - 2026-09-07 · Compare. Iris could tell you whether one output was good. It could not tell you whether this week was worse than last week - the question every team actually asks, and the one a single verdict…

04 · Who maintains Iris Eval MCP Server

mcp-server is maintained by iris-eval. It's the only MCP server we track from this author; the repo dates to Mar 2026.

05 · Facts

category
DevOps & monitoring - ranked #19 of 120 actively-maintained DevOps & monitoring servers as of 2026-09-18.
release cadence
10+ releases in the last 90 days (latest 2026-09-08)
registry
io.github.iris-eval/mcp-server (active, first published 2026-03-15 · 27 versions)
packages
npm:@iris-eval/mcp-server

06 · Iris Eval MCP Server FAQ

What is Iris Eval MCP Server?

Iris scores every agent run for quality, safety, and cost - on your machine, with no SDK and no account. Most agent projects check quality by running a few remembered prompts and eyeballing the output. Iris replaces that with numbers you can audit: your agent's runs land in a SQLite database on your disk, 20 built-in rules score them deterministically - PII, prompt injection, hallucination markers, cost thresholds…

Is Iris Eval MCP Server still maintained?

Yes - as of 2026-09-18, its last commit was 2026-09-17 and it shipped 10+ releases in the last 90 days. We re-verify nightly.

How do I install Iris Eval MCP Server?

Run `npx -y @iris-eval/mcp-server`. The README documents 3 environment variables (IRIS_ANTHROPIC_API_KEY, IRIS_API_KEY, IRIS_ALLOW_UNAUTHENTICATED) to set first. Set IRIS_ANTHROPIC_API_KEY, IRIS_ALLOW_UNAUTHENTICATED before connecting. IRIS_API_KEY is optional or environment-specific per the README. You can also paste the ready-made client config above.

Does Iris Eval MCP Server run locally?

Yes - it's a stdio server: it runs on your machine (via npx) with your user's permissions. Your data stays local unless the server itself calls external APIs.

07 · Alternatives to Iris Eval MCP Server

More DevOps & monitoring MCP servers · Data Sentry · Marktplaats MCP · Forge Craft · Thoughtbox · Mushi Mushi

More TypeScript MCP servers · Stellaroid Earn · MERN MCP · Forage · A11y Check · Kolada MCP Server · see all