EvalGate

by evalgate · remote · no sign-in to list tools · v1.0.0 · published by GitHub user evalgate

Create and run AI evaluations, record traces, and inspect results with scoped organization access.

Changes · 3

Compare Registry entry

12 tools: 3 change things and 9 only read.

Scanned Oct 21, 2026

Deletes or cancels0Claude Code: deny
Can't be undone0Claude Code: ask
Changes things3Claude Code: ask: see these tools
Only reads9Claude Code: allow: see these tools

3 checks matched something in the tool definitions. No finding is not a safety guarantee. How the checks work.

claude mcp add --transport http evalgate https://www.evalgate.com/api/mcp --header 'Authorization: <your-authorization>'

Findings

Matches of fixed checks, with the text they matched.

2 warn1 info

Warnruns.list
The server marks "runs.list" read-only (readOnlyHint: true), and its own name, description or input give the class "write".
Matched text
annotations: {"readOnlyHint":true,"destructiveHint":false,"idempotentHint":true,"openWorldHint":false}; The name "runs.list" says "run": a word for a change.
What this check looks for
Warnrun.explain
The server marks "run.explain" read-only (readOnlyHint: true), and its own name, description or input give the class "write".
Matched text
annotations: {"readOnlyHint":true,"destructiveHint":false,"idempotentHint":true,"openWorldHint":false}; The name "run.explain" says "run": a word for a change.
What this check looks for
Infoconnections.graph
The input schema at properties.id.description mentions "credential".
Matched text
inputSchema.properties.id.description: "...returned by connections.backfill, not a credential ID."
What this check looks for

Tools

Open a tool for its reasons and full description. Descriptions are the publisher's own words, shown as they are.

12 tools

Changes things 3Creates or changes something that can be changed back.Claude Code: ask

connections.rootsPage independent configured account roots using current administrator authority.No findings
Why it is in this group
- Nothing in its name or description says what it does, so it is counted as a write.
- The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
Description, as the server wrote it
Page independent configured account roots using current administrator authority. Does not list secrets or imply verified connector availability.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
run.explainExplain a run using its status, failed-case metadata, and evidence-lineage summary.1 finding
Why it is in this group
- The name "run.explain" says "run": a word for a change.
- The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
Findings
- Warn
  The server marks "run.explain" read-only (readOnlyHint: true), and its own name, description or input give the class "write".
  Matched text
  annotations: {"readOnlyHint":true,"destructiveHint":false,"idempotentHint":true,"openWorldHint":false}; The name "run.explain" says "run": a word for a change.
  What this check looks for
Description, as the server wrote it
Explain a run using its status, failed-case metadata, and evidence-lineage summary.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
runs.listList evaluation runs with stable cursors and regression signals.1 finding
Why it is in this group
- The name "runs.list" says "run": a word for a change.
- The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
Findings
- Warn
  The server marks "runs.list" read-only (readOnlyHint: true), and its own name, description or input give the class "write".
  Matched text
  annotations: {"readOnlyHint":true,"destructiveHint":false,"idempotentHint":true,"openWorldHint":false}; The name "runs.list" says "run": a word for a change.
  What this check looks for
Description, as the server wrote it
List evaluation runs with stable cursors and regression signals.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false

Only reads 9Looks things up and changes nothing.Claude Code: allow

baseline.lineageShow the published baseline anchor and its evidence lineage.No findings
Why it is in this group
- The description's first verb is "show": a word for reading.
Description, as the server wrote it
Show the published baseline anchor and its evidence lineage.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
connections.catalogInspect all connector definitions and exact installed setup paths.No findings
Why it is in this group
- The description's first verb is "inspect": a word for reading.
Description, as the server wrote it
Inspect all connector definitions and exact installed setup paths. Unavailable blueprints and live verification are separate facts.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
connections.graphRead canonical connection references and currently visible exact resource revisions.1 finding
Why it is in this group
- The description's first verb is "read": a word for reading.
Findings
- Info
  The input schema at properties.id.description mentions "credential".
  Matched text
  inputSchema.properties.id.description: "...returned by connections.backfill, not a credential ID."
  What this check looks for
Description, as the server wrote it
Read canonical connection references and currently visible exact resource revisions. No source access grant or execution.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
connections.listList current workspace connection metadata, with source restrictions, freshness and bounded continuation.No findings
Why it is in this group
- The name "connections.list" says "list": a word for reading.
Description, as the server wrote it
List current workspace connection metadata, with source restrictions, freshness and bounded continuation. Does not reveal secrets or grant source access.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
connector.healthShow the latest connector-readiness reports for the organization.No findings
Why it is in this group
- The description's first verb is "show": a word for reading.
Description, as the server wrote it
Show the latest connector-readiness reports for the organization.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
docs.searchSearch the published OpenAPI operation catalog for relevant help.No findings
Why it is in this group
- The name "docs.search" says "search": a word for reading.
Description, as the server wrote it
Search the published OpenAPI operation catalog for relevant help.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
evaluations.listList evaluations with a stable cursor for the organization.No findings
Why it is in this group
- The name "evaluations.list" says "list": a word for reading.
Description, as the server wrote it
List evaluations with a stable cursor for the organization.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
project.inspectInspect the evaluations and project keys available in the authenticated organization.No findings
Why it is in this group
- The name "project.inspect" says "inspect": a word for reading.
Description, as the server wrote it
Inspect the evaluations and project keys available in the authenticated organization.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false
project.planReturn a non-mutating next-step plan for connecting a repository, evaluation, or trace source.No findings
Why it is in this group
- The description's first verb is "return": a word for reading.
Description, as the server wrote it
Return a non-mutating next-step plan for connecting a repository, evaluation, or trace source.
Annotations the server declares
- readOnlyHint: true
- destructiveHint: false
- idempotentHint: true
- openWorldHint: false

This is not a safety rating, and no finding is not a safety guarantee. The groups and findings come from fixed checks of the tool definitions the server returned on the date shown, not from its code or what it does when called. How the checks work.

Install

Pinned to version 1.0.0. Values in angle brackets are yours to fill in.

claude mcp add --transport http evalgate https://www.evalgate.com/api/mcp --header 'Authorization: <your-authorization>'

Run in a terminal.

Claude Code permissions

Allow the reads, ask before a change, deny the deletes. Paste into .claude/settings.json.

.claude/settings.json

{
  "permissions": {
    "allow": [
      "mcp__evalgate__project_inspect",
      "mcp__evalgate__project_plan",
      "mcp__evalgate__evaluations_list",
      "mcp__evalgate__baseline_lineage",
      "mcp__evalgate__docs_search",
      "mcp__evalgate__connector_health",
      "mcp__evalgate__connections_list",
      "mcp__evalgate__connections_catalog",
      "mcp__evalgate__connections_graph"
    ],
    "ask": [
      "mcp__evalgate__runs_list",
      "mcp__evalgate__run_explain",
      "mcp__evalgate__connections_roots"
    ],
    "deny": []
  }
}

Tools that only read are allowed, tools that change things ask first, tools that delete or cancel are denied. It assumes the server is installed as evalgate. Review it before you use it.

Keep track

Get told when this server's tools change: a new tool, a new description, a new class.

https://anlyon.dev/servers/io.github.evalgate/evalgate/changes.xml

An Atom feed. Works in any feed reader or Slack's RSS app.

Anlyon alternative

3 of these tools change something. Run those as governed actions.

Declare what an action changes, and Anlyon puts it under a shared limit, binds every approval to the exact request, and grades the outcome. It works on any HTTPS API you can describe as an action.

Anlyon does not run, proxy or govern this MCP server. A tool your own code calls directly is not routed through Anlyon and is not governed by it.

Import an OpenAPI spec →

Compare with other servers for the same product.

Source: MCP Registry. Synced Oct 21, 2026, 18:33 UTC.

For agents: Markdown · JSON · report this listing