Skip to content
anlyon.devby Anlyon

SCRIPTMASTERLABS — Calibration Court

com.scriptmasterlabs/calibration-courtscriptmasterlabs.comstreamable-httpv1.0.0Scanned

Calibration Court MCP: model calibration leaderboard, ledger verify, paid recalibration via x402.

5 tools: 5 change things.

Tools: 0 delete, 0 irreversible, 5 write, 0 read.
  • Reads private data · 0
  • Reads text others write · 0
  • Can send data out · 0
  • 1 finding

Anlyon alternative

5 of these tools change something. Run those as governed actions.

Declare what an action changes, and Anlyon puts it under a shared limit, binds every approval to the exact request, and grades the outcome. It works on any HTTPS API you can describe as an action.

Anlyon does not run, proxy or govern this MCP server. A tool your own code calls directly is not routed through Anlyon and is not governed by it.

Import an OpenAPI spec →
Compare with similar serversMarkdownJSONReport this listing

Tools

Grouped by what each tool does, most consequential first. Open one for its reasons and full description; descriptions are the publisher's own words.

5 tools

Changes things 5Claude Code: ask
  • court_calibrate_labelsPaid (x402, USDC on Base).1 finding

    Why it is in this group

    • The name "court_calibrate_labels" says "label": a word for a change.
    • The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.

    Findings

    • Warn

      The server marks "court_calibrate_labels" read-only (readOnlyHint: true), and its own name, description or input give the class "write".

      Matched text

      annotations: {"readOnlyHint":true}; The name "court_calibrate_labels" says "label": a word for a change.

      What this check looks for
    Description, as the server wrote it
    Paid (x402, USDC on Base). Fit isotonic calibration on YOUR labelled outcomes ({p,y} pairs) and recalibrate the given probabilities. Stateless; nothing is stored.

    Annotations the server declares

    • readOnlyHint: true
    • x-price-usd: 0.05
  • court_leaderboardLive ranking of decision models by Brier score on resolved real-world questions.No findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    • The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
    Description, as the server wrote it
    Live ranking of decision models by Brier score on resolved real-world questions. Free. Returns empty lists when nothing has resolved.

    Annotations the server declares

    • readOnlyHint: true
  • court_model_reportCalibration report for one model: Brier, ECE, reliability bins with Wilson intervals, overconfidence, drift.No findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    • The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
    Description, as the server wrote it
    Calibration report for one model: Brier, ECE, reliability bins with Wilson intervals, overconfidence, drift. Free.

    Annotations the server declares

    • readOnlyHint: true
  • court_recalibratePaid (x402, USDC on Base).No findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    • The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
    Description, as the server wrote it
    Paid (x402, USDC on Base). Map a model's raw probability to an empirically calibrated one using resolved outcomes on the ledger. Refuses with insufficient_data below 30 samples.

    Annotations the server declares

    • readOnlyHint: true
    • x-price-usd: 0.01
  • court_verify_ledgerRecompute the SHA-256 hash chain and cross-check derived tables.No findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    • The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
    Description, as the server wrote it
    Recompute the SHA-256 hash chain and cross-check derived tables. Free.

    Annotations the server declares

    • readOnlyHint: true

This is not a safety rating, and no finding is not a safety guarantee. The groups and findings come from fixed checks of the tool definitions the server returned on the date shown, not from its code or what it does when called. How the checks work.

Exfil surface

Which tools read private data, which read text someone else can write, and which can send data out. One of each is a path a prompt injection can use.

No private-data, untrusted-input, outbound path in this server alone: no tool is tagged private-data or untrusted-input or outbound.

Reads private data0
Reads files, mail, messages, databases, secrets, calendars or repositories.
Reads text others write0
Brings in text someone else can write: web pages, inbound email, messages, issues and comments.
Can send data out0
Can carry data to people or systems: it sends, posts or publishes, or takes a recipient, channel or URL.

Other servers in the same agent add their own tools to these paths. Audit your whole setup to see them together.

Findings

Matches of fixed checks, with the text they matched.

1 warn
  • Warncourt_calibrate_labels

    The server marks "court_calibrate_labels" read-only (readOnlyHint: true), and its own name, description or input give the class "write".

    Matched text

    annotations: {"readOnlyHint":true}; The name "court_calibrate_labels" says "label": a word for a change.

    What this check looks for

History

Changes to its tool definitions and to its remote endpoint, newest first.

No change seen yet. Its tools are rescanned every day, and a remote endpoint is looked at once a week.

All changes to this server

Install

Pinned to version 1.0.0. Values in angle brackets are yours to fill in.

claude mcp add --transport http calibration-court https://calibration-court.onrender.com/mcp
claude mcp add --transport http calibration-court https://calibration-court.onrender.com/mcp

Run in a terminal.

Claude Code permissions

Allow the reads, ask before a change or a way out, deny the deletes. Paste into .claude/settings.json.

.claude/settings.json
{
  "permissions": {
    "allow": [],
    "ask": [
      "mcp__calibration-court__court_leaderboard",
      "mcp__calibration-court__court_model_report",
      "mcp__calibration-court__court_verify_ledger",
      "mcp__calibration-court__court_recalibrate",
      "mcp__calibration-court__court_calibrate_labels"
    ],
    "deny": []
  }
}

Tools that only read are allowed, tools that change things ask first, tools that delete or cancel are denied. A read that can send data out (it takes a URL, say) asks first too. It assumes the server is installed as calibration-court. Review it before you use it.

Pin

Keep the decision: fail CI when the tools change, follow every change, or show a badge.

Pin in CI

Fail a build when the tools you reviewed are not the tools the server serves today.

curl -s "https://anlyon.dev/api/v1/servers/com.scriptmasterlabs/calibration-court/verify?hash=6bff18e54881e52e5cdc62d8c5b657dda666e431b2f9fc5295dab5a33814f9fa" | jq -e '.changed == false'

Pinned hash 6bff18e54881, from Oct 24, 2026, 10:18 UTC.

Watch

Get told when its tools change: a new tool, a new description, a new class.

https://anlyon.dev/servers/com.scriptmasterlabs/calibration-court/changes.xml

An Atom feed. Works in any feed reader or Slack's RSS app.

Badge

anlyon.dev badge for com.scriptmasterlabs/calibration-court
[![anlyon.dev](https://anlyon.dev/badge/com.scriptmasterlabs/calibration-court.svg)](https://anlyon.dev/servers/com.scriptmasterlabs/calibration-court)

Source: MCP Registry. Synced Oct 24, 2026, 10:17 UTC.