Skip to content

io.github.lazymac2x/llm-output-quality-monitor

by lazymac2x · remote · no sign-in to list tools · v1.0.0 · published by GitHub user lazymac2x

Cloudflare Workers MCP server: llm-output-quality-monitor

Changes · 3
CompareRegistry entry

5 tools: 3 change things and 2 only read.

Scanned Oct 21, 2026

No check matched anything in the tool definitions. No finding is not a safety guarantee. How the checks work.

claude mcp add --transport http llm-output-quality-monitor https://api.lazy-mac.com/llm-output-quality-monitor/mcp

Tools

Open a tool for its reasons and full description. Descriptions are the publisher's own words, shown as they are.

5 tools

Changes things 3Claude Code: ask
  • consistency_checkCheck consistency across multiple LLM responsesNo findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    Description, as the server wrote it
    Check consistency across multiple LLM responses
  • drift_detectorDetect quality drift between current and previous LLM responsesNo findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    Description, as the server wrote it
    Detect quality drift between current and previous LLM responses
  • hallucination_scorerPattern-based heuristic risk scoring for LLM responses (0-100).No findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    Description, as the server wrote it
    Pattern-based heuristic risk scoring for LLM responses (0-100). Detects linguistic signals such as contradictory assertions, unsourced claims, and uncertainty markers. Not a semantic hallucination detector.
Only reads 2Claude Code: allow
  • quality_validatorValidate LLM response quality based on length, format, and structureNo findings

    Why it is in this group

    • The description's first verb is "validate": a word for reading.
    Description, as the server wrote it
    Validate LLM response quality based on length, format, and structure
  • schema_enforcerValidate JSON response against schemaNo findings

    Why it is in this group

    • The description's first verb is "validate": a word for reading.
    Description, as the server wrote it
    Validate JSON response against schema

This is not a safety rating, and no finding is not a safety guarantee. The groups and findings come from fixed checks of the tool definitions the server returned on the date shown, not from its code or what it does when called. How the checks work.

Install

Pinned to version 1.0.0. Values in angle brackets are yours to fill in.

claude mcp add --transport http llm-output-quality-monitor https://api.lazy-mac.com/llm-output-quality-monitor/mcp

Run in a terminal.

Claude Code permissions

Allow the reads, ask before a change, deny the deletes. Paste into .claude/settings.json.

.claude/settings.json
{
  "permissions": {
    "allow": [
      "mcp__llm-output-quality-monitor__quality_validator",
      "mcp__llm-output-quality-monitor__schema_enforcer"
    ],
    "ask": [
      "mcp__llm-output-quality-monitor__drift_detector",
      "mcp__llm-output-quality-monitor__hallucination_scorer",
      "mcp__llm-output-quality-monitor__consistency_check"
    ],
    "deny": []
  }
}

Tools that only read are allowed, tools that change things ask first, tools that delete or cancel are denied. It assumes the server is installed as llm-output-quality-monitor. Review it before you use it.