Skip to content

Model Tested

by modeltested.com · remote · no sign-in to list tools · v1.0.0 · published by com.modeltested

Independent test scores for open-weight LLMs: best model for your GPU or Mac, comparisons.

Changes · 1
CompareRegistry entry

5 tools: 1 change things and 4 only read.

Scanned Oct 21, 2026

No check matched anything in the tool definitions. No finding is not a safety guarantee. How the checks work.

claude mcp add --transport http llm-benchmarks https://modeltested.com/mcp

Tools

Open a tool for its reasons and full description. Descriptions are the publisher's own words, shown as they are.

5 tools

Changes things 1Claude Code: ask
  • decision_modelsUse this whenever the user asks about decision models or LLMs for classification, routing, triage or yes/no calls.No findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    • The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
    Description, as the server wrote it
    Use this whenever the user asks about decision models or LLMs for classification, routing, triage or yes/no calls. Accuracy on our decision test (routing tickets, applying rules, spotting phishing, flagging risky code changes), how well each model's confidence matches its accuracy (calibration), and API cost per 1,000 calls. Covers dedicated decision models and regular LLMs given the same tasks.

    Annotations the server declares

    • readOnlyHint: true
    • openWorldHint: false
Only reads 4Claude Code: allow
  • compare_modelsUse this whenever the user asks how two or more open-weight models compare, or which of them to pick.No findings

    Why it is in this group

    • The name "compare_models" says "compare": a word for reading.
    Description, as the server wrote it
    Use this whenever the user asks how two or more open-weight models compare, or which of them to pick. Returns our test scores, rank and memory needs for 2 to 6 models side by side.

    Annotations the server declares

    • readOnlyHint: true
    • openWorldHint: false
  • find_modelsUse this whenever the user asks which local or open-weight LLM is best, overall or for coding, documents or decisions, or which model they can run on their graphics card (VRAM) or …No findings

    Why it is in this group

    • The name "find_models" says "find": a word for reading.
    Description, as the server wrote it
    Use this whenever the user asks which local or open-weight LLM is best, overall or for coding, documents or decisions, or which model they can run on their graphics card (VRAM) or Mac. Returns tested models ranked by our own test scores, best first; with a GPU or Mac memory size it only returns models that fit, plus the quantization to download and the memory it needs. Examples: 'best model for a 16 GB GPU', 'best coding model on a 32 GB Mac', 'best small model under 10B'.

    Annotations the server declares

    • readOnlyHint: true
    • openWorldHint: false
  • get_modelUse this whenever the user asks about a specific open-weight model: how good it is, its benchmark scores, whether it's worth using, how much VRAM or memory it needs, or which quant…No findings

    Why it is in this group

    • The name "get_model" says "get": a word for reading.
    Description, as the server wrote it
    Use this whenever the user asks about a specific open-weight model: how good it is, its benchmark scores, whether it's worth using, how much VRAM or memory it needs, or which quantization to download. Returns our test scores, rank, memory at each quantization, the smallest GPU and Mac it fits, decision accuracy and our Q4 run on a Mac when there is one. Accepts a name or slug, e.g. 'qwen3.5 9b' or 'gpt-oss-20b'.

    Annotations the server declares

    • readOnlyHint: true
    • openWorldHint: false
  • search_articlesFind Model Tested articles and ranking pages by keyword, newest first: news about newly tested models, guides on quantization, Ollama and memory.No findings

    Why it is in this group

    • The name "search_articles" says "search": a word for reading.
    Description, as the server wrote it
    Find Model Tested articles and ranking pages by keyword, newest first: news about newly tested models, guides on quantization, Ollama and memory. Returns title, summary, date and link.

    Annotations the server declares

    • readOnlyHint: true
    • openWorldHint: false

This is not a safety rating, and no finding is not a safety guarantee. The groups and findings come from fixed checks of the tool definitions the server returned on the date shown, not from its code or what it does when called. How the checks work.

Install

Pinned to version 1.0.0. Values in angle brackets are yours to fill in.

claude mcp add --transport http llm-benchmarks https://modeltested.com/mcp

Run in a terminal.

Claude Code permissions

Allow the reads, ask before a change, deny the deletes. Paste into .claude/settings.json.

.claude/settings.json
{
  "permissions": {
    "allow": [
      "mcp__llm-benchmarks__find_models",
      "mcp__llm-benchmarks__get_model",
      "mcp__llm-benchmarks__compare_models",
      "mcp__llm-benchmarks__search_articles"
    ],
    "ask": [
      "mcp__llm-benchmarks__decision_models"
    ],
    "deny": []
  }
}

Tools that only read are allowed, tools that change things ask first, tools that delete or cancel are denied. It assumes the server is installed as llm-benchmarks. Review it before you use it.