AimRank

by aimrank.io · remote · no sign-in to list tools · v4.12.0 · published by io.aimrank

Read public pairwise-preference rankings and their statistical quality evidence. No API key.

Changes · 4

Compare Registry entry

21 tools: 4 change things and 17 only read.

Scanned Oct 21, 2026

Deletes or cancels0Claude Code: deny
Can't be undone0Claude Code: ask
Changes things4Claude Code: ask: see these tools
Only reads17Claude Code: allow: see these tools

1 check matched something in the tool definitions. No finding is not a safety guarantee. How the checks work.

claude mcp add --transport http aimrank https://app.aimrank.io/mcp/public

Findings

Matches of fixed checks, with the text they matched.

1 warn

Warnaimrank_create_share_card
The server marks "aimrank_create_share_card" read-only (readOnlyHint: true), and its own name, description or input give the class "write".
Matched text
annotations: {"readOnlyHint":true,"idempotentHint":true,"openWorldHint":true}; The name "aimrank_create_share_card" says "create": a word for a change.
What this check looks for

Tools

Open a tool for its reasons and full description. Descriptions are the publisher's own words, shown as they are.

21 tools

Changes things 4Creates or changes something that can be changed back.Claude Code: ask

aimrank_create_share_cardReturn share-ready URLs + embed snippets for a ranking.1 finding
Why it is in this group
- The name "aimrank_create_share_card" says "create": a word for a change.
- The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
Findings
- Warn
  The server marks "aimrank_create_share_card" read-only (readOnlyHint: true), and its own name, description or input give the class "write".
  Matched text
  annotations: {"readOnlyHint":true,"idempotentHint":true,"openWorldHint":true}; The name "aimrank_create_share_card" says "create": a word for a change.
  What this check looks for
Description, as the server wrote it
Return share-ready URLs + embed snippets for a ranking. Formats: "all" (default — everything), "twitter", "linkedin", "embed_leaderboard", "embed_vote", "badge_markdown", "qr_code", "data_card". Pass these to a human to paste into a tweet, blog, Notion page, or Slack message. The OG image renders automatically when the public_url is unfurled by Twitter / LinkedIn / Slack. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_healthcheckiCOMPLY contract: liveness + DB-connectivity probe.No findings
Why it is in this group
- Nothing in its name or description says what it does, so it is counted as a write.
- The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
Description, as the server wrote it
iCOMPLY contract: liveness + DB-connectivity probe.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_predictiCOMPLY contract: pairwise prediction with provenance fields.No findings
Why it is in this group
- Nothing in its name or description says what it does, so it is counted as a write.
- The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
Description, as the server wrote it
iCOMPLY contract: pairwise prediction with provenance fields. Returns the engine's predicted winner + probability shaped so iCOMPLY's Annex IV section-4 generator can ingest the response directly. See [iCOMPLY_INTEGRATION_STRATEGY.md] for the contract. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_predict_matchup_winnerPredict the winner of a matchup BEFORE a vote is cast.No findings
Why it is in this group
- Nothing in its name or description says what it does, so it is counted as a write.
- The server marks it read-only (readOnlyHint: true), but an annotation never lowers a class.
Description, as the server wrote it
Predict the winner of a matchup BEFORE a vote is cast. Uses Glicko-2 win probability under the same formula matchmaking uses internally. Pairs with aimrank_submit_vote for the "Claude predicts, you vote, we compare" demo. Does not record a vote — read-only. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true

Only reads 17Looks things up and changes nothing.Claude Code: allow

aimrank_discover_public_rankingsBrowse public rankings — agent equivalent of surfing aimrank.io.No findings
Why it is in this group
- The description's first verb is "browse": a word for reading.
Description, as the server wrote it
Browse public rankings — agent equivalent of surfing aimrank.io. Filters: category, media_type ("text" | "image" | "audio" | "video"), sort ("trending" | "recent" | "most_votes" | "random"), limit 1-50. Each result embeds share assets so the agent can hand any ranking back to the user as a clickable link without a follow-up call. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_explainiCOMPLY contract: explain a prediction in features + narrative.No findings
Why it is in this group
- The name "aimrank_explain" says "explain": a word for reading.
Description, as the server wrote it
iCOMPLY contract: explain a prediction in features + narrative. Returns the Glicko-2 μ/φ inputs for both entities + a deterministic narrative. No LLM-synthesised rationale — these are the actual numbers the math uses, which is exactly what an Annex IV auditor needs to trace. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_find_similar_domainsFind public domains most similar to a query or a known domain.No findings
Why it is in this group
- The name "aimrank_find_similar_domains" says "find": a word for reading.
Description, as the server wrote it
Find public domains most similar to a query or a known domain. Use ``query`` for free-text search ("pharma evaluation") OR ``domain_id`` to find domains similar to one you already know. Exactly one must be provided. TF-IDF + cosine similarity over name + description + category + declared constitution + objectives text. Cheap (no embedding API calls), 5-minute in-process cache. Only public domains are searched / returned. Score in [0, 1] — typical "useful match" threshold is ≥0.15; "near duplicate" is ≥0.5. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_agreementInter-annotator agreement — Layer 5.No findings
Why it is in this group
- The name "aimrank_get_agreement" says "get": a word for reading.
Description, as the server wrote it
Inter-annotator agreement — Layer 5. Returns Cohen's κ (n=2 raters), Fleiss' κ, Krippendorff's α, Scott's π + Landis-Koch interpretation, plus the multi-rater coverage report. `min_raters` overrides the ranking's configured min_raters_per_pair. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_ceilingPairwise-κ ceiling from qualification attempts.No findings
Why it is in this group
- The name "aimrank_get_ceiling" says "get": a word for reading.
Description, as the server wrote it
Pairwise-κ ceiling from qualification attempts. The upper bound any judge / RM can credibly hit on this domain — used to pin the L3 pilot refund clause (refund if κ < ceiling - 5pp). api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_crowd_btCrowdBT — joint fit of entity scores + per-annotator reliability η.No findings
Why it is in this group
- The name "aimrank_get_crowd_bt" says "get": a word for reading.
Description, as the server wrote it
CrowdBT — joint fit of entity scores + per-annotator reliability η. Surfaces noisy / anti-correlated raters explicitly. Methodology audit, not a live engine. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_daily_pairFetch today's Daily Pair — the trending matchup chosen at 00:00 UTC.No findings
Why it is in this group
- The name "aimrank_get_daily_pair" says "get": a word for reading.
Description, as the server wrote it
Fetch today's Daily Pair — the trending matchup chosen at 00:00 UTC. Pairs with the `vote_of_the_day` agent template. Returns the challenge + a fresh matchup. If the cron hasn't run yet, falls back via ok=False so the agent can use `aimrank_get_matchup` instead. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_data_cardAuto data card — Layer 7.No findings
Why it is in this group
- The name "aimrank_get_data_card" says "get": a word for reading.
Description, as the server wrote it
Auto data card — Layer 7. Provenance + IAA + coverage + per-annotator quality + transitivity + qualification stats in one synthesized markdown audit artefact. Format: 'markdown' (default) or 'json' for structured summary. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_domainGet domain details including entity pool and competition list.No findings
Why it is in this group
- The name "aimrank_get_domain" says "get": a word for reading.
Description, as the server wrote it
Get domain details including entity pool and competition list. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_leaderboardGet the top N entities of a ranking sorted by rating.No findings
Why it is in this group
- The name "aimrank_get_leaderboard" says "get": a word for reading.
Description, as the server wrote it
Get the top N entities of a ranking sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_matchupGet the next pair of entities to evaluate.No findings
Why it is in this group
- The name "aimrank_get_matchup" says "get": a word for reading.
Description, as the server wrote it
Get the next pair of entities to evaluate. Strategies: adaptive (default), swiss, balanced, random, uncertainty, explore, information_gain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_plackett_lucePlackett-Luce listwise ranking aggregation — OFFLINE AUDIT ONLY.No findings
Why it is in this group
- The name "aimrank_get_plackett_luce" says "get": a word for reading.
Description, as the server wrote it
Plackett-Luce listwise ranking aggregation — OFFLINE AUDIT ONLY. Reported post-hoc; it NEVER writes ratings, and setting it as a ranking's algorithm returns 400. AimRank has 6 rating engines plus 2 offline aggregators (this and CrowdBT) — never describe it as an 8th rating algorithm. Generalises Bradley-Terry to ranked lists. On pairwise data, collapses to BT MLE — useful as a second-opinion aggregator. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_get_rankingFetch a ranking's metadata + top 25 entities sorted by rating.No findings
Why it is in this group
- The name "aimrank_get_ranking" says "get": a word for reading.
Description, as the server wrote it
Fetch a ranking's metadata + top 25 entities sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_list_competitionsList all competitions (open voting + brackets) in a domain.No findings
Why it is in this group
- The name "aimrank_list_competitions" says "list": a word for reading.
Description, as the server wrote it
List all competitions (open voting + brackets) in a domain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_list_domain_entitiesList all entities in a domain's pool sorted by rating.No findings
Why it is in this group
- The name "aimrank_list_domain_entities" says "list": a word for reading.
Description, as the server wrote it
List all entities in a domain's pool sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_list_public_judgesBrowse public judge-prompt artifacts shared by other users.No findings
Why it is in this group
- The name "aimrank_list_public_judges" says "list": a word for reading.
Description, as the server wrote it
Browse public judge-prompt artifacts shared by other users. Filter by ``category`` (free-text), ``domain_id``, or both. Sort options: ``fork_count`` (default — most-forked first), ``recent``, ``faithfulness``. Returns artifact summaries WITHOUT the full prompt text — call `aimrank_fork_judge_prompt` or the REST GET to retrieve the full prompt before using it. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true
aimrank_search_entitiesFind entities by name substring within a ranking.No findings
Why it is in this group
- The name "aimrank_search_entities" says "search": a word for reading.
Description, as the server wrote it
Find entities by name substring within a ranking. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.
Annotations the server declares
- readOnlyHint: true
- idempotentHint: true
- openWorldHint: true

This is not a safety rating, and no finding is not a safety guarantee. The groups and findings come from fixed checks of the tool definitions the server returned on the date shown, not from its code or what it does when called. How the checks work.

Install

Pinned to version 4.12.0. Values in angle brackets are yours to fill in.

claude mcp add --transport http aimrank https://app.aimrank.io/mcp/public

Run in a terminal.

Claude Code permissions

Allow the reads, ask before a change, deny the deletes. Paste into .claude/settings.json.

.claude/settings.json

{
  "permissions": {
    "allow": [
      "mcp__aimrank__aimrank_get_daily_pair",
      "mcp__aimrank__aimrank_get_ranking",
      "mcp__aimrank__aimrank_get_leaderboard",
      "mcp__aimrank__aimrank_get_matchup",
      "mcp__aimrank__aimrank_search_entities",
      "mcp__aimrank__aimrank_discover_public_rankings",
      "mcp__aimrank__aimrank_list_domain_entities",
      "mcp__aimrank__aimrank_get_domain",
      "mcp__aimrank__aimrank_list_competitions",
      "mcp__aimrank__aimrank_get_data_card",
      "mcp__aimrank__aimrank_get_agreement",
      "mcp__aimrank__aimrank_get_ceiling",
      "mcp__aimrank__aimrank_get_plackett_luce",
      "mcp__aimrank__aimrank_get_crowd_bt",
      "mcp__aimrank__aimrank_list_public_judges",
      "mcp__aimrank__aimrank_find_similar_domains",
      "mcp__aimrank__aimrank_explain"
    ],
    "ask": [
      "mcp__aimrank__aimrank_create_share_card",
      "mcp__aimrank__aimrank_predict_matchup_winner",
      "mcp__aimrank__aimrank_predict",
      "mcp__aimrank__aimrank_healthcheck"
    ],
    "deny": []
  }
}

Tools that only read are allowed, tools that change things ask first, tools that delete or cancel are denied. It assumes the server is installed as aimrank. Review it before you use it.

Keep track

Get told when this server's tools change: a new tool, a new description, a new class.

https://anlyon.dev/servers/io.aimrank/aimrank/changes.xml

An Atom feed. Works in any feed reader or Slack's RSS app.

Anlyon alternative

4 of these tools change something. Run those as governed actions.

Declare what an action changes, and Anlyon puts it under a shared limit, binds every approval to the exact request, and grades the outcome. It works on any HTTPS API you can describe as an action.

Anlyon does not run, proxy or govern this MCP server. A tool your own code calls directly is not routed through Anlyon and is not governed by it.

Import an OpenAPI spec →

Compare with other servers for the same product.

Source: MCP Registry. Synced Oct 21, 2026, 18:13 UTC.

For agents: Markdown · JSON · report this listing