Skip to content

agent-web — URL to LLM-ready markdown: a polite, robots-respecting web page reader (free)

by foomworks · remote · no sign-in to list tools · v0.2.1 · published by GitHub user foomworks

URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key

Changes · 1
CompareRegistry entry

5 tools: 1 change things and 4 only read.

Scanned Oct 21, 2026

No check matched anything in the tool definitions. No finding is not a safety guarantee. How the checks work.

claude mcp add --transport http agent-web https://agent-web.foomworks.workers.dev/mcp

Tools

Open a tool for its reasons and full description. Descriptions are the publisher's own words, shown as they are.

5 tools

Changes things 1Claude Code: ask
  • render_pdfPAID (x402): returns x402 payment instructions for a PDF render of a publicly reachable URL, via a real, robots-respecting headless browser.No findings

    Why it is in this group

    • Nothing in its name or description says what it does, so it is counted as a write.
    Description, as the server wrote it
    PAID (x402): returns x402 payment instructions for a PDF render of a publicly reachable URL, via a real, robots-respecting headless browser. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.
Only reads 4Claude Code: allow
  • read_urlFetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown).No findings

    Why it is in this group

    • The name "read_url" says "read": a word for reading.
    Description, as the server wrote it
    Fetch one publicly reachable URL and return clean, LLM-ready markdown (title + page description + word count + markdown). HTML pages are extracted to markdown — including HTML tables, which become GitHub-flavored Markdown tables; URLs pointing straight at a Markdown or plain-text document (raw READMEs, llms.txt, docs) are passed through verbatim. Polite by design: honors the origin's robots.txt for our user-agent, identifies honestly, read-only GET, never bypasses anti-bot/CAPTCHA/paywalls. Free. JavaScript-rendered pages are not supported yet.
  • read_url_previewLike read_url but returns only the page description + the first ~600 characters of the markdown (title + word count + a truncation flag) — a cheap way to check a page's relevance b…No findings

    Why it is in this group

    • The name "read_url_preview" says "read": a word for reading.
    Description, as the server wrote it
    Like read_url but returns only the page description + the first ~600 characters of the markdown (title + word count + a truncation flag) — a cheap way to check a page's relevance before pulling the full text. Free.
  • render_previewFree discovery stub for the screenshot/PDF render lane.No findings

    Why it is in this group

    • The name "render_preview" says "preview": a word for reading.
    Description, as the server wrote it
    Free discovery stub for the screenshot/PDF render lane. Same robots/SSRF guards as read_url. Currently returns a 503 (no charge) until Cloudflare Browser Rendering is provisioned on this account.
  • render_screenshotPAID (x402): returns x402 payment instructions for a PNG screenshot of a publicly reachable URL, rendered via a real, robots-respecting headless browser.No findings

    Why it is in this group

    • The name "render_screenshot" says "screenshot": a word for reading.
    Description, as the server wrote it
    PAID (x402): returns x402 payment instructions for a PNG screenshot of a publicly reachable URL, rendered via a real, robots-respecting headless browser. Use render_preview (free) first. Currently soft-skips 503 until Cloudflare Browser Rendering is provisioned.

This is not a safety rating, and no finding is not a safety guarantee. The groups and findings come from fixed checks of the tool definitions the server returned on the date shown, not from its code or what it does when called. How the checks work.

Install

Pinned to version 0.2.1. Values in angle brackets are yours to fill in.

claude mcp add --transport http agent-web https://agent-web.foomworks.workers.dev/mcp

Run in a terminal.

Claude Code permissions

Allow the reads, ask before a change, deny the deletes. Paste into .claude/settings.json.

.claude/settings.json
{
  "permissions": {
    "allow": [
      "mcp__agent-web__read_url",
      "mcp__agent-web__read_url_preview",
      "mcp__agent-web__render_preview",
      "mcp__agent-web__render_screenshot"
    ],
    "ask": [
      "mcp__agent-web__render_pdf"
    ],
    "deny": []
  }
}

Tools that only read are allowed, tools that change things ask first, tools that delete or cancel are denied. It assumes the server is installed as agent-web. Review it before you use it.