Skip to content
MCPSTAMP

AnswerLive data

Can Claude check if a page is noindexed?

Not reliably from a chat. A noindex can sit in a meta robots tag or in an X-Robots-Tag response header, and the page text Claude reads with web search may show neither. Claude Code can fetch the page with curl and read both on your machine. Connect the Backlink Checker server (free token) and Claude fetches any URL and reports its HTTP status, content type, and whether it carries noindex or a page-level nofollow. It reads the page's own signals. For robots.txt rules and whether Google has indexed the page, use Search Console.

Connect with a free token Backlink Checker MCP server

What Claude does alone, and what needs the server

Claude on its own

  • Reads a meta robots tag in HTML you upload or paste.
  • Explains noindex, nofollow and robots.txt.

With the Backlink Checker server

  • The meta robots tag and X-Robots-Tag header of a live URL.
  • A quick check after a deploy that a page is indexable.
  • The same check on a page that links to you.

A real call to the live server

We sent this to the hosted server on 2026-11-05. The answer below is the server's own text, not a mock-up. Live values will differ when you ask.

You ask

Is Wikipedia's search page noindexed?

Tool call

robots_guard_check {"url":"https://en.wikipedia.org/wiki/Special:Search"}

Server answer

URL: https://en.wikipedia.org/wiki/Special:Search Status: 200 Content-Type: text/html; charset=UTF-8 noindex: YES nofollow (page-level): YES

Run on 5 November 2026 against live pages, so a later run can differ.

You ask

And the Model Context Protocol article?

Tool call

robots_guard_check {"url":"https://en.wikipedia.org/wiki/Model_Context_Protocol"}

Server answer

URL: https://en.wikipedia.org/wiki/Model_Context_Protocol Status: 200 Content-Type: text/html; charset=UTF-8 noindex: no nofollow (page-level): no

Run on 5 November 2026 against live pages, so a later run can differ.

Connect it in 1 minute

Get a free token first. No account, 30 days, 600 calls an hour. Put it in the URL in place of <token>. In Claude.ai or Claude Desktop open Settings, then Connectors, then Add custom connector, and paste the URL.

1. Free token

curl -s -X POST https://mcp.zovo.one/mcp/token

Connector URL (replace <token>)

https://mcp.zovo.one/mcp/backlink-checker/t/<token>

Claude Code

claude mcp add --transport http backlink-checker https://mcp.zovo.one/mcp/backlink-checker/t/<token>

Cursor (~/.cursor/mcp.json)

{
  "mcpServers": {
    "backlink-checker": {
      "url": "https://mcp.zovo.one/mcp/backlink-checker/t/<token>"
    }
  }
}

VS Code (.vscode/mcp.json)

{
  "servers": {
    "backlink-checker": {
      "type": "http",
      "url": "https://mcp.zovo.one/mcp/backlink-checker/t/<token>"
    }
  }
}

All 6 tools, free and Pro limits and more prompts are on the Backlink Checker MCP server page.

Questions

Can Claude check if a page is noindexed?
Not reliably from a chat. A noindex can sit in a meta robots tag or in an X-Robots-Tag response header, and the page text Claude reads with web search may show neither. Claude Code can fetch the page with curl and read both on your machine. Connect the Backlink Checker server (free token) and Claude fetches any URL and reports its HTTP status, content type, and whether it carries noindex or a page-level nofollow. It reads the page's own signals. For robots.txt rules and whether Google has indexed the page, use Search Console.
Does noindex mean Google dropped the page?
No. It means the page asks search engines not to index it. Whether Google has indexed it is shown in Search Console.
What is free, and what does Pro add?
Single-URL link checks and robots checks are free with no monthly cap, and link_audit takes 3 URLs per call. Nothing is stored, so every check is a fresh fetch. Pro is $19 once for the Backlink Checker server, or $39 once for all 49 servers. It removes the 3 URL limit on link_audit.
Is the server free?
The hosted Backlink Checker server has a free tier. A free token lasts 30 days and allows 600 calls an hour, with no account. Some features are Pro, and the server page lists what is free and what is not.

More questions people ask Claude

All answers ยท All free servers

Get an email when a new free server ships

About once a month, one short email lists the free MCP servers and Can Claude answers we added since the last one. Your address is used for nothing else. We first send a link to confirm, and you are not on the list until you click it. Every email has an unsubscribe link. Details are on the privacy page.