podlexicon.com

5 of 8 AI crawlers may read the site, 3 disallowed

• GET /robots.txt -> HTTP 200, 2.7 KB, 8 user-agent groups
• Allowed: OAI-SearchBot (via *) (8 path rules), Google-Extended, Amazonbot (via *) (8 path rules), CCBot (via *) (8 path rules), Bytespider (via *) (8 path rules)
• Disallowed: GPTBot, ClaudeBot, PerplexityBot
• Sitemap declared: https://podlexicon.com/sitemap.xml

Fix: Add a group for GPTBot, ClaudeBot, PerplexityBot with "Allow: /" (or drop the blanket "Disallow: /") if you want answer engines to cite you.

2 of 7 surfaces present (/llms.txt, /.well-known/mcp-registry-auth); sitemap via robots.txt

• /llms.txt: HTTP 200, 1.8 KB of text
• /sitemap.xml: HTTP 200 but binary content (application/xml, application/xml)
• /.well-known/x402: HTTP 403
• /.well-known/agent-card.json: HTTP 403
• /.well-known/mcp-registry-auth: HTTP 200, 67 B of text (MCPv1 record)
• /openapi.json: HTTP 200 but an HTML page (catch-all route, not a real file)
• /ai.txt: HTTP 200 but an HTML page (catch-all route, not a real file)
• Sitemap declared in robots.txt instead: https://podlexicon.com/sitemap.xml

Fix: Nothing to fix here.

Home page is a JS-only shell

• GET https://podlexicon.com/ -> HTTP 200, text/html, 4.9 KB
• 74 characters of visible text with scripts, styles and tags removed; <title>: "PodLexicon - Discover Your Perfect Podcast"
• 1 external script, 2 inline; <noscript> present
• empty root container found (<div id="root">): the page is assembled by JavaScript
• first words: "Discover Your Perfect Podcast — Search 85,000+ Episode Transcripts with AI"

Fix: Server-render or prerender the first paint so the HTML carries your text; agents and most crawlers do not execute your scripts.

2 JSON-LD blocks, Open Graph incomplete

• 2 JSON-LD blocks: @type Organization, WebSite
• Open Graph: no og:title; no og:description
• meta description: present

Fix: add og:title and og:description so answer engines describe you accurately.

Unavailable

• takeitdown.agentexchange.work/check.json: refused takeitdown.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would - unavailable

Fix: Re-run in a few minutes; the notice check could not be completed.

Exposes /mcp but is not in the census

• census unavailable (refused index.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would time )
• GET /mcp -> HTTP 200 (text/event-stream): an endpoint answers
• Index MCP probe record: refused index.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would time

Fix: Publish /.well-known/x402 with your paid routes so payment indexers can list you.