Top fixes
- Crawler access (+2 points): Add a group for GPTBot, ClaudeBot, OAI-SearchBot and the others with "Allow: /" (or drop the blanket "Disallow: /") if you want answer engines to cite you. How to fix
- MCP census entry (+2 points): Expose a Streamable HTTP MCP endpoint at /mcp (or a paid x402 route) so agents can call you, not just read you. How to fix
- Machine-readable surfaces (+1 point): Publish /llms.txt (a short Markdown guide to your key pages); one agent surface: /openapi.json, /.well-known/agent-card.json, or /.well-known/x402 if you sell to agents. How to fix
Ordered by points recoverable. Each area: 2/2 pass, 1/2 warn, 0/2 fail.
huffpost.com is graded D. The $49 AI Visibility Full Report turns the 2 failing checks above (crawler access, machine-readable surfaces) into a prioritized, specific fix list for huffpost.com, and tests 8 real buyer questions across ChatGPT-class models to show what AI answers say about you today.
Get the full report — $49 Stripe checkout asks for your brand name and category; the report is ready about 60 seconds after payment. Legal notices and the MCP census entry are not in this report (free: Compliance Desk check, census claim).
Crawler access (robots.txt)
0/2 · fail
0 of 8 AI crawlers may read the site, 8 disallowed
- GET /robots.txt -> HTTP 200, 2.5 KB, 33 user-agent groups
- Disallowed: GPTBot, ClaudeBot, OAI-SearchBot, PerplexityBot, Google-Extended, Amazonbot, CCBot, Bytespider
- Sitemap declared: https://www.huffpost.com/static-assets/isolated/huffpostsitemapgeneratorjob-prod-public/us/sitemaps/sitemap-v1.xml, https://www.huffpost.com/static-assets/isolated/huffpostsitemapgeneratorjob-prod-public/us/sitemaps/sitemap-google-news.xml, https://www.huffpost.com/static-assets/isolated/huffpostsitemapgeneratorjob-prod-public/us/sitemaps/sitemap-google-video.xml (+2)
Fix: Add a group for GPTBot, ClaudeBot, OAI-SearchBot and the others with "Allow: /" (or drop the blanket "Disallow: /") if you want answer engines to cite you.
Machine-readable surfaces
1/2 · warn
None of the 7 machine-readable surfaces is published (a sitemap is declared in robots.txt)
- /llms.txt: HTTP 404
- /sitemap.xml: HTTP 404
- /.well-known/x402: HTTP 404
- /.well-known/agent-card.json: HTTP 404
- /.well-known/mcp-registry-auth: HTTP 404
- /openapi.json: HTTP 404
- /ai.txt: HTTP 404
- Sitemap declared in robots.txt instead: https://www.huffpost.com/static-assets/isolated/huffpostsitemapgeneratorjob-prod-public/us/sitemaps/sitemap-v1.xml
Fix: Publish /llms.txt (a short Markdown guide to your key pages); one agent surface: /openapi.json, /.well-known/agent-card.json, or /.well-known/x402 if you sell to agents.
Readable without JavaScript
2/2 · pass
Home page is readable
- GET https://huffpost.com/ -> HTTP 200 after 1 redirect (final: https://www.huffpost.com/), text/html, 1.4 MB+ (truncated at 1.5 MB)
- 87,856 characters of visible text with scripts, styles and tags removed; <title>: "HuffPost - Breaking News, Politics, Entertainment & Opinion"
- 4 external scripts, 22 inline; <noscript> present
- first words: "Skip to Main Content Main Menu U.S. Edition News U.S. News World News Business Environment Health Social Justice Crime Politics Congress Ext..."
Fix: Nothing to fix here.
Structured data
2/2 · pass
1 JSON-LD block, Open Graph complete
- 1 JSON-LD block: @type NewsMediaOrganization, WebSite, WebPage, ItemList, ListItem
- Open Graph: og:title "HuffPost - Breaking News, U.S. and World News"; og:description present
- meta description: present
Fix: Nothing to fix here.
Legal notices (TAKE IT DOWN desk check)
not measured
Unavailable
- takeitdown.agentexchange.work/check.json: refused takeitdown.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would - unavailable
Fix: Re-run in a few minutes; the notice check could not be completed.
MCP census entry (index.agentexchange.work)
0/2 · fail
Not selling to agents: no census entry, no /mcp endpoint
- census unavailable (refused index.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would time )
- GET /mcp -> HTTP 404: no MCP endpoint at the root
Fix: Expose a Streamable HTTP MCP endpoint at /mcp (or a paid x402 route) so agents can call you, not just read you.
$49 AI Visibility Full Report
This grade is free and automated. The paid next step is the $49 AI Visibility Full Report (which brands a representative AI model, standing in for ChatGPT-class assistants, names when buyers ask about your category, with a prioritized fix list) from aivisibility.agentexchange.work, run for huffpost.com. It includes:
- 8 real buyer questions tested across ChatGPT-class models
- Competitor share-of-voice: who AI names, how often, versus you
- Full GEO site audit with prioritized, specific fixes
- Agent-Readiness Score: crawler access, llms.txt, schema, discovery manifest
- Custom 30/60/90-day action plan to get cited by ChatGPT, Perplexity and Google AI Overviews
- Shareable report, generated in about 60 seconds after checkout
Get the Full Report — $49 Stripe checkout asks for your brand name and category; the report is ready about 60 seconds after payment. Legal notices and the MCP census entry are not in this report (free: Compliance Desk check, census claim).
