Crawler access (robots.txt)
1/2 · warn
5 of 8 AI crawlers may read the site, 3 disallowed
- GET /robots.txt -> HTTP 200, 928 B, 10 user-agent groups
- Allowed: GPTBot (2 path rules), ClaudeBot (2 path rules), OAI-SearchBot (2 path rules), PerplexityBot (2 path rules), Google-Extended (2 path rules)
- Disallowed: Amazonbot, CCBot, Bytespider
- Content-Signal: ai-train=no, search=yes, ai-input=yes
- Sitemap declared: https://socialintel.dev/sitemap.xml, https://socialintel.dev/docs/sitemap.xml
Fix: Add a group for Amazonbot, CCBot, Bytespider with "Allow: /" (or drop the blanket "Disallow: /") if you want answer engines to cite you.
Machine-readable surfaces
2/2 · pass
5 of 7 surfaces present (/llms.txt, /sitemap.xml, /.well-known/x402, /.well-known/agent-card.json, /openapi.json)
- /llms.txt: HTTP 200, 4.2 KB of text
- /sitemap.xml: HTTP 200, XML sitemap (17 KB)
- /.well-known/x402: HTTP 200, valid JSON (4 paid resources)
- /.well-known/agent-card.json: HTTP 200, valid JSON (agent "Social Intel API")
- /.well-known/mcp-registry-auth: HTTP 404
- /openapi.json: HTTP 200, valid JSON (OpenAPI 3.1.0)
- /ai.txt: HTTP 404
Fix: Nothing to fix here.
Readable without JavaScript
2/2 · pass
Home page is readable
- GET https://socialintel.dev/ -> HTTP 200, text/html, 26 KB
- 5,268 characters of visible text with scripts, styles and tags removed; <title>: "Social Intel API — Instagram Influencer Search API | Pay-per-request"
- 4 external scripts, 1 inline; <noscript> absent
- first words: "Social Intel Blog API Docs Compare Pricing Order CSV Try API → Blog API Docs Compare Pricing Order CSV Try API → Instagram Influen..."
Fix: Nothing to fix here.
Structured data
2/2 · pass
5 JSON-LD blocks, Open Graph complete
- 5 JSON-LD blocks: @type BreadcrumbList, ListItem, WebAPI, WebSite, FAQPage, Question, HowTo
- Open Graph: og:title "Social Intel API — Instagram Influencer Search API"; og:description present
- meta description: present
Fix: Nothing to fix here.
Legal notices (TAKE IT DOWN desk check)
not measured
Unavailable
- takeitdown.agentexchange.work/check.json: refused takeitdown.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would - unavailable
Fix: Re-run in a few minutes; the notice check could not be completed.
MCP census entry (index.agentexchange.work)
not measured
Unavailable
- census hosts.json: refused index.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would time
- GET /mcp failed: timed out after 7s
Fix: Re-run in a few minutes.
$49 AI Visibility Full Report
This grade is free and automated. The paid next step is the $49 AI Visibility Full Report (which brands a representative AI model, standing in for ChatGPT-class assistants, names when buyers ask about your category, with a prioritized fix list) from aivisibility.agentexchange.work, run for socialintel.dev. It includes:
- 8 real buyer questions tested across ChatGPT-class models
- Competitor share-of-voice: who AI names, how often, versus you
- Full GEO site audit with prioritized, specific fixes
- Agent-Readiness Score: crawler access, llms.txt, schema, discovery manifest
- Custom 30/60/90-day action plan to get cited by ChatGPT, Perplexity and Google AI Overviews
- Shareable report, generated in about 60 seconds after checkout
Get the Full Report — $49 Stripe checkout asks for your brand name and category; the report is ready about 60 seconds after payment. Legal notices and the MCP census entry are not in this report (free: Compliance Desk check, census claim).
