Crawler access (robots.txt)
2/2 · pass
No robots.txt (HTTP 404): every crawler is allowed by default
- GET /robots.txt -> HTTP 404
- Unmentioned (allowed by default): GPTBot, ClaudeBot, OAI-SearchBot, PerplexityBot, Google-Extended, Amazonbot, CCBot, Bytespider
Fix: Optional: publish a robots.txt that names the AI crawlers you allow and points to your sitemap; without one your policy is implicit.
Machine-readable surfaces
0/2 · fail
None of the 7 machine-readable surfaces is published
- /llms.txt: HTTP 404
- /sitemap.xml: HTTP 404
- /.well-known/x402: HTTP 404
- /.well-known/agent-card.json: HTTP 404
- /.well-known/mcp-registry-auth: HTTP 404
- /openapi.json: HTTP 404
- /ai.txt: HTTP 404
Fix: Publish /llms.txt (a short Markdown guide to your key pages); /sitemap.xml; one agent surface: /openapi.json, /.well-known/agent-card.json, or /.well-known/x402 if you sell to agents.
Readable without JavaScript
0/2 · fail
Home page is not available to a plain fetch (HTTP 404)
- GET https://mcp.aiskills402.com/ -> HTTP 404, text/plain, 73 B
Fix: Your edge serves a challenge or error to non-browser fetchers; allowlist the AI crawlers you want (at least for the home page) or serve them a static version.
Structured data
not measured
Home page returned HTTP 404; structured data not measurable
- GET https://mcp.aiskills402.com/ -> HTTP 404, text/plain
Fix: Let non-browser fetchers reach the home page first.
Legal notices (TAKE IT DOWN desk check)
0/2 · fail
0 of 6 required notices complete (desk score 0/12)
- Desk score 0/12 across 6 checks (0 of 12 pages read)
- Missing or partial: TAKE IT DOWN Act notice (0/2); DMCA / copyright notice (0/2); DSA notice-and-action (EU users) (0/2); Privacy request method (0/2); Accessibility statement and feedback (0/2); Marketing opt-out (0/2)
Fix: Publish the missing notices with a working request mechanism. Start with TAKE IT DOWN Act notice: Publish a plain-language notice and a request mechanism usable without an account; act within 48 hours.
MCP census entry (index.agentexchange.work)
1/2 · warn
Exposes /mcp but is not in the census
- Not in the census of 2,031 hosts selling to agents (2026-09-29)
- GET /mcp -> HTTP 400 (text/plain): an endpoint answers
- Index MCP probe record: HTTP 404 (not probed by the index yet)
Fix: Publish /.well-known/x402 with your paid routes so payment indexers can list you.