Crawler access (robots.txt)
2/2 · pass
8 of 8 AI crawlers may read the site, 0 disallowed
- GET /robots.txt -> HTTP 200, 899 B, 2 user-agent groups
- Allowed: GPTBot (1 path rule), ClaudeBot (1 path rule), OAI-SearchBot (1 path rule), PerplexityBot (1 path rule), Google-Extended (1 path rule), Amazonbot (1 path rule), CCBot (1 path rule), Bytespider (1 path rule)
- Sitemap declared: https://dynamicfeed.ai/sitemap.xml
Fix: Nothing to fix here.
Machine-readable surfaces
2/2 · pass
7 of 7 surfaces present (/llms.txt, /sitemap.xml, /.well-known/x402, /.well-known/agent-card.json, /.well-known/mcp-registry-auth, /openapi.json, /ai.txt)
- /llms.txt: HTTP 200, 36 KB of text
- /sitemap.xml: HTTP 200, XML sitemap (31 KB)
- /.well-known/x402: HTTP 200, valid JSON
- /.well-known/agent-card.json: HTTP 200, valid JSON (agent "Dynamic Feed")
- /.well-known/mcp-registry-auth: HTTP 200, 66 B of text (MCPv1 record)
- /openapi.json: HTTP 200, valid JSON (OpenAPI 3.1.0)
- /ai.txt: HTTP 200, 1.4 KB of text
Fix: Nothing to fix here.
Structured data
2/2 · pass
1 JSON-LD block, Open Graph complete
- 1 JSON-LD block: @type Organization
- Open Graph: og:title "Dynamic Feed | Infrastructure for trustworthy machine decisions"; og:description present
- meta description: present
Fix: Nothing to fix here.
MCP census entry (index.agentexchange.work)
1/2 · warn
Exposes /mcp but is not in the census
- census unavailable (refused index.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would time )
- GET /mcp -> HTTP 200 (text/event-stream): an endpoint answers
- Index MCP probe record: refused index.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would time
Fix: Publish /.well-known/x402 with your paid routes so payment indexers can list you.