Crawler access (robots.txt)
2/2
8 of 8 AI crawlers may read the site, 0 disallowed
- GET /robots.txt -> HTTP 200, 61 B, 1 user-agent group
- Allowed: GPTBot (via *), ClaudeBot (via *), OAI-SearchBot (via *), PerplexityBot (via *), Google-Extended (via *), Amazonbot (via *), CCBot (via *), Bytespider (via *)
- Sitemap declared: https://www.discourse.org/sitemap.xml
Fix: Nothing to fix here.
Machine-readable surfaces
1/2
1 of 7 surfaces present (/sitemap.xml)
- /llms.txt: HTTP 404
- /sitemap.xml: HTTP 200, XML sitemap (7.6 KB)
- /.well-known/x402: HTTP 404
- /.well-known/agent-card.json: HTTP 404
- /.well-known/mcp-registry-auth: HTTP 404
- /openapi.json: HTTP 404
- /ai.txt: HTTP 404
Fix: Publish /llms.txt (a short Markdown guide to your key pages); one agent surface: /openapi.json, /.well-known/agent-card.json, or /.well-known/x402 if you sell to agents.
Readable without JavaScript
2/2
Home page is readable
- GET https://discourse.org/ -> HTTP 200 after 1 redirect (final: https://www.discourse.org/), text/html, 107 KB
- 7,959 characters of visible text with scripts, styles and tags removed; <title>: "Discourse | One platform. Any community."
- 19 external scripts, 8 inline; <noscript> present
- first words: "Skip to content × About What is Discourse? Who we are Open source Customers Wall of love Partners Careers Features Discover Enterprise Prici..."
Fix: Nothing to fix here.
2 JSON-LD blocks, Open Graph complete
- 2 JSON-LD blocks: @type Organization, WebSite
- Open Graph: og:title "One platform. Any community."; og:description present
- meta description: present
Fix: Nothing to fix here.
Legal notices (TAKE IT DOWN desk check)
2/2
4 of 6 required notices complete (desk score 10/12)
- Desk score 10/12 across 6 checks (7 of 12 pages read)
- Missing or partial: TAKE IT DOWN Act notice (1/2); DSA notice-and-action (EU users) (1/2)
- Complete: DMCA / copyright notice; Privacy request method; Accessibility statement and feedback; Marketing opt-out
Fix: Publish the missing notices with a working request mechanism. Start with TAKE IT DOWN Act notice: Publish a plain-language notice and a request mechanism usable without an account; act within 48 hours.
MCP census entry (index.agentexchange.work)
0/2
Not selling to agents: no census entry, no /mcp endpoint
- Not in the census of 2,031 hosts selling to agents (2026-09-29)
- GET /mcp -> HTTP 404: no MCP endpoint at the root
Fix: Expose a Streamable HTTP MCP endpoint at /mcp (or a paid x402 route) so agents can call you, not just read you.