agent.travellersgroup.com.au

No robots.txt (HTTP 404): every crawler is allowed by default

• GET /robots.txt -> HTTP 404, HTML body
• Unmentioned (allowed by default): GPTBot, ClaudeBot, OAI-SearchBot, PerplexityBot, Google-Extended, Amazonbot, CCBot, Bytespider

Fix: Optional: publish a robots.txt that names the AI crawlers you allow and points to your sitemap; without one your policy is implicit.

None of the 7 machine-readable surfaces is published

• /llms.txt: HTTP 404
• /sitemap.xml: HTTP 404
• /.well-known/x402: HTTP 404
• /.well-known/agent-card.json: HTTP 404
• /.well-known/mcp-registry-auth: HTTP 404
• /openapi.json: HTTP 404
• /ai.txt: HTTP 404

Fix: Publish /llms.txt (a short Markdown guide to your key pages); /sitemap.xml; one agent surface: /openapi.json, /.well-known/agent-card.json, or /.well-known/x402 if you sell to agents.

Home page is not available to a plain fetch (HTTP 404)

• GET https://agent.travellersgroup.com.au/ -> HTTP 404, text/html, 139 B
• <title>: "Error"

Fix: Your edge serves a challenge or error to non-browser fetchers; allowlist the AI crawlers you want (at least for the home page) or serve them a static version.

Home page returned HTTP 404; structured data not measurable

• GET https://agent.travellersgroup.com.au/ -> HTTP 404, text/html

Fix: Let non-browser fetchers reach the home page first.

0 of 6 required notices complete (desk score 0/12)

• Desk score 0/12 across 6 checks (0 of 12 pages read)
• Missing or partial: TAKE IT DOWN Act notice (0/2); DMCA / copyright notice (0/2); DSA notice-and-action (EU users) (0/2); Privacy request method (0/2); Accessibility statement and feedback (0/2); Marketing opt-out (0/2)

Fix: Publish the missing notices with a working request mechanism. Start with TAKE IT DOWN Act notice: Publish a plain-language notice and a request mechanism usable without an account; act within 48 hours.

Not selling to agents: no census entry, no /mcp endpoint

• Not in the census of 2,031 hosts selling to agents (2026-09-29)
• GET /mcp -> HTTP 404: no MCP endpoint at the root

Fix: Expose a Streamable HTTP MCP endpoint at /mcp (or a paid x402 route) so agents can call you, not just read you.