structforge.askqa.app

Robots.txt is an HTML page (treated as absent): every crawler is allowed by default

• GET /robots.txt -> HTTP 200, HTML body
• Unmentioned (allowed by default): GPTBot, ClaudeBot, OAI-SearchBot, PerplexityBot, Google-Extended, Amazonbot, CCBot, Bytespider

Fix: Optional: publish a robots.txt that names the AI crawlers you allow and points to your sitemap; without one your policy is implicit.

1 of 7 surfaces present (/llms.txt)

• /llms.txt: HTTP 200, 447 B of text
• /sitemap.xml: HTTP 200 but an HTML page (catch-all route, not a real file)
• /.well-known/x402: HTTP 404
• /.well-known/agent-card.json: HTTP 404
• /.well-known/mcp-registry-auth: HTTP 404
• /openapi.json: HTTP 200 but an HTML page (catch-all route, not a real file)
• /ai.txt: HTTP 200 but an HTML page (catch-all route, not a real file)

Fix: Publish /sitemap.xml; one agent surface: /openapi.json, /.well-known/agent-card.json, or /.well-known/x402 if you sell to agents.

Home page is a JS-only shell

• GET https://structforge.askqa.app/ -> HTTP 200, text/html, 3.4 KB
• 286 characters of visible text with scripts, styles and tags removed; <title>: "ASKQA — StructForge"
• 0 external scripts, 0 inline; <noscript> absent
• first words: "ASK QA StructForge — documents that agents can use Turn messy files into structured fields your workflows can trust. Get MCP access StructFo..."

Fix: Server-render or prerender the first paint so the HTML carries your text; agents and most crawlers do not execute your scripts.

No JSON-LD, Open Graph incomplete

• 0 JSON-LD blocks
• Open Graph: no og:title; no og:description
• meta description: present

Fix: add a JSON-LD block (Organization or WebSite, plus Product, FAQPage or Article where relevant); add og:title and og:description so answer engines describe you accurately.

0 of 6 required notices complete (desk score 0/12)

• Desk score 0/12 across 6 checks (12 of 12 pages read)
• Missing or partial: TAKE IT DOWN Act notice (0/2); DMCA / copyright notice (0/2); DSA notice-and-action (EU users) (0/2); Privacy request method (0/2); Accessibility statement and feedback (0/2); Marketing opt-out (0/2)

Fix: Publish the missing notices with a working request mechanism. Start with TAKE IT DOWN Act notice: Publish a plain-language notice and a request mechanism usable without an account; act within 48 hours.

Exposes /mcp but is not in the census

• Not in the census of 2,031 hosts selling to agents (2026-09-29)
• GET /mcp -> HTTP 400 (application/json): an endpoint answers
• Index MCP probe record: HTTP 404 (not probed by the index yet)

Fix: Publish /.well-known/x402 with your paid routes so payment indexers can list you.