Crawler access (robots.txt)
2/2 · pass
8 of 8 AI crawlers may read the site, 0 disallowed
- GET /robots.txt -> HTTP 200, 226 B, 1 user-agent group
- Allowed: GPTBot (via *) (5 path rules), ClaudeBot (via *) (5 path rules), OAI-SearchBot (via *) (5 path rules), PerplexityBot (via *) (5 path rules), Google-Extended (via *) (5 path rules), Amazonbot (via *) (5 path rules), CCBot (via *) (5 path rules), Bytespider (via *) (5 path rules)
- Sitemap declared: https://www.thewholetorah.ai/sitemap.xml
Fix: Nothing to fix here.
Machine-readable surfaces
2/2 · pass
2 of 7 surfaces present (/llms.txt, /sitemap.xml)
- /llms.txt: HTTP 200, 3.3 KB of text
- /sitemap.xml: HTTP 200, XML sitemap (>64 KB)
- /.well-known/x402: HTTP 404
- /.well-known/agent-card.json: HTTP 404
- /.well-known/mcp-registry-auth: HTTP 404
- /openapi.json: HTTP 404
- /ai.txt: HTTP 404
Fix: Publish one agent surface: /openapi.json, /.well-known/agent-card.json, or /.well-known/x402 if you sell to agents.
Readable without JavaScript
2/2 · pass
Home page is readable
- GET https://www.thewholetorah.ai/ -> HTTP 200 after 1 redirect (final: https://www.thewholetorah.ai/en), text/html, 121 KB
- 4,578 characters of visible text with scripts, styles and tags removed; <title>: "TheWholeTorah.ai"
- 15 external scripts, 33 inline; <noscript> absent
- first words: "TheWholeTorah .ai Beta ✦ Chat 1-on-1 Topics Books About Contact Sign In Get Started English עברית Русский Español Français אידיש ✦ New Nach ..."
Fix: Nothing to fix here.
Structured data
2/2 · pass
2 JSON-LD blocks, Open Graph complete
- 2 JSON-LD blocks: @type Organization, WebSite
- Open Graph: og:title "TheWholeTorah.ai"; og:description present
- meta description: present
Fix: Nothing to fix here.
Legal notices (TAKE IT DOWN desk check)
0/2 · fail
0 of 6 required notices complete (desk score 1/12)
- Desk score 1/12 across 6 checks (5 of 12 pages read)
- Missing or partial: TAKE IT DOWN Act notice (0/2); DMCA / copyright notice (0/2); DSA notice-and-action (EU users) (0/2); Privacy request method (1/2); Accessibility statement and feedback (0/2); Marketing opt-out (0/2)
Fix: Publish the missing notices with a working request mechanism. Start with TAKE IT DOWN Act notice: Publish a plain-language notice and a request mechanism usable without an account; act within 48 hours.
MCP census entry (index.agentexchange.work)
0/2 · fail
Not selling to agents: no census entry, no /mcp endpoint
- Not in the census of 2,031 hosts selling to agents (2026-09-29)
- GET /mcp -> HTTP 200 HTML page (catch-all route, not an MCP endpoint)
Fix: Expose a Streamable HTTP MCP endpoint at /mcp (or a paid x402 route) so agents can call you, not just read you.
