doctorsfile.jp

7 of 8 AI crawlers may read the site, 1 disallowed

• GET /robots.txt -> HTTP 200, 21 KB, 4 user-agent groups
• Allowed: GPTBot (via *) (10 path rules), ClaudeBot (via *) (10 path rules), OAI-SearchBot (via *) (10 path rules), PerplexityBot (via *) (10 path rules), Google-Extended (via *) (10 path rules), CCBot (via *) (10 path rules), Bytespider (via *) (10 path rules)
• Disallowed: Amazonbot
• Sitemap declared: https://doctorsfile.jp/sitemap.xml.gz, https://doctorsfile.jp/sitemaps/sitemap1.xml.gz, https://doctorsfile.jp/sitemaps/sitemap2.xml.gz (+342)

Fix: Add a group for Amazonbot with "Allow: /" (or drop the blanket "Disallow: /") if you want answer engines to cite you.

None of the 7 machine-readable surfaces is published (a sitemap is declared in robots.txt)

• /llms.txt: HTTP 404
• /sitemap.xml: HTTP 404
• /.well-known/x402: HTTP 404
• /.well-known/agent-card.json: HTTP 404
• /.well-known/mcp-registry-auth: HTTP 404
• /openapi.json: HTTP 404
• /ai.txt: HTTP 404
• Sitemap declared in robots.txt instead: https://doctorsfile.jp/sitemap.xml.gz

Fix: Publish /llms.txt (a short Markdown guide to your key pages); one agent surface: /openapi.json, /.well-known/agent-card.json, or /.well-known/x402 if you sell to agents.

Home page is readable

• GET https://doctorsfile.jp/ -> HTTP 200, text/html, 220 KB
• 8,582 characters of visible text with scripts, styles and tags removed; <title>: "ドクターズ・ファイル｜症状から探せる、病気がわかる、ドクターが見つかる"
• 9 external scripts, 9 inline; <noscript> present
• first words: "全国のドクター14,543人の想いを取材 クリニック・病院 156,366件の情報を掲載（2026年10月16日現在） 病院・総合病院探しは ホスピタルズ・ファイルへ 検索 キャンセル 会員登録 ログイン メニュー ドクターズ・ファイル会員でできること 予約情報 をマイページ上で..."

Fix: Nothing to fix here.

1 JSON-LD block, Open Graph complete

• 1 JSON-LD block: @type WebSite
• Open Graph: og:title "ドクターズ・ファイル｜症状から探せる、病気がわかる、ドクターが見つかる"; og:description present
• meta description: present

Fix: Nothing to fix here.

Unavailable

• takeitdown.agentexchange.work/check.json: refused takeitdown.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would - unavailable

Fix: Re-run in a few minutes; the notice check could not be completed.

Not selling to agents: no census entry, no /mcp endpoint

• census unavailable (refused index.agentexchange.work: hosts on agentexchange.work cannot be graded from inside the same Cloudflare zone; every check would time )
• GET /mcp -> HTTP 404: no MCP endpoint at the root

Fix: Expose a Streamable HTTP MCP endpoint at /mcp (or a paid x402 route) so agents can call you, not just read you.