Checking…
Re-test this site

domaining.com

Framework unknown
https://www.domaining.com/
F14 / 100
Grade F · Level 1DiscoverableFailing — your site is largely invisible to AI agents.
6 checks need fixing

5 failed · 1 partial out of 7 that apply to your site.

See top fixes

Quick Wins

Top 3 fixes ranked by score impact

  • 01Fail

    Markdown content negotiation

    +8 pts if fixed

    Serve text/markdown when the client sends Accept: text/markdown, or publish /index.md.

    See full details
  • 02Fail

    robots.txt present & sane

    +6 pts if fixed

    Serve a non-blocking /robots.txt that references your Sitemap.

    See full details
  • 03Fail

    /llms.txt

    +6 pts if fixed

    Publish /llms.txt per llmstxt.org with an H1, summary, and ## sections of markdown links.

    See full details
Hand-off prompt for your coding agent6 issues
# Agent-readiness remediation brief

Site: https://www.domaining.com/
Platform: unknown (0% confidence)
AIScan score: 14/100 — Level 1 (Discoverable)
Rubric: v2026-06-08.1

## Failing checks (sorted by weight)
- **[C1] Markdown content negotiation** — FAIL
  - Evidence: Accept: text/markdown → 200 (text/html; Charset=utf-8)
  - Fix: Serve text/markdown when the client sends Accept: text/markdown, or publish /index.md.
- **[D1] robots.txt present & sane** — FAIL
  - Evidence: HTTP 404
  - Fix: Serve a non-blocking /robots.txt that references your Sitemap.
- **[C2] /llms.txt** — FAIL
  - Evidence: HTTP 404
  - Fix: Publish /llms.txt per llmstxt.org with an H1, summary, and ## sections of markdown links.
- **[B2] Explicit AI bot rules** — FAIL
  - Evidence: 0 known AI agent(s) addressed in robots.txt
  - Fix: Add explicit allow/deny rules for GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.
- **[D2] XML sitemap** — FAIL
  - Evidence: no /sitemap.xml or /sitemap_index.xml resolved
  - Fix: Publish /sitemap.xml and reference it in robots.txt.
- **[C3] Structured HTML (title, meta, JSON-LD, single H1)** — PARTIAL
  - Evidence: h1: 0, title: true, meta description: true, JSON-LD: false
  - Fix: Ensure a single <h1>, <title>, meta description, and schema.org JSON-LD.

## General guidance
- Static-first: `robots.txt`, `llms.txt`, `/.well-known/*` JSON cards.
- Markdown negotiation: serve `text/markdown` when requested via `Accept` header or `?format=md`.
- Bot access: explicit allow/deny per AI user-agent (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended, Bytespider, Amazonbot, CCBot, meta-externalagent, cohere-ai, Diffbot).
- Capabilities: publish an MCP server card and (optionally) an Agent Skills manifest even if the runtime isn't live — discovery first.
- Re-scan at aiscan.site after deploying.

Discoverability

23

Can agents find your pages? robots, sitemaps, llms.txt.

12
  • Your site is missing this right now, so AI agents can't use it. The fix below is what to change.

    ID · D1

    What we found

    HTTP 404

    How to fix it

    Serve a non-blocking /robots.txt that references your Sitemap.

    ⚡ Fix automatically with AIScan

    Option A — Agent Skill (any agent runtime)
    Install the AIScan skill in one command:
    ```
    npx add-skill https://aiscan.site/aiscan-skill.json
    ```
    Or download it directly: https://aiscan.site/aiscan-skill.json
    Then ask your agent: "Fix the failing AI readiness checks for <your-url>"

    Option B — Claude Code skill (CLAUDE.md)

    1. Download CLAUDE.md from https://aiscan.site/CLAUDE.md and place it in your project root.
    2. Ask Claude Code: "Fix the failing AIScan checks for <your-url>" — it reads the skill, calls our API, and applies the fix.

    Option C — MCP (Claude Desktop, Cursor, or any MCP client)

    • Endpoint: https://aiscan.site/api/mcp
    • Tools: scan_website, get_fixes, get_grade
    • Call get_fixes with your URL for machine-readable fix instructions.

    Option D — REST API
    ```
    GET https://aiscan.site/api/public/scan?url=YOUR_URL
    ```
    Returns the full report with all checks and fix details.

    Re-scan at https://aiscan.site to verify after applying fixes.

    Create /robots.txt

    Place this file at the site root so it's served at https://yoursite.com/robots.txt.

    Recommended contents

    User-agent: *
    Allow: /
    Sitemap: https://example.com/sitemap.xml
    
    # Content Signals (Cloudflare proposal)
    Content-Signal: search=yes, ai-train=no, ai-input=yes
    
    # Explicit AI agent rules
    User-agent: GPTBot
    Allow: /
    
    User-agent: ClaudeBot
    Allow: /
    
    User-agent: PerplexityBot
    Allow: /
    
    User-agent: Google-Extended
    Allow: /
    
    User-agent: Applebot-Extended
    Allow: /
    

    Verify

    After deploying, re-scan at https://aiscan.site. You can also test with curl -I or curl directly.

  • Your site is missing this right now, so AI agents can't use it. The fix below is what to change.

    ID · D2

    What we found

    no /sitemap.xml or /sitemap_index.xml resolved

    How to fix it

    Publish /sitemap.xml and reference it in robots.txt.

    ⚡ Fix automatically with AIScan

    Option A — Agent Skill (any agent runtime)
    Install the AIScan skill in one command:
    ```
    npx add-skill https://aiscan.site/aiscan-skill.json
    ```
    Or download it directly: https://aiscan.site/aiscan-skill.json
    Then ask your agent: "Fix the failing AI readiness checks for <your-url>"

    Option B — Claude Code skill (CLAUDE.md)

    1. Download CLAUDE.md from https://aiscan.site/CLAUDE.md and place it in your project root.
    2. Ask Claude Code: "Fix the failing AIScan checks for <your-url>" — it reads the skill, calls our API, and applies the fix.

    Option C — MCP (Claude Desktop, Cursor, or any MCP client)

    • Endpoint: https://aiscan.site/api/mcp
    • Tools: scan_website, get_fixes, get_grade
    • Call get_fixes with your URL for machine-readable fix instructions.

    Option D — REST API
    ```
    GET https://aiscan.site/api/public/scan?url=YOUR_URL
    ```
    Returns the full report with all checks and fix details.

    Re-scan at https://aiscan.site to verify after applying fixes.

    Generate a sitemap

    Most frameworks have a built-in sitemap generator (Next.js: app/sitemap.ts, TanStack: a route at /sitemap.xml). Publish all public URLs.

    Reference it in robots.txt

    Sitemap: https://yoursite.com/sitemap.xml

    Verify

    After deploying, re-scan at https://aiscan.site. You can also test with curl -I or curl directly.

Content

11

Can agents read your content cleanly? Markdown, structured data.

12
  • Your site is missing this right now, so AI agents can't use it. The fix below is what to change.

    ID · C1

    What we found

    Accept: text/markdown → 200 (text/html; Charset=utf-8)

    How to fix it

    Serve text/markdown when the client sends Accept: text/markdown, or publish /index.md.

    ⚡ Fix automatically with AIScan

    Option A — Agent Skill (any agent runtime)
    Install the AIScan skill in one command:
    ```
    npx add-skill https://aiscan.site/aiscan-skill.json
    ```
    Or download it directly: https://aiscan.site/aiscan-skill.json
    Then ask your agent: "Fix the failing AI readiness checks for <your-url>"

    Option B — Claude Code skill (CLAUDE.md)

    1. Download CLAUDE.md from https://aiscan.site/CLAUDE.md and place it in your project root.
    2. Ask Claude Code: "Fix the failing AIScan checks for <your-url>" — it reads the skill, calls our API, and applies the fix.

    Option C — MCP (Claude Desktop, Cursor, or any MCP client)

    • Endpoint: https://aiscan.site/api/mcp
    • Tools: scan_website, get_fixes, get_grade
    • Call get_fixes with your URL for machine-readable fix instructions.

    Option D — REST API
    ```
    GET https://aiscan.site/api/public/scan?url=YOUR_URL
    ```
    Returns the full report with all checks and fix details.

    Re-scan at https://aiscan.site to verify after applying fixes.

    Serve text/markdown on Accept negotiation

    When a client sends Accept: text/markdown, return a markdown rendering of the same content. The simplest path is to publish parallel .md files (e.g. /about/about.md) and rewrite based on the Accept header.

    Test it

    curl -H "Accept: text/markdown" https://yoursite.com/

    Verify

    After deploying, re-scan at https://aiscan.site. You can also test with curl -I or curl directly.

  • Your site is missing this right now, so AI agents can't use it. The fix below is what to change.

    ID · C2

    What we found

    HTTP 404

    How to fix it

    Publish /llms.txt per llmstxt.org with an H1, summary, and ## sections of markdown links.

    ⚡ Fix automatically with AIScan

    Option A — Agent Skill (any agent runtime)
    Install the AIScan skill in one command:
    ```
    npx add-skill https://aiscan.site/aiscan-skill.json
    ```
    Or download it directly: https://aiscan.site/aiscan-skill.json
    Then ask your agent: "Fix the failing AI readiness checks for <your-url>"

    Option B — Claude Code skill (CLAUDE.md)

    1. Download CLAUDE.md from https://aiscan.site/CLAUDE.md and place it in your project root.
    2. Ask Claude Code: "Fix the failing AIScan checks for <your-url>" — it reads the skill, calls our API, and applies the fix.

    Option C — MCP (Claude Desktop, Cursor, or any MCP client)

    • Endpoint: https://aiscan.site/api/mcp
    • Tools: scan_website, get_fixes, get_grade
    • Call get_fixes with your URL for machine-readable fix instructions.

    Option D — REST API
    ```
    GET https://aiscan.site/api/public/scan?url=YOUR_URL
    ```
    Returns the full report with all checks and fix details.

    Re-scan at https://aiscan.site to verify after applying fixes.

    Create /llms.txt at the site root

    Follows the llmstxt.org spec: a single H1, optional blockquote summary, then ## sections of markdown links.

    Template

    # Example Co
    > One-line summary of what this site / product does.
    
    A short paragraph explaining the audience, what's here, and how
    to navigate it.
    
    ## Docs
    - [Getting started](/docs/quickstart): install, first call in 5 min
    - [API reference](/docs/api): all endpoints, params, examples
    
    ## Pages
    - [Pricing](/pricing): plans and limits
    - [Changelog](/changelog): recent releases
    
    ## Optional
    - [Brand assets](/press): logos and screenshots
    

    Verify

    After deploying, re-scan at https://aiscan.site. You can also test with curl -I or curl directly.

Bot Access

0

Are AI crawlers explicitly allowed or blocked?

1
  • Your site is missing this right now, so AI agents can't use it. The fix below is what to change.

    ID · B2

    What we found

    0 known AI agent(s) addressed in robots.txt

    How to fix it

    Add explicit allow/deny rules for GPTBot, ClaudeBot, PerplexityBot, Google-Extended, etc.

    ⚡ Fix automatically with AIScan

    Option A — Agent Skill (any agent runtime)
    Install the AIScan skill in one command:
    ```
    npx add-skill https://aiscan.site/aiscan-skill.json
    ```
    Or download it directly: https://aiscan.site/aiscan-skill.json
    Then ask your agent: "Fix the failing AI readiness checks for <your-url>"

    Option B — Claude Code skill (CLAUDE.md)

    1. Download CLAUDE.md from https://aiscan.site/CLAUDE.md and place it in your project root.
    2. Ask Claude Code: "Fix the failing AIScan checks for <your-url>" — it reads the skill, calls our API, and applies the fix.

    Option C — MCP (Claude Desktop, Cursor, or any MCP client)

    • Endpoint: https://aiscan.site/api/mcp
    • Tools: scan_website, get_fixes, get_grade
    • Call get_fixes with your URL for machine-readable fix instructions.

    Option D — REST API
    ```
    GET https://aiscan.site/api/public/scan?url=YOUR_URL
    ```
    Returns the full report with all checks and fix details.

    Re-scan at https://aiscan.site to verify after applying fixes.

    Add explicit User-agent blocks

    Don't rely on User-agent: * alone. Address each major AI crawler so your policy is unambiguous.

    Recommended block

    User-agent: GPTBot
    Allow: /
    
    User-agent: ClaudeBot
    Allow: /
    
    User-agent: PerplexityBot
    Allow: /
    
    User-agent: Google-Extended
    Allow: /
    
    User-agent: Applebot-Extended
    Allow: /

    Verify

    After deploying, re-scan at https://aiscan.site. You can also test with curl -I or curl directly.

Share the result

Share as a social image

Download a 1200×630 social card or post straight to X, LinkedIn or Facebook — sized for every feed.

AIScan share card — www.domaining.com graded F

Tip: for X and LinkedIn, upload the downloaded PNG with your post so the card shows in the feed. Posts that include just the link will still preview AIScan.site.

Showcase your grade

Embed your AIScan badge

Drop this badge into your site footer, GitHub README, or docs. It links back to a fresh scan of www.domaining.com on AIScan.site.

AIScan.site grade F
HTML
<!-- AIScan.site agent-readiness badge -->
<a href="https://aiscan.site/?u=https%3A%2F%2Fwww.domaining.com%2F" target="_blank" rel="noopener" title="Agent-Readiness Grade F (14/100) — AIScan.site">
  <img src="https://aiscan.site/api/public/badge.svg?score=14&grade=F&host=www.domaining.com" alt="AIScan.site Grade F — 14/100" width="240" height="64" loading="lazy" />
</a>
Markdown
[![AIScan.site Grade F — 14/100](https://aiscan.site/api/public/badge.svg?score=14&grade=F&host=www.domaining.com)](https://aiscan.site/?u=https%3A%2F%2Fwww.domaining.com%2F)

Create a free account to track this site over time

  • Save scan history
  • See score trends
  • Re-scan anytime
Free · No signup · ~20 seconds

Scan your own site

Get a plain-English agent-readiness report you can hand straight to ChatGPT or Claude.

Or browse the community feed to see what others have scanned.