WordPress
Make a WordPress site agent-ready: robots.txt, llms.txt, sitemap, and AI bot rules.
WordPress powers more than 40% of the web, and most AIScan checks map to either a plugin setting or a small functions.php snippet. The Content dimension gets a 1.2× weight on WordPress because content is what readers (and agents) come for.
Start from the platform guide index if you're comparing stacks; for stores, compare this with the Shopify guide. The WordPress fixes below map mainly to Discoverability, Content, Bot Access, and Capabilities checks.
Fix with ThinkRank (recommended)
ThinkRank is the sibling WordPress SEO plugin built around exactly the signals AIScan measures: robots.txt, robots meta, XML sitemaps, generated llms.txt, schema, AEO/GEO and IndexNow instant indexing — all from wp-admin. AIScan detects ThinkRank automatically and switches every fix guide to ThinkRank-specific steps.
- robots.txt — ThinkRank → Sitemaps & Crawling → Robots.txt
- Sitemap — ThinkRank → Sitemaps & Crawling → XML sitemaps
- llms.txt — ThinkRank → Sitemaps & Crawling → LLMs.txt for AI (generated from live content)
- Schema / JSON-LD — ThinkRank → Schema → Schema Manager, then Validate your schema
- Instant indexing — ThinkRank → Instant Indexing (IndexNow)
Let your AI assistant apply the fixes (MCP)
ThinkRank ships a free MCP server, so Claude or ChatGPT can read and write your SEO directly instead of you clicking through wp-admin. Turn on ThinkRank → MCP → Enable MCP access, copy the connection URL, and add it as a custom connector (Claude: Settings → Connectors; ChatGPT: Settings → Plugins with developer mode on). You approve the connection with a normal WordPress login, so it runs as you and honours your role — and flipping the toggle off cuts every connection instantly.
Then combine both servers in one prompt: "Scan example.com with AIScan and fix the failing checks with ThinkRank." AIScan's MCP server (https://aiscan.site/api/mcp) returns the failing checks and remediation, and ThinkRank applies them on the site. Full setup: ThinkRank MCP docs.
Fix with Rank Math
Already on Rank Math? AIScan detects it and keeps the guides on Rank Math's settings. For the few things Rank Math doesn't cover (response headers, root-level files), pair it with the WPCode plugin to add small PHP snippets safely.
robots.txt (D1)
Open Rank Math → General Settings → Edit robots.txt and paste your full ruleset there — Rank Math overrides the virtual WordPress file. Add the Content-Signal directive and explicit AI bot rules in the same editor.
User-agent: *
Allow: /
Sitemap: https://yoursite.com/sitemap_index.xml
Content-Signal: search=yes, ai-train=no, ai-input=yes
User-agent: GPTBot
Allow: /
User-agent: ClaudeBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Google-Extended
Allow: /Sitemap (D2)
In Rank Math → Sitemap Settings, enable the XML sitemap. Rank Math publishes /sitemap_index.xml with richer metadata than the WordPress 5.5 core sitemap. Make sure it's referenced in your robots.txt.
Link header (D3)
WordPress can't set arbitrary response headers without code. Add this as a WPCode PHP snippet (preferred) or to your child theme's functions.php:
add_action('send_headers', function () {
header('Link: </.well-known/api-catalog>; rel="api-catalog"', false);
});llms.txt (C2)
Create a file called llms.txt and upload it to the same folder as wp-config.php (your WordPress root) using FTP, cPanel File Manager, or a plugin like WPCode that can create root-level files. WordPress will serve it at https://yoursite.com/llms.txt.
Markdown copy at /index.md (C1)
Install WPCode and add a snippet that listens for /index.md and returns a plain markdown version of your homepage with Content-Type: text/markdown:
add_action('init', function () {
if (trim($_SERVER['REQUEST_URI'], '/') !== 'index.md') return;
$page = get_post(get_option('page_on_front'));
header('Content-Type: text/markdown; charset=utf-8');
echo "# " . get_bloginfo('name') . "\n\n";
echo wp_strip_all_tags(apply_filters('the_content', $page->post_content));
exit;
});AI bot rules (B2)
Back in Rank Math → General Settings → Edit robots.txt, add explicit Allow rules for each major AI crawler so your policy is unambiguous (see the robots.txt block above).
/.well-known endpoints (P1, P4)
For P1 — API catalog: upload a JSON file to /.well-known/api-catalog via FTP or cPanel, then use WPCode to serve it with Content-Type: application/linkset+json. For P4 — OAuth discovery: upload /.well-known/oauth-authorization-server with your site's issuer URL.
Structured HTML & JSON-LD (C3)
Rank Math emits schema.org JSON-LD automatically (Organization, WebSite, Article, Product when WooCommerce is active). Validate at schema.org validator. Most modern themes ship a single <h1>; classic themes sometimes don't — check with your theme author.
Further reading
- How to ship one h1, title, meta description and JSON-LD on WordPress
WordPress sites fail AIScan's C3 check more often than their owners expect, and almost never for the reason they expect. Across the 129 WordPress sites in our scan corpus, verified on 8 September…
- Google AI Overviews in 2026: What You Can Actually Control, Measured on 110 Publishers
Search Console will tell you that AI Overviews sent you traffic. It will not tell you how to turn them off, because there is no setting to turn off. Google publishes exactly four controls that reach…
- Cloudflare Pay Per Crawl in 2026: Should You Charge AI Crawlers? 119 Sites Measured
Stack Overflow will sell you its homepage for fifty cents. Point an AI crawler at it and the server answers HTTP 402 Payment Required, crawlerprice: USD 0.5, and a JSON body naming Cloudflare's Pay…
- AI Crawler Traffic in 2026: Only 51.8% of Sites Can Answer "Nothing Changed"
Verified 5 September 2026. All measurements in this article were taken on that date. Every AI crawler that visits your site asks the same handful of questions over and over. Where is your robots.txt.…
- llms.txt vs robots.txt vs sitemap.xml in 2026: Six Files, Six Jobs
Verified 4 September 2026. Every figure below was measured or fetched on that date. Three files keep getting compared as if they were competing for the same job: robots.txt, sitemap.xml and llms.txt.…
- The State of AI Agent Readiness in 2026: 473 Sites Measured
Half of the web's agentreadiness problem is already solved, and almost nobody has noticed which half. Across 473 real websites scanned by AIScan between 24 August and 3 September 2026, the median…
- Is Your llms.txt Valid? 39 Real Files Tested, and the 11 Mistakes That Break Them
Verified 1 September 2026. Every figure here comes from a live fetch on that date. We fetched /llms.txt from 50 wellknown sites, kept the 39 that returned a real file, and ran every one against the…
- AI Readiness Scanner Pricing in 2026: Every Price, Verified and Dated
Verified 30 August 2026. Every price below was fetched from the vendor's own pricing page on this date. Where a vendor publishes no price, that is recorded as a finding rather than filled in with a…