Guide library
Every published guide, grouped by the AIScan check dimension it helps you pass and by the platform you run. New guides join these groups automatically from their tags.
By check dimension
Discoverability
46 guides- What a Failing AIScan Check Really Says: 2,961 Fail Lines Audited16 Oct 2026 21 min
- How to return a real 404 with a recoverable body on Wix15 Oct 2026 5 min
- Rate-limit AI crawlers without blocking them15 Oct 2026 9 min
- Which Agent-Readiness Checks Travel Together: 739 Sites, Three Bundles15 Oct 2026 21 min
- How to return a real 404 with a recoverable body on Docusaurus14 Oct 2026 5 min
- Platform League Table: WordPress, Next.js, Astro and Shopify Across 728 Sites14 Oct 2026 19 min
- How to return a real 404 with a recoverable body on Lovable13 Oct 2026 5 min
- Blocked Probes: 85 of 712 Sites Scored the Firewall, Not the Site13 Oct 2026 17 min
- How to return a real 404 with a recoverable body on Webflow12 Oct 2026 5 min
- How to Publish an OpenAPI File AI Agents Can Find12 Oct 2026 11 min
- Which Checks Do Sites Fix? 349 Repeat Scans Compared12 Oct 2026 19 min
- How to return a real 404 with a recoverable body on Astro11 Oct 2026 5 min
- Redirect www and http to one canonical host, the way an agent needs it11 Oct 2026 10 min
- How to return a real 404 with a recoverable body on Next.js10 Oct 2026 5 min
- Monitor AI Readiness Over Time and Catch Silent Regressions9 Oct 2026 9 min
- Duplicate www and apex Hosts: 38.2% of 696 Sites Fail the Canonical Check7 Oct 2026 19 min
- Link Header Discovery: Only 9.3% of 690 Sites Name an Agent File6 Oct 2026 18 min
- Does AIScan Give the Same Score Twice? 303 Repeat Scans Measured5 Oct 2026 22 min
- The Agent-Readiness Fix That Moves Your Score Most (2026): 681 Sites Ranked4 Oct 2026 25 min
- agents.md: What It Is and How It Differs from llms.txt4 Oct 2026 8 min
- Publish a Sitemap AI Crawlers Can Actually Find and Trust3 Oct 2026 8 min
- Can Your Site Say "Nothing Changed"? ETag and Last-Modified on 300 Hosts3 Oct 2026 13 min
- Your Sitemap Passes the Check and Still Fails Agents: 669 Sites Measured1 Oct 2026 20 min
- Link Headers for AI Agent Discovery: Set Up RFC 8288 Relations29 Sept 2026 8 min
- Audit Your Own Agent Readiness From a Terminal in Ten Minutes28 Sept 2026 17 min
- Publish an API Catalog Agents Can Discover (RFC 9727)25 Sept 2026 11 min
- The Soft 404 Problem: Why HTTP 200 Breaks Every Agent Discovery Check25 Sept 2026 18 min
- Your llms.txt Is Sending AI Agents to 404s: We Measured It on Our Own Site24 Sept 2026 19 min
- What a real 404 should return to an AI agent23 Sept 2026 11 min
- Docs Sites and AI Agents: Four Markdown Routes, 52 Sites Tested10 Sept 2026 19 min
- Gate AI readiness in CI so a regression fails the build9 Sept 2026 12 min
- Stealth Crawling vs User-Driven Fetching in 2026: What 75 Sites Actually Do9 Sept 2026 22 min
- The complete AI readiness setup for Wix in 20268 Sept 2026 12 min
- The Agentic Commerce Stack in 2026: UCP, ACP, AP2 and x402, Measured on 30 Storefronts8 Sept 2026 18 min
- How to declare allow/deny rules for named AI crawlers in robots.txt on Wix7 Sept 2026 7 min
- The complete AI readiness setup for Docusaurus in 20267 Sept 2026 13 min
- Google AI Overviews in 2026: What You Can Actually Control, Measured on 110 Publishers7 Sept 2026 21 min
- How to declare allow/deny rules for named AI crawlers in robots.txt on Docusaurus6 Sept 2026 7 min
- The complete AI readiness setup for Hugo in 20266 Sept 2026 12 min
- The complete AI readiness setup for Squarespace in 20265 Sept 2026 11 min
- AI Crawler Traffic in 2026: Only 51.8% of Sites Can Answer "Nothing Changed"5 Sept 2026 17 min
- The complete AI readiness setup for Framer in 20264 Sept 2026 11 min
- llms.txt vs robots.txt vs sitemap.xml in 2026: Six Files, Six Jobs4 Sept 2026 18 min
- The State of AI Agent Readiness in 2026: 473 Sites Measured3 Sept 2026 19 min
- The complete AI readiness setup for Replit in 20262 Sept 2026 11 min
- The complete AI readiness setup for Lovable in 20261 Sept 2026 10 min
Content
60 guides- What a Failing AIScan Check Really Says: 2,961 Fail Lines Audited16 Oct 2026 21 min
- Rate-limit AI crawlers without blocking them15 Oct 2026 9 min
- Which Agent-Readiness Checks Travel Together: 739 Sites, Three Bundles15 Oct 2026 21 min
- Platform League Table: WordPress, Next.js, Astro and Shopify Across 728 Sites14 Oct 2026 19 min
- 10 Best Instagram Profile Analyzers in 2026 (Tested)13 Oct 2026 21 min
- Blocked Probes: 85 of 712 Sites Scored the Firewall, Not the Site13 Oct 2026 17 min
- Which Checks Do Sites Fix? 349 Repeat Scans Compared12 Oct 2026 19 min
- Monitor AI Readiness Over Time and Catch Silent Regressions9 Oct 2026 9 min
- Server-Rendered Text and Headings: 16.6% of 699 Sites Fail E39 Oct 2026 20 min
- Markdown for AI Agents Beyond Docs: Only 19.3% of 701 Sites Serve It8 Oct 2026 19 min
- FAQ and Q&A schema that answers an agent's questions6 Oct 2026 10 min
- Link Header Discovery: Only 9.3% of 690 Sites Name an Agent File6 Oct 2026 18 min
- Does AIScan Give the Same Score Twice? 303 Repeat Scans Measured5 Oct 2026 22 min
- Fetch Your Own Site the Way an AI Agent Sees It5 Oct 2026 9 min
- How to serve text/markdown to AI agents on Docusaurus4 Oct 2026 6 min
- The Agent-Readiness Fix That Moves Your Score Most (2026): 681 Sites Ranked4 Oct 2026 25 min
- agents.md: What It Is and How It Differs from llms.txt4 Oct 2026 8 min
- How to serve text/markdown to AI agents on Hugo3 Oct 2026 6 min
- How to serve text/markdown to AI agents on Astro2 Oct 2026 7 min
- JSON-LD for AI: The Schema Types Worth Adding (C3, M4)2 Oct 2026 9 min
- How to serve text/markdown to AI agents on WordPress1 Oct 2026 9 min
- Make a Page Answerable by AI: C1, C3 and E3 Fixes1 Oct 2026 9 min
- Your Sitemap Passes the Check and Still Fails Agents: 669 Sites Measured1 Oct 2026 20 min
- How to serve text/markdown to AI agents on Next.js30 Sept 2026 6 min
- llms-full.txt: When a Full-Text File Beats a Link List30 Sept 2026 10 min
- How Many Sites Show an AI Crawler a Blank Page: 663 Measured30 Sept 2026 18 min
- How to publish an RSS/Atom/JSON feed and declare it in the head on Docusaurus29 Sept 2026 6 min
- Link Headers for AI Agent Discovery: Set Up RFC 8288 Relations29 Sept 2026 8 min
- What a Shopping Agent Can Read About Your Prices: 282 Sites Measured29 Sept 2026 14 min
- How to publish an RSS/Atom/JSON feed and declare it in the head on Replit28 Sept 2026 7 min
- Audit Your Own Agent Readiness From a Terminal in Ten Minutes28 Sept 2026 17 min
- The AI-Crawler Statistics Everyone Quotes, and Which You Can Actually Check27 Sept 2026 18 min
- How to publish an RSS/Atom/JSON feed and declare it in the head on Lovable26 Sept 2026 6 min
- How to ship one h1, title, meta description and JSON-LD on Wix25 Sept 2026 7 min
- The Soft 404 Problem: Why HTTP 200 Breaks Every Agent Discovery Check25 Sept 2026 18 min
- How to ship one h1, title, meta description and JSON-LD on Replit24 Sept 2026 7 min
- Add an RSS Feed AI Agents Can Actually Find24 Sept 2026 9 min
- Your llms.txt Is Sending AI Agents to 404s: We Measured It on Our Own Site24 Sept 2026 19 min
- How to ship one h1, title, meta description and JSON-LD on Lovable23 Sept 2026 8 min
- How to ship one h1, title, meta description and JSON-LD on Ghost22 Sept 2026 8 min
- How to ship one h1, title, meta description and JSON-LD on Webflow10 Sept 2026 9 min
- Docs Sites and AI Agents: Four Markdown Routes, 52 Sites Tested10 Sept 2026 19 min
- How to ship one h1, title, meta description and JSON-LD on Next.js9 Sept 2026 8 min
- Gate AI readiness in CI so a regression fails the build9 Sept 2026 12 min
- How to ship one h1, title, meta description and JSON-LD on WordPress8 Sept 2026 7 min
- The complete AI readiness setup for Wix in 20268 Sept 2026 12 min
- The complete AI readiness setup for Docusaurus in 20267 Sept 2026 13 min
- The complete AI readiness setup for Hugo in 20266 Sept 2026 12 min
- How to publish a valid llms.txt on Wix5 Sept 2026 7 min
- The complete AI readiness setup for Squarespace in 20265 Sept 2026 11 min
- AI Crawler Traffic in 2026: Only 51.8% of Sites Can Answer "Nothing Changed"5 Sept 2026 17 min
- How to publish a valid llms.txt on Docusaurus4 Sept 2026 7 min
- The complete AI readiness setup for Framer in 20264 Sept 2026 11 min
- llms.txt vs robots.txt vs sitemap.xml in 2026: Six Files, Six Jobs4 Sept 2026 18 min
- How to publish a valid llms.txt on Hugo3 Sept 2026 6 min
- The State of AI Agent Readiness in 2026: 473 Sites Measured3 Sept 2026 19 min
- How to publish a valid llms.txt on Framer2 Sept 2026 7 min
- The complete AI readiness setup for Replit in 20262 Sept 2026 11 min
- How to publish a valid llms.txt on Replit1 Sept 2026 7 min
- The complete AI readiness setup for Lovable in 20261 Sept 2026 10 min
Bot Access
29 guides- What a Failing AIScan Check Really Says: 2,961 Fail Lines Audited16 Oct 2026 21 min
- Which Agent-Readiness Checks Travel Together: 739 Sites, Three Bundles15 Oct 2026 21 min
- Platform League Table: WordPress, Next.js, Astro and Shopify Across 728 Sites14 Oct 2026 19 min
- Blocked Probes: 85 of 712 Sites Scored the Firewall, Not the Site13 Oct 2026 17 min
- Which Checks Do Sites Fix? 349 Repeat Scans Compared12 Oct 2026 19 min
- Declare your content-use policy to AI: Content Signals, ai.txt, TDMRep10 Oct 2026 8 min
- Control which AI crawlers reach your site: a robots.txt starter7 Oct 2026 9 min
- Fetch Your Own Site the Way an AI Agent Sees It5 Oct 2026 9 min
- The Agent-Readiness Fix That Moves Your Score Most (2026): 681 Sites Ranked4 Oct 2026 25 min
- What Sites Tell GPTBot in robots.txt, and Whether They Mean It2 Oct 2026 15 min
- Audit Your Own Agent Readiness From a Terminal in Ten Minutes28 Sept 2026 17 min
- The AI-Crawler Statistics Everyone Quotes, and Which You Can Actually Check27 Sept 2026 18 min
- Web Bot Auth: Cryptographic Crawler Identity, Explained26 Sept 2026 9 min
- How Stale Are AI Crawler IP Lists? We Checked All 15 Files26 Sept 2026 17 min
- Does Blocking AI Training Protect Your Content?23 Sept 2026 18 min
- Stealth Crawling vs User-Driven Fetching in 2026: What 75 Sites Actually Do9 Sept 2026 22 min
- The complete AI readiness setup for Wix in 20268 Sept 2026 12 min
- How to declare allow/deny rules for named AI crawlers in robots.txt on Wix7 Sept 2026 7 min
- The complete AI readiness setup for Docusaurus in 20267 Sept 2026 13 min
- Google AI Overviews in 2026: What You Can Actually Control, Measured on 110 Publishers7 Sept 2026 21 min
- How to declare allow/deny rules for named AI crawlers in robots.txt on Docusaurus6 Sept 2026 7 min
- Cloudflare Pay Per Crawl in 2026: Should You Charge AI Crawlers? 119 Sites Measured6 Sept 2026 21 min
- The complete AI readiness setup for Hugo in 20266 Sept 2026 12 min
- The complete AI readiness setup for Squarespace in 20265 Sept 2026 11 min
- The complete AI readiness setup for Framer in 20264 Sept 2026 11 min
- llms.txt vs robots.txt vs sitemap.xml in 2026: Six Files, Six Jobs4 Sept 2026 18 min
- The State of AI Agent Readiness in 2026: 473 Sites Measured3 Sept 2026 19 min
- The complete AI readiness setup for Replit in 20262 Sept 2026 11 min
- The complete AI readiness setup for Lovable in 20261 Sept 2026 10 min
Capabilities
26 guides- What a Failing AIScan Check Really Says: 2,961 Fail Lines Audited16 Oct 2026 21 min
- Platform League Table: WordPress, Next.js, Astro and Shopify Across 728 Sites14 Oct 2026 19 min
- How to Publish an OpenAPI File AI Agents Can Find12 Oct 2026 11 min
- Agent Discovery Files Census: P1, P3, P4 and E2 Across 835 Sites11 Oct 2026 16 min
- UCP profiles: Shopify serves one, most other stores don't10 Oct 2026 15 min
- How to publish /.well-known/mcp/server-card.json on Docusaurus9 Oct 2026 4 min
- How to publish /.well-known/mcp/server-card.json on Hugo8 Oct 2026 5 min
- How to Test Whether an AI Agent Can Complete a Task on Your Site8 Oct 2026 10 min
- How to publish /.well-known/mcp/server-card.json on Lovable7 Oct 2026 5 min
- How to publish /.well-known/mcp/server-card.json on Astro6 Oct 2026 5 min
- Link Header Discovery: Only 9.3% of 690 Sites Name an Agent File6 Oct 2026 18 min
- How to serve an MCP server card on Next.js5 Oct 2026 5 min
- The Agent-Readiness Fix That Moves Your Score Most (2026): 681 Sites Ranked4 Oct 2026 25 min
- Link Headers for AI Agent Discovery: Set Up RFC 8288 Relations29 Sept 2026 8 min
- OAuth Discovery for AI Agents: RFC 8414 and RFC 9728 Explained28 Sept 2026 11 min
- Audit Your Own Agent Readiness From a Terminal in Ten Minutes28 Sept 2026 17 min
- Publish an Agent Skills Index for Your Website27 Sept 2026 11 min
- Publish an API Catalog Agents Can Discover (RFC 9727)25 Sept 2026 11 min
- Publish an MCP Server Card So Agents Can Find Your Tools10 Sept 2026 11 min
- Docs Sites and AI Agents: Four Markdown Routes, 52 Sites Tested10 Sept 2026 19 min
- The complete AI readiness setup for Wix in 20268 Sept 2026 12 min
- The Agentic Commerce Stack in 2026: UCP, ACP, AP2 and x402, Measured on 30 Storefronts8 Sept 2026 18 min
- llms.txt vs robots.txt vs sitemap.xml in 2026: Six Files, Six Jobs4 Sept 2026 18 min
- The State of AI Agent Readiness in 2026: 473 Sites Measured3 Sept 2026 19 min
- WebMCP in 2026: Do You Actually Need It Yet? 85 Sites Measured2 Sept 2026 17 min
- The complete AI readiness setup for Lovable in 20261 Sept 2026 10 min
Commerce
11 guides- Return HTTP 402 with an x402 payload on a paid resource14 Oct 2026 7 min
- Publish a UCP Profile for a Store That Is Not on Shopify13 Oct 2026 9 min
- UCP profiles: Shopify serves one, most other stores don't10 Oct 2026 15 min
- FAQ and Q&A schema that answers an agent's questions6 Oct 2026 10 min
- JSON-LD for AI: The Schema Types Worth Adding (C3, M4)2 Oct 2026 9 min
- What a Shopping Agent Can Read About Your Prices: 282 Sites Measured29 Sept 2026 14 min
- Audit Your Own Agent Readiness From a Terminal in Ten Minutes28 Sept 2026 17 min
- Make your pricing machine-readable for shopping agents22 Sept 2026 10 min
- The Agentic Commerce Stack in 2026: UCP, ACP, AP2 and x402, Measured on 30 Storefronts8 Sept 2026 18 min
- Cloudflare Pay Per Crawl in 2026: Should You Charge AI Crawlers? 119 Sites Measured6 Sept 2026 21 min
- WebMCP in 2026: Do You Actually Need It Yet? 85 Sites Measured2 Sept 2026 17 min
By platform
WordPress
22 guides- Platform League Table: WordPress, Next.js, Astro and Shopify Across 728 Sites14 Oct 2026 19 min
- Publish a UCP Profile for a Store That Is Not on Shopify13 Oct 2026 9 min
- Redirect www and http to one canonical host, the way an agent needs it11 Oct 2026 10 min
- Declare your content-use policy to AI: Content Signals, ai.txt, TDMRep10 Oct 2026 8 min
- Server-Rendered Text and Headings: 16.6% of 699 Sites Fail E39 Oct 2026 20 min
- Markdown for AI Agents Beyond Docs: Only 19.3% of 701 Sites Serve It8 Oct 2026 19 min
- FAQ and Q&A schema that answers an agent's questions6 Oct 2026 10 min
- The Agent-Readiness Fix That Moves Your Score Most (2026): 681 Sites Ranked4 Oct 2026 25 min
- agents.md: What It Is and How It Differs from llms.txt4 Oct 2026 8 min
- Publish a Sitemap AI Crawlers Can Actually Find and Trust3 Oct 2026 8 min
- JSON-LD for AI: The Schema Types Worth Adding (C3, M4)2 Oct 2026 9 min
- How to serve text/markdown to AI agents on WordPress1 Oct 2026 9 min
- Make a Page Answerable by AI: C1, C3 and E3 Fixes1 Oct 2026 9 min
- How Many Sites Show an AI Crawler a Blank Page: 663 Measured30 Sept 2026 18 min
- What a Shopping Agent Can Read About Your Prices: 282 Sites Measured29 Sept 2026 14 min
- Make your pricing machine-readable for shopping agents22 Sept 2026 10 min
- How to ship one h1, title, meta description and JSON-LD on WordPress8 Sept 2026 7 min
- Google AI Overviews in 2026: What You Can Actually Control, Measured on 110 Publishers7 Sept 2026 21 min
- Cloudflare Pay Per Crawl in 2026: Should You Charge AI Crawlers? 119 Sites Measured6 Sept 2026 21 min
- AI Crawler Traffic in 2026: Only 51.8% of Sites Can Answer "Nothing Changed"5 Sept 2026 17 min
- llms.txt vs robots.txt vs sitemap.xml in 2026: Six Files, Six Jobs4 Sept 2026 18 min
- The State of AI Agent Readiness in 2026: 473 Sites Measured3 Sept 2026 19 min
Shopify
16 guides- Platform League Table: WordPress, Next.js, Astro and Shopify Across 728 Sites14 Oct 2026 19 min
- UCP profiles: Shopify serves one, most other stores don't10 Oct 2026 15 min
- How to Test Whether an AI Agent Can Complete a Task on Your Site8 Oct 2026 10 min
- Markdown for AI Agents Beyond Docs: Only 19.3% of 701 Sites Serve It8 Oct 2026 19 min
- FAQ and Q&A schema that answers an agent's questions6 Oct 2026 10 min
- agents.md: What It Is and How It Differs from llms.txt4 Oct 2026 8 min
- Publish a Sitemap AI Crawlers Can Actually Find and Trust3 Oct 2026 8 min
- JSON-LD for AI: The Schema Types Worth Adding (C3, M4)2 Oct 2026 9 min
- Make a Page Answerable by AI: C1, C3 and E3 Fixes1 Oct 2026 9 min
- What a Shopping Agent Can Read About Your Prices: 282 Sites Measured29 Sept 2026 14 min
- The Agentic Commerce Stack in 2026: UCP, ACP, AP2 and x402, Measured on 30 Storefronts8 Sept 2026 18 min
- Google AI Overviews in 2026: What You Can Actually Control, Measured on 110 Publishers7 Sept 2026 21 min
- Cloudflare Pay Per Crawl in 2026: Should You Charge AI Crawlers? 119 Sites Measured6 Sept 2026 21 min
- AI Crawler Traffic in 2026: Only 51.8% of Sites Can Answer "Nothing Changed"5 Sept 2026 17 min
- llms.txt vs robots.txt vs sitemap.xml in 2026: Six Files, Six Jobs4 Sept 2026 18 min
- WebMCP in 2026: Do You Actually Need It Yet? 85 Sites Measured2 Sept 2026 17 min
Next.js / Vercel
14 guides- Platform League Table: WordPress, Next.js, Astro and Shopify Across 728 Sites14 Oct 2026 19 min
- How to Publish an OpenAPI File AI Agents Can Find12 Oct 2026 11 min
- Redirect www and http to one canonical host, the way an agent needs it11 Oct 2026 10 min
- How to return a real 404 with a recoverable body on Next.js10 Oct 2026 5 min
- Server-Rendered Text and Headings: 16.6% of 699 Sites Fail E39 Oct 2026 20 min
- Markdown for AI Agents Beyond Docs: Only 19.3% of 701 Sites Serve It8 Oct 2026 19 min
- How to serve an MCP server card on Next.js5 Oct 2026 5 min
- Publish a Sitemap AI Crawlers Can Actually Find and Trust3 Oct 2026 8 min
- How to serve text/markdown to AI agents on Next.js30 Sept 2026 6 min
- How Many Sites Show an AI Crawler a Blank Page: 663 Measured30 Sept 2026 18 min
- How to ship one h1, title, meta description and JSON-LD on Next.js9 Sept 2026 8 min
- AI Crawler Traffic in 2026: Only 51.8% of Sites Can Answer "Nothing Changed"5 Sept 2026 17 min
- llms.txt vs robots.txt vs sitemap.xml in 2026: Six Files, Six Jobs4 Sept 2026 18 min
- The State of AI Agent Readiness in 2026: 473 Sites Measured3 Sept 2026 19 min
docusaurus
7 guides- How to return a real 404 with a recoverable body on Docusaurus14 Oct 2026 5 min
- How to publish /.well-known/mcp/server-card.json on Docusaurus9 Oct 2026 4 min
- How to serve text/markdown to AI agents on Docusaurus4 Oct 2026 6 min
- How to publish an RSS/Atom/JSON feed and declare it in the head on Docusaurus29 Sept 2026 6 min
- The complete AI readiness setup for Docusaurus in 20267 Sept 2026 13 min
- How to declare allow/deny rules for named AI crawlers in robots.txt on Docusaurus6 Sept 2026 7 min
- How to publish a valid llms.txt on Docusaurus4 Sept 2026 7 min
astro
6 guides- Platform League Table: WordPress, Next.js, Astro and Shopify Across 728 Sites14 Oct 2026 19 min
- How to return a real 404 with a recoverable body on Astro11 Oct 2026 5 min
- Server-Rendered Text and Headings: 16.6% of 699 Sites Fail E39 Oct 2026 20 min
- Markdown for AI Agents Beyond Docs: Only 19.3% of 701 Sites Serve It8 Oct 2026 19 min
- How to publish /.well-known/mcp/server-card.json on Astro6 Oct 2026 5 min
- How to serve text/markdown to AI agents on Astro2 Oct 2026 7 min
wix
5 guides- How to return a real 404 with a recoverable body on Wix15 Oct 2026 5 min
- How to ship one h1, title, meta description and JSON-LD on Wix25 Sept 2026 7 min
- The complete AI readiness setup for Wix in 20268 Sept 2026 12 min
- How to declare allow/deny rules for named AI crawlers in robots.txt on Wix7 Sept 2026 7 min
- How to publish a valid llms.txt on Wix5 Sept 2026 7 min
Lovable
5 guides- How to return a real 404 with a recoverable body on Lovable13 Oct 2026 5 min
- How to publish /.well-known/mcp/server-card.json on Lovable7 Oct 2026 5 min
- How to publish an RSS/Atom/JSON feed and declare it in the head on Lovable26 Sept 2026 6 min
- How to ship one h1, title, meta description and JSON-LD on Lovable23 Sept 2026 8 min
- The complete AI readiness setup for Lovable in 20261 Sept 2026 10 min
hugo
4 guidesReplit
4 guides- How to publish an RSS/Atom/JSON feed and declare it in the head on Replit28 Sept 2026 7 min
- How to ship one h1, title, meta description and JSON-LD on Replit24 Sept 2026 7 min
- The complete AI readiness setup for Replit in 20262 Sept 2026 11 min
- How to publish a valid llms.txt on Replit1 Sept 2026 7 min
woocommerce
2 guideswebflow
2 guidesframer
2 guidesnginx
1 guidecloudflare
1 guideghost
1 guidesquarespace
1 guideAll guides, newest first
- What a Failing AIScan Check Really Says: 2,961 Fail Lines Audited16 Oct 2026 21 min
- How to return a real 404 with a recoverable body on Wix15 Oct 2026 5 min
- Rate-limit AI crawlers without blocking them15 Oct 2026 9 min
- Which Agent-Readiness Checks Travel Together: 739 Sites, Three Bundles15 Oct 2026 21 min
- How to return a real 404 with a recoverable body on Docusaurus14 Oct 2026 5 min
- Return HTTP 402 with an x402 payload on a paid resource14 Oct 2026 7 min
- Platform League Table: WordPress, Next.js, Astro and Shopify Across 728 Sites14 Oct 2026 19 min
- How to return a real 404 with a recoverable body on Lovable13 Oct 2026 5 min
- 10 Best Instagram Profile Analyzers in 2026 (Tested)13 Oct 2026 21 min
- Publish a UCP Profile for a Store That Is Not on Shopify13 Oct 2026 9 min
- Blocked Probes: 85 of 712 Sites Scored the Firewall, Not the Site13 Oct 2026 17 min
- How to return a real 404 with a recoverable body on Webflow12 Oct 2026 5 min
- How to Publish an OpenAPI File AI Agents Can Find12 Oct 2026 11 min
- Which Checks Do Sites Fix? 349 Repeat Scans Compared12 Oct 2026 19 min
- How to return a real 404 with a recoverable body on Astro11 Oct 2026 5 min
- Redirect www and http to one canonical host, the way an agent needs it11 Oct 2026 10 min
- Agent Discovery Files Census: P1, P3, P4 and E2 Across 835 Sites11 Oct 2026 16 min
- How to return a real 404 with a recoverable body on Next.js10 Oct 2026 5 min
- Declare your content-use policy to AI: Content Signals, ai.txt, TDMRep10 Oct 2026 8 min
- UCP profiles: Shopify serves one, most other stores don't10 Oct 2026 15 min
- How to publish /.well-known/mcp/server-card.json on Docusaurus9 Oct 2026 4 min
- Monitor AI Readiness Over Time and Catch Silent Regressions9 Oct 2026 9 min
- Server-Rendered Text and Headings: 16.6% of 699 Sites Fail E39 Oct 2026 20 min
- How to publish /.well-known/mcp/server-card.json on Hugo8 Oct 2026 5 min
- How to Test Whether an AI Agent Can Complete a Task on Your Site8 Oct 2026 10 min
- Markdown for AI Agents Beyond Docs: Only 19.3% of 701 Sites Serve It8 Oct 2026 19 min
- How to publish /.well-known/mcp/server-card.json on Lovable7 Oct 2026 5 min
- Control which AI crawlers reach your site: a robots.txt starter7 Oct 2026 9 min
- Duplicate www and apex Hosts: 38.2% of 696 Sites Fail the Canonical Check7 Oct 2026 19 min
- How to publish /.well-known/mcp/server-card.json on Astro6 Oct 2026 5 min
- FAQ and Q&A schema that answers an agent's questions6 Oct 2026 10 min
- Link Header Discovery: Only 9.3% of 690 Sites Name an Agent File6 Oct 2026 18 min
- How to serve an MCP server card on Next.js5 Oct 2026 5 min
- Does AIScan Give the Same Score Twice? 303 Repeat Scans Measured5 Oct 2026 22 min
- Fetch Your Own Site the Way an AI Agent Sees It5 Oct 2026 9 min
- How to serve text/markdown to AI agents on Docusaurus4 Oct 2026 6 min
- The Agent-Readiness Fix That Moves Your Score Most (2026): 681 Sites Ranked4 Oct 2026 25 min
- agents.md: What It Is and How It Differs from llms.txt4 Oct 2026 8 min
- How to serve text/markdown to AI agents on Hugo3 Oct 2026 6 min
- Publish a Sitemap AI Crawlers Can Actually Find and Trust3 Oct 2026 8 min
- Can Your Site Say "Nothing Changed"? ETag and Last-Modified on 300 Hosts3 Oct 2026 13 min
- How to serve text/markdown to AI agents on Astro2 Oct 2026 7 min
- JSON-LD for AI: The Schema Types Worth Adding (C3, M4)2 Oct 2026 9 min
- What Sites Tell GPTBot in robots.txt, and Whether They Mean It2 Oct 2026 15 min
- How to serve text/markdown to AI agents on WordPress1 Oct 2026 9 min
- Make a Page Answerable by AI: C1, C3 and E3 Fixes1 Oct 2026 9 min
- Your Sitemap Passes the Check and Still Fails Agents: 669 Sites Measured1 Oct 2026 20 min
- How to serve text/markdown to AI agents on Next.js30 Sept 2026 6 min
- llms-full.txt: When a Full-Text File Beats a Link List30 Sept 2026 10 min
- How Many Sites Show an AI Crawler a Blank Page: 663 Measured30 Sept 2026 18 min
- How to publish an RSS/Atom/JSON feed and declare it in the head on Docusaurus29 Sept 2026 6 min
- Link Headers for AI Agent Discovery: Set Up RFC 8288 Relations29 Sept 2026 8 min
- What a Shopping Agent Can Read About Your Prices: 282 Sites Measured29 Sept 2026 14 min
- How to publish an RSS/Atom/JSON feed and declare it in the head on Replit28 Sept 2026 7 min
- OAuth Discovery for AI Agents: RFC 8414 and RFC 9728 Explained28 Sept 2026 11 min
- Audit Your Own Agent Readiness From a Terminal in Ten Minutes28 Sept 2026 17 min
- Publish an Agent Skills Index for Your Website27 Sept 2026 11 min
- The AI-Crawler Statistics Everyone Quotes, and Which You Can Actually Check27 Sept 2026 18 min
- How to publish an RSS/Atom/JSON feed and declare it in the head on Lovable26 Sept 2026 6 min
- Web Bot Auth: Cryptographic Crawler Identity, Explained26 Sept 2026 9 min
- How Stale Are AI Crawler IP Lists? We Checked All 15 Files26 Sept 2026 17 min
- How to ship one h1, title, meta description and JSON-LD on Wix25 Sept 2026 7 min
- Publish an API Catalog Agents Can Discover (RFC 9727)25 Sept 2026 11 min
- The Soft 404 Problem: Why HTTP 200 Breaks Every Agent Discovery Check25 Sept 2026 18 min
- How to ship one h1, title, meta description and JSON-LD on Replit24 Sept 2026 7 min
- Add an RSS Feed AI Agents Can Actually Find24 Sept 2026 9 min
- Your llms.txt Is Sending AI Agents to 404s: We Measured It on Our Own Site24 Sept 2026 19 min
- How to ship one h1, title, meta description and JSON-LD on Lovable23 Sept 2026 8 min
- What a real 404 should return to an AI agent23 Sept 2026 11 min
- Does Blocking AI Training Protect Your Content?23 Sept 2026 18 min
- Make your pricing machine-readable for shopping agents22 Sept 2026 10 min
- How to ship one h1, title, meta description and JSON-LD on Ghost22 Sept 2026 8 min
- How to ship one h1, title, meta description and JSON-LD on Webflow10 Sept 2026 9 min
- Publish an MCP Server Card So Agents Can Find Your Tools10 Sept 2026 11 min
- Docs Sites and AI Agents: Four Markdown Routes, 52 Sites Tested10 Sept 2026 19 min
- How to ship one h1, title, meta description and JSON-LD on Next.js9 Sept 2026 8 min
- Gate AI readiness in CI so a regression fails the build9 Sept 2026 12 min
- Stealth Crawling vs User-Driven Fetching in 2026: What 75 Sites Actually Do9 Sept 2026 22 min
- How to ship one h1, title, meta description and JSON-LD on WordPress8 Sept 2026 7 min
- The complete AI readiness setup for Wix in 20268 Sept 2026 12 min
- The Agentic Commerce Stack in 2026: UCP, ACP, AP2 and x402, Measured on 30 Storefronts8 Sept 2026 18 min
- How to declare allow/deny rules for named AI crawlers in robots.txt on Wix7 Sept 2026 7 min
- The complete AI readiness setup for Docusaurus in 20267 Sept 2026 13 min
- Google AI Overviews in 2026: What You Can Actually Control, Measured on 110 Publishers7 Sept 2026 21 min
- How to declare allow/deny rules for named AI crawlers in robots.txt on Docusaurus6 Sept 2026 7 min
- Cloudflare Pay Per Crawl in 2026: Should You Charge AI Crawlers? 119 Sites Measured6 Sept 2026 21 min
- The complete AI readiness setup for Hugo in 20266 Sept 2026 12 min
- How to publish a valid llms.txt on Wix5 Sept 2026 7 min
- The complete AI readiness setup for Squarespace in 20265 Sept 2026 11 min
- AI Crawler Traffic in 2026: Only 51.8% of Sites Can Answer "Nothing Changed"5 Sept 2026 17 min
- How to publish a valid llms.txt on Docusaurus4 Sept 2026 7 min
- The complete AI readiness setup for Framer in 20264 Sept 2026 11 min
- llms.txt vs robots.txt vs sitemap.xml in 2026: Six Files, Six Jobs4 Sept 2026 18 min
- How to publish a valid llms.txt on Hugo3 Sept 2026 6 min
- The State of AI Agent Readiness in 2026: 473 Sites Measured3 Sept 2026 19 min
- How to publish a valid llms.txt on Framer2 Sept 2026 7 min
- The complete AI readiness setup for Replit in 20262 Sept 2026 11 min
- WebMCP in 2026: Do You Actually Need It Yet? 85 Sites Measured2 Sept 2026 17 min
- How to publish a valid llms.txt on Replit1 Sept 2026 7 min
- The complete AI readiness setup for Lovable in 20261 Sept 2026 10 min