Make sure AI assistants can read your store
Shoppers ask AI assistants for product picks. If a store's robots.txt or bot protection shuts out OAI-SearchBot, PerplexityBot or Amazonbot, the store can't be read or cited. Citewren shows each bot's access and whether pages declare structured data.
How ecommerce teams use Citewren
- Check your store's homepage address in Citewren.
- In the crawler table, confirm search and assistant bots are allowed; decide separately about training bots.
- With Pro, crawl 15 pages from the sitemap to find product pages missing structured data or descriptions.
- Publish llms.txt with your main categories and policies, then re-check.
Citewren reads robots.txt rules; a CDN or firewall that blocks bots before robots.txt matters is outside what it can see.
How the 0-100 score is built
| Area | Points | What is checked |
|---|---|---|
| Citation bots | 30 | robots.txt access for OAI-SearchBot, ChatGPT-User, Claude-SearchBot, Claude-User, PerplexityBot, Perplexity-User, Googlebot, Bingbot |
| Structured data | 20 | schema.org JSON-LD types on the homepage |
| llms.txt | 15 | present, Markdown (not an HTML catch-all), # title, > summary, link lists |
| Sitemap | 10 | found and URL count |
| Open Graph | 10 | og:title, og:description, og:image |
| Basics | 10 | title, meta description, canonical link, html lang |
| Indexable | 5 | no noindex on the homepage (meta tag or X-Robots-Tag) |
Source: Scoring weights and checks from products/citewren/worker/src/audit.js (score comment and CITE bot list); screenshot is the live check of cybermaxtools.com captured 8 Oct 2026.
FAQ
Should a store block GPTBot?
That is a business choice. Blocking training crawlers does not block ChatGPT search, which uses OAI-SearchBot.
Does it check Product schema on every page?
The free check reads the homepage; the Pro crawl checks up to 15 pages from your sitemap.
Citewren: full guide with prices and alternatives · All use cases · Store