Our crawler
AIVisionAuditBot
AIVisionAuditBot is the checker behind AI Vision Audit. It visits a store only when someone asks us to audit that store or to check one of its pages for structured data, and it reads the same public pages any visitor can see.
What it fetches
- One page of each type the store has: the homepage, a product, a collection, the cart, search, the blog, an article, a content page, the FAQ, contact and the policy pages. Paid plans check more pages.
robots.txt,llms.txtand your sitemap- Shopify policy pages (refund, privacy, terms, shipping, legal notice)
- A quick status check on a few internal links, to find broken ones
- The one page someone checks with our Schema Markup tool
It never logs in, submits forms, adds items to a cart or reads anything behind a password. Speed results come from Google PageSpeed Insights, which fetches your page from Google's own servers.
How many requests
The number of requests depends on how many pages the store owner's plan checks, and they're spread over a minute or two. Nothing runs again until the store owner re-runs the audit or schedules one, apart from one free re-check 14 days after a store's first audit.
How to allow it
If your firewall or bot protection blocks unknown crawlers, allow requests with this user agent:
Mozilla/5.0 (compatible; AIVisionAuditBot/1.0; +https://aivisionaudit.com/bot)AIVisionAuditBot always identifies itself, and we never retry as a regular browser. If your store blocks it, the audit stops and tells the store owner that the store blocked our checker. That audit doesn't use one of their monthly audits. Allow the user agent above, then run the audit again.