How to allow AI crawlers on your Shopify store

Before asking whether ChatGPT recommends your products, there's a more basic question: are its crawlers even allowed to read your store? An overly restrictive robots.txt file is enough to make an entire catalog invisible to AI, regardless of how good the product pages are.

This is a technical setting, not a page to rewrite, and it's often the first lock to open before fixing anything else.

What robots.txt does, and why it matters for AI

The robots.txt file, served at the root of your domain, tells crawlers which pages they're allowed to read. AI answer engines send their own crawlers: GPTBot for ChatGPT, PerplexityBot for Perplexity, among others. If your robots.txt blocks these user agents, or contains an overly broad rule that catches them by accident, your catalog stays invisible to those engines even if every product page is otherwise perfect. One exception worth knowing: the Google-Extended token does not control your eligibility for AI Overviews or AI Mode, since those ride on standard Google Search indexing. It only lets you allow or refuse the use of your content by Google's generative models, such as Gemini.

This happens more often than you'd think: a rule inherited from an old theme, meant to block some unwanted bot, can also block a legitimate AI crawler by accident. Nobody notices, because the block doesn't throw any visible error on the storefront.

How to check and fix robots.txt on Shopify

• Open yourdomain.com/robots.txt to see the file currently being served
• Identify the user agents for the AI crawlers you care about (ChatGPT's, Google's, Perplexity's in particular) and check that no rule is blocking them
• On Shopify, create or edit the robots.txt.liquid file in your theme to adjust the rules without touching the default generated file
• Avoid overly broad Disallow rules that accidentally block an entire folder of product pages
• Publish the theme and check the live file again to confirm the change took effect
• Recheck periodically: a theme update can regenerate a more restrictive default robots.txt

This setting doesn't show up in any sales dashboard, which makes it easy to forget even though it gates everything else. Tadow builds this check into its AI-readiness audit: whether your robots.txt is blocking the engines you track is part of what gets checked before your product pages are even fixed.