Nikhil Sharma Tools
Free tool · Runs in your browser

Is your store blocking the AI crawlers that sell for you?

Paste your robots.txt below. You'll see, bot by bot, whether ChatGPT, Perplexity, Google AI, and Claude can reach your store, and get a copy-ready block to fix it.

Generate the fix

Pick the crawlers you want to allow, copy the block, and add it to your robots.txt. On Shopify: edit templates/robots.txt.liquid.


      
    

robots.txt is only half the story

Your robots.txt can be perfect and the crawler still gets a 403. Cloudflare's Block AI bots setting rejects these crawlers at the edge, before robots.txt is ever read. Turn it off under Security → Bots, then verify from any terminal:

curl -I -A "OAI-SearchBot" https://yourstore.com/

A 200 means you're open. A 403 means something upstream is still blocking. The full sequence, including feed and schema fixes, is in the free AI Shopping Checklist.

Common questions

Which crawler does ChatGPT shopping actually use?
OAI-SearchBot powers search and shopping results. ChatGPT-User fetches pages when a user clicks through in a conversation. GPTBot is training-only; blocking it does not affect shopping visibility.
This says I'm allowed, but I still don't show up in ChatGPT.
This tool reads robots.txt only. CDN-level blocks (Cloudflare's AI-bot setting is the usual one) happen before robots.txt. Verify with the curl command above. After that, it's feed and schema quality; start with the ChatGPT product listing guide.
Is this check exact?
It's a simplified evaluation of site-wide access: it finds the rule group that applies to each bot and checks whether the root path is disallowed. Edge cases with overlapping Allow/Disallow patterns on specific paths may differ. For product pages specifically, test the exact URL in Google Search Console's robots tester or with curl.

Read next on the blog

Get new tools and posts in your inbox

Occasional notes on Shopify, paid ads, and AI in commerce. No spam.

Thanks - check your inbox to confirm.

Want the free AI Shopping Checklist PDF instead? →