Free · Instant · Built for propane operators
Cloudflare changes its AI settings on September 15.
See what your site tells the AI crawlers today. And why the “block AI bots” switch can shut off Googlebot too.
Your customers live inside a 30–35 mile circle around your bulk plant. Those are the only searches that pay you, and Google is how most of them find you.
Is your propane website blocking AI crawlers?
Two things can block AI crawlers from your propane website. One is your robots.txt, if it tells a crawler to stay out. The other is Cloudflare’s default on September 15, 2026, which applies only to pages that show ads. Googlebot and other search crawlers stay allowed under that default. This page reads your live robots.txt and names what is blocked.
What changes September 15
The switch to know about sits in Cloudflare’s Security settings: block AI bots. Flip it on and Googlebot can go off with it, because the same bot does both jobs.
| Claim | Status |
|---|---|
| Date is September 15, 2026 | True. |
| Training and agent crawlers blocked by default | True, but only on pages that display ads. |
| Search crawlers stay allowed by default | True. |
| Applies to new Cloudflare domains, new sites from existing customers, and all existing free-plan customers | True. That includes free Cloudflare plans. |
| Blocking training crawlers also blocks the multi-purpose bots (Googlebot, Applebot, Bingbot) | True. Those bots do both jobs. Turn off one and you turn off the other. |
| Site owners can opt out in Security settings before September 15 | True. |
Sources: Cloudflare’s own announcement, TechCrunch 2026-07-01, Help Net Security 2026-07-02. Checked against Cloudflare’s announcement on August 30, 2026.
Questions
- What does this check?
- Your live robots.txt. We read it and mark every AI crawler we track — plus Googlebot — allowed, blocked, or not named. No AI guesswork. No score to argue with. It is a fact about the file your site is serving right now.
- What changes on September 15, 2026?
- On pages that show ads, Cloudflare will block AI training and agent crawlers by default. That covers new domains and existing free-plan sites. Search crawlers stay allowed by default. You can opt out in Security settings before September 15, 2026. That all comes from Cloudflare’s own announcement, which we checked on August 30, 2026. Cloudflare sets this policy and can change it.
- Will every propane dealer site be blocked from AI on September 15?
- No. The new default only hits pages that show ads, and most dealer sites don’t run ads. The bigger thing to watch is the “block AI bots” switch — flip that and Googlebot goes off with it, and those are ordinary search crawlers you spent years earning.
- Is this free?
- Yes. Enter the website. Work email is optional. Your result shows up right on this page.