If you added your website URL to Boei but the chatbot keeps saying it doesn't know anything about your business, there's a good chance Cloudflare is blocking Boei from reading your site.
This is one of the most common setup issues, and it's easy to fix. This guide walks you through it in about 5 minutes.
How to get there: Go to Setup → Chatbot in the top menu → click your chatbot → Training → Website tab.
When you connect your website to Boei, Boei visits your pages and reads the content, just like Google does when it indexes your site. This is how your chatbot learns about your business.
Cloudflare is a popular security service. Its job is to keep out bots and automated visitors. Boei's crawler looks like a bot to Cloudflare, because technically it is one. A friendly one that you invited, but Cloudflare doesn't know that yet.
The result: Cloudflare blocks Boei before it can read a single page. Your chatbot ends up knowing nothing about your business.
The fix: tell Cloudflare to let Boei through.
Not sure? Here's a quick way to check:
You can also just try the fix below. If your site isn't on Cloudflare, it won't cause any harm.
Go to dash.cloudflare.com and log in. Click on your website domain from the list.
In the left sidebar, click Security, then click WAF.
Click the Custom rules tab, then click the blue Create rule button.
Give the rule a name, something like: Allow Boei chatbot crawler
Under If incoming requests match, set up the condition:
| Field | Operator | Value |
|---|---|---|
| User Agent | contains | BoeiBot |
What is a User Agent? It's how a visitor identifies itself to your website. Boei's crawler introduces itself as "BoeiBot" so you and Cloudflare can recognize it.
Under Then take action, select Skip. Then check all the boxes that appear underneath:
This tells Cloudflare: when you see BoeiBot, don't apply any security checks.
Click Deploy (or Save) in the top right corner. The rule is active immediately.
Once the rule is saved in Cloudflare:
Boei will now be able to read your pages. Within a few minutes, your chatbot will know your business.
You have Super Bot Fight Mode enabled. This is a more aggressive setting on paid Cloudflare plans. You may need to create the WAF rule slightly differently. Contact Boei support and we'll walk you through it.
Your hosting provider has its own firewall. Some hosts (like WP Engine or Kinsta) add their own security layer on top of Cloudflare. You may need to whitelist BoeiBot there as well. Your hosting provider's support team can help.
Your site is password-protected or behind a login. Boei can only read publicly accessible pages. If your content is behind a login, add it manually using text snippets or file upload instead.
Other security tools and hosting providers that can also block crawlers:
If you use one of these, look for a "whitelist IP" or "allow bot" setting and add BoeiBot as an allowed user agent. If you're not sure how, reach out to Boei support and we'll help.
Questions? Contact us via the Boei chat widget on boei.help or email us directly.