Training Auto-Sync

Auto-sync keeps trained website content up to date without a manual re-train.

How to get there: Go to Setup → AI agent → select your chatbot → Training → Website → click the Manual sync or Auto sync badge on a source. For one page, open its ··· menu and choose Auto-sync settings.

Sitemap Sources

At the selected frequency, Boei reads the sitemap again:

  1. New URLs are added and trained.
  2. URLs removed from the sitemap are removed from the source.
  3. Existing URLs are refreshed when their sitemap <lastmod> is newer than the previous crawl.
  4. If <lastmod> is absent or unreadable, Boei uses a time-based fallback.

Your sitemap should provide an accurate <lastmod> for each URL. Use the date when that page's content last changed. Do not set every URL to the deployment date, because this can cause unnecessary crawling and training costs.

Sitemaps support Daily, Weekly, and Monthly checks. A correct <lastmod> can trigger a refresh at each check. When <lastmod> is missing, daily and weekly sources use a weekly fallback and monthly sources use a monthly fallback. A present <lastmod> is trusted, so an incorrect frozen value can prevent content refreshes. This avoids charging for an unconditional crawl of every trained page.

Site Crawls

Crawled websites can auto-sync Monthly. Boei maps the site again, adds new URLs, and checks existing trained pages. URLs missing from a crawler map are not deleted, because crawler maps can be incomplete.

Individual Pages

Individual pages can auto-sync Monthly. A page inside a source can also use monthly sync, unless its parent source already has auto-sync enabled. This prevents duplicate crawls.

During an automatic refresh, Boei checks whether a page has changed. Unchanged pages keep their existing training data, which avoids unnecessary processing costs.

Manual Sync and Email

Choose Sync now from a source's ··· menu to check it immediately. Manual re-training always reads and processes the page again.

Source sync emails report pages queued for training. A separate email is sent when a user-started training batch has actually finished.

Availability

Auto-sync is available on the Growth plan and above. The light Manual sync · Upgrade badge opens the upgrade explanation when the feature is not included in the current plan.