Open Container for Bots — Let crawlers index GTM

What is Open Container for Bots?

The Open Container for Bots add-on allows legitimate search engine crawlers (Googlebot, Bingbot) access to your server-side GTM container. This is useful if you send structured data or SEO events via sGTM.

Why use Open Container for Bots?

• SEO: Google can index structured data sent via sGTM.
• Rich snippets: Product schema, Review schema, BreadcrumbList, etc.
• Event tracking: Crawlers see GTM events (for debugging).

Default behavior (add-on off)

By default DataNostro blocks ALL bots on the sGTM endpoints (/collect, /g/collect, /gtm.js). The reason: bot traffic distorts analytical data and needlessly consumes resources.

How to activate

1. Go to Dashboard → Add-ons
2. Turn on the "Open Container for Bots" toggle
3. The power-up automatically allows whitelisted crawlers

Whitelisted crawlers

• Googlebot — Google Search crawler
• Googlebot-Image — Google Images crawler
• Bingbot — Bing Search crawler
• Slurp — Yahoo Search crawler
• DuckDuckBot — DuckDuckGo crawler

Blocked bots (even after activation)

Scrapers and spam bots stay blocked:

• AhrefsBot, SEMrushBot, MJ12bot (SEO scrapers)
• PetalBot, DataForSeoBot (data scrapers)
• All bots without a known User Agent

Use case: Product structured data via sGTM

// GTM server-side variable — Product Schema
const productData = {
  "@context": "https://schema.org/",
  "@type": "Product",
  "name": "{{ product_name }}",
  "offers": {
    "@type": "Offer",
    "price": "{{ product_price }}",
    "priceCurrency": "CZK"
  }
};

// Insert into the HTML response (if the request is from Googlebot)
if (isBot()) {
  return productData;
}