Crawler

GroowBot

If you saw GroowBot in your logs, someone added your website to Groow (usually your own team or your marketing agency) or ran our free check on it.

What it does

When a company is set up in Groow, GroowBot reads its public website once to learn what the company sells and who it sells to. That profile is used to write the questions Groow tracks in AI assistants. It does not log in, submit forms, or read anything that isn't publicly linked.

Anyone can also run GroowBot's free check from this site. It reads one website's home page, robots.txt, sitemap and llms.txt once, and the same website is checked at most once an hour.

How it behaves

  • User agent: GroowBot/0.1 (+https://groowgroup.com/bot)
  • Follows robots.txt, including rules written for GroowBot specifically.
  • Reads at most 25 pages per setup, four at a time, and only on the website that was added.
  • Skips logins, carts, checkouts, account and search pages, and files like PDFs and images.
  • Once a week, and when someone runs the free check, Groow's AI access check asks for the home page once as each major AI crawler would (for example OAI-SearchBot or ClaudeBot), to tell the site's owner whether those crawlers can get in. These requests come from Groow, not from those companies.

How to block it

Add this to your robots.txt:

User-agent: GroowBot
Disallow: /

Can AI read your website?

GroowBot checks ChatGPT, Claude, Perplexity, Google and Bing in about 10 seconds. Free.

Run the free check

Questions or a problem? Email us.