Definition
ClaudeBot
ClaudeBot is the web crawler operated by Anthropic to gather public web content used in training the Claude family of models, identified by the ClaudeBot user-agent. Whether it can read your site influences how accurately Claude describes and recommends your brand.
ClaudeBot is one of a handful of AI crawlers every site should decide on explicitly in robots.txt, alongside GPTBot, Google-Extended, and PerplexityBot. Blocking it makes your content invisible to Claude's training pipeline, so Claude can only rely on stale or second-hand descriptions of you.
Related terms
Reading definitions won’t tell you where you stand
Run the free check and see whether AI actually recommends your brand.
Check my AI visibility