Definition
GPTBot
GPTBot is the web crawler OpenAI uses to collect public web content for training its models, identified by the GPTBot user-agent string. Allowing it in robots.txt lets your pages contribute to what future OpenAI models know about your brand; blocking it removes you from that training signal.
GPTBot is distinct from OAI-SearchBot, the crawler that fetches pages for live ChatGPT search results. Most site owners want both allowed so their brand is both learned during training and retrievable at answer time. Like most AI crawlers, GPTBot does not execute JavaScript.
Related terms
Reading definitions won’t tell you where you stand
Run the free check and see whether AI actually recommends your brand.
Check my AI visibility