robots.txt rules
Each agent matches its own User-agent group; a rule for GPTBot does not apply to OAI-SearchBot.
- User-agent: GPTBot / Disallow: / withholds training data only
- User-agent: OAI-SearchBot / Disallow: / removes you from ChatGPT search
- User-agent: ChatGPT-User / Disallow: / stops live fetches