ai-search-policy

Do Robots.txt Blocks Prevent ChatGPT Scraping?

Yes for documented crawlers, no for the wider system: what each OpenAI bot feeds, what blocking cannot reach, and the commercial calculus by site type.