Creators · Jul 31
Patreon’s AI bot blocking recasts creator archives as controlled platform data assets
The move from robots.txt requests to Cloudflare backed blocking is a platform power shift, not just a scraper cleanup.
- Ask platforms whether bot access is actively blocked, not just discouraged by robots.txt.
- Treat creator archives as valuable data assets and track where each archive lives.
- Separate future blocking from past scraping, because stronger gates do not erase old data collection.