Cloudflare Changes Its Crawler Defaults on September 15. Sites Blocking AI Training Will Start Blocking Googlebot.

Cloudflare changes what its AI blocking controls do on September 15, and the change most likely to catch site owners off guard is not the new default setting. The one-click preset to block AI bots, described by the company as covering single-purpose training crawlers, will start catching Googlebot. From that date, according to Cloudflare’s announcement, crawlers … Continue reading Cloudflare Changes Its Crawler Defaults on September 15. Sites Blocking AI Training Will Start Blocking Googlebot.