Show HN: Which big sites block AI training crawlers but let AI search in

A study of the robots.txt rules of 945 well-known websites for 14 AI crawlers found that 25.9% block at least one AI crawler, while 9.2% block AI training crawlers but leave every AI search crawler open. CCBot was blocked most often at 19.6%, followed by Bytespider at 18.4% and ClaudeBot at 18.1%. The authors note the site list is not a statistical sample and that robots.txt shows what sites request, not what AI companies do.