The AI crawling standard proposed by Kevin Kelley of Anthropic uses a shared policy token within a website's robots.txt file to block scrapers collecting generative AI training data across multiple providers simultaneously
Agree
Disagree
Overview
Debates
Related claims
Topics
Sources
5
52c7ae14
AI standards, audits, and compliance
420
claims
·
90
news stories
0
B
b5a31f81
Topic
AI copyright & training data
244
claims
·
68
news stories
0
Opening sign-in…