The biggest names in AI are backing a new way to opt out of scraping

OpenAI, Google, Microsoft, and Anthropic accidental they volition follow a caller modular that publishers tin usage to opt retired of being scraped by AI, arsenic reported earlier by Search Engine Roundtable. With this control, publishers tin use their AI grooming preferences crossed aggregate AI companies, alternatively of mounting them individually.

The shared "policy token" signal is projected by Kevin Kelley, a method pb for standards astatine Anthropic, arsenic portion of the Internet Engineering Task Force (IETF). It volition unrecorded wrong a website's robots.txt file, which has agelong signaled which web crawlers tin and can't scrape a tract - whether for hunt indexing, archiving, oregon …

Read the afloat communicative astatine The Verge.