With robots.txt preferences widely ignored, the AI Preferences Working Group is developing a new way for publishers to shield content from AI bot scraping.