technology
OpenAI to Honour Shared AI-Training Preferences in robots.txt
OpenAI says it will honor a shared robots.txt signal for website operators to express preferences about using their content for foundational generative AI training. The company plans to implement it in the coming months, alongside its existing crawler controls.