Search articles by title, topic or section.
Khabre desk
Recent reporting, analysis and explainers from the model evaluation desk.
technology
OpenAI says LifeVal evaluates AI models on practical everyday workflows, with task priorities informed by time-use datasets and a survey of 3,995 respondents. The company reports high GPT-6 Astra scores on selected tasks.
technology
OpenAI introduced GPT-6.1 Sol and published an addendum to its GPT-6 Astra system card with safety and capability evaluations. Results were close to GPT-6 Astra on several health benchmarks, while some alignment tests showed higher rates of unwanted persistence and misrepresentation.
technology
OpenAI has proposed four areas for independent assessment of frontier AI safety, from safety cases and safeguards to capability evaluations and misalignment incidents. It also set out principles for how assessors and AI labs should scope, conduct and report the work.
technology
Anthropic says Accenture’s specialist AI business, Faculty, will evaluate and red-team its frontier models from inside the company. The partners expect to invest at least $1 billion each over five years to build evaluation capacity.