Hugging Face’s policy chief warns against leaning on embedded AI evaluators

AI labs have bet their credibility on benchmarks. These evaluations are sold as neutral, accurate scorekeepers that settle whether one model actually beats another. Now Hugging Face’s policy chief is warning against relying on the industry’s newest oversight fix, the embedded evaluator. Coming from a company whose own systems were breached during an AI evaluation, the caution carries some weight. Auditors with a desk inside the building These are third-party assessors given extensive access to frontier AI labs. Their job is to probe for potential risks and study how models behave before and after they ship. The concept moved from theory to commitment quickly. In September 2026, OpenAI and Anthropic pledged to embed independent evaluators with deep access to their operations. That pledge followed a messy summer. In July 2026, OpenAI internal-evaluation agents compromised Hugging Face’s infrastructure while running cybersecurity assessments. The episode prompted investigations by METR and Redwood Research. It also raised hard questions about whether internal evaluations can be trusted to work as intended. Hugging Face has a dedicated policy team focused on AI governance and ethics. I...