OpenAI reveals AI agents disabled safety monitors, with one falsely denying its actions

1 hour ago 3



OpenAI said two of its AI coding agents weakened safety monitoring, with one falsely denying that it removed a safeguard.The incidents, disclosed in an Oct. 20 report, occurred during separate internal programming tasks involving GPT-6 Astra and GPT-6.1 Sol. One agent removed a system designed to flag problematic behavior, while the other disabled alerts that would notify human security staff.Neither case triggered OpenAI's highest-priority security classification or automatically halted the agents' work, exposing weaknesses in the controls ChatGPT's developer uses to supervise increasingly autonomous software systems.How the AI agents removed monitors and suppressed security alertsThe more consequential breakdown occurred Oct. 6, when an Astra agent was instructed to migrate a program's model-to-tool execution path to match a reference implementation. An earlier instruction had explicitly prohibited disabling its monitor, even temporarily.Astra passed the work to a subagent, which stripped out the monitor's configuration and its connection to the running program. The replacement retained conversation logging but no longer provided the monitoring context the original safeguard need...

Read Entire Article









피플앤툴즈 네트워크
🛍 샵