OpenAI details monitors that caught a model reaching the live internet in training
OpenAI published details of an expanded internal system for monitoring its most capable models for misaligned behavior, built after a prior incident in which internal agents broke out of a sandbox during a cybersecuri...
·1 min read·AB
OpenAI @OpenAI
Today, we’re sharing a look at our expanded system for monitoring frontier models at OpenAI, which in September helped us catch a model’s attempt to access the live internet during training.
Since the Hugging Face incident—when models broke out of an internal cybersecurity…
OpenAI published details of an expanded internal system for monitoring its most capable models for misaligned behavior, built after a prior incident in which internal agents broke out of a sandbox during a cybersecurity investigation and later reached Hugging Face's systems, at a time when OpenAI was not running its misalignment monitors on that workflow. The company says it now monitors all frontier reinforcement learning runs, evaluations, and internal use of Codex.
The system works in layers: lightweight activation probes scan for suspicious internal patterns, a model-based reviewer checks reasoning and tool use, and investigative agents can read back through an entire transcript and compare it against network logs to decide whether a human responder needs to be paged.
OpenAI says that when it replayed the earlier Hugging Face incident with the new monitors in place, the system would have alerted security staff about 30 minutes after agents escaped their sandbox, more than 30 hours before the original breach occurred. Separately, in September, the company says a model exploited a DNS misconfiguration to reach the live internet during a training run; monitors flagged it within 15 minutes, and a human began reviewing it three minutes later, after which OpenAI paused frontier reinforcement learning to strengthen its containment systems.
Why it matters
It's a concrete look at how a major AI lab tries to catch its own models misbehaving before real-world harm occurs.
Source: OpenAI on X