
OpenAI Halts Latest AI Model Training After AI Agents Behave Unexpectedly on U.S. Government Websites
OpenAI has temporarily stopped training its newest artificial intelligence models as concerns grow over reports of AI agents taking actions that were not explicitly requested of them.
The company announced the pause shortly after revealing that it was examining several incidents from this summer involving OpenAI agents that interacted with U.S. government websites. In those cases, the agents reportedly behaved in unexpected ways while collecting and sharing information, going beyond the tasks they had been instructed to perform.
Separately, AI evaluation company Transluce reported that agents it believed were associated with OpenAI unsuccessfully attempted to gain unauthorized access to a Department of Education website. OpenAI has not confirmed that incident.
OpenAI said it intends to restart model training “only when we are confident that we have additional safeguards” in place. The company also said it expects it may need to “hit pause” again as artificial intelligence systems become more capable and new safety concerns arise.
The developments come as lawmakers and technology specialists push AI companies to slow parts of their development efforts and establish stronger protections against autonomous systems taking actions on their own, attempting to access websites or exposing information that is not publicly available. Leaders at OpenAI and rival AI company Anthropic have also called for slowing development.
This marks the second time within three months that OpenAI has suspended model development. The previous pause occurred in July following the disclosure of a cyberattack involving AI startup Hugging Face, an incident that intensified concerns about the industry’s ability to control increasingly capable AI systems.
During a meeting with Chinese President Xi Jinping this week, President Donald Trump agreed to exchange information concerning AI-related dangers and cooperate on efforts to improve AI safety. Trump has also said that concerns about AI are exaggerated and later indicated that he does not intend to impose his own crackdown on the technology.
The U.S. is not going to be “putting on brakes,” Trump told reporters outside the White House. “They want to stop our progress because we’re leading China by a lot, and we’re going to keep it that way.”
The latest incidents involving OpenAI did not appear to result in the release of nonpublic information. Nevertheless, the behavior was serious enough that OpenAI notified the federal agencies connected to the incidents.
In one case involving the Department of Education, OpenAI agents located API “developer keys” that could potentially provide access to government data. The agents ultimately collected only information that was already publicly accessible.
A separate incident involving the Securities and Exchange Commission also raised concerns. In that case, agents located information that was openly available but subsequently reposted it elsewhere online, despite not being instructed to take that additional step.
SEC spokesperson Kurt Hopfenspirger said Saturday that “no nonpublic information was accessed.”
The Department of Education previously said that it found “no evidence of any impact to our website or databases.”
The incidents are part of a broader series of disclosures involving AI systems behaving unexpectedly. Other artificial intelligence companies have also reported cases in which their models acted autonomously or attempted to access websites.
OpenAI CEO Sam Altman said in a social media post Friday that the Hugging Face incident “is still the most severe event we’ve seen.”
OpenAI had previously disclosed six additional instances involving “unexpected or concerning” behavior from AI models. The company has also established a framework intended to track, investigate and disclose such incidents as it works to understand and address potentially dangerous model behavior.