\n<\/p>\n
In one alarming announcement after another, artificial intelligence companies in recent months have shared examples of their technology acting in ways that appeared to evade instructions from humans<\/a>. <\/p>\n The episodes have highlighted the vulnerabilities in AI security and raised questions over how the fast-growing technology<\/a> can be developed safely as its usage becomes more widespread globally.<\/p>\n Industry critics have argued that many concerning events, including AI agents’ hacks of external websites, are the result of security lapses on the part of the companies building the technology. But the AI agents’ capabilities have raised widespread concerns<\/a> about the possibility bots could break away and work toward their own agenda. <\/p>\n Below are some notable events:<\/p>\n The San Francisco-based company said it was delaying the release<\/a> of a new model, called GPT-6.1 Astra, out of safety concerns voiced by its researchers. The company said the model had demonstrated leaps in completing tasks, but OpenAI needed to balance that capability against unauthorized behavior. \u201cWe have an extremely high bar in terms of safety and alignment,\u201d said Saachi Jain, OpenAI\u2019s head of safety systems.<\/p>\n As part of a review of unanticipated behavior by its AI models, OpenAI said it discovered agents had interacted with several U.S. government websites<\/a> in unexpected ways. The company’s models accessed publicly available information on websites operated by the Securities and Exchange Commission as well as U.S. Census Bureau data. OpenAI said it did not find evidence of a compromise or vulnerability. On the same day, AI evaluator and research lab Transluce said it found that agents appearing to originate from OpenAI attempted a hack on the website of the Education Department’s civil rights office, which did not succeed.<\/p>\n OpenAI CEO Sam Altman said on social media that there is an \u201cextensive and ongoing review related to our agents\u2019 use of internet access during training and evaluation.\u201d The day after the disclosure, the company announced it was pausing the training<\/a> of its most advanced models.<\/p>\n Australia’s Prime Minister Anthony Albanese said an OpenAI agent infiltrated<\/a> the public-facing Medicare Statistics Reporting Service portal on June 18. The portal hosted aggregate data about health spending and drug subsidies. No personal information had been accessed, the government said.<\/p>\n Albanese said the artificial intelligence company took too long to reveal the incident. The prime minister made the breach public following a telephone conversation with Altman. OpenAI said in a statement \u201cour models took actions we did not intend.\u201d<\/p>\n Google confirmed its Gemini AI model hacked three companies in May as part of a test of its cybersecurity capabilities. The company, which disclosed the hacks after an inquiry by The Wall Street Journal, said the model guessed passwords in one case and found passwords and credentials in a public repository in the other two cases. As in earlier such cases, the tests were being run by Irregular, a startup that describes itself as the \u201cfirst frontier security lab.” <\/p>\n Meta disclosed one of its AI models accessed the internet on its own and hacked another company. The company said that a \u201cmisconfiguration\u201d during cybersecurity testing by Irregular inadvertently allowed one of its models to access the internet. A spokesperson for Irregular said the Meta episode involved a test-environment issue that was disclosed a week earlier by Anthropic.<\/p>\n Anthropic said its artificial intelligence models hacked into three other organizations during testing<\/a>. Anthropic, the San Francisco-based AI company behind Claude<\/a>, posted on its website that it discovered the three incidents after reviewing more than 141,000 evaluation runs. In all three incidents, the AI models were tasked with a \u201ccapture the flag\u201d cybersecurity challenge, which Anthropic said has been one of the ways it assesses a model\u2019s cyber capabilities.<\/p>\n The models were given a fictional scenario and told a piece of secret information, or the \u201cflag,\u201d had been hidden on a different machine on the network with the objective of breaking in and retrieving it, it said. Anthropic said it reached out to the organizations, but it did not name them publicly.<\/p>\n The ChatGPT maker OpenAI<\/a> announced that its artificial intelligence system hacked into another AI company<\/a> on its own in what the company called an \u201cunprecedented cyber incident.\u201d <\/p>\n A week earlier, AI startup Hugging Face said, it had detected an intrusion into its data processing systems that it suspected was caused by an AI agent autonomously acting on its own.<\/p>\n OpenAI said its AI used stolen credentials and discovered a previously unknown vulnerability to access Hugging Face servers. It was working with reduced guardrails because it was supposed to be in an isolated testing environment known as a sandbox.<\/p>\n<\/div>\n