header logo
Vallibel FD
Selan Bank
Science & Tech
OpenAI says its rogue AI tried to hack other companies
Jul 30, 202608:26 AM
OpenAI says its rogue AI tried to hack other companies
Mobitel inner 1278

OpenAI has revealed a cyber-attack carried out by rogue ChatGPT agents went further than just one company.

 

Hugging Face was thought to be the only victim of the unprecedented hack - but OpenAI now admits its bot attacked several "publicly-available services".

The out-of-control AI found four logins online which allowed it to access four separate, unnamed services.

Meanwhile, in an emergency briefing with hundreds of cyber security professionals, Hugging Face has described what it was like to be on the receiving end of the world's first fully autonomous AI hack.

The firm described how the AI worked at superhuman speed but also made strange decisions and mistakes that no human hacker would have made.

Hugging Face, which is like an app store for AI tools, said the hacking agents worked relentlessly with thousands of different methods trialled simultaneously.

The company first revealed that it had been hacked by someone using powerful autonomous AI on 16 July and reported it to police.

Nearly a week later, OpenAI admitted it was its AI that had escaped a closed environment and attacked Hugging Face on its own during a test.

It was trying to find the answers to a hacking exam it had been set by OpenAI, and targeted Hugging Face.

On Wednesday OpenAI updated its statement to include the extra detail that the hack went further than first thought.

"The models identified and used publicly exposed credentials at the account-level on other publicly-available services. This includes four accounts on four services," the company said.

OpenAI did not clarify whether "publicly-available services" means companies - but it said the new attacks were not the same level of severity as the Hugging Face hack.

Clumsy behaviours
On Tuesday, the industry body the Cloud Security Alliance (CSA) wrote-up a report based on the emergency meeting with Hugging Face on Friday - which Hugging Face itself has reviewed.

"The agents followed inefficient routes and exhibited clumsy behaviours that no human would choose", the CSA wrote.

The agents repeated actions that they had already completed - a sign of an agentic AI losing its thread and context.

The agents also hallucinated reams of incoherent commands and text and were sloppy and did not cover their tracks well.

But among the errors and strange behaviour, Hugging Face warned the AI agents made brilliant technical moves and were able to rapidly adapt to new scenarios in the days-long hack.

Jurassic Park
It took three days for them to be discovered inside the Hugging Face IT network and it took the company's AI and cyber-security experts many hours to contain and eject the AI agents - something standard companies might struggle with.

The company would not say how much the hack cost it but said staff worked for many hours to rebuild about a third of their infrastructure.

Hugging Face has been praised for its transparency in telling the AI and cyber industry what happened.

The CSA warned the incident shows that AI "agents... find a way" - a reference to the film Jurassic Park, where dinosaurs escape their enclosures.

"They are objective-driven, set their own sub-goals, adapt in real time to bypass defences, and operate with a machine-speed persistence that can overwhelm manual operations," the paper reads.

Cyber security officer Ritesh Patel was on the Hugging Face briefing call with around 450 others and says the industry is working hard to address the new threat of rogue AI agents.

"This is the reality of autonomous agents powered by frontier models: they are relentlessly persistent, sometimes highly noisy, and will try every possible path to achieve their goal, which can easily overwhelm traditional defences," he said.

Ethical hacker Valentina Palmiotti - better known as Chompie - reviewed the CSA report and says the way the agents hack might seem haphazard but it is clearly effective.

"They throw out a bunch of stuff and see what sticks," she said.

"But they also don't get bored, they don't sleep and can be infinitely tenacious."

Rogue history
This is not the first time AI agents have been shown to go "rogue".

In the CSA's report it references previous examples like in September 2024 when an earlier model of ChatGPT escaped its container to get an answer it needed for another test.

That event was contained in OpenAI's own IT systems and "largely celebrated at the time", the CSA noted.

But "rogue" behaviour "is the standard, not the exception," the paper claimed.

It warned cyber-security professionals around the world they needed to adapt to the new normal of swarms of AI agents working at speed in strange and clumsy ways that might lead to more breaches.

The paper also urged people who use or develop AI agents to be responsible in how they control them, calling for some way for cyber-security defenders to find out who is the ultimate owner of agents to increase transparency.

Previous reports suggest it took OpenAI four days to realise its AI had hacked Hugging Face.

OpenAI said it would release the findings of its own investigation soon to help people learn from the event.
Source: BBC
--Agencies

 

Disclaimer: All the comments will be moderated by the AD editorial. Abstain from posting comments that are obscene, defamatory or slanderous. Please avoid outside hyperlinks inside the comment and avoid typing all capitalized comments. Help us delete comments that do not follow these guidelines by flagging them (mouse over a comment and click the flag icon on the right side). Do use these forums to voice your opinions and create healthy discourse.

Comments

0
Comments are disabled

Note: Due to legal constraints, the Ada Derana Editorial team has taken a decision to disable comments on all articles concerning ongoing court procedures.

MostRead
Mobitel 1278
VideoStories
Met Dept. forecasts heavy rains in coming days, warns of possible floods and earth slips

Met Dept. forecasts heavy rains in coming days, warns of possible floods and earth slips

Construction of Mannar Hospital Emergency Treatment Unit begins under President’s patronage

Construction of Mannar Hospital Emergency Treatment Unit begins under President’s patronage

Heavy rains submerge Colombo roads; Showers above 100mm expected in several areas tomorrow

Heavy rains submerge Colombo roads; Showers above 100mm expected in several areas tomorrow

“Vital intelligence withheld”:  New allegations emerge in 2019 Easter Sunday attacks case

“Vital intelligence withheld”: New allegations emerge in 2019 Easter Sunday attacks case

Sri Lanka's economy grows 4.2% in Q2 despite Iran war, weak agriculture, slower services

Sri Lanka's economy grows 4.2% in Q2 despite Iran war, weak agriculture, slower services

2027 Appropriation Bill gets Cabinet nod; Draft to be gazetted before parliamentary submission

2027 Appropriation Bill gets Cabinet nod; Draft to be gazetted before parliamentary submission

10,000 job opportunities for Sri Lankans in Thailand under new labour pact

10,000 job opportunities for Sri Lankans in Thailand under new labour pact

Will Govt. increase fuel prices? CPC incurs losses due to sale of diesel, says Chairman

Will Govt. increase fuel prices? CPC incurs losses due to sale of diesel, says Chairman

Rain returns, bringing relief to drought-hit areas; Heavy rainfall predicted in the coming days

Rain returns, bringing relief to drought-hit areas; Heavy rainfall predicted in the coming days

“Let’s act before dengue gets worse!” Dengue control week begins across 15 districts

“Let’s act before dengue gets worse!” Dengue control week begins across 15 districts

Sri Lanka rejects stock of cancer treatment vaccines due to missing printed labels

Sri Lanka rejects stock of cancer treatment vaccines due to missing printed labels

Americans mark 25 years anniversary since September 11 terrorist attacks

Americans mark 25 years anniversary since September 11 terrorist attacks

Suspect arrested over illegal USD 80 million overseas transfers remanded until September 17

Suspect arrested over illegal USD 80 million overseas transfers remanded until September 17

 Indian Defence Minister Rajnath Singh concludes official three-day visit to Sri Lanka

Indian Defence Minister Rajnath Singh concludes official three-day visit to Sri Lanka

Supreme Court invalidates presidential pardon granted to Gnanasara Thero by ex-President Maithipala

Supreme Court invalidates presidential pardon granted to Gnanasara Thero by ex-President Maithipala

Lassana Flora