Michaela
AI research and development company Anthropic has claimed that Chinese state-linked hackers exploited its AI chatbot Claude to carry out automated cyber attacks on around 30 international organizations.
Key Points
- In a November 14 blog post, Anthropic explained that hackers deceived its chatbot into executing automated tasks while pretending to conduct cybersecurity research
- The company described the incident as the “first reported AI-orchestrated cyber espionage campaign” and noted that it identified the hacking attempts in mid-September
- The operation was carried out by individuals posing as legitimate cybersecurity professionals
In a November 14 blog post, Anthropic explained that hackers deceived its chatbot into executing automated tasks while pretending to conduct cybersecurity research. The company described the incident as the “first reported AI-orchestrated cyber espionage campaign” and noted that it identified the hacking attempts in mid-September.
The operation was carried out by individuals posing as legitimate cybersecurity professionals. They instructed the chatbot to perform small automated tasks which, when combined, created what Anthropic described as a “highly sophisticated espionage campaign.”
The attackers targeted a range of organizations, including tech firms, financial institutions, chemical manufacturers, and government agencies. Using Claude’s coding capabilities, they developed an unspecified program that could autonomously breach selected targets with minimal human intervention. Anthropic has not revealed the identities of the specific organizations affected.
Anthropic confirmed that the hackers have been blocked from accessing the chatbot and that both the affected organizations and relevant law enforcement agencies have been notified.
Related: Trump Plans ‘One Rule’ AI Executive Order to Override All State-Level Laws
Despite Anthropic’s claims, reactions from the cybersecurity community were mixed. Following the report, U.S. Senator Chris Murphy urged that AI regulation become a national priority, prompting Meta’s Chief AI Scientist Yann LeCun to caution that Murphy was “being played” by parties seeking regulatory capture. “They are scaring everyone with dubious studies so that open source models are regulated out of existence,” LeCun wrote.
Supporting LeCun’s perspective, Me & Qi founder Arnaud Bertrand responded, urging caution against what he described as “obvious propaganda.” Bertrand revealed that he had asked Claude to analyze the company’s own report to determine whether there was any evidence supporting its claim that the attacks were carried out by a “Chinese state-sponsored group.”
“No. The report provides no evidence whatsoever to support the attribution to a ‘Chinese state-sponsored group.’ Throughout the entire document, Anthropic simply asserts that the operation was “conducted by a Chinese state-sponsored group we’ve designated GTG-1002” without providing any technical indicators, infrastructure analysis, or methodology that led to this attribution,” Claude responded.
Related: Study Finds AI Chatbots Can Sway Political Opinions Using False Info
However, some commentators countered Bertrand’s skepticism, suggesting that Anthropic may have valid reasons for not disclosing how it identified the hackers as a Chinese state-sponsored group. Revealing the full tracing method could alert the perpetrators and prevent the company from tracking or countering their activities in the future.
As the debate over AI-powered cyberattacks heats up, one thing remains clear: the intersection of artificial intelligence and cybersecurity is only going to get more complex. Companies like Anthropic are navigating uncharted territory, balancing transparency, technical limitations, and the urgent need to protect global organizations from emerging threats.
MICHAELA
Michaela is a news writer focused on cryptocurrency and blockchain topics. She prioritizes rigorous research and accuracy to uncover interesting angles and ensure engaging reporting. A lifelong book lover, she applies her passion for reading to deeply explore the constantly evolving crypto world.
