Michaela
Analysts at the UK nonprofit Internet Watch Foundation (IWF) report that online circulation has emerged of criminal images depicting girls aged 11 to 13, which “appear to have been created” using Elon Musk’s AI chatbot, Grok.
Key Points
- The IWF discovered sexualized images of girls aged 11–13 reportedly created using Grok on dark web forums.
- Cases of AI-generated sexual content extend beyond children, with adults also being targeted for harassment and image manipulation on X.
- UK regulators, including Ofcom and the Technology Secretary, have demanded urgent action and stronger AI content safeguards.
The IWF reported discovering sexualized and topless images of underage girls on a dark web forum, where users claimed they had been generated using Grok. Ngaire Alexander, Head of Hotline at the IWF, told the BBC that AI tools like Grok could potentially “bring sexual AI imagery of children into the mainstream.”
Under UK law, the images found would be classified as Category C, the lowest level of criminal material. However, Alexander noted that the individual responsible had subsequently used a different AI tool, not developed by xAI, to produce a Category A image, which represents the most severe classification of illegal content.
“We are extremely concerned about the ease and speed with which people can apparently generate photo-realistic child sexual abuse material (CSAM),” Alexander stated. Analysts from the IWF said the images of underage girls were discovered on the dark web, not on Musk’s social media platform X, where users can also access Grok.
Related: New AI Agent ‘Clawdbot’ Exposes Users to Remote Hijacking
Incidents like this are increasingly spotlighting the serious risks that women and underage girls encounter on the internet. Shortly after New Year’s, Reuters reported that Rio de Janeiro-based musician Julie Yukari experienced online harassment after her fiancé posted a photo of her in a red dress, cuddling her black cat, on X before midnight on New Year’s Eve. The following day, the image received hundreds of likes, alongside numerous requests from users asking Grok to digitally alter the photo to depict her in a bikini.
Yukari initially ignored the notifications, assuming Grok would not act on the requests. However, the AI reportedly generated nearly-naked images of her, which were subsequently shared on X. Reuters noted that Yukari’s experience is not isolated, citing multiple instances in which Grok has been used to produce sexualized images of children.
Related: Back from the Shadows: Kusama Teases AI Evolution, SHIB Bounces
Both Ofcom, the UK’s communications regulator, and Technology Secretary Liz Kendall have urged X to address the creation and circulation of abusive imagery generated by its AI. “What we have been seeing online in recent days has been absolutely appalling, and unacceptable in decent society,” Kendal said. “X needs to deal with this urgently. It is absolutely right that Ofcom is looking into this as a matter of urgency and it has my full backing to take any enforcement action it deems necessary,” she added.
The incident has sparked renewed debate about the responsibilities of AI developers and social media platforms in preventing the misuse of emerging technologies, emphasizing the urgent need for stronger safeguards and clearer regulatory guidance.
Frequently Asked Questions
MICHAELA
Michaela is a news writer focused on cryptocurrency and blockchain topics. She prioritizes rigorous research and accuracy to uncover interesting angles and ensure engaging reporting. A lifelong book lover, she applies her passion for reading to deeply explore the constantly evolving crypto world.
