Key Highlights
- UK regulator Ofcom has began a proper investigation into Elon Musk-owned X over considerations linked to Grok AI-generated sexual deepfakes.
- Senior ministers, together with the UK’s PM Keir Starmer, have urged swift motion, calling the pictures “disgusting” and doubtlessly illegal.
- Ofcom will assess whether or not X breached its authorized obligation to forestall UK customers from encountering unlawful content material.
Britain’s media regulator Ofcom has launched a proper investigation into Elon Musk-owned social media platform X to find out whether or not its AI chatbot Grok has been used to generate and flow into unlawful sexual deepfake photographs. The probe will assess whether or not X (previously Twitter) failed to satisfy its obligations underneath UK legislation to guard customers from dangerous and illegal content material.
Ofcom Launches Investigation Into X Over Grok AI’s Deepfake Pictures
In an announcement issued on Monday, Ofcom stated it had obtained ‘deeply regarding stories’ suggesting that Grok was getting used to create undressed photographs of individuals with out consent, in addition to sexualised photographs of youngsters. The UK regulator stated such content material might quantity to non-consensual intimate picture abuse or youngster sexual abuse materials, each of that are unlawful within the UK.
This investigation might be one of many first of its sort to check whether or not AI instruments constructed into social media platforms adjust to the UK’s on-line security legal guidelines.
Regulator Flags Dangers of Unlawful and Little one Sexual Content material
Ofcom said that it might examine whether or not X correctly assessed the dangers posed by Grok’s image-generation characteristic and whether or not the corporate responded shortly sufficient to take away unlawful content material.
The watchdog is underneath rising political strain because the UK’s Prime Minister Keir Starmer described photographs generated utilizing Grok as ‘disgusting’ and ‘illegal’ final week. He additional said that X wanted to ‘get a grip’ on the software, as considerations mounted over the unfold of AI-generated sexual imagery.
Moreover, Enterprise Secretary Peter Kyle additionally said on Monday that banning X within the UK was ‘after all’ an choice, though he emphasised that the authority to take such motion rests with Ofcom.
You might also like: AI boom reportedly made tech billionaires like Elon Musk even richer in 2025
X Responds, Says It Takes Motion Towards Unlawful Content material
Responding to the investigation, X said that it takes motion towards unlawful content material on the platform, together with any youngster sexual abuse materials. The corporate stated in such situations, the content material is eliminated, and accounts are completely suspended, as reported by Reuters.
The platform added that customers who immediate Grok to generate unlawful content material face the identical penalties as those that add such materials straight. X has additionally stated it restricts requests to undress individuals in photographs to paying customers.
Though Elon Musk has criticised the UK authorities’s response, suggesting it was in search of “any excuse for censorship” after questions have been raised about why different AI platforms weren’t going through related scrutiny.
What UK Regulation Says on AI-Generated Sexual Pictures
Beneath British legislation, creating or sharing non-consensual intimate photographs is prohibited, no matter whether or not the content material is AI-generated. The identical applies to youngster sexual abuse materials, together with digitally created sexual imagery involving minors.
Know-how platforms are required not solely to take away unlawful content material as soon as recognized, but additionally to take proactive steps to forestall customers within the UK from encountering it. Ofcom stated it might study whether or not X used ‘extremely efficient’ measures, together with age assurance methods, to restrict entry to pornographic content material.
If X is discovered to have breached its duties, Ofcom has the authority to impose fines of as much as 10% of the corporate’s world annual income or £18 million, whichever is greater. In excessive circumstances, the regulator also can search court docket orders to limit entry to the platform within the UK.
What Occurs Subsequent in Ofcom’s Probe
Ofcom stated the investigation can be handled as a matter of ‘highest precedence’ however didn’t present a timeline for its conclusion. The regulator added that it might not hesitate to behave the place there’s a danger of significant hurt, notably to youngsters.
The probe comes because the scrutiny of Grok’s image-generation software intensifies globally. French authorities have reported X to prosecutors and regulators, calling related content material “manifestly unlawful”. Equally, Malaysia and Indonesia have briefly blocked entry to the characteristic.
The end result of Ofcom’s investigation might set an essential precedent for the way AI-generated content material is policed on social media platforms within the UK, notably as generative AI instruments change into extra extensively built-in into merchandise designed for most of the people.
