The European Commission has opened formal proceedings against X after reports that its AI chatbot, Grok, generated millions of sexualized deepfake images of real people without consent.
According to regulators, Grok produced around three million such images within days. Some of the content may involve minors, raising serious legal and safety concerns.
The probe falls under the EU’s Digital Services Act (DSA), which requires large platforms to assess and reduce risks linked to illegal content. Regulators will examine whether X met its obligations.
The commission said users were able to upload real photos and ask Grok to create altered, sexualized versions. Investigators are reviewing whether X had adequate safeguards in place.
The case marks a major escalation in EU scrutiny of AI-generated content on social media platforms. Authorities have not yet announced possible penalties or corrective measures.
X and representatives for owner Elon Musk did not immediately respond to requests for comment.
The investigation comes as the EU and member states push stricter rules on non-consensual sexual deepfakes. New proposals aim to criminalize such content and strengthen protections for minors.
Regulators said the outcome of the case could shape how AI tools are deployed and supervised across major online platforms in the future.
