abusesaffiliationarrow-downarrow-leftarrow-rightarrow-upattack-typeblueskyburgerchevron-downchevron-leftchevron-rightchevron-upClock iconclosedeletedevelopment-povertydiscriminationdollardownloademailenvironmentexternal-linkfacebookfilterflaggenderglobeglobegroupshealthC4067174-3DD9-4B9E-AD64-284FDAAE6338@1xinformation-outlineinformationinstagraminvestment-trade-globalisationissueslabourlanguagesShapeCombined Shapeline, chart, up, arrow, graphLinkedInlocationmap-pinminusnewsorganisationotheroverviewpluspreviewArtboard 185profilerefreshIconnewssearchsecurityPathStock downStock steadyStock uptagticktooltiptriangletwitteruniversalitywebwhatsappxIcons / Social / YouTube

The content is also available in the following languages: 日本語

Story

Global backlash over Grok-generated explicit deepfakes on social media platform X

There is increasing scrutiny from regulators in Europe and beyond following global outcry over the reported proliferation of sexually explicit deepfakes of women and minors generated through x.AI's chatbot Grok, which is integrated into social media platform X.

UK media watchdog Ofcom opened a formal investigation into X on 12 January over "concerning reports of the Grok AI chatbot account on X being used to create and share undressed images of people". According to the BBC, Ofcom can potentially issue a fine of up to 10% of a company's worldwide revenue.

EU Commission President Ursula von der Leyen said she is "appaled", adding that the EU will not leave child protection and consent to "Silicon Valley". "If they don't act, we will", she told several media outlets. This comes after an EU order to X to retain all Grok-related documents and data, and calls from within EU institutions to take bolder measures than this.

French prosecutors have widened an ongoing criminal investigation into X to include deepfake allegations, with several other EU countries also raising concerns.

Indonesia and Malaysia temporarily blocked access to Grok over the last weekend.

X referred media to a statement posted by its Safety account earlier this month: "Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content." Grok said it has limited AI image editing functions to paid users, which however was criticised as not addressing the issue at hand.

Timeline