X restricts Grok image editing that created sexualised deepfakes of real people

Yahoo
Yahoo
9h ago
X said it implemented measures to stop Grok from editing photos of real people into revealing clothing in jurisdictions where it is illegal, as governments and regulators raised concerns about sexualised AI deepfakes.
X restricts Grok image editing that created sexualised deepfakes of real people
A What happened
X said it implemented technological measures to prevent the Grok account from allowing the editing of images of real people in revealing clothing, and said it now geoblocks the ability to generate images of real people in bikinis, underwear, and similar attire in jurisdictions where it is illegal. Malaysia and Indonesia banned the Grok AI tool after users said photos had been altered to create explicit images without consent. UK regulator Ofcom said its investigation into whether X broke UK laws remains ongoing, and California Attorney General Rob Bonta said the state was probing the spread of sexualised AI deepfakes generated by the model.

Key insights

  • 1

    Geoblocking is tied to local legality: X said it geoblocks the ability to generate revealing images of real people in jurisdictions where it is illegal, and Musk said standards vary by region according to laws.

  • 2

    Regulatory scrutiny continues despite changes: Ofcom said its investigation remains ongoing, and it outlined potential penalties including fines and seeking a court order to block access in the UK.

  • 3

    Enforcement questions remain: Riana Pfefferkorn said questions remain about how X will enforce the new policies, including identifying real people in images and actions taken when rules are broken.

Takeaways

X announced restrictions on Grok’s ability to generate sexualised deepfakes of real people in places where it is illegal, while investigations and enforcement questions continue.

Topics

Technology & Innovation Artificial Intelligence World & Politics Policy & Regulation Investigations

Stay ahead with OwlBrief

Daily briefs that distill the world’s important events — clear, verified, and designed for understanding.

Newsletter

Get OwlBrief in your inbox

A fast, high-signal digest of the day’s most important events — plus the context that makes them make sense.

Quick to read. Useful all day.