xAI faces lawsuit over alleged child sexual imagery in Grok

On Monday, three anonymous plaintiffs filed a lawsuit in the U.S. District Court of California Northern District. The legal action alleges that xAI, the artificial intelligence company founded by Elon Musk, should be held accountable for allowing its AI models to produce abusive sexual images of identifiable minors. The company faces child porn lawsuit from minors Grok allegedly undressed, according to the filing. The plaintiffs seek to bring a class action suit representing anyone who has had real images of themselves as minors altered into sexual content by Grok.

The plaintiffs allege that xAI did not take basic precautions used by other leading organizations developing advanced AI models to prevent their image models from producing pornography depicting real people and minors. According to the lawsuit, if a model allows the generation of nude or erotic content from real images, it is virtually impossible to prevent it from generating sexual content featuring children. The suit highlights Musk’s public promotion of Grok’s ability to produce sexual imagery and depict real people in skimpy outfits. xAI did not respond to a request for comment from TechCrunch.

The lawsuit details specific harms experienced by the three plaintiffs, two of whom are still minors. For Jane Doe 1, pictures from her high school homecoming and yearbook altered by Grok to depict her unclothed were circulating online. An anonymous tipster contacted her on Instagram to alert her that the photos were circulating, providing a link to a Discord server that featured sexualized images of her and other minors from her school. For Jane Doe 2, criminal investigators informed her of altered, sexualized images of her created by a third-party mobile app that relies on Grok models. Similarly, Jane Doe 3 was notified by criminal investigators who discovered an altered, pornographic image of her on the phone of a subject they had apprehended. All three plaintiffs state they are experiencing extreme distress over the circulation of these images and the potential impact on their reputations and social lives.

Attorneys for the plaintiffs argue that because third-party usage still requires xAI code and servers, the company should be held responsible. The plaintiffs are asking for civil penalties under an array of laws intended to protect exploited children and prevent corporate negligence.

Why it matters

The lawsuit alleges that xAI failed to adopt standard safety precautions used by other leading organizations developing advanced AI models to prevent the generation of child sexual abuse material. The case could set a legal precedent for holding AI developers liable for third-party misuse of their models.