New plaintiffs have joined a federal lawsuit against Elon Musk’s xAI and Stability AI, alleging the companies’ artificial intelligence tools were used to generate sexually explicit images of them as children. The case raises a question that no court has yet resolved: when an AI system produces child sexual abuse material, who is legally responsible?
Additional victims have joined an existing federal lawsuit against xAI, the artificial intelligence company founded by Elon Musk, and Stability AI, alleging that the companies’ generative AI tools were used to create sexually explicit images of them as children. The new plaintiffs say their likenesses were used without consent to generate child sexual abuse material, and that the companies knew or should have known their systems were capable of producing such content and failed to implement adequate safeguards to prevent it.
The lawsuit targets two of the most prominent names in generative AI. xAI is the company behind the Grok AI assistant, which Musk launched as an alternative to ChatGPT and made available through the X social media platform. Stability AI is the company behind Stable Diffusion, an open-source image generation model that has been widely used and widely misused since its public release. Both companies have said they prohibit the generation of sexually explicit content involving minors and that their systems include filters designed to prevent it. The plaintiffs allege those filters were insufficient and that the companies’ business decisions prioritized capability and growth over safety.
The legal theory the plaintiffs are pursuing has not been tested at this scale. Child sexual abuse material is a federal crime under 18 U.S.C. 2256, regardless of whether it depicts a real child or a synthetic image. The PROTECT Act of 2003 extended federal obscenity law to cover computer-generated depictions of minors engaged in sexually explicit conduct. The question the lawsuit must answer is whether the companies that built and distributed the AI tools bear civil liability when those tools are used to generate prohibited content, even if the specific generation was triggered by a user rather than the companies themselves.
Section 230 of the Communications Decency Act, which shields online platforms from liability for user-generated content, is the legal defense both companies are expected to invoke. Whether Section 230 applies to AI-generated content — as opposed to content posted by users — is an unresolved question that multiple ongoing lawsuits are working toward answering. The distinction matters because a generative AI system does not merely host what a user posts. It actively produces new content in response to a prompt. Whether that production constitutes the company’s own speech, or merely the facilitation of user expression, is the legal line that courts are now being asked to draw.
The Florida investigation into OpenAI’s ChatGPT following the 2025 Florida State University shooting, which involved more than 200 messages between the shooter and the chatbot, established a precedent for state-level regulatory scrutiny of AI systems in cases involving harm. The federal lawsuit against xAI and Stability AI pushes that question into civil liability territory and into the most serious category of harm the law recognizes: the sexual exploitation of children. If the plaintiffs prevail, the ruling would establish that AI companies bear responsibility not just for what their systems are designed to do, but for what they can be made to do.
The children in these images are real people. Their likenesses were taken without consent and used to generate content that the law has prohibited for decades. The companies whose technology made that generation possible have lawyers and legal theories. The plaintiffs have lawyers too. What neither side has yet is a court ruling on who bears responsibility when the machine does the harm. That ruling is coming. This lawsuit may be the one that produces it.
Discover more from KVIG Informative
Subscribe to get the latest posts sent to your email.
