Lawsuit Highlights Child Sexual Abuse Risks in X's Grok AI Content Moderation
An amended class action lawsuit alleges that X and xAI obstructed law enforcement investigations into child sexual abuse material (CSAM) generated by the Grok AI tool.
An amended class action lawsuit filed against X and xAI alleges that the companies not only enabled the creation of child sexual abuse material (CSAM) via the Grok AI tool but also actively obstructed law enforcement investigations. The complaint details a case in which a stepfather allegedly used Grok to generate 7,000 sexually explicit images of his stepdaughter. According to the filing, xAI’s safety systems only triggered a CyberTip to the National Center for Missing and Exploited Children (NCMEC) after the user prompted the system for “gang rape.” The lawsuit contends that xAI subsequently failed to provide investigators with essential data, including the user’s IP address, which was necessary to identify and apprehend the perpetrator.
Legal teams representing the plaintiffs, including Lieff Cabraser Heimann & Bernstein and Baehr-Jones Law, argue that this incident reflects a systemic failure in xAI’s reporting protocols. Citing NCMEC data from early 2026, the complaint alleges that 90 percent of xAI’s CyberTipline reports “were not actionable by law enforcement because xAI declined to include user information that would allow law enforcement to track and locate perpetrators.” The lawsuit claims that in the specific case of the stepfather, xAI’s report to NCMEC omitted the AI-generated CSAM images and the user’s location data, reportedly stymieing the investigation for weeks while the abuse continued.
The amended complaint also introduces Stability AI as a defendant, alleging that its open-weight models serve as the foundation for third-party “nudify” applications. Plaintiffs argue that Stability AI deliberately relaxed safety guardrails to capture market share after experiencing a decline in usage. The filing cites a June report indicating that the “Stable Diffusion family is the primary driver of image-based nudification” online, accounting for 42.7 percent of such content. The lawsuit asserts that without Stability AI’s models, many derivative applications used to alter explicit Grok outputs would not possess the capabilities required to generate CSAM.
In response to the allegations, a spokesperson for Stability AI stated that the company is “committed to preventing the misuse of AI technology,” noting that CSAM is prohibited under its Acceptable Use Policy. The spokesperson emphasized that the company partners with law enforcement and organizations such as Thorn and the Tech Coalition, asserting that any claim that safety is not a priority is “categorically wrong.” Meanwhile, xAI founder Elon Musk has denied that Grok has been used to generate child sex images, and X did not respond to requests for comment regarding the lawsuit’s claims.
The legal action highlights the tension between generative AI capabilities and platform accountability. Plaintiffs allege that xAI prioritizes profits over child safety, noting that the company has monetized the Grok feature despite reports that it has harmed tens of thousands of minors. The complaint describes the severe personal impact on the victims, noting that the stepfather in the primary case died by suicide after his arrest. The litigation seeks to address what the plaintiffs describe as a pattern of silence and obstruction, arguing that the technology functions as a “free, easily accessible weapon” that facilitates the exploitation of children.