At least 37 attorneys general for US states are responding to the ongoing problem of the Grok chatbot creating child sexual abuse materials (CSAM).
It follows the app being banned in two countries and investigations being opened in both the UK and EU, but both Apple and Google have so far ignored requests for them to temporarily remove Grok and X from their respective app stores …
The Grok CSAM problem
Most AI chatbots these days are able to generate images from text prompts, and xAI’s Grok is no exception. It can do so either directly in the app, on the web, or through X.
What is exceptional, however, is Grok’s extremely loose guardrails. This has seen it being used to generate non-consensual effectively-nude images of real individuals, including children. One estimate said it had generated around 23,000 CSAM images in a period of just 11 days.
Two countries have blocked the app, with investigations live in both the UK and EU.
37 US states respond
Wired reports that at least 37 US states and territories are now calling on the company to address the problem following an open letter signed by most of them.
At least 37 attorneys general for US states and territories are taking action against xAI after people used its chatbot, Grok, to generate a flood of sexualized images earlier this year […] In addition to [the 35] who signed the letter, attorneys general from California and Florida tell WIRED they have also taken action.
The letter calls for xAI to take six steps:
... continue reading