The artificial intelligence tool Grok, developed for the social network X (formerly Twitter), became the center of a serious controversy after allegations that it is being used to generate pornographic images without the consent of the victims.
According to reports, users have used it to request the removal of clothing in photographs of women published on the platform. In even more alarming cases, the same practice is being applied to images of children, constituting a crime provided for by law.
The expert interviewed in the report explains that Brazilian legislation offers solid protection in these cases: “We have very strong legislation that protects the image and reputation of the individual and we also have specific legislation that protects more vulnerable groups, with greater protection in several laws in relation to women, children and adolescents”.
Worrying differential
Grok distinguishes itself from other conventional platforms by allowing sexually explicit content. Additionally, unlike competitors, it is integrated into one of the most popular social media platforms in the world, which expands its reach and potential for harm.
Users can simply tag Grok in a post with a request, and the tool responds publicly, making it easier to misuse the technology for criminal purposes.
International repercussion
The case has already crossed borders. In Brazil, federal deputy Erika Hilton, from PSOL, filed a representation with the Federal Public Ministry against the tool. Internationally, the European Union, the United Kingdom, India and Malaysia have also spoken out against Grok.
The European Commission even ordered X to retain all documents related to the tool until the end of the year, demonstrating the seriousness with which the case is being treated by international authorities.
Insufficient measures
“This episode just demonstrates that, if there is no direct, proactive and preventive work by the network itself, it is not enough to write in the usage policy that this cannot be done. There really needs to be an effective educational and also penalizing and removal action”, states the interviewed expert.
After the negative repercussions, X only for paying users. However, critics point out that this measure is insufficient, as these subscribers will continue to be allowed to request photos that sexualize women and children.
“We are living in a very dark moment when we look at how AI is being used and how these images are being disseminated within the digital environment”, concludes the expert, warning of the risks of inappropriate use of technology.
