AI Tool 'Grok' Under Investigation for Producing Inappropriate Content Involving Minors and Women
In a growing controversy surrounding artificial intelligence, international calls for an investigation have intensified following the dissemination of explicit fake videos and images produced by the AI tool Grok, integrated into the platform X. These materials have reportedly depicted minors and adult women in inappropriate contexts.
Last night, Grok acknowledged the existence of "vulnerabilities" that allowed users to access digitally altered images and clips showing partial or full nudity of real individuals. This admission has drawn significant criticism and prompted French authorities to expand their judicial inquiry into the platform.
* "We are working to address vulnerabilities immediately"
The Grok account on platform X responded to user complaints by stating:
"We have detected vulnerabilities in our security procedures and are urgently working to rectify them. The sexual exploitation of minors is illegal and strictly prohibited."
Reports indicate that some users submitted images or videos of children and adolescents, requesting the program to modify them to show nudity. Meanwhile, the company X AI, the developer of the program, has not issued any official comment regarding the recent controversy, merely responding automatically to some inquiries by asserting that traditional media "lies."
Nevertheless, Grok warned users that any company in the United States "could face civil or criminal liability if it intentionally facilitates the production of child pornography or fails to take action to prevent it."
* Vulnerabilities Affecting Adult Women as Well
The misuse of Grok is not limited to minors; some internet users have also utilized the tool to alter images of adult women on social media, exposing them inappropriately.
In response, India's Ministry of Electronics and Information Technology issued an official notice to platform X, demanding a detailed report within 72 hours on measures taken to eliminate "obscene, nude, inappropriate, and sexually explicit content" produced by the application without the consent of the women involved.
* Expanded Judicial Investigation in France
In France, the Paris prosecutor's office has broadened its investigation against platform X to include the Grok tool, following complaints from three ministers and members of parliament who claimed it generated and published sexually explicit fake videos featuring minors without their consent.
The ministers and parliamentarians confirmed that the videos were based on deepfake technology and called for their immediate removal from the platform. The original investigation began last July, prompted by allegations of algorithm manipulation by the platform.
This latest crisis raises significant questions regarding the safety of artificial intelligence tools and the responsibility of developing companies to prevent misuse, particularly concerning the rights of minors and women.
