The Grok AI chatbot has rapidly gained traction, offering users advanced AI-generated content. While its text-based capabilities have been widely embraced, the platform’s image generation feature has come under scrutiny for allegedly creating obscene and offensive visuals. In response, the X Team has imposed strict restrictions, limiting image generation to premium subscribers only, ensuring that only paying users can access this feature.
The move follows the viral “Remove This Picture” trend, which highlighted the misuse of Grok AI in conjunction with the social media platform X. Some individuals used the tool to harass and morph women’s photos, sparking global outrage and prompting criticism from multiple quarters. The incident brought to light the potential ethical and legal risks associated with unregulated AI image generation.
The Indian government, through the Ministry of Electronics and Information Technology (MeitY), issued official notices to X, stating that Grok AI was being used to produce sexually degrading, offensive, and unethical content, particularly by manipulating images of women without consent. Authorities emphasized that such practices violate both legal and ethical standards and ordered the removal of all inappropriate content.
Following similar directives from the European Union, Malaysia, France, and Brazil, X has restricted access to the image generation feature entirely. Officials stressed that these measures aim to protect the privacy and dignity of women and children while ensuring compliance with global ethical and legal norms.