New Delhi: The Elon Musk-owned social media platform ‘X’ (formerly Twitter) has come under regulatory scrutiny once again, with the Central Government expressing serious concern over the misuse of its AI tool, Grok. The Ministry of Electronics and Information Technology (MeitY) has issued a formal notice to the platform, citing violations related to user privacy, particularly involving women and children.
According to the government, Grok AI has been used to generate obscene, indecent and sexually explicit content, including the unauthorised morphing of women’s photographs. MeitY stated that such activity is not only unethical but also constitutes a clear violation of Indian law. The ministry noted that the unchecked functioning of the AI tool has enabled the large-scale circulation of objectionable content on the platform.
In recent weeks, a disturbing trend has emerged on ‘X’, where images of ordinary women are uploaded into Grok AI with prompts designed to produce sexually explicit or derogatory outputs. These manipulated images are then widely shared, raising serious concerns over consent, dignity and online safety. The government described this trend as a direct threat to women’s privacy and security.
Reacting to the issue, Shiv Sena (UBT) MP Priyanka Chaturvedi wrote to Union IT Minister Ashwini Vaishnaw, warning that the misuse of AI tools like Grok poses grave risks to women. She urged the government to take immediate and strict action, terming such misuse a criminal offence rather than a technological lapse.
Another controversial trend linked to Grok AI, referred to as “Remove This Picture,” has also drawn attention. In this trend, users upload photographs of well-known personalities and use prompts such as “remove the criminal” or “remove the non-actor.” Grok’s responses are then shared online, triggering political and social debates. Several prominent figures, including Mahatma Gandhi, Jawaharlal Nehru, Prime Minister Narendra Modi, Rahul Gandhi, Donald Trump, Shah Rukh Khan and Aamir Khan, have reportedly been targeted.
In its notice, MeitY has flagged non-compliance with provisions of the Information Technology Act, 2000, and the IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021. The ministry stated that ‘X’ has failed to fulfil its obligations as an intermediary by allowing the generation and spread of unlawful content through Grok AI.
The Centre has given ‘X’ a 72-hour deadline to submit an Action Taken Report (ATR). The platform has been directed to conduct a comprehensive technical review of Grok AI, immediately remove obscene and unlawful content, take action against offending accounts, and clearly outline its reporting mechanisms to law enforcement agencies. The ATR must also detail corrective measures introduced within the AI system and the role of the Chief Compliance Officer in enforcing safeguards.
The government has issued a clear warning that failure to comply will result in the withdrawal of legal protection under Section 79 of the IT Act, exposing the platform and its officials to criminal liability. It also noted that action could be initiated under multiple laws, including the Bharatiya Nyaya Sanhita (BNS), BNSS, the POCSO Act, and statutes related to the prohibition of obscene representations of women.
Centre issues notice to social media platform 'X' over obscene content targeting women, children on AI tool Grok.#Akashvani #News pic.twitter.com/tGh4R3wEgi
— All India Radio News (@airnewsalerts) January 3, 2026
Union IT Minister Ashwini Vaishnaw reiterated that social media platforms are fully responsible for the content hosted on their services. He stressed that using AI to morph and circulate images of women without consent is a punishable offence and that stricter regulatory oversight is necessary. He also pointed out that parliamentary committees have already recommended stronger laws to deal with AI-driven abuses.
The Grok AI controversy has sparked a wider debate on the risks associated with unregulated artificial intelligence. While experts acknowledge AI’s potential benefits, they warn that inadequate safeguards can lead to serious social harm. As the 72-hour deadline approaches, all eyes are on how ‘X’ will respond, with the episode emerging as a critical test case for AI governance and platform accountability in India.