Social media platform X has admitted to lapses in content moderation and assured the Government of India that it will strictly operate in accordance with Indian laws, government sources said as quoted in media, following a controversy over the circulation of obscene and sexually explicit content generated using its AI service, Grok.
As part of the corrective action, authorities said around 3,500 pieces of objectionable content have been blocked, and more than 600 accounts have been removed from the platform. The steps were taken after the government raised serious concerns about the spread of indecent imagery and unlawful content on X.
Government sources said the platform has also given assurances that such content will not be allowed in the future and has committed to strengthening its content moderation mechanisms to prevent similar violations going forward.
The action comes days after the Ministry of Electronics and Information Technology (MeitY) flagged the misuse of AI tools like Grok for generating vulgar and sexually explicit content. The ministry expressed concern over how such tools were being used to create objectionable material and circulate it widely on social media.
On January 2, MeitY issued a directive to X ordering the immediate removal of all vulgar, obscene, and unlawful content on the platform, particularly content generated or amplified using Grok. The ministry warned that failure to comply would invite action under the Information Technology Act and other applicable laws.
The directive also required X to submit a detailed Action Taken Report within 72 hours, outlining the steps taken to address the issue.
According to official sources, the ministry asked X to clearly spell out:
The technical and administrative measures taken in relation to Grok
The level of oversight exercised by the Chief Compliance Officer
The action initiated against objectionable content, users, and accounts
The systems put in place to ensure compliance with mandatory reporting obligations under Indian law
The government further observed that Grok was being misused not only to create fake profiles but also to harass, target, and sexually abuse women whose images or videos were posted online. This misuse reportedly involved AI prompts, image editing, and the generation of synthetic content to manipulate or degrade visuals of individuals without consent.
On January 8, X submitted a detailed reply to the IT Ministry responding to the government’s concerns. However, the response was described by Indian authorities as “detailed but not adequate,” indicating that the government remains dissatisfied with certain aspects of the platform’s compliance and safeguards.
Despite this, government sources said X has now acknowledged its mistakes in handling the situation and has committed to tighter controls, improved supervision, and stricter enforcement of its content policies in line with Indian regulations.
The Grok obscenity row has once again brought the spotlight on the growing challenges posed by AI-generated content and the responsibility of social media platforms to prevent misuse. The government has signalled that while innovation is welcome, platforms must ensure that emerging technologies do not become tools for abuse, harassment, or the violation of Indian law.
