X's Grok AI Under Fire: MeitY Demands Answers on Image Manipulation, Abuse

• India's MeitY issued formal notices to Elon Musk's X platform regarding the misuse of its AI tool, Grok, for image manipulation and generating sexualized content without consent.
• Tensions escalated after X's India team was summoned by MeitY officials, who expressed concerns over Grok's capabilities to digitally shame political figures and create objectionable imagery.
• X defended Grok, stating outputs were based on credible sources and user-generated, but MeitY noted competitors like Google's Nano Banana and OpenAI's ChatGPT Images do not permit such misuse.
• MeitY's notice demands an "action taken report" from X, detailing technical measures, Chief Compliance Officer oversight, and actions against offending content/users to ensure compliance with Indian laws.
• Legal experts warn that X's safe harbour protection is at risk if it fails to proactively remove illegal sexual content, emphasizing that platforms are not exempt from accountability for content on their platforms.

Why It Matters: MeitY takes strict action against X for Grok AI misuse, highlighting risks to safe harbour protection.