AI Content Moderation and Tampering Convictions
Subject : Technology and Criminal Law - Intermediary Liability and Evidence Integrity
In a striking confluence of digital regulation and criminal accountability, India's legal landscape has witnessed two significant developments that highlight the nation's commitment to curbing online harms and upholding evidentiary integrity. On one front, the Ministry of Electronics and Information Technology (MeitY) has issued a detailed notice to X Corp, accusing the platform of failing to prevent the misuse of its Grok AI tool for generating obscene and sexually explicit content, particularly targeting women, and demanding an Action Taken Report within 72 hours. On the other, a Kerala court has convicted MLA Antony Raju of tampering with material evidence in a decades-old narcotics case, marking a rare instance of judicial reckoning for a sitting legislator and former advocate. These actions not only invoke key provisions of the Information Technology Act and criminal procedure laws but also signal a broader push toward ethical governance in technology and justice, with profound implications for intermediaries, AI developers, and legal practitioners alike.
The controversy surrounding X's Grok AI erupted amid growing public outrage over its alleged role in facilitating derogatory content against women. Grok, developed by xAI and integrated into the X platform, allows users to generate images and text through prompts, a feature that has been exploited to create synthetic obscene visuals. Reports indicate that users, often via fake accounts, have input prompts to "undress" or sexualize images of women, including those posted by the women themselves, leading to widespread denigration and privacy violations.
MeitY's notice, addressed to X's Chief Compliance Officer in India, accuses the platform of breaching statutory due diligence obligations under the Information Technology Act, 2000 (IT Act), and the IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021. The ministry highlighted that such misuse extends beyond anonymous accounts to direct targeting of individuals' shared content through image manipulation and AI outputs. "It has especially been observed that the service namely 'Grok AI' developed by you and integrated and made available on the X platform, is being misused by users to create fake accounts to host, generate, publish or share obscene images or videos of women in a derogatory or vulgar manner in order to indecently denigrate them," the letter stated.
The notice demands immediate action, including a comprehensive review of Grok's technical architecture—encompassing prompt-processing, large language model outputs, image handling, and safety guardrails—to prevent the generation of nudity, sexualization, or unlawful content. X is instructed to enforce its terms of service rigorously, suspending or terminating violating accounts, and to remove all offending material without delay, in line with IT Rules timelines. Crucially, the ministry warned of severe repercussions for non-compliance: "Failure to observe such due diligence obligations shall result in the loss of the exemption from liability under section 79 of the IT Act, and you shall also be liable for consequential action as provided under any law including the IT Act and BNS."
This escalation follows a letter from Shiv Sena (UBT) MP Priyanka Chaturvedi to Union Minister Ashwini Vaishnaw, flagging the trend as a "gross misuse of an AI function." Chaturvedi emphasized, "What is worse is that Grok is enabling this behaviour by adhering to such requests. This is a breach of women’s right to privacy as well as unauthorised use of their pictures, which is not just unethical but also criminal." Her intervention prompted swift governmental response, underscoring parliamentary pressure on tech accountability. Singer-activist Chinmayi Sripaada also amplified the issue on X, decrying how such tools expose and enable misogynistic behavior.
The backdrop includes a recent MeitY advisory to all social media intermediaries, urging enhanced content moderation to curb obscene material. Internationally, parallel concerns have surfaced; French authorities have flagged Grok-generated "sexual and sexist" content as illegal, notifying prosecutors. In India, the notice invokes multiple statutes, noting that AI-facilitated obscenity, paedophilia, or privacy invasions attract penalties under the Bharatiya Nyaya Sanhita (BNS) and require mandatory reporting under Section 33 of the Bharatiya Nagarik Suraksha Sanhita (BNSS). MeitY has sought a detailed report covering technical measures, compliance officer oversight, user actions, and reporting mechanisms, to be submitted within 72 hours of the notice's issuance on January 2, 2026.
For legal professionals, this represents a pivotal moment in intermediary liability. Section 79 of the IT Act provides safe harbor only if platforms exercise due diligence, including proactive AI safeguards. The case could test the boundaries of vicarious liability for AI tools, potentially leading to precedents where platforms are held accountable for algorithmic outputs akin to user-generated content.
In a courtroom drama spanning over three decades, Judicial First Class Magistrate-I at Nedumangad, Kerala, has found MLA Antony Raju guilty of tampering with evidence in a narcotics case, a verdict that revives a notorious episode from 1990 and holds a former advocate accountable for undermining justice. Raju, arrayed as the second accused in Case No. CC No. 811/2014 (T G Gopalakrishnan Nair and Ors. v Jose and Anr.), was practicing as a junior lawyer when the alleged tampering occurred.
The origins trace back to April 1990 at Thiruvananthapuram International Airport, where Australian national Andrew Salvatore was apprehended en route to Mumbai. Customs officials discovered narcotics concealed in a custom-sewn pocket of his underwear during a frisking. Charged under the Narcotic Drugs and Psychotropic Substances (NDPS) Act, 1985, Salvatore was convicted and sentenced to 10 years' imprisonment by a trial court. His personal effects, including the incriminating underwear as a material exhibit, were placed in the safe custody of the Judicial Magistrate's court.
Months later, Salvatore applied for the release of his non-evidentiary belongings, which was granted. The court clerk handed these items, inadvertently including the underwear, to Antony Raju, Salvatore's junior counsel. Raju allegedly returned the underwear to custody, but discrepancies emerged during Salvatore's appeal to the Kerala High Court. In a bizarre "practical test," the court had Salvatore try on the garment, revealing it did not fit—being of a different size. This led to his acquittal in February 1991, with the High Court expressing suspicion of evidence planting: "The underwear allegedly returned by Antony Raju did not fit Salvatore. It was not his size. This had led the High Court to acquit Salvatore in February 1991. However, the High Court had expressed suspicion about planting the evidence."
A subsequent vigilance inquiry in 1994 culminated in an FIR against Raju and the court clerk for criminal conspiracy to destroy evidence, alleging Raju made "alterations" to render the underwear unfit. In 2006, the magistrate took cognizance of charges under Sections 120B (conspiracy) and 201 (causing disappearance of evidence) of the Indian Penal Code. However, in 2023, the Kerala High Court quashed the proceedings, citing the bar under Section 195(1)(b) of the Code of Criminal Procedure (CrPC), which restricts private complaints for offenses affecting justice administration without prior sanction.
This quashing was overturned by the Supreme Court in 2024, restoring the case for a de novo investigation and trial, emphasizing procedural propriety. The recent conviction by the Nedumangad court marks the culmination, finding Raju guilty of tampering while underscoring the perils of lax evidence handling in sensitive NDPS trials.
This outcome resonates deeply in criminal law circles, where evidence integrity is paramount. The Supreme Court's intervention highlights the judiciary's intolerance for procedural evasions that shield wrongdoers, particularly those in the legal profession bound by Bar Council ethics on candor and justice.
Both developments illuminate critical fault lines in Indian law: the tension between innovation and regulation in the AI story, and the enduring pursuit of justice against procedural hurdles in the Raju case.
For the Grok notice, the core issue revolves around Section 79's conditional immunity. Intermediaries like X must not only react to violations but proactively prevent them, especially with AI's generative capabilities. The IT Rules mandate grievance mechanisms and content takedowns within 36 hours for harmful material, but AI's real-time outputs challenge this. Failure here could expose X to direct liability under BNS for abetment of obscenity or privacy breaches (e.g., Section 354C on voyeurism analogs). Legal experts may argue this pushes for "AI-specific" due diligence, such as watermarking synthetics or prompt blacklisting, aligning with global frameworks like the EU AI Act.
In the Raju verdict, the analysis centers on CrPC Section 195's interpretive scope. The High Court's quashing invoked the bar to prevent frivolous suits against judicial officers, but the Supreme Court's restoration clarified that tampering allegations warrant fresh scrutiny if initial procedures falter. This reinforces principles under BNS Sections 238 (fabricating false evidence) and 239 (tampering), with potential sentencing implications for Raju as a public figure. It also spotlights advocate accountability, potentially inviting Bar Council proceedings under Chapter II, Part VI of the Advocates Act for professional misconduct.
Common threads include due diligence failures—X's in platform design, Raju's in evidence custody—and the role of higher courts in rectifying lapses, signaling a judiciary proactive against tech-enabled harms and ethical breaches.
These cases will reshape legal practice profoundly. Tech and cyber law firms may see a surge in compliance consulting for AI tools, advising on guardrail implementation to retain Section 79 protections. Litigation could rise in privacy torts against platforms, with women's rights advocates leveraging this for class actions on digital harassment. Policymakers might accelerate AI ethics guidelines, possibly amending IT Rules for mandatory impact assessments on generative models.
In criminal practice, the Raju conviction serves as a deterrent, prompting protocols for evidence release in trials—especially NDPS cases involving personal items. It bolsters arguments for fresh investigations in quashed matters, empowering prosecutors. For politicians like Raju, it underscores dual accountability, potentially fueling ethics reforms in legislative immunity debates.
Broader systemic impacts include enhanced digital safety for women and children, normalizing zero-tolerance for AI misuse, and fortifying judicial independence. International platforms face harmonized pressures, as seen in Franco-Indian parallels, urging global standards.
The MeitY notice to X and the conviction of MLA Raju exemplify India's evolving jurisprudence at the nexus of technology and tradition. By demanding swift AI safeguards and delivering long-delayed justice on tampering, these actions affirm the rule of law's adaptability. Legal professionals must navigate this terrain vigilantly, as precedents emerge that could redefine intermediary duties and evidentiary safeguards, ultimately fostering a safer digital and judicial ecosystem.
obscene content generation - platform safeguards failure - women's digital safety - evidence alteration - privacy invasion - intermediary due diligence - criminal conspiracy
#AIinLaw #IntermediaryLiability
Belated Challenge by Non-Bidders to GeM Tender Conditions for School Sports Equipment Not Maintainable: Delhi High Court
30 Apr 2026
Physical Assault and Threats Creating Psychological Fear Attract Section 8 Goa Children's Act: Bombay HC at Goa Refuses FIR Quashing
30 Apr 2026
Failure to Frame Specific Issues Under Section 13 HMA Leads to 'Ballpark Assessment': Patna High Court Remands Divorce Case
30 Apr 2026
No Sane Person De-Boards Running Train: Gujarat HC Upholds Rs 8 Lakh Compensation under Section 124A Railways Act
30 Apr 2026
Supreme Court Orders Action Against Noida Bar Strikes
30 Apr 2026
Delhi High Court Preserves Sunjay Kapur Assets Pending Trial
30 Apr 2026
PIL Dismissed with ₹25K Costs for Concealing Credentials & Pending Criminal Cases: Allahabad High Court
30 Apr 2026
Pendency of EP Against One Judgment Debtor No Bar to Proceed Against Guarantor: Andhra Pradesh High Court
30 Apr 2026
Madras High Court Denies Anticipatory Bail in Film Leak
30 Apr 2026
Login now and unlock free premium legal research
Login to SupremeToday AI and access free legal analysis, AI highlights, and smart tools.
Login
now!
India’s Legal research and Law Firm App, Download now!
Copyright © 2023 Vikas Info Solution Pvt Ltd. All Rights Reserved.