Supreme Court Directs Union of India to Consider Mechanism for Blocking AI-Generated Content and Doxing
In a significant move toward regulating the digital landscape, the has directed the Union of India to consider a representation seeking a constitutionally compliant mechanism for urgent reporting and URL-specific disabling of access to content that poses threats to individual safety and dignity. The order, passed by a bench comprising Chief Justice of India Surya Kant, Justice Joymalya Bagchi, and Justice V. Mohana, comes in response to a (PIL) filed by , who appeared in person before the court.
The bench instructed the
, the
, and the
to examine the petitioner's representation and
"take remedial measures as may be required."
The representation, dated
, urges the government to establish a structured process for the swift removal of harmful online content, particularly in cases involving explicit threats of physical or sexual violence, doxing that raises reasonable apprehension of harm, unauthorized disclosure of minor children's private details, and non-consensual intimate, morphed, synthetic, or AI-generated material.
The court's direction underscores the growing challenge of balancing the unrestricted flow of information with the need to protect citizens from digital harms, especially in the age of deepfakes and synthetic media. The petitioner had highlighted a
"plethora of issues, including the harms of unauthorized online content, deepfakes and online threats,"
prompting the court to acknowledge the urgent need for a robust response mechanism.
The Representation: A Comprehensive Framework
At the heart of the PIL lies a detailed representation seeking the creation of a time-bound, judicially reviewable system for addressing specific categories of harmful content. The proposed mechanism would allow affected individuals to report content that falls into five distinct categories:
- Specific threats of physical violence, sexual violence, or death.
- Doxing that creates a reasonable apprehension of harm.
- Unauthorized disclosure of private details, photographs, school information, location data, or identity markers of minor children.
- Non-consensual intimate, morphed, synthetic, or AI-generated content.
- Non-consensual deepfakes or digitally manipulated impersonation causing immediate grave harm to safety, dignity, livelihood, or reputation.
For each category, the representation envisions a process that includes urgent reporting, preservation of the content, legal or , and URL-specific disabling of access within India. Crucially, the petitioner sought these directions as an until the government fully considers the representation, allowing aggrieved persons to approach the jurisdictional court, High Court, or any designated duty court for URL-specific relief.
The representation also emphasizes the importance of preserving any content that is complained about, ensuring that evidence is not lost before legal intervention. This aspect is particularly vital for victims who may need to rely on such material in future proceedings.
Free Speech Safeguards
A notable feature of the petitioner's request is the explicit clarification that the proposed directions should not authorize or emergency takedowns of political speeches, journalistic work, satire, fair criticism, or similar protected expression. This safeguard reflects a careful balancing of the need to curb harmful content with the constitutional guarantee of free speech under of the Constitution.
The Supreme Court's order does not impose a binding timeline on the government, but it does indicate that the representation should be considered
"in a timebound manner, preferably within 3 months."
The court's directive is procedural, directing the authorities to examine the representation and act as they deem appropriate, but it does not mandate any specific outcome.
The Broader Legal Context
This development arrives at a time when the judiciary and policymakers are grappling with the challenges posed by rapid technological advancements. The Supreme Court has previously recognized the importance of protecting individuals from online harassment and non-consensual intimate imagery, even as it upholds the principles of freedom of expression. The present PIL seeks to fill a critical gap by providing a clear, accessible route for victims to obtain swift relief without having to navigate the often slow and cumbersome legal process.
The reference to "AI-generated content" and "deepfakes" is particularly timely, as these technologies have outpaced existing legal frameworks. The representation does not propose a blanket prohibition on such content; rather, it calls for a targeted approach that addresses specific instances of harm, respecting the principles of .
From a practitioner's perspective, the court's direction may signal a shift toward expecting the executive to proactively design mechanisms that reconcile digital safety with fundamental rights. Legal experts will be watching closely to see how the government responds and whether it adopts a framework that includes judicial oversight, transparency, and .
Impact on Legal Practice and the Justice System
If the government implements a mechanism along the lines suggested, it could significantly alter the way online disputes are handled. The possibility of approaching a designated duty court for URL-specific relief would provide an expedited route for victims, potentially reducing the burden on higher courts and making the system more responsive. Legal professionals would need to familiarize themselves with the new procedures and the standards for obtaining such orders, including the evidentiary requirements and the scope of .
Moreover, the emphasis on preservation of content would require intermediaries and online platforms to maintain data in a manner that facilitates legal actions. This could have practical implications for how platforms handle user-generated content and respond to legal requests.
The court's decision to direct the Union to consider the representation rather than adjudicate the merits of the PIL suggests a collaborative approach between the judiciary and the executive. It acknowledges that the resolution of these complex issues may require policy intervention, while leaving the door open for future judicial scrutiny if the government's response is found inadequate.
Conclusion
The Supreme Court's directive marks a proactive step toward addressing the evolving threats posed by digital technologies. By urging the government to consider a comprehensive mechanism for blocking harmful content, the court has reaffirmed that the right to life and personal liberty under extends to the digital realm. At the same time, the careful attention to free speech safeguards ensures that the solution respects the delicate constitutional balance.
As the Union of India deliberates on the representation, stakeholders—including legal practitioners, technology companies, and civil society—will be keenly observing the outcome. The case, Narendra Kumar Goswami v. Union of India & Ors. (W.P.(C) No. 823/2026), may well set the stage for a more structured and rights-respecting approach to online content regulation in India. For now, the ball is in the government's court, with a gentle but clear nudge from the apex court.