Back
Sounds Alarm on AI Deepfake Surge in Landmark PIL
In a significant move addressing the escalating threat of AI-generated deepfakes, the has directed the Central and State governments, along with the , to file their responses to a . The bench, led by Chief Justice Mrs. Justice Sunita Agarwal alongside Justice D.N. Ray , is probing critical gaps in India's digital regulatory framework amid a sharp rise in harmful online content.
The Deepfake Deluge: Categories of Concern
Petitioner Vikas Vijay Nair brought attention to three alarming categories of fake and AI-generated media flooding platforms like video-sharing sites, social media, and messaging apps: (i) Deepfake impersonations; (ii) Obscene and vulgar portrayals; and (iii) Mocking and dehumanizing depictions . These, the PIL argues, pose risks to public order, privacy, and institutional legitimacy—especially when targeting constitutional authorities.
The petition traces the existing legal arsenal under the , which criminalizes identity theft, cheating by personation, privacy violations, and obscene content dissemination. It highlights under , conditioned on per the , plus 2025 and 2026 amendments targeting "synthetically generated information" (SGI).
Petitioner's Spotlight on Enforcement Hurdles
Despite this "detailed regulatory architecture," the PIL pinpoints practical procedural gaps :
- Lack of real-time support for police and cyber units against fast-spreading deepfakes.
- Poor coordination between state police, 's blocking portals (like Sahyog/takedown), and platform enforcement.
- Absence of clear prioritization protocols for deepfakes targeting constitutional figures.
Nair urges invocation of , pressing the State to frame rules under sub-section (2) for interception, monitoring, and decryption procedures to tackle these threats effectively.
Government's Initial Response and Platforms on Hold
Learned Advocate General Kamal Trivedi , assisted by Government Pleader G.H. Virk , appeared for the State, while advocate Ankit Shah represented respondents 3 and 4. As per court records and reports, respondents 1-4 encompass the Centre, State government, and Gujarat DGP. The court deferred notices to intermediary giants— , , , , and (respondents 5-9)—pending these replies.
Court's Procedural Directive: Next Steps Set
Delivering the oral order, Chief Justice Agarwal stated:
"The responses of the respondent Nos. 1 to 4 are to be filed by the next date fixed. The question of issuance of notice to the respondent Nos. 5 to 9 would be considered after the responses of the respondent Nos. 1 to 4 are received. List on
."
Key Observations from the Bench -
"Sharp and alarming rise in fake and AI-generated videos/photographs being uploaded on online platforms... largely of three categories: (i) Deepfake impersonations; (ii) Obscene and vulgar portrayals and (iii) Mocking and dehumanizing depictions."
-
"The
expands the framework by defining 'synthetically generated information' (SGI), imposing labeling and traceability obligations on intermediaries..."
-
"Practical procedural gaps still persist in... (i) real-time support available to police... (ii) coordination between State police,
’s blocking... and (iii) clear prioritisation and escalation protocols..."
Broader Implications for Digital India
This interim order underscores the judiciary's proactive stance on AI's darker side, potentially catalyzing tighter enforcement of 36-hour takedowns, three-hour government deadlines for sensitive SGI, and mandatory reporting. As responses roll in, the PIL could reshape intermediary accountability, bridging legislative intent with on-ground reality—and safeguarding democracy from digital deception.
