Author: Anna Mutungura, a 7th Semester BA.LLB student at MVN University.
Abstract
Artificial Intelligence (AI) has transformed the way information is created, shared and consumed. Among its most controversial developments is deepfake technology, which allows individuals to generate or manipulate images, videos and audio recordings to make them appear authentic. Although this technology has beneficial applications in entertainment, education and communication, its misuse presents serious concerns relating to privacy, personal identity, consent, reputation and individual security. In India, the growing circulation of manipulated digital content has raised questions about whether existing legal provisions adequately protect individuals against such misuse. This article examines the legal challenges associated with AI-generated deepfakes in India, particularly under the Information Technology Act, 2000, the Digital Personal Data Protection Act, 2023, and the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, including their 2026 amendments. It further considers the responsibilities of digital platforms, the difficulties of establishing liability and the need for a balanced regulatory approach that protects individuals without unnecessarily restricting technological innovation.
Keywords: Artificial Intelligence, Deepfakes, Digital Privacy, Consent, Cybercrime, Intermediary Liability, Indian Law.
Introduction
The development of Artificial Intelligence has introduced new possibilities for creating, modifying and distributing digital content. Tasks that once required professional editing skills can now be performed using readily available AI applications. While these developments have improved creativity and accessibility, they have also created opportunities for digital manipulation.
One particularly concerning development is deepfake technology. Deepfakes use artificial intelligence and machine learning techniques to generate or alter visual, audio or video content in a manner that makes fabricated material appear genuine. A person’s face can be placed into a video, their voice can be imitated, or they can be portrayed as making statements they never actually made.
The concern is not simply that digital content can be manipulated. It is that such manipulation can create a false representation of a real individual and circulate it to millions of people before the truth becomes known. A fabricated recording may damage someone’s professional reputation, expose them to harassment, facilitate financial fraud or cause emotional distress.
In India, where digital communication and social media have become central to everyday activities, the consequences can be particularly serious. Deepfakes can affect ordinary individuals, public figures, businesses and institutions. Women and children may face additional risks when their identities are used to create sexually explicit or humiliating material without their permission.
The increasing accessibility of generative AI therefore presents an important legal question: how effectively can Indian law protect individuals when their identities are digitally manipulated? Although several existing laws address related forms of misconduct, the distinct nature of synthetic media creates difficulties concerning consent, attribution, evidence and accountability.
Understanding Deepfake Technology and Its Misuse.
Deepfake technology involves the use of AI systems to create or manipulate content that imitates real people or events. These systems may use photographs, voice recordings or publicly available videos as reference material to produce convincing synthetic representations.
Not every use of deepfake technology is unlawful. It can support film production, educational demonstrations, accessibility tools, historical recreations and artistic expression. For example, a filmmaker may use synthetic imagery to recreate a historical scene, while an educator may use AI-generated simulations to explain complex subjects.
The legal concerns arise when this technology is used without appropriate consent or in circumstances that cause harm.
Some common forms of misuse include:
Identity impersonation: An individual’s face or voice may be used to create misleading videos or recordings that falsely suggest their involvement in particular activities.
Financial deception: Criminals may imitate the voice of a business executive, employer or family member to persuade victims to transfer money or disclose confidential information.
Non-consensual intimate imagery: Images of individuals may be manipulated to create sexually explicit material without their knowledge or permission.
Misinformation: Fabricated recordings of politicians, public officials or other influential individuals may be circulated to mislead the public or influence public discussions.
Reputational damage: A person may be falsely portrayed as making offensive statements or engaging in conduct that damages their personal and professional standing.
These examples demonstrate that deepfake misuse is not exclusively a technological problem. It raises questions of personal autonomy, dignity, privacy and the responsibility of individuals and organisations participating in the digital ecosystem.
Constitutional Protection of Privacy and Personal Dignity.
The Indian Constitution provides an important foundation for addressing the misuse of deepfake technology. Article 21 guarantees the right to life and personal liberty, which the Supreme Court has interpreted to include the right to privacy.
In Justice K.S. Puttaswamy (Retd.) v. Union of India (2017), the Supreme Court recognised privacy as a constitutionally protected fundamental right. The judgment established that privacy is connected with individual autonomy, dignity and the ability to exercise control over personal matters.
This constitutional understanding is relevant to deepfake technology because an individual’s face, voice and personal characteristics form part of their identity. Using these characteristics to create misleading or humiliating representations without consent can interfere with personal autonomy and dignity.
For instance, when an individual’s photograph is manipulated to create an intimate video, the resulting harm extends beyond the circulation of false information. It involves the unauthorised use of personal identity and may seriously affect the individual’s psychological well-being, relationships and reputation.
However, constitutional protection does not automatically mean that every manipulated image constitutes a violation of Article 21. The circumstances, nature of the content, applicable legal provisions and responsibility of the parties involved must be examined.
The constitutional framework nevertheless provides an important basis for developing laws and regulatory measures that protect individuals against harmful uses of emerging technologies.
Existing Legal Framework Governing Deepfakes in India
India does not rely on a single comprehensive statute dealing exclusively with deepfakes. Instead, different laws address the consequences of digital impersonation, privacy violations, fraud, obscenity and unlawful publication.
Information Technology Act, 2000
The Information Technology Act, 2000 is one of the principal laws governing cyber-related offences in India.
Section 66C deals with identity theft involving the fraudulent or dishonest use of another person’s electronic signature, password or other unique identification feature. Section 66D addresses cheating by personation through communication devices or computer resources.
However, these provisions must be applied carefully. Not every synthetic image or imitation automatically satisfies theThese provisions may become relevant where deepfake technology is used to impersonate another individual for dishonest purposes. For example, an AI-generated voice recording used to deceive someone into transferring money may attract legal consequences where the necessary elements of cheating and personation are established.
Section 66E addresses the violation of privacy through the capture, publication or transmission of images of a person’s private areas in circumstances that violate privacy. Sections 67 and 67A deal with the publication or transmission of obscene material and material containing sexually explicit acts in electronic form.
However, these provisions must be applied carefully. Not every synthetic image or imitation automatically satisfies the requirements of these offences. The distinction between an actual recording and a digitally fabricated representation may create difficulties when determining which provision applies.
The Act therefore provides important legal remedies, but its effectiveness depends on the facts of each case and the ability of investigators to establish the required elements of an offence.
Digital Personal Data Protection Act, 2023
The Digital Personal Data Protection Act, 2023 introduces a statutory framework for processing digital personal data in India.
Deepfake creation may involve the collection, use or processing of photographs, videos, voice recordings and other information relating to identifiable individuals. Where such material constitutes digital personal data, the Act becomes relevant, subject to its scope, exemptions and applicable commencement provisions.
The Act establishes obligations concerning lawful processing, consent, certain legitimate uses, data security and the rights of individuals. These principles are important when personal data is used to train AI systems or generate synthetic representations.
Nevertheless, it is important to distinguish between the unlawful creation of a deepfake and the unlawful processing of personal data. They are related concerns, but they are not necessarily identical legal issues. Whether a particular use attracts liability under the Act requires an examination of the relevant processing activity and statutory requirements.
Bharatiya Nyaya Sanhita, 2023
The Bharatiya Nyaya Sanhita, 2023 provides criminal law provisions that may apply to certain forms of deepfake misuse.
Depending on the circumstances, offences involving cheating, personation, forgery, defamation and the circulation of obscene material may become relevant.
For example, a fabricated video created to deceive another person or facilitate financial fraud may involve conduct punishable under applicable criminal provisions. Similarly, false representations circulated to damage someone’s reputation may raise questions concerning criminal defamation.
Section 353 also addresses certain forms of false information, statements and rumours that may cause public mischief or fear, subject to its statutory requirements.
The important consideration is that the use of AI does not automatically establish criminal liability. Investigators must still establish the accused person’s involvement, the relevant intention or knowledge and the other elements required by the applicable offence.
Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021.
Digital platforms play a significant role in determining how quickly deepfake content reaches the public. The Information Technology Rules, 2021 establish due diligence obligations for intermediaries operating in India.
These obligations include maintaining appropriate grievance mechanisms and taking action in relation to unlawful information in accordance with applicable legal requirements.
The 2026 amendments introduced additional provisions addressing synthetically generated information. These changes are particularly important because they recognise the regulatory challenges associated with realistic AI-generated content.
The amended framework strengthens obligations concerning the identification, labelling and handling of synthetic content, alongside measures intended to prevent the creation and circulation of unlawful material.
These developments represent an important step towards addressing the risks of deepfakes. However, regulatory requirements must be implemented in a manner that is transparent, proportionate and consistent with the protection of legitimate expression.
Consent and the Unauthorised Use of Personal Identity.
Consent is one of the most significant legal and ethical issues surrounding deepfake technology.
In the digital environment, individuals regularly share photographs, videos and voice recordings through social networking platforms. However, making personal content publicly available does not necessarily amount to granting unrestricted permission for its use in AI-generated material.
A person may willingly upload a photograph for professional networking or social communication without agreeing to have that photograph used to create an artificial video or manipulated recording.
This distinction is important because consent should be understood in relation to the purpose and circumstances for which personal information is used.
The unauthorised manipulation of someone’s identity can interfere with their ability to control how they are represented publicly. It can also create a situation in which victims must repeatedly explain that a video or recording circulating online is not genuine.
Women are particularly vulnerable to non-consensual sexual deepfakes. Such content can be used for harassment, intimidation, blackmail and public humiliation. Even when the material is entirely fabricated, the reputational and psychological consequences may be substantial.
An effective legal response must therefore recognise that harm can arise from the creation and circulation of synthetic content itself, rather than requiring proof that the depicted event actually occurred.
Platform Accountability and the Problem of Rapid Circulation.
Social media platforms have become central to the distribution of digital information. Their ability to connect users across geographical boundaries also makes them potential channels for the rapid spread of manipulated content.
A deepfake can be uploaded, downloaded, reproduced and shared across multiple platforms within a short period. Even if the original upload is removed, copies may continue circulating through other accounts and communication channels.
This creates a significant challenge for victims seeking legal remedies.
Intermediaries operate under the framework established by the Information Technology Act and the applicable IT Rules. Section 79 provides conditional safe-harbour protection to intermediaries, subject to compliance with statutory requirements and due diligence obligations.
The 2026 amendments to the IT Rules further strengthen the framework governing synthetically generated information.
However, platform accountability must be approached carefully. Requiring platforms to remove unlawful material is important, but overly broad removal obligations may also affect lawful expression, satire, artistic works and legitimate criticism.
A platform should have clear procedures for receiving complaints, assessing reported content and responding within the timelines prescribed by law. Users should also have access to meaningful grievance mechanisms when their identities are misused.
The challenge is to ensure that platforms respond effectively to genuine harm without becoming unrestricted arbiters of online speech.
Difficulties in Investigation and Establishing Liability.
Even when legal provisions are available, investigating deepfake-related offences can be complicated.
The first difficulty is identifying the person responsible for creating or distributing the material. A person may use anonymous accounts, virtual private networks or multiple online services to conceal their identity.
The second difficulty concerns digital evidence. Investigators may need to establish whether a recording is genuine, whether it has been manipulated and which tools or accounts were involved in its creation.
Digital forensic examination may assist in identifying alterations, metadata and other technical indicators. However, sophisticated AI systems can produce increasingly realistic content, making detection more difficult.
Another challenge is determining the intention behind the creation and distribution of the material. A synthetic video created for harmless entertainment may raise different legal questions from one created to facilitate fraud or harassment.
The distinction matters because criminal liability depends on the ingredients of the relevant offence, not merely on the fact that AI technology was used.
Cross-border conduct creates further complications. A person may generate content in one country, upload it through a service based in another jurisdiction and target a victim in India. Investigating such cases may require cooperation between authorities and service providers in different countries.
These challenges demonstrate the importance of technical expertise, proper evidence preservation and effective cooperation between law enforcement agencies and digital platforms.
Balancing Regulation with Freedom of Expression.
Although regulating deepfake misuse is necessary, restrictions on synthetic media must not unnecessarily interfere with freedom of expression.
Article 19(1)(a) of the Constitution protects freedom of speech and expression, subject to the reasonable restrictions provided under Article 19(2).
AI-generated content can serve legitimate purposes, including political satire, parody, education, artistic expression and social commentary. A complete prohibition on synthetic media would therefore be neither practical nor desirable.
The legal distinction should focus on the nature, purpose and consequences of the content.
For example, a clearly labelled satirical video should not automatically be treated in the same manner as a fabricated recording designed to deceive voters or obtain money through impersonation.
Regulatory measures should therefore distinguish between harmful deception and legitimate creative expression.
Transparency is equally important. Labelling AI-generated material can help viewers understand whether content has been artificially created or altered. However, labelling alone cannot prevent all forms of misuse, particularly where content is deliberately distributed without disclosure.
A balanced approach should combine transparency, accountability, proportionate restrictions and accessible remedies for affected individuals.
Recommendations for Strengthening India’s Legal Response.
India has taken important steps towards regulating the misuse of AI-generated content. Nevertheless, further measures could improve the effectiveness of existing protections.
First, clearer legal recognition of non-consensual synthetic identity misuse is necessary. The law should provide greater clarity regarding the unauthorised creation and distribution of realistic synthetic representations of individuals, particularly where such conduct causes serious harm but does not easily fall within an existing offence.
Second, grievance redressal mechanisms should be strengthened. Victims should be able to report harmful content through accessible procedures. Platforms should communicate decisions clearly and provide appropriate avenues for challenging incorrect decisions.
Third, digital forensic capacity should be improved. Law enforcement agencies require specialised training and access to reliable tools for examining manipulated audio, images and videos. This would support more effective investigations and evidence collection.
Fourth, public awareness should be increased. Digital literacy programmes should educate users about the risks of synthetic media, the importance of verifying information and the legal consequences of creating or distributing harmful content.
Fifth, platforms and AI developers should adopt responsible practices. Appropriate safeguards, transparency measures and mechanisms for detecting misuse should form part of the development and deployment of generative AI systems.
Finally, protection for vulnerable individuals must receive particular attention. Children and victims of non-consensual intimate deepfakes require accessible reporting procedures, timely intervention and appropriate legal support.
These measures would help create a regulatory environment that protects individuals while allowing responsible technological development.
Conclusion
AI-generated deepfakes present a complex challenge for India’s legal system because they combine technological innovation with questions of privacy, identity, consent and accountability. Although existing laws provide remedies for several forms of digital misconduct, the distinctive nature of synthetic media exposes difficulties in identifying offenders, proving liability and responding to content that spreads rapidly across digital platforms.
The Information Technology Act, 2000, the Digital Personal Data Protection Act, 2023, the Bharatiya Nyaya Sanhita, 2023 and the amended IT Rules provide important elements of the existing legal framework. However, effective protection requires more than the availability of statutory provisions. It requires accessible remedies, capable investigative institutions, responsible digital platforms and greater public awareness.
Ultimately, the objective should not be to prevent the development of AI technology but to ensure that innovation does not come at the expense of individual dignity and fundamental rights. As synthetic media becomes increasingly sophisticated, Indian law must continue adapting to protect individuals against digital manipulation while preserving legitimate freedom of expression.
The future of AI governance in India will depend on achieving this balance between technological progress and legal responsibility.

