The question of whether an artificial intelligence platform can qualify as an “intermediary” under Indian law — and thereby claim the protection of safe harbour under Section 79 of the Information Technology Act, 2000 — is one of the most pressing and underexamined questions in Indian technology law today. For more than two decades, Section 79 has functioned as the backbone of India’s internet economy, shielding platforms from secondary liability for third-party content. The provision was drafted at a time when the internet was imagined as a passive pipe: a conduit through which users sent and received information. Algorithms of the generative and recommending kind that now define digital experience were simply not contemplated [1].

Today, platforms such as YouTube, Instagram, and AI-native services like Grok do not simply host content. Their algorithms curate, amplify, personalise, and in the case of generative AI, actively produce it. This makes the question far from academic: if an algorithm is found to be an active participant in content creation or curation, the platform deploying it may lose its statutory shield entirely. The Ministry of Electronics and Information Technology (MeitY) has, through a series of advisories in 2023 and 2024, begun to signal precisely this shift — that AI is not simply content hosted on a platform, but content shaped and generated by it [2].

The Architecture of Section 79 of the IT Act: What the Provision Actually Says

Section 79 of the Information Technology Act, 2000, provides in its operative part: “Notwithstanding anything contained in any law for the time being in force but subject to the provisions of sub-sections (2) and (3), an intermediary shall not be liable for any third party information, data, or communication link made available or hosted by him.” This immunity is not unconditional. Sub-section (2) requires that the intermediary must not have initiated the transmission, must not have selected the receiver, and must not have selected or modified the information contained in the transmission. It must also observe due diligence and comply with the guidelines prescribed by the Central Government.

Sub-section (3) withdraws the protection in two scenarios: first, where the intermediary has conspired with, abetted, aided, or induced the commission of an unlawful act; and second, where the intermediary, upon receiving “actual knowledge” that unlawful content is being hosted on its platform, fails to expeditiously remove or disable access to that material. The term “intermediary” is defined under Section 2(1)(w) of the IT Act as “any person who on behalf of another person receives, stores or transmits that record or provides any service with respect to that record,” and expressly includes telecom service providers, internet service providers, web-hosting service providers, search engines, online payment sites, online-auction sites, online marketplaces, and cyber cafes [1].

The structure of this provision assumes a fundamental premise: that the intermediary is a passive actor. Its immunity is premised on its not having shaped the content in question. The moment it crosses into active participation — selecting, modifying, inducing — the statutory protection falls away. The rise of AI platforms tests every element of this assumption.

Shreya Singhal v. Union of India (2015): The Constitutional Baseline

No discussion of Section 79 of the IT Act is complete without a reckoning with the Supreme Court’s landmark judgment in Shreya Singhal v. Union of India, (2015) 5 SCC 1, delivered on 24 March 2015 by a bench of Justices J. Chelameswar and R.F. Nariman. The case arose from a batch of writ petitions under Article 32 of the Constitution of India, principally challenging the constitutionality of Sections 66A, 69A, and 79 of the IT Act. The Supreme Court’s treatment of Section 79 fundamentally reshaped the intermediary liability regime in India [3].

The Court read down Section 79(3)(b) to narrow its scope significantly. The holding was unambiguous:

“Section 79 is valid subject to Section 79(3)(b) being read down to mean that an intermediary upon receiving actual knowledge from a court order or on being notified by the appropriate Government or its agency that unlawful acts relatable to Article 19(2) are going to be committed then fails to expeditiously remove or disable access to such material.”

In practical terms, the Court held that intermediaries are not required to act upon private takedown requests. “Actual knowledge,” as used in Section 79(3)(b), was interpreted to mean knowledge received through the medium of a court order — not a complaint from a private party. This interpretation rested on a practical foundation: holding intermediaries like Google and Facebook to a standard of responding to every private complaint would make it impossible for them to function, since millions of requests are received and an intermediary cannot be expected to adjudicate the legality of each piece of content on its own. The Court further affirmed that there is no positive obligation on intermediaries to monitor content on their platforms [3]. This no-monitoring principle remains foundational to India’s safe harbour regime under Section 79 of the IT Act, even as AI regulation begins to chip away at it.

Active vs. Passive Intermediaries: The Christian Louboutin Standard

The passive/active distinction now central to the AI liability debate was crystallised in Indian jurisprudence by the Delhi High Court in Christian Louboutin SAS v. Nakul Bajaj & Ors., 2018 SCC OnLine Del 12215, decided on 2 November 2018 by Justice Prathiba M. Singh. The case involved the luxury shoe brand’s claim against darveys.com, an e-commerce platform that used the plaintiff’s trademarks as meta-tags and claimed to sell authentic goods sourced from authorised stores [4].

The defendant’s principal defence was that it was a mere intermediary under Section 79 of the IT Act. Justice Singh rejected this defence and, in doing so, laid down a twenty-six point framework to determine whether an online platform is a passive conduit or an active participant. The court reasoned that so long as a platform acts as “mere conduit or passive transmitters of the records or of the information, they continue to be intermediaries, but merely calling themselves as intermediaries does not qualify all e-commerce platforms or online market places as one.” The court then held:

“When an e-commerce website is involved in or conducts its business in such a manner, which would see the presence of a large number of elements enumerated above, it could be said to cross the line from being an intermediary to an active participant.”

By curating product listings, arranging logistics, using meta-tags, and guaranteeing authenticity, darveys.com had exceeded the role of a neutral conduit. The court also held that failure to observe due diligence with respect to intellectual property rights could amount to “conspiring, aiding, abetting, or inducing” unlawful conduct under Section 79(3)(a), independently disentitling the platform from safe harbour [4].

This framework applies with full force to AI platforms. When a recommendation algorithm selects which content a user sees, or when a generative AI model produces text or video in response to a user prompt, the question of whether these functions constitute “selection” or “modification” of information within the language of Section 79(2)(b) becomes the defining legal inquiry. The Christian Louboutin standard supplies the doctrinal tool; generative AI supplies the stress test.

IT (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021: Expanding the Compliance Perimeter

The Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Rules, 2021, notified on 25 February 2021 under Section 87 read with Section 79 of the IT Act, represent the most significant regulatory expansion of intermediary obligations since the original 2011 Guidelines. Rule 7 makes explicit that an intermediary which fails to comply with prescribed due diligence requirements shall no longer be entitled to safe harbour under Section 79(1) of the IT Act and shall be liable under applicable laws [1].

The 2021 Rules introduced the classification of “significant social media intermediaries” (SSMIs) — social media intermediaries with more than fifty lakh (five million) registered users in India. SSMIs bear substantially heavier obligations: they must appoint a Chief Compliance Officer, a Grievance Redressal Officer, and a Nodal Contact Person, all resident in India. Rule 4(2) requires SSMIs that primarily provide messaging services to enable identification of the “first originator” of information where directed by a court or competent authority under Section 69 of the IT Act.

For AI platforms, the most consequential provision is Rule 3(1)(b), which requires intermediaries to “make reasonable efforts by itself, and to cause the users of its computer resource” not to publish certain categories of prohibited content. This language has been interpreted as potentially imposing a preventive obligation — not merely reactive removal — that moves the compliance standard toward something approaching a monitoring duty. If AI systems deployed on a platform generate or amplify prohibited content, the question of whether the platform made “reasonable efforts” to prevent this, independently of any user action, becomes immediately live [2].

MeitY’s AI Advisories: The Regulatory Turn

India’s formal attempt to address AI within the intermediary liability framework began in November 2023 and crystallised through MeitY advisories issued in early 2024. The March 15, 2024 Advisory — which replaced the March 1, 2024 Advisory — directed intermediaries to ensure that the use of “AI models, large language models, generative AI technology, software or algorithms” on or through their platforms does not allow users to host, display, upload, modify, publish, transmit, store, update, or share any content in violation of the Intermediary Guidelines or any other law in force [2].

The advisory’s significance lies in its implicit treatment of AI not as content but as a potentially liable actor within the intermediary ecosystem. By requiring platforms to ensure that AI models deployed on them do not enable unlawful conduct, MeitY effectively placed the responsibility for AI-generated harm squarely on the platform. A platform that deploys a generative AI model which produces deepfake content, defamatory material, or content that undermines democratic processes cannot credibly claim it was merely hosting third-party information — because the AI is not a third party in any conventional sense. It is the platform’s own deployed technology [2].

The advisories also addressed deepfakes specifically, reflecting the 2023 Rashmika Mandanna incident, where AI-generated synthetic video caused significant public and political concern. That episode illustrated how AI-generated content can cause reputational harm at a scale and speed that outpaces any traditional notice-and-takedown mechanism, and demonstrated to MeitY that the existing framework needed explicit AI-specific obligations [5].

IT (Intermediary Guidelines) Amendment Rules, 2026: Formalising AI Liability

The most direct regulatory intervention to date is the Information Technology (Intermediary Guidelines and Digital Media Ethics Code) Amendment Rules, 2026, notified by MeitY on 20 February 2026. These rules, for the first time, introduce a statutory definition of “synthetically generated information” (SGI), described as any content that is artificially or algorithmically created, generated, modified, or altered using a computer resource in a manner that appears authentic. This definition is intentionally broad, capturing the full range of AI-generated content including deepfakes, synthetic audio-visual material, and algorithmically altered images [5].

The 2026 Rules impose mandatory labelling obligations on intermediaries that facilitate the creation of SGI. Visual content must carry a clear and permanent metadata identifier covering at least ten percent of the display area; audio content must contain an audible disclosure during at least ten percent of its duration. These labels cannot be removed, modified, or suppressed by users. The rules also dramatically reduce takedown timelines: unlawful or prohibited AI-generated content must be removed or disabled within three hours of receiving a lawful notice [5].

The 2026 Rules expressly clarify that intermediaries acting in good faith and in compliance with these obligations will continue to enjoy safe harbour protection under Section 79 of the IT Act. Conversely, failure to comply — failure to label, delay in takedown, or inadequate grievance handling — may result in the loss of that protection. Safe harbour is thereby transformed from a passive shield into a compliance-contingent privilege. The standard is no longer merely reactive: an intermediary must demonstrate system-level preparedness to deal with AI-generated risks proactively, not merely respond to them after harm has occurred [5].

The Grok Question: When AI Is the Platform

The most pointed articulation of the AI-as-creator problem in Indian regulatory discourse concerns the deployment of Grok, an AI model integrated into X (formerly Twitter). The Indian government has argued — publicly, if not yet conclusively in litigation — that X’s deployment of Grok effectively makes it a creator of content, not merely a host. If Grok generates content in response to user prompts, X cannot claim to be a neutral intermediary whose only role is the passive transmission of third-party information. On this view, Section 79’s safe harbour would not apply, because the platform itself is the origin point of at least some of the content on it [6].

This is the active/passive distinction from Christian Louboutin transposed directly onto generative AI. The legal framework as it currently stands does not offer a clean answer. The definition of intermediary in Section 2(1)(w) refers to a person who “receives, stores or transmits” electronic records or “provides any service with respect to that record.” A generative AI model arguably does none of these things in the traditional sense — it creates records rather than receiving or transmitting them [1][6].

Researchers at the Carnegie Endowment have observed that existing definitions under the IT Act, when applied to AI systems, are “being stretched too thin” and that “generative AI systems may not fall neatly within the purview of either publisher or intermediary” under the current statutory framework [7]. This definitional gap is precisely why the 2026 Amendment Rules and the anticipated Digital India Act are significant: they represent attempts to fill a statutory vacuum that the original IT Act, drafted in 2000, could not have anticipated.

MySpace Inc. v. Super Cassettes Industries Ltd.: The No-Monitoring Principle and Its Limits

The no-monitoring principle affirmed in Shreya Singhal was reaffirmed by a Division Bench of the Delhi High Court in MySpace Inc. v. Super Cassettes Industries Ltd., (2017) 236 DLT 478. The court held that intermediaries are not under any positive obligation to proactively monitor content on their platforms for copyright infringement, and that “actual knowledge” must be in the form of a court order — not constructive or inferred knowledge. The court expressly rejected the argument that a platform’s technical ability to detect infringing content was equivalent to legal knowledge sufficient to impose liability [8].

This principle sits uneasily alongside the 2026 Rules’ mandatory labelling and three-hour takedown obligations for AI-generated content. If a platform deploys an AI model that generates content, and that content turns out to be unlawful, the platform’s argument that it had no “actual knowledge” of the specific unlawfulness is considerably weakened — because the AI is the platform’s own system. The content did not arrive from an unknown third-party originator; it was produced by the platform’s own technology. The no-monitoring principle was premised on the practical impossibility of reviewing every piece of user-generated content. That impossibility argument does not translate cleanly to AI-generated content, which the platform’s own systems produced and could, in principle, have been designed to screen from the outset [8].

X Corp. v. Union of India: Section 79(3)(b) and the Live Battleground of Safe Harbour

The question of how Section 79(3)(b) interacts with AI-generated content is being contested in live litigation before the Karnataka High Court in X Corp. v. Union of India, a writ petition filed on 5 March 2025 before Justice M. Nagaprasanna. X Corp. challenges the legality of information-blocking orders issued by various government ministries under Section 79(3)(b), following a MeitY Office Memorandum of 31 October 2023 that authorised all central ministries, state governments, and local police officers to issue content blocking orders through the Sahyog portal [9].

X’s core argument, drawing expressly on Shreya Singhal, is that Section 79(3)(b) cannot function as an independent mechanism for content blocking. Content blocking, X submits, can only occur through the constitutionally safeguarded process under Section 69A of the IT Act, which requires reasoned orders and procedural safeguards. By contrast, Section 79(3)(b) merely describes the circumstances in which safe harbour is lost — it does not independently confer blocking power on the executive [9]. For AI platforms, the implications are significant: if informal government notices under Section 79(3)(b) are sufficient to trigger takedown obligations for AI-generated content, platforms will face executive pressure to remove such content without judicial oversight, fundamentally altering the architecture of safe harbour from an immunity into a tool of executive content governance.

Conclusion

Section 79 of the IT Act was not written for the age of algorithms. Its passive-intermediary model, refined through case law from Shreya Singhal to Christian Louboutin to MySpace, assumes a clean separation between the platform and the content it hosts. Generative AI destroys that separation. When an algorithm recommends, curates, or creates content, the platform is no longer merely a conduit — it is a participant. Whether courts will treat that participation as sufficient to strip safe harbour protection depends on how the active/passive distinction is applied to algorithmic conduct. MeitY’s 2026 Amendment Rules have begun to answer this question legislatively, by conditioning safe harbour on demonstrated compliance with AI-specific obligations, mandatory labelling, and accelerated takedown timelines. The answer, in short, is that an algorithm can be treated as part of the intermediary for regulatory purposes — but the intermediary that deploys it cannot hide behind Section 79 when the algorithm itself is the source of the harm.

References

[1] Information Technology Act, 2000, Sections 2(1)(w) and 79, Ministry of Electronics and Information Technology, Government of India. Available at: https://www.indiacode.nic.in/show-data?actid=AC_CEN_45_76_00001_200021_1517807324077&orderno=105

[2] S&R Associates, “Investing in AI in India (Part 3): AI-related Advisories Under the Intermediary Guidelines,” October 2024. Available at: https://www.snrlaw.in/investing-in-ai-in-india-part-3-ai-related-advisories-under-the-intermediary-guidelines/

[3] Shreya Singhal v. Union of India, (2015) 5 SCC 1, Supreme Court of India, 24 March 2015. Full judgment available at: https://globalfreedomofexpression.columbia.edu/wp-content/uploads/2015/06/Shreya_Singhal_vs_U.O.I_on_24_March_2015.pdf

[4] Christian Louboutin SAS v. Nakul Bajaj & Ors., 2018 SCC OnLine Del 12215, Delhi High Court, 2 November 2018. Available at: https://indiankanoon.org/doc/99622088/

[5] TBA Law, “India’s IT Intermediary Rules 2026 Amendment on AI-Generated Content: A Legal Analysis,” 2026. Available at: https://www.tbalaw.in/post/india-s-it-intermediary-rules-2026-amendment-on-ai-generated-content-a-legal-analysis

[6] IAS Gyan, “Grok Case Raises Questions of AI Governance,” 2024. Available at: https://www.iasgyan.in/daily-editorials/grok-case-raises-questions-of-ai-governance

[7] Carnegie Endowment for International Peace, “India’s Advance on AI Regulation,” November 2024. Available at: https://carnegieendowment.org/research/2024/11/indias-advance-on-ai-regulation?lang=en

[8] Bar and Bench, “Generative AI and Intermediary Liability Under the Information Technology Act” (discussing MySpace Inc. v. Super Cassettes Industries Ltd., (2017) 236 DLT 478). Available at: https://www.barandbench.com/view-point/generative-ai-and-intermediary-liability-under-the-information-technology-act

[9] SC Observer, “X Relies on ‘Shreya Singhal’ in Arbitrary Content-Blocking Case in Karnataka HC,” July 2025. Available at: https://www.scobserver.in/journal/x-relies-on-shreya-singhal-in-arbitrary-content-blocking-case-in-karnataka-hc/

The post Section 79 Safe Harbour and AI Platforms: Can an Algorithm Be an Intermediary Under Indian Law? appeared first on Bhatt & Joshi Associates.

Introduction

The digital revolution has fundamentally transformed how celebrity identity is commodified, exploited, and protected in contemporary society. In recent years, Indian courts have witnessed an unprecedented surge in litigation concerning the unauthorized use of celebrity personas, particularly through emerging technologies like artificial intelligence and deepfake mechanisms. The Delhi High Court’s recent interventions in protecting Bollywood celebrities such as Aishwarya Rai Bachchan, Abhishek Bachchan, and filmmaker Karan Johar against unauthorized commercial exploitation represent a watershed moment in the evolution of celebrity personality rights jurisprudence in India. These judicial pronouncements signal a robust commitment to safeguarding individual autonomy over personal identity in an increasingly digitized commercial landscape.

The significance of these developments extends beyond the entertainment industry, touching fundamental questions about human dignity, economic exploitation, and the balance between commercial interests and individual rights. As technology enables increasingly sophisticated methods of replicating human likeness and voice, the legal system must adapt to protect individuals from having their identities weaponized without consent. This article examines the comprehensive legal framework governing personality rights in India, analyzes landmark judicial decisions that have shaped this doctrine, explores the regulatory mechanisms currently in place, and discusses the challenges posed by artificial intelligence in the contemporary context.

Understanding Personality Rights in India: Conceptual Foundations

Personality rights in India encompass the legal entitlements that protect an individual’s control over the commercial use of their identity attributes. These attributes include not merely physical characteristics like name, image, and voice, but extend to unique mannerisms, signature catchphrases, distinctive styles, and any other identifiable features that constitute a person’s public persona. The doctrine recognizes that an individual’s identity possesses inherent economic value, particularly for public figures and celebrities whose fame creates marketable goodwill.

The philosophical underpinning of personality rights rests on two distinct but interconnected foundations. First, the dignitary interest recognizes that every person has a fundamental right to control how their identity is presented to the world, protecting against misrepresentation, degradation, or unauthorized association with products or causes. Second, the proprietary interest acknowledges that celebrities invest significant time, effort, and resources in building their public image, creating legitimate economic interests that warrant legal protection against free-riding and unjust enrichment by third parties.

Unlike many Western jurisdictions where personality rights are codified through specific legislation, India’s approach remains predominantly common law-based, drawing from multiple legal doctrines including privacy rights, passing off, defamation, and copyright principles. This fragmented approach has both advantages and disadvantages—while allowing judicial flexibility to adapt to evolving circumstances, it also creates uncertainty and inconsistency in application across different cases and jurisdictions.

Constitutional Framework and Privacy Rights

The Indian Constitution does not explicitly enumerate personality rights as fundamental rights. However, the Supreme Court’s expansive interpretation of Article 21, which guarantees the right to life and personal liberty, has created constitutional foundations for personality rights protection in India. The watershed moment came in 1994 with the Supreme Court’s decision in R. Rajagopal v. State of Tamil Nadu [1], where the Court recognized that the right to privacy forms an intrinsic component of personal liberty under Article 21.

The Rajagopal case involved a proposed autobiography of a death row convict named Auto Shankar, which prison authorities sought to suppress. While the immediate issue concerned freedom of press versus privacy, the Court laid down seminal principles regarding personality rights in India. The judgment established that every individual possesses the right to safeguard their privacy, including control over how their personal information and identity are disseminated publicly. Crucially, the Court held that unauthorized commercial exploitation of a person’s name or likeness constitutes a violation of this constitutional right.

The Court articulated a framework balancing privacy rights against freedom of expression guaranteed under Article 19(1)(a). It held that while the press enjoys freedom to publish matters of public interest, this freedom does not extend to invading privacy for purely commercial purposes. The judgment recognized that public figures have somewhat reduced privacy expectations regarding matters of legitimate public concern, but retained full protection against unauthorized commercial appropriation of their identity.

Building upon Rajagopal, subsequent constitutional developments have reinforced personality rights. The nine-judge bench decision in Justice K.S. Puttaswamy (Retd.) v. Union of India (2017) definitively established privacy as a fundamental right, explicitly recognizing the “right to control one’s personal information” as a critical aspect of informational privacy. While this case primarily concerned data protection and government surveillance, its principles extend naturally to personality rights, as both doctrines center on individual autonomy and control over personal attributes.

Statutory Framework: Limited but Significant Protections

India lacks dedicated legislation specifically addressing personality rights, instead relying on provisions scattered across various intellectual property and commercial statutes. This patchwork approach requires creative legal interpretation to provide adequate protection.

The Trade Marks Act, 1999 offers indirect protection through the doctrine of passing off under common law, codified in Section 27(2). While primarily designed to prevent consumer confusion regarding goods and services, courts have extended passing off principles to protect celebrity identities. When a third party uses a celebrity’s name or likeness in a manner suggesting endorsement or association, this may constitute actionable passing off even absent trademark registration. The critical requirement is demonstrating goodwill and reputation that the unauthorized use seeks to exploit.

The Copyright Act, 1957 provides limited protection for certain personality attributes. Section 57 grants performers moral rights over their performances, including the right to prevent distortion or mutilation that would harm their honor or reputation. Section 38-B, introduced through the 2012 amendment, specifically addresses performers’ rights to broadcast and communication of their performances. While these provisions primarily target unauthorized reproduction of performances rather than identity per se, recent cases like Arijit Singh v. Codible Ventures LLP have successfully invoked these provisions in personality rights disputes [2].

The Information Technology Act, 2000, though not designed for personality rights protection, has become relevant in addressing digital violations. Section 66E criminalizes violation of privacy through intentional capture, publication, or transmission of images of private areas without consent. Section 66D addresses punishment for cheating by personation using computer resources. While these provisions primarily target privacy and identity theft rather than commercial exploitation, they establish the legal framework recognizing digital identity as worthy of protection.

Judicial Development: Landmark Cases Shaping Personality Rights in India

Indian courts have played the defining role in developing personality rights doctrine through progressive judgments that have expanded protection incrementally. Beyond the foundational Rajagopal decision, several cases merit detailed examination for their contribution to this evolving jurisprudence.

The Madras High Court’s decision concerning actor Rajinikanth established important precedents regarding the threshold for proving personality rights violations. The Court held that when a celebrity’s identity is sufficiently distinctive and recognized, unauthorized commercial use need not demonstrate consumer confusion or deception. The mere appropriation of the celebrity’s identity attributes for commercial gain, without consent, constitutes actionable wrong. This departure from traditional passing off requirements significantly strengthened personality rights protection by eliminating the often-difficult burden of proving actual confusion.

In ICC Development (International) Ltd. v. Arvee Enterprises (2003), the Delhi High Court addressed personality rights in the context of sports marketing. While the case primarily concerned ICC’s rights to the Cricket World Cup brand, the Court’s observations about protecting individual players’ rights laid groundwork for future personality rights litigation. The judgment recognized that sportspersons develop protectable rights in their performances and public personas.

The case of Titan Industries Ltd. v. Ramkumar Jewellers (2012) saw the Delhi High Court injuncting unauthorized use of celebrity cricketer M.S. Dhoni’s image in jewelry advertisements. The Court held that Dhoni had acquired distinctive goodwill and reputation, creating protectable personality rights. Unauthorized use not only caused economic harm through lost endorsement opportunities but also violated his right to control commercial associations with his identity.

The AI Era: Recent Judicial Responses to Technological Threats

The emergence of artificial intelligence technologies capable of creating hyper-realistic deepfakes, voice clones, and digital avatars has precipitated a new wave of personality rights litigation. Courts have responded with heightened protective measures recognizing the existential threat these technologies pose to individual autonomy.

The Delhi High Court’s 2023 decision protecting actor Anil Kapoor represents a landmark in addressing AI-driven personality rights violations [3]. Kapoor approached the Court after discovering numerous instances of AI-generated deepfake videos superimposing his face onto other actors, unauthorized merchandise featuring his likeness, and websites selling fake autographs. The Court granted a sweeping ex-parte injunction restraining not only specifically identified defendants but also “the world at large” from misusing Kapoor’s personality attributes including his name, image, voice, signature catchphrases like “jhakaas,” and any AI-generated content featuring his likeness.

The Court’s reasoning emphasized several critical points. First, it recognized that personality rights exist independent of contractual arrangements or intellectual property registrations—they are inherent rights flowing from personal identity. Second, the judgment acknowledged that AI technologies democratize the ability to create convincing fake content, exponentially increasing the risk of harm. Third, the Court held that the scale and persistence of digital violations justify broader injunctions than traditional intellectual property cases, including dynamic injunctions that automatically apply to future infringers.

The Bombay High Court’s 2024 decision in Arijit Singh v. Codible Ventures LLP marked another significant milestone in protecting artists against AI voice cloning [2]. Singh sued after discovering platforms offering AI tools that could replicate his distinctive voice, allowing users to create songs apparently sung by him without permission. The Bombay High Court granted ad-interim injunction restraining the defendants from operating or promoting such voice cloning tools targeting Singh’s voice.

The Court’s analysis integrated multiple legal doctrines. It invoked the Copyright Act’s provisions on performers’ rights, holding that Singh’s voice constitutes a protected performance. The judgment recognized personality rights as protecting the commercial value of Singh’s distinctive vocal characteristics. Significantly, the Court held that merely providing tools for others to create infringing content constitutes contributory infringement, establishing potential liability for technology platforms facilitating personality rights violations.

Balancing Rights: Personality Rights versus Freedom of Expression

While courts have robustly protected personality rights, they have simultaneously recognized the critical importance of preserving freedom of expression, particularly for artistic works, parody, satire, and matters of public interest. Establishing appropriate boundaries between these competing rights remains an ongoing judicial challenge.

The Delhi High Court’s decision in DM Entertainment Pvt. Ltd. v. Baby Gift House addressed this balance in the context of Rajesh Khanna’s estate seeking protection of the late actor’s personality rights. The Court granted protection but carved out exceptions for biographical works, documentaries, and artistic expressions that reference Khanna’s life and career. The judgment emphasized that personality rights cannot be weaponized to suppress legitimate artistic or journalistic expression about public figures.

Similarly, in Digital Collectibles PTE Ltd. v. Galactus Funware Technology Pvt. Ltd., the Court distinguished between commercial exploitation and permissible uses. The judgment held that using celebrity images or references in contexts of parody, criticism, or commentary—even when the creator derives revenue—does not necessarily violate personality rights if the use is genuinely expressive rather than purely commercial. The critical inquiry focuses on whether the use exploits the celebrity’s commercial value or rather makes an independent statement about them.

Courts have adopted a multi-factor test for evaluating whether particular uses fall within protected expression. Relevant considerations include: the transformative nature of the use, whether the work comments upon or criticizes the celebrity, the extent to which the celebrity’s identity dominates the work, whether the work serves primarily as a vehicle for commercial gain versus artistic expression, and the potential for consumer confusion regarding endorsement or sponsorship.

This balancing approach reflects constitutional imperatives. Article 19(1)(a) protects not merely speech but also artistic expression, satire, and dissent. An overly expansive interpretation of personality rights could chill legitimate artistic and journalistic endeavors, creating chilling effects on cultural production. Courts therefore tread carefully, protecting personality rights against naked commercial exploitation while preserving breathing space for creative expression.

Regulatory Mechanisms and Enforcement Challenges

Enforcing personality rights in India in the digital age presents formidable practical challenges. The borderless nature of internet commerce, the anonymity afforded by digital platforms, and the sheer volume of potential infringements create significant obstacles to effective rights protection.

Traditional enforcement mechanisms include civil suits seeking injunctions and damages. Courts have shown willingness to grant ex-parte injunctions in clear-cut cases, particularly where continuing violations threaten irreparable harm. However, obtaining and enforcing judgments against online infringers, especially those operating from foreign jurisdictions, remains extremely difficult. The technical complexity of blockchain-based platforms and cryptocurrency transactions further complicates enforcement.

Platform liability has emerged as a critical issue. While the Information Technology Act’s safe harbor provisions under Section 79 protect intermediaries from liability for user-generated content if they act as passive conduits and remove infringing content upon notice, courts have shown willingness to hold platforms accountable when they actively facilitate or profit from infringement. The dynamic injunction approach adopted in cases like Anil Kapoor’s attempts to address this by requiring platforms to proactively prevent similar future violations.

Administrative enforcement through existing regulatory bodies remains limited. While the Advertising Standards Council of India provides self-regulatory oversight over advertising content, including unauthorized celebrity endorsements, its jurisdiction is limited and enforcement mechanisms lack teeth. The Ministry of Electronics and Information Technology has issued guidelines and rules addressing various aspects of digital content, but these do not specifically target personality rights violations.

Criminal remedies exist for certain egregious violations. Sections 66C (identity theft) and 66D (cheating by personation) of the Information Technology Act criminalize specific digital identity crimes. However, prosecution under these provisions requires proving intent to defraud or cause harm, which may not encompass all personality rights violations motivated by commercial gain rather than malicious intent.

International Perspectives and Comparative Analysis

Examining how other jurisdictions address personality rights provides valuable insights for India’s evolving legal framework. The United States recognizes “right of publicity” through state law, with significant variations across jurisdictions. California’s statute provides robust protection extending even posthumously, allowing estates to control commercial use of deceased celebrities’ identities. Courts have developed sophisticated doctrines balancing publicity rights against First Amendment protections.

The European Union addresses personality rights through multiple instruments including the General Data Protection Regulation, which protects personal data including biometric identifiers, and various national laws protecting image rights. France, for example, recognizes strong personality rights under the Civil Code, protecting individuals’ right to control their image throughout life and limiting posthumous commercial exploitation.

The United Kingdom primarily addresses personality rights through passing off and trademark law, requiring demonstration of goodwill and misrepresentation. This approach resembles India’s but has developed more extensive case law. Recent cases have addressed social media influencers’ personality rights and digital exploitation.

Learning from these jurisdictions, India could benefit from more explicit statutory frameworks while maintaining judicial flexibility. Clear legislative standards would provide predictability for both rights holders and potential users, reducing litigation costs and fostering innovation while respecting personality rights.

Contemporary Challenges: Deepfakes, NFTs, and the Metaverse

Emerging technologies continue presenting novel challenges to personality rights protection. Deepfake technology, which uses machine learning to create synthetic media indistinguishable from authentic recordings, poses existential threats to personal autonomy and truth itself. Beyond commercial exploitation, deepfakes enable creation of non-consensual intimate imagery, political disinformation, and reputational destruction.

Non-fungible tokens (NFTs) and digital collectibles raise complex questions about personality rights in virtual spaces. When digital artists create and sell NFTs featuring celebrity likenesses, does this constitute protected artistic expression or commercial exploitation? Courts will need to develop nuanced approaches distinguishing transformative artistic works from mere digital merchandise.

The metaverse and virtual worlds present perhaps the most complex frontier. As individuals increasingly inhabit digital avatars and virtual identities, questions arise about personality rights in these contexts. Can celebrities prevent others from creating virtual avatars resembling them? What about AI-powered virtual influencers modeled on real persons? These questions lack clear answers under existing legal frameworks.

Voice cloning technology, as addressed in the Arijit Singh case, continues advancing rapidly. Platforms now offer tools allowing anyone to synthesize speech in celebrity voices within seconds. While legitimate applications exist—such as preserving voices of individuals with degenerative conditions—the potential for abuse is immense, ranging from fraudulent impersonation to unauthorized commercial endorsements.

The Path Forward: Recommendations for Legislative Reform

Given the challenges identified, comprehensive legislative reform appears increasingly necessary. A dedicated personality rights statute could provide clarity while maintaining flexibility to address evolving technologies. Such legislation should clearly define protectable personality attributes, establish registration mechanisms for those seeking heightened protection, specify exceptions for legitimate uses including news reporting, artistic expression, parody, and satire, and provide effective remedies including injunctions, damages, and statutory penalties for willful violations.

The statute should address temporal limitations, particularly regarding posthumous personality rights. While some protection for deceased personalities’ estates may be appropriate given ongoing commercial value, unlimited perpetual protection risks removing public domain material and hampering creative expression. A balanced approach might provide limited posthumous protection, perhaps 50-70 years, similar to copyright terms.

Platform accountability must be strengthened. Legislation should clarify intermediary liability standards, requiring platforms to implement robust content moderation systems, respond promptly to takedown notices, and potentially employ proactive measures like AI-driven detection of likely infringing content. Safe harbor protections should be contingent on demonstrable good faith efforts to prevent infringement.

Creating specialized adjudicatory mechanisms could expedite dispute resolution. Personality rights disputes often require technical expertise regarding digital technologies and quick resolution to prevent ongoing harm. Specialized tribunals or fast-track procedures within existing intellectual property forums could provide efficient remedies.

Conclusion

India’s personality rights jurisprudence stands at a critical juncture. Judicial decisions over the past three decades have constructed a robust framework protecting individuals’ autonomy over their identities, with recent cases responding proactively to technological threats posed by artificial intelligence and deepfakes. The Delhi High Court’s protection of Anil Kapoor [3] and the Bombay High Court’s decision in Arijit Singh’s favor [2] demonstrate judicial recognition that traditional legal doctrines must adapt to digital realities.

However, the absence of comprehensive statutory frameworks creates uncertainty and risks inconsistent application across jurisdictions. As technology continues advancing, enabling ever-more sophisticated methods of identity appropriation and manipulation, the need for clear legislative standards becomes increasingly urgent. Such legislation must carefully balance personality rights protection against freedom of expression, ensuring that legitimate artistic, journalistic, and public interest uses remain permissible while preventing commercial exploitation and malicious misuse.

The stakes extend beyond celebrity endorsements and commercial interests. Personality rights implicate fundamental questions of human dignity, autonomy, and identity in an increasingly digital world. As artificial intelligence blurs boundaries between authentic and synthetic, protecting individuals’ control over their own identities becomes essential to preserving meaningful human agency. India’s legal system must continue evolving to meet these challenges, combining judicial innovation with thoughtful legislative reform to create a framework protecting personality rights for all citizens, not merely the famous few.

References

[1] R. Rajagopal v. State of Tamil Nadu, AIR 1995 SC 264. Available at: https://indiankanoon.org/doc/501107/ 

[2] SpicyIP. (2024). Synthetic Singers and Voice Theft: BomHC protects Arijit Singh’s Personality Rights. Available at: https://spicyip.com/2024/08/synthetic-singers-and-voice-theft-bomhc-protects-arijit-singhs-personality-rights-part-i.html 

[3] LiveLaw. (2023). Delhi High Court Protects Actor Anil Kapoor’s Personality Rights, Restrains Misuse Of His Name, Image Or Voice Without Consent. Available at: https://www.livelaw.in/top-stories/delhi-high-court-anil-kapoor-voice-image-misuse-personality-rights-238217 

[4] World Intellectual Property Organization. (2024). AI voice cloning: how a Bollywood veteran set a legal precedent. Available at: https://www.wipo.int/web/wipo-magazine/articles/ai-voice-cloning-how-a-bollywood-veteran-set-a-legal-precedent-73631 

[5] The IP Press. (2023). Delhi High Court’s Landmark Order: Protecting Anil Kapoor’s Persona in the Age of AI. Available at: https://www.theippress.com/2023/10/09/delhi-high-courts-landmark-order-protecting-anil-kapoors-persona-in-the-age-of-ai-an-indian-legal-perspective/ 

[6] Indian Kanoon. R. Rajagopal v. State of Tamil Nadu Full Judgment. Available at: https://indiankanoon.org/doc/501107/ 

[7] Business Standard. (2023). Delhi HC restrains use of Anil Kapoor’s name, image, signature catchphrase. Available at: https://www.business-standard.com/india-news/delhi-hc-restrains-use-of-anil-kapoor-s-name-image-signature-catchphrase-123092001237_1.html 

[8] The IP Press. (2024). Voice Theft in the Digital Age: Bombay High Court’s Landmark Ruling on AI and Personality Rights. Available at: https://www.theippress.com/2024/09/05/voice-theft-in-the-digital-age-bombay-high-courts-landmark-ruling-on-ai-and-personality-rights/ 

[9] SCC Online. (2024). Bombay HC grants ad-interim injunction in favour of Arijit Singh to protect his personality rights. Available at: https://www.scconline.com/blog/post/2024/08/02/bomhc-grants-ad-interim-injunction-to-arijit-singh-to-protect-his-personality-rights/ 

The post Personality Rights in India: Legal Framework and Judicial Evolution appeared first on Bhatt & Joshi Associates.

Introduction

The emergence of deepfake technology and AI-created content detached from real-world impacts has fundamentally changed how people create, consume and interact with digital content. Deepfakes can create realistic videos, images, and audio by using sophisticated machine learning algorithms, especially generative adversarial networks (GANs), to overlay a person’s voice or face onto someone else’s body and speech. While the possible uses for this technology across innovation, entertainment, and education industries are plentiful, its ethical, social, and legal repercussions are equally concerning. This article looks at the legal aspects surrounding deepfakes and AI-generated media, with special focus on their regulation, existing laws, landmark cases, and judicial analysis, seeking to address how society can deal with the challenges brought by this new technology.

Understanding Deepfakes and AI-Generated Media

Deepfakes are the result of highly sophisticated artificial intelligence techniques that use GANs. A GAN uses two neural networks competing against each other. One creates content, while the other seeks to detect it. At the end of each round, the two will swap positions. The AI trained to spot fakes will be better at spotting them while the one trained to generate them will be better at generating them. The result is media content that is extremely convincing but fake. AI-generated media includes deepfakes, but also visual and audio, computer-generated arts, music, literature, and so many more. These developments are transforming what is understood as creativity and bringing moral and legal issues regarding creation, copyright, and responsibility.

The focus of image and video manipulation technology has shifted to the concerns of damage that can be done to people and society as a whole. Some such harmful uses include non-consensual pornography, identity deception, political tampering, and even monetary scams. Legal systems in many regions are struggling with how to enforce laws on this advanced technology without limiting freedom and creativity.

Regulatory Frameworks Governing Deepfakes

Regulating deepfakes involves a delicate balance between mitigating harm and upholding freedom of expression and technological progress. Different jurisdictions have adopted varied approaches, reflecting their legal traditions, cultural values, and levels of technological advancement.

United States

The approach to regulating deepfakes in the US is disjointed and fragmented, varying widely by state. Some states like California, Texas, and Virginia have taken steps to legislate certain malicious applications of deepfake technology. For instance, California’s AB 730 bans the use of videos which falsely claim to be deepfakes within 60 days before an election. AB 602 also helps victims of deeply non-consensual pornographic deepfake videos by criminalizing the creation and advertisement of such videos. The legislation in Texas has also evolved to recognize the dangers of deepfake technology by criminalizing the use and creation of deepfakes that cause damage to people or manipulate election outcomes.

At the state level, the DEEPFAKES Accountability introduces legislation that aims to counter the use of deepfake technology from a more holistic point of view. The Act is not yet in effect but suggests deepfake content marked with identifying labels along with penalties for abusive uses failing which will result in severe punishments. While there are other laws such as the Communications Decency Act (Section 230) and some intellectual property laws do aid in trying to address some of the deepfake problems, their influence is quite passive, and vague.

European Union

The European Union has a broader strategy for regulating AI-based media. The outlined Artificial Intelligence Act (AIA) classifies AI systems into distinct risk classes and lays down highly restrictive obligations on those high-risk applications, the deepfakes. Transparency is one of the “cornerstones” of the AIA, and it requires disclosure whenever content is created or changed by an AI system.

The EU’s General Data Protection Regulation (GDPR) is also an important tool for the prevention of deepfakes. An unlawful generation or sharing of deepfake content is commonly achieved by, for instance, processing personal information without permission in a manner prohibited by the provisions of the GDPR. Specifically, the Digital Services Act (DSA) and the Digital Markets Act (DMA) are works in progress that will seek to improve the responsibility of online platforms with respect to tackling harmful content, like deepfakes, amongst others.

India

In India, the legal framework to deal with deepfakes is still in its infancy. Although no specific law specifically criminalizes the use of deepfake technology, the Indian Information Technology Act, 2000, and the Indian Penal Code (IPC) are used as legal frameworks to prosecute the offences that are related to this technology. Section 67A of Ithe T Act makes it unlawful to publish inc. nonconsensual pornographic deepfakes. Relevant other sections are defamation (Section 499 of the IPC) and identity theft (Section 66C of the IT Act). Nevertheless, enforcement difficulties remain because of the anonymity afforded by digital platforms and jurisdictional issues.

Key Legal Issues Surrounding Deepfakes 

Privacy and Consent

Privacy violations and lack of consent are among the most pressing legal concerns associated with deepfakes. Non-consensual pornographic deepfakes disproportionately target women and have devastating consequences for their victims. Legal systems are increasingly recognizing the need to criminalize such conduct. However, the enforcement of privacy laws remains challenging, particularly in the digital age, where anonymity and cross-border platforms complicate accountability.

Intellectual Property

Deepfake and AI media produce a host of questions centred around the issues of intellectual property. The central issue is whether or not AI-generated media is copyrightable and if so who should own the copyright. The United States Copyright Office has clarified that a work will not be eligible for copyright protection simply because it was created solely by AI and as a result. After all, such works lack human authorship. However, when an AI is used as a tool by a human creator the resulting work may qualify for protection. Similar questions are being raised in the EU and other jurisdictions where laws are grappling with the concept of authorship about AI.

Defamation and Misinformation

Deepfakes have been used to create false and damaging representations of individuals, leading to defamation claims. The difficulty lies in proving the falsity and harm caused by the deepfake, as well as identifying the creator. The use of deepfakes in spreading political misinformation further complicates matters, raising concerns about the integrity of democratic processes. Legal frameworks must address these risks while safeguarding freedom of speech and expression.

National Security and Public Safety

Deepfakes pose significant risks to national security and public safety. They can be weaponized to spread disinformation, impersonate public officials, or incite panic. For example, a deepfake of a government leader issuing a false directive could have catastrophic consequences. Addressing these risks requires a multi-faceted approach, including robust legal and regulatory measures, technological interventions, and public awareness campaigns.

Landmark Cases on Deepfakes and AI Media

A myriad of legal cases have framed the debate on deepfakes and AI media, showcasing how the field is shifting:

People v. Tracey (California, 2020) – The case dealt with the nonconsensual deepfake pornography production and its distribution. The court upheld the California AB 602 law which said that there needs to be stronger legal boundaries against the infringement of privacy.

Deepfakes in Political Campaigns: There are still developing cases but there has been some discussion within the courts regarding the use of deepfakes in political elections. The suspension proceedings within California AB 730 cases illustrate the importance of the judicial power in stopping electoral fraud.

Thaler v. Copyright Office (2022): This case dealt with the AI-created works regarding copyright. The United States Copyright Office denied a copyright application for a piece of art generated from an AI program with no human involvement, thus restating the need for human authorship. 

EU Jurisprudence on GDPR Violations: European courts have been increasingly dealing with the issue of personal information being used without consent for the making of deepfakes, demonstrating the relationship between the law and technology.

The Path Forward for Deepfakes and AI-Generated Media

Strengthening Legal Frameworks

To address the challenges posed by deepfakes and AI-generated media effectively, legal systems must evolve. Comprehensive legislation should explicitly define and regulate the creation, distribution, and use of deepfakes. Transparency requirements, such as labelling AI-generated content, should be mandated, and malicious uses of the technology, including non-consensual pornography and disinformation campaigns, must be penalized.

Enhancing International Cooperation

The borderless nature of the internet necessitates international collaboration to combat the misuse of deepfake technology. Harmonizing legal standards and facilitating cross-border enforcement through treaties and agreements are crucial steps in this direction.

Leveraging Technology

Regulators and law enforcement agencies can harness AI and machine learning to detect and combat deepfakes. Developing robust detection tools and integrating them into online platforms can help mitigate the spread of harmful content and reduce the technology’s misuse.

Promoting Ethical AI Development

Governments, tech companies, and civil society must share the responsibility of ensuring that AI technologies are developed and deployed responsibly. Ethical guidelines and industry standards can play a pivotal role in minimizing the risks associated with deepfakes.

Conclusion

The rise of deepfakes and AI-generated media creates unprecedented legal difficulties which must be dealt with creatively and proactively. While the existing laws provide some protection for the issues at hand they cannot address some of the issues that the tremendous evolution of technology creates. A forward-thinking view must be taken alongside innovative solutions to make use of the potential offered by these technologies while also protecting individual rights, public safety and democracy. Robust legal frameworks, international cooperation, technological development and ethical AI techniques will be essential in dealing with the complexities of this crucial turning point.

The post The Legal Status of Deepfakes and AI-Generated Media appeared first on Bhatt & Joshi Associates.

Introduction

Artificial Intelligence (AI) has transformed various sectors, and the legal domain is no exception. One of the most controversial applications of AI is in criminal sentencing, where algorithms and predictive analytics are used to assist judges in making decisions about bail, parole, and sentencing. While this technological advancement promises efficiency and objectivity, it also raises numerous legal, ethical, and procedural challenges. These challenges are critical because they directly impact the fairness of trials, the rights of the accused, and the integrity of the justice system.

The Integration of AI in Criminal Sentencing

AI tools in criminal sentencing are designed to analyze vast amounts of data, including criminal records, demographic information, and case histories, to predict the likelihood of recidivism or assess the risk posed by defendants. Popular examples include risk assessment tools like COMPAS (Correctional Offender Management Profiling for Alternative Sanctions) and PSA (Public Safety Assessment). These tools aim to provide judges with data-driven insights to reduce biases and improve consistency in sentencing decisions.

However, these systems often operate as black boxes, where the methodology and decision-making processes are not transparent. This lack of transparency has profound legal implications, particularly regarding the right to a fair trial and due process. It raises the question of whether reliance on AI undermines the judiciary’s role as the ultimate arbiter of justice.

Regulatory Framework Governing AI in Criminal Justice

Local AI supervision within criminal sentencing contexts is quite different from one state to another. In the case of the United States, there is no broad AI sentencing law that is federal. Rather, the courts approximate the legality of the functions to general constitutional norms, such as the due process clause of the Fifth and Fourteenth Amendments. Some degree of regulation has been passed by state legislatures as well – certain states require concealment and accountability provisions to be implemented. 

With its General Data Protection Regulation (GDPR), the European Union (EU) has automated decision-making, such as the right not only to receive an explanation but contest the outcome of algorithmic decision-making, granted under EU laws. Jurisdictions within the EU may choose to opt out of the GDPR provisions about criminal justice, but violations of personal rights through AI systems remain actionable. The planned EU Artificial Intelligence Act intends to design a categorization system based on the degree of risk posed by various AI systems, so criminal justice usages are seen as high risk and are therefore heavily regulated.

Currently, Indian legislation does not define the employment of AI within the criminal justice system. However, Article 14’s Equality before Law and Article 21’s Right to Life and Personal Liberty provide scaffolding to contest unfair practices stemming from the use of AI technologies.

Bias and Discrimination in AI Systems

Perhaps the most important AI-biased concern in the criminal jurisdiction is discrimination in sentencing. AI systems are highly dependent on the information they are given data to work with, which may introduce bias. The underlying data from criminal justice systems, for example, are fraught with biases like discrimination due to race, class, or region including socio-economic factors that AI systems assist in propagating and such. For example, one study showed that the algorithm used in COMPAS disproportionately identifies criminal risk among Black defendants than White counterparts.

The Bounds of Reasonable Discretion of algorithmic discrimination, legal standards for other countries such as the Equal Protection Clause of the Fourth Amendment of U.S law, prohibits discriminatory practices. Proving algorithmic bias is not applicable in the law context. It is challenging and technical. The State vs. Loomis case in 2016 was assured of how complicated this set of issues turns out to be. The defendant in question claimed that his due process rights were violated by the Illinois court’s use of COMPAS in sentencing the fact that they relied on an algorithm which does not make its logic public. While the Supreme Court of Wisconsin acknowledged the risk of misuse, ‘guardrails’, with related concepts, is necessary it did so without compromising the aim of placing AI-based systems in the decision-making processes of the law, it accepted reliance on COMPAS.

In the UK, worries have also been expressed about AI and its capacity to reproduce and even worsen existing gaps in sentencing. Civil rights organisations have reported how unjust use of algorithms may lead to outcomes requiring more scrutiny, societal responsibility, and demand.

Accountability and Transparency

The discussions about the use of AI technology in sentencing highlight the need for transparency and accountability. Many times, defendants alongside their counsel do not have access to the algorithms and information that determine risk scores, making a challenge to these assessments next to impossible. This primary lack of information creates suspicion issues relating to procedural due process; where a person has to be provided with a reasonable opportunity to contest decisions made that affect their rights.

The courts have begun to respond to these concerns. In the case of United States v. Molen (2013), the court held that the government was obligated to provide information detailing how the forensic software was constructed, arguing that there should be a lack of transparency with such technology evidence. The same reasoning should apply to AI-sentencing tools. Opponents believe that the sentencing algorithms and the data used to train them must be made available and put through independent assessments to ensure there is no bias and discrimination.

Intellectual property rights also add another layer of cloudiness to the already opaque systems of AI. Developers often shield their algorithms using claimed trade secrets, preventing the system from being examined in detail. This conflict between proprietary claims and the requisite for information within the justice system remains unsolved, presenting numerous obstacles to accountability.

Judicial Oversight and Discretion

The integration of AI in sentencing raises questions about the role of judicial discretion. While AI can provide valuable insights, over-reliance on these tools risks undermining the judiciary’s authority and responsibility to evaluate each case individually. Judicial discretion is a cornerstone of criminal justice, allowing judges to consider unique circumstances and exercise empathy. The mechanization of sentencing decisions, driven by AI, could lead to a one-size-fits-all approach, which conflicts with the principle of individualized justice.

To address this issue, courts and policymakers must strike a balance between leveraging AI’s capabilities and preserving judicial discretion. Jurisdictions like Canada have emphasized the importance of maintaining judicial independence in the face of technological advancements. In the case of R v. Nur (2015), the Canadian Supreme Court highlighted the need for proportionality in sentencing, which AI alone cannot guarantee.

Ethical and Privacy Concerns

To produce risk evaluations, AI technologies tend to depend on highly sensitive personally identifiable information. This dependence creates ethical dilemmas and privacy risks. Data collection is subject to various privacy laws and ethical guidelines to ensure that people do not become victims of unnecessary attention and abuse of their details.

The GDPR’s principles of data protection such as purpose limitation and data minimization are very strong when it comes to privacy protection in the use of AI. American privacy issues are handled by a mix of state and federal legislation like the excuse of unreasonable search and seizure of the Fourth Amendment. Carpenter v. United States (2018) is one such case where the boundaries of these protections were extended to cover digital data, which has important implications for AI systems in the criminal justice domain.

There are other ethical concerns besides privacy issues. Some critics maintain that allowing AI to determine sentencing disrespects human beings as it turns them into mere numbers and statistics which they are. This concern is part of the broader issue of respecting individual autonomy and fundamental human rights.

International Perspectives on AI in Criminal Sentencing

Different nations have taken different steps towards trying to regulate the use of AI in their criminal justice system. The Sentencing Council in the United Kingdom has suggested caution in the implementation of AI tools, offering the claim that it is imperative to have human oversight, in addition to saying that the systems need to be validated. In China, however, AI assumes a more active role in the judiciary system, with the existence of AI systems like “Smart Court” platforms which serve to aid judges in decision writing. This creates issues concerning possible over-dependence and ever-shrinking accountability.

The differences in the systems point to the fact that there is an introspective problem where there needs to be more collaboration internationally in addressing the common problem of the use of AI in sentencing. There are reports from the United Nations describing the AI “arms race” which call for parameters that dictate and contain the use of AI such that basic human rights and respect of laws are not violated. These actions indicate the risks acknowledged and the attention AI requires.

Future Directions and Legal Reforms

To solve the legal issues concerning AI and criminal sentencing, a number of reforms are needed. In the first place, everything must begin with the appropriate level of scrutiny. There should be laws and policy decisions from legislatures and the courts that require the disclosure of algorithms and training data in AI systems. In the second place, there ought to be bias mitigation audits and assessments done on a routine basis. Third, policies should constrain the capability of AI with respect to exercising discretion on sentences such that the judges’ powers will always be the overriding factor. 

Furthermore, judges and other legal practitioners need to undergo post-graduate courses in AI for them to understand the practical workings of the tools in question. This understanding will enable them to analyze the results provided by those systems and outputs in detail. 

In addition, the participation of the general public is equally important as already noted. The design and use of AI technologies in the criminal justice system should be reviewed by other constituencies like civil society organizations, information and communication technologists, and communities with a special focus on systematic marginalization to foster inclusion. Such collaboration can go a long way in achieving AI that automatically fulfils the requirements of equity and justice.

Conclusion: Ensuring Fairness in AI-Assisted Sentencing

The integration of AI in criminal sentencing presents both opportunities and challenges. While these tools have the potential to enhance efficiency and consistency, they also raise significant legal and ethical concerns. Issues such as bias, transparency, accountability, and judicial discretion must be carefully addressed to ensure that AI complements rather than undermines the justice system. Through thoughtful regulation, international cooperation, and ongoing legal reforms, it is possible to harness the benefits of AI while safeguarding the principles of fairness and due process. As the legal landscape evolves, it is imperative to prioritize human rights and the rule of law in the adoption of AI-driven technologies in criminal justice.

The post Legal Challenges of AI in Criminal Sentencing appeared first on Bhatt & Joshi Associates.

Introduction

Artificial intelligence (AI) has emerged as a transformative technology, influencing every aspect of modern life, from healthcare and finance to military and governance. While its benefits are undeniable, AI also poses significant ethical and legal challenges, particularly in the realm of international law. The development and deployment of AI technologies across borders raise questions about accountability, fairness, and compliance with international legal norms. This article explores the intersection of artificial intelligence and international law, focusing on ethical concerns, regulatory efforts, and the need for a coherent global framework.

The Rise of Artificial Intelligence

AI refers to the simulation of human intelligence by machines, enabling them to perform tasks such as decision-making, problem-solving, and pattern recognition. Recent advances in machine learning, neural networks, and natural language processing have accelerated AI’s integration into critical domains. Autonomous weapons systems, predictive algorithms, and facial recognition technologies exemplify AI’s far-reaching applications.

However, these advancements also raise concerns about misuse, discrimination, and the erosion of privacy. In the context of international law, AI’s deployment in areas such as warfare, border control, and global governance highlights the urgent need for ethical and legal oversight.

Ethical Concerns in AI Deployment

The ethical challenges associated with AI are multifaceted, often involving conflicts between innovation and fundamental rights. Key concerns include:

1. Bias and Discrimination: AI systems often reflect the biases present in their training data, leading to discriminatory outcomes. This issue is particularly concerning in areas such as criminal justice, immigration, and employment, where biased algorithms can perpetuate systemic inequalities.
2. Accountability and Transparency: The complexity of AI systems makes it difficult to determine responsibility for their actions. This lack of transparency, often referred to as the “black box” problem, complicates efforts to ensure accountability under international law.
3. Autonomous Weapons and Warfare: The development of lethal autonomous weapons systems (LAWS) raises ethical questions about the delegation of life-and-death decisions to machines. Such systems challenge the principles of proportionality, distinction, and accountability under international humanitarian law.
4. Privacy and Surveillance: AI-powered surveillance technologies, including facial recognition and predictive policing, often infringe on individuals’ privacy and freedom. These practices may violate international human rights norms, such as those enshrined in the Universal Declaration of Human Rights (UDHR).

International Legal Frameworks and Artificial Intelligence 

The regulation of AI at the international level remains fragmented and nascent. While existing legal frameworks provide a basis for addressing some AI-related issues, they are often inadequate for the complexities of this rapidly evolving technology. Key legal instruments include:

1. International Humanitarian Law (IHL): IHL governs the conduct of armed conflicts, including the use of new technologies. The principles of distinction, proportionality, and necessity must be upheld in the deployment of AI-powered weapons. However, the applicability of IHL to autonomous systems remains a subject of debate.
2. Universal Declaration of Human Rights (UDHR): AI technologies must comply with human rights norms, including the right to privacy, freedom of expression, and protection from discrimination. The UDHR provides a foundational framework for evaluating AI’s impact on human rights.
3. General Data Protection Regulation (GDPR): While a regional framework, the EU’s GDPR has global implications for AI development. It establishes strict rules for data processing, consent, and accountability, offering a model for regulating AI’s use of personal data.
4. United Nations Initiatives: The UN has initiated discussions on the ethical and legal implications of AI, emphasizing the need for inclusive and transparent governance. The establishment of the High-Level Panel on Digital Cooperation and UNESCO’s Recommendation on the Ethics of AI are notable steps in this direction.

Challenges in Regulating AI 

Several challenges hinder the development of comprehensive international legal frameworks for AI:

1. Rapid Technological Advancement: The pace of AI innovation outstrips the ability of legal systems to adapt, creating regulatory gaps and uncertainties.
2. Divergent National Priorities: States have varying approaches to AI regulation, reflecting their economic, political, and cultural contexts. Achieving consensus on global standards is a significant challenge.
3. Dual-Use Nature of AI: AI technologies often have both civilian and military applications, complicating efforts to regulate their use without stifling innovation.
4. Enforcement and Compliance: Ensuring adherence to international norms in the AI domain requires robust monitoring and enforcement mechanisms, which are currently lacking.

The Path Forward: Toward a Global AI Governance Framework

Addressing the ethical and legal implications of AI requires a coordinated international effort. Key recommendations include:

1. Developing Binding Agreements: States should negotiate binding international treaties to govern the development and deployment of AI, particularly in sensitive areas such as autonomous weapons and surveillance technologies.
2. Promoting Ethical Guidelines: International organizations should establish ethical guidelines for AI, emphasizing fairness, accountability, and respect for human rights. These guidelines can serve as a basis for national and regional regulations.
3. Strengthening Multilateral Cooperation: Multilateral forums, such as the United Nations and the G20, should prioritize AI governance and facilitate dialogue among stakeholders, including governments, industry, and civil society.
4. Investing in Research and Capacity Building: International efforts should focus on research and capacity building to address the ethical, technical, and legal challenges of AI. This includes fostering cross-border collaboration and sharing best practices.

Conclusion: Regulating Artificial Intelligence in International Law

Artificial intelligence holds immense potential to drive progress and innovation, but its ethical and legal implications demand careful scrutiny. The intersection of artificial intelligence and international law presents both challenges and opportunities, requiring a balanced approach that upholds fundamental rights while enabling technological advancement. By fostering global cooperation and developing robust governance frameworks, the international community can ensure that AI serves the collective good and aligns with the principles of justice and equity.

The post Artificial Intelligence and International Law: Ethical and Legal Implications appeared first on Bhatt & Joshi Associates.