Deepfakes in India: Analysing AI-powered deception and its far-reaching consequences

Deepfakes are on the rise in India, posing a growing threat to elections, trust in media, and individual privacy. Experts weigh in on the challenges of detection, legal implications, and the urgent need for technological and legislative solutions to protect India's digital landscape

In a world where seeing is no longer believing, a new threat lurks in the digital shadows: Deepfakes. These AI-powered illusions are so convincing that they blur the lines between reality and fabrication, leaving us questioning what’s real and what’s not. Imagine a world leader declaring war they never intended, or a loved one saying words they never spoke. This isn’t science fiction; it’s the chilling reality of deepfakes, a technology projected to become a $38.5 billion industry by 2030.

Drawing on a comprehensive report by The Dialogue on “Deepfakes in India: Prevention, Detection, Reporting, and Compliance,” this article will explore the complex landscape of deepfakes. Understanding deepfakes is crucial in today’s digital age, where misinformation and manipulation can have far-reaching consequences.

Understanding deepfakes

Deepfakes aren’t your average Photoshopped images. They leverage sophisticated AI techniques, particularly machine learning, to create convincing audio or video content where someone says or does something they never actually did. This technology is so powerful that it’s often impossible to distinguish a deepfake from genuine content with the naked eye.

The double-edged sword of synthetic media

While the broader category of synthetic media, of which deepfakes are a subset, offers exciting possibilities (think personalised ads or virtual historical figures in education), deepfakes represent the dark side of this innovation. They can be weaponised for disinformation, defamation, and even political manipulation.

A study found that 66% of people are concerned about deepfakes being used to spread misinformation, highlighting the public’s growing awareness of this threat.

The deepfake threat landscape: A global concern

Deepfakes in India

Geopolitical tensions: Imagine deepfakes of world leaders falsely declaring war or surrender. This isn’t science fiction – it’s a real concern in the age of “intelligentised warfare.”

Individual rights and reputation: Celebrities aren’t the only targets. Deepfakes can be used for blackmail, revenge porn, or to ruin the reputation of ordinary individuals. As per the report, deepfakes pose a significant threat to privacy and personality rights, particularly when used for malicious purposes.

Child safety: The creation of AI-generated child sexual abuse material (CSAM) is a disturbing reality that deepfakes have enabled. The report highlights the alarming presence of such material in online databases, underscoring the urgent need for stricter regulations and enforcement.

Election integrity: Deepfakes can be used to spread false information about candidates, potentially swaying elections. The report identifies the potential for deepfakes to undermine democratic processes, emphasising the need for robust detection and response mechanisms.

Kumar Ritesh, CEO & Founder of Cyfirma, warns, “Hackers and cybercriminals are working to refine their manipulation techniques to bypass detection,” making the fight against election manipulation even more challenging.

Social Unrest: Deepfakes can incite violence by manipulating information along religious or ethnic lines. The report warns that deepfakes have the potential to exacerbate existing social tensions and fuel conflict, particularly in regions with a history of communal discord.

Fighting back: The technology and policy front in India

Tech companies on the offensive: Industry giants like Google, Microsoft, and Meta are developing tools to detect and watermark AI-generated content. These tools use complex algorithms to identify subtle inconsistencies in deepfakes, with varying accuracy rates ranging from 72% to 96%. However, the report notes that these tools often struggle with Indian languages and dialects, highlighting the need for localised solutions.

Pankit Desai, CEO & Co-founder of Sequretek, points out, “One of the leading methods is the use of AI and Machine Learning, which deploy advanced algorithms capable of detecting subtle patterns that differentiate fake images or videos from genuine ones.”

Watermarking for authenticity: Think of watermarks as invisible signatures on AI-generated content. This technology can trace the origin of a video or image, making it easier to identify fakes. The report emphasises the importance of watermarking as a potential solution but notes that standardised implementation across platforms and content types is crucial for its effectiveness in India.

Collaborative efforts: Groups like the Partnership on AI and the Content Authenticity Initiative bring together diverse stakeholders to tackle the deepfake challenge from multiple angles. The report calls for increased collaboration between the Indian government, tech companies, and civil society organisations to develop a comprehensive and coordinated response to deepfakes.

Kumar Ritesh contends, “Collaboration and information-sharing with cybersecurity researchers, industry peers, and threat intelligence providers is important to stay ahead of the evolving threat landscape.”

He further highlights the challenge of acquiring accurate datasets for training deepfake detection systems, stating, “Deepfake detection systems rely on large datasets of both authentic and manipulated media for training and validation. However, acquiring high-quality datasets that accurately represent real-world scenarios can be challenging.”

Educating the public: Media literacy initiatives aim to empower users to critically assess digital content and recognise potential deepfakes. The report recommends incorporating media literacy into school curricula to equip future generations with the skills to navigate the digital landscape. It also emphasises the need for public awareness campaigns in multiple languages to reach a wider audience in India.

Desai stresses the importance of ongoing education and awareness, stating, “Organisations must diligently stay informed about the latest threats and technological advancements to effectively combat deepfakes.”

Challenges and the road ahead

The Dialogue report identifies unique challenges in the Indian context, including linguistic diversity, varying levels of digital literacy, and the potential for deepfakes to be used to exploit existing social vulnerabilities. The report recommends a multi-pronged approach, encompassing technological solutions, legal frameworks, and public awareness campaigns, to address these challenges effectively.

Linguistic diversity: India’s numerous languages and dialects pose a significant challenge for deepfake detection tools, which are often trained on English-language datasets.

Varying levels of digital literacy: A large portion of the Indian population has limited digital literacy, making them more vulnerable to deepfake deception.

Advocate Siddharth Chandrashekhar emphasises the importance of user education, stating, “Technology companies face substantial liability and compliance challenges in detecting, removing, and preventing the spread of deepfakes. Effective content moderation, clear policies, and user education are necessary to balance detection with user privacy rights.”

Social vulnerabilities: Deepfakes can be used to exploit existing social tensions and divisions in India, potentially leading to violence and unrest.

Siddharth Chandrashekhar highlights the need for a legal mechanism, stating, “To better tackle deepfakes, the Indian Penal Code (IPC) and the IT Act must be updated with specific offenses and stricter penalties, alongside stronger data protection laws ensuring mandatory consent for creating synthetic media.”

The rise of deepfakes presents a significant challenge to the integrity of information and the trust we place in digital media. While the technology behind deepfakes continues to evolve at an alarming rate, so too do the efforts to detect and counter them. The battle against deepfakes is a race against time, but with collaborative efforts from tech companies, policymakers, educators, and the public, we can strive to protect ourselves from this AI-powered deception and preserve the integrity of our digital world.