DEEPFAKE

Why in the News?

  • A deep fake video featuring Rashmika Mandanna’s likeness over British-Indian Zara Patel surfaced.
  • The incident prompted global discussions on AI, its regulation, and its potential misuse.
Source: Research Gate

The Allure of AI in Entertainment

  • AI applications in entertainment, like deepfake videos, have fascinated social media users.
  • Entertainment media often serves as a medium for introducing AI capabilities to the public.

The High-Risk Aspect of Deepfakes

  • Deepfakes created using generative AI pose a high-risk challenge beyond traditional cybercrimes.
  • Generative AI can produce almost perfect renditions, making it difficult to distinguish between real and manipulated content.
  • The rapid advancement of generative AI raises concerns about future risks surpassing current controversies.

Legislation and Victim Recourse

  • Victims are advised to report deepfake posts to social media platforms, legally bound to address grievances and remove content within 36 hours.
  • The government is working towards legislation specifically addressing deepfakes and AI-related crimes.

AI vs. AI: Combating Dark AI

  • AI models are being developed to counter Dark AI activities, including tools like Intel’s deepfake detector (FakeCatcher).
  • Open-source tools like Nightshade tweak digital artwork to make it challenging for AI models to train on manipulated content.
  • Measures like the Coalition for Content Provenance and Authenticity aim to authenticate digital pictures and enhance transparency in AI use.

Government Action and Global AI Summit

  • India plans to host a global AI partnership summit to address challenges posed by deepfakes and AI misuse.
  • Union Minister Ashwini Vaishnaw discusses measures with social media platforms and AI experts, including legal instruments, detection improvement, prevention of rapid spread, content reporting mechanisms, and public awareness.
  • Clear actionable items, focusing on detection improvement, prevention, content reporting, and public awareness, to be implemented within 10 days.

Future Concerns and Collective Awareness

  • The deepfake controversy highlights the vulnerability of public figures, particularly women, to AI-related crimes.
  • Lack of a national union for Indian cinema actors raises concerns about potential AI misuse by studios.