IndiaAI Enhances Safe AI Initiatives with Solutions for Deepfake Detection, Bias Mitigation, and AI Penetration Testing
As artificial intelligence (AI) technologies rapidly advance, India is prioritizing the establishment of safe, transparent, and trustworthy frameworks for their use. The country is actively developing indigenous governance tools that cater to its unique socio-technical landscape. To further this initiative, IndiaAI has launched the second round of Expression of Interest (EoI) under the ‘Safe & Trusted AI’ pillar, inviting proposals from various sectors to enhance AI safety and reliability.
Launch of the Second Expression of Interest
On December 10, 2024, IndiaAI initiated the second round of its Expression of Interest, focusing on the ‘Safe & Trusted AI’ pillar. This initiative aims to gather innovative proposals that address critical themes in AI governance. The response was overwhelming, with over 400 submissions from esteemed academic institutions, startups, research organizations, and civil society groups. A multi-stakeholder committee was formed to evaluate these proposals, ensuring that the selected projects align with the goals of responsible AI development.
The committee’s efforts culminated in the selection of five projects that exemplify the principles of “Safe & Trusted AI.” These projects are designed to implement practical solutions, including resilience testing and bias audits, which are essential for the responsible deployment of AI technologies in India.
Selected Projects Under the Initiative
The five projects chosen under the second EoI represent a diverse range of themes within the AI landscape. One of the notable projects is the “Saakshya” framework, developed by IIT Jodhpur and IIT Madras, which focuses on deepfake detection and governance. Another significant initiative is “AI Vishleshak,” a collaboration between IIT Mandi and the Directorate of Forensic Services in Himachal Pradesh, aimed at enhancing audio-visual deepfake detection and improving signature forgery detection capabilities.
Additionally, IIT Kharagpur is working on a real-time voice deepfake detection system, while the project led by Digital Futures Lab and Karya seeks to evaluate gender bias in agricultural language models. Lastly, Globals ITES Pvt Ltd and IIIT Dharwad are developing a penetration testing and evaluation tool for large language models and generative AI. These projects collectively aim to create a safer and more equitable AI ecosystem in India.
Impact on AI Governance and Development
The selected projects under the second EoI highlight IndiaAI’s commitment to translating the vision of Safe & Trusted AI into actionable solutions. By focusing on real-time deepfake detection, forensic analysis, bias mitigation, and robust evaluation tools, these initiatives are set to enhance the reliability and security of AI systems deployed in the country. The collaboration among leading academic institutions, industry partners, and civil society underscores the importance of a multi-faceted approach to AI governance.
These efforts are crucial in ensuring that AI technologies not only meet the technical standards but also align with ethical practices and societal needs. As India continues to foster innovation in AI, the emphasis on safety and trust will play a pivotal role in shaping the future of technology in the nation.
About IndiaAI
IndiaAI operates as an independent business division under the Ministry of Electronics and Information Technology (MeitY). Its primary mission is to democratize the benefits of AI across all segments of society while reinforcing India’s leadership in the field. The organization is dedicated to promoting technological self-reliance and ensuring the ethical and responsible use of AI technologies. Through initiatives like the Safe & Trusted AI pillar, IndiaAI aims to create a resilient AI ecosystem that addresses the diverse needs of the nation.
Observer Voice is the one stop site for National, International news, Sports, Editor’s Choice, Art/culture contents, Quotes and much more. We also cover historical contents. Historical contents includes World History, Indian History, and what happened today. The website also covers Entertainment across the India and World.
