Virtual Deliberative Dialogue: AI and Trust in Healthcare

Key takeaways from a discussion on AI and Trust in Healthcare conducted by Tandem Research and International Innovation Corps.

Tandem Research and International Innovation Corps convened a panel of 8 experts composed of academia, healthcare professionals, lawyers and industry professionals with experience in building AI in healthcare in India to explore the dynamics of trust in clinical and health settings in India and the impact of AI on these existing structures and relationships. The session also sought to elicit ideas for designing solutions and safeguards that can encourage responsibility and trust in AI in the healthcare ecosystem in India.

What transpired through the session is the understanding that engendering trust in AI cannot be solved through purely technological quick fixes. Instead, concerns regarding trust are intricately tied to the context of use as well as current preferences, norms, and understanding of responsibility. Further, the development and deployment of AI solutions in healthcare requires greater policy conversations around issues of liability and accountability.

  • The introduction of AI in healthcare systems has led to a diffusion of responsibility. This requires re-examining questions regarding accountability and liability.
  • In some use case scenarios, trust may not be the deciding factor in administering the tool.
  • Building trust in AI depends on a disclosure regime.
  • It is difficult to speak of trust in an abstract form, and much of it depends on the context of its use and the design of the application.
  • Institutional mechanisms such as certification are necessary to build trust but not sufficient; they need to be accompanied by policy changes which prescribe transparency and accountability.
  • Engendering trust requires room for experimentation. But, at the same time, experimentation in sectors critical for safety such as healthcare could also prove costly.

Initiative

AI & Society

Authors

Angelina Chamuah

Angelina Chamuah is a Research Fellow at Tandem Research. Her current work examines the social and ethical implications of AI and other emerging technologies in India. She has been studying the impact of AI in India across different sectors including agriculture, healthcare, policing, and finance. Key to her research are questions of values and interests that drive socio-technological imaginaries of AI and the future of AI governance in India. In addition to AI, her research interests include the role of Big Tech companies in India, politics of data and human-machine interaction. She holds an M.Phil in Sociology and a Masters in Sociology from the Delhi School of Economics, DU.

Joanne D'Cunha

Joanne D'Cunha is a research associate with the AI and Society Initiative at Tandem. Her work focuses on data governance, artificial intelligence, and related legal and policy challenges. She's interested in investigating the implications of data and emerging technologies, and its interaction with law and society. She has a Masters of Law in Information Technology from the University of Sussex, and a Bachelors of Arts and Law from Symbiosis Law School.