How is ‘Unexplainable’ and Non-transparent AI Affecting Healthcare Delivery?

The healthcare industry is undergoing a profound transformation with the integration of artificial intelligence (AI) into various healthcare settings. However, the successful implementation of AI in healthcare is challenged by several factors, particularly the lack of transparency and explainability in current AI systems. These limitations hamper their effectiveness and reduce their adoption in the field. The key issues that require attention encompass accountability, biases, erroneous results, lack of justification of medical decisions, and the erosion of trust. This paper addresses the challenges raised by non-transparent and non-explainable AI and analyses whether these features jeopardise the responsible integration of AI into healthcare.