Adopting Post-Hoc Explainable Reinforcement Learning in Healthcare Scenarios
Author(s)
Melloni, DANIELE
Date Issued
2025
Type
conferenceObject
Start Page
536
End Page
541
Abstract
As artificial intelligence systems become predominant in multiple applications, the transparency and trustworthiness of models are not prioritized enough. In this work, a novel application of Markov networks is explored in the healthcare scenario of Type 1 Diabetes Mellitus (T1DM) management. Attached to the Deep Q-Network (DQN) agent, the Markov networks are able to increase transparency in the inner mechanics of the system. This results in an improved trust and accountability of the algorithm, enhancing human-AI collaboration and decision support. In particular, explanations generated by this method resulted in a 28% increase in trust towards the closed-loop system when presented to 41 real T1DM patients. In conclusion, using post-hoc explainability methods such as Markov networks in applications such as healthcare is of paramount importance for the adoption of safety-critical agents.
Conference(s)
2025 IEEE International Conference on Metrology for eXtended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)