To black box or not to black box?

You are interested in machine learning applications in the health sector. You know that some of the tasks require a high accuracy but it's not that important to know what happens inside the model. Others require an Explainable AI approach because the rationale for each classification is important.