DARPA has this same problem; most people aren't just willing to "trust the machine", and it's hard to know where it went wrong, how to improve it, or who messed up without it. See XAI: https://www.darpa.mil/program/explainable-artificial-intelli...