Explained: How to tell if artificial intelligence is working the way we want it to
Deep-learning models have become very powerful, but that has come at the expense of transparency. As these models are used more widely, a new area of research has risen that focuses on creating and testing explanation methods that may shed some light on the inner-workings of these black-box models.
Source: mit.edu