Neural Networks are thought to be a “black box” due to their capability of autonomous feature learning. This nature of the neural networks can be prone to potential biases in the data and ethical dilemmas that are not intended. To avoid these potential ethical and moral problems, we need to understand decision-making of our machine learning or deep learning model.