The Community for Technology Leaders
2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM) (2018)
Xi'an
Sept. 13, 2018 to Sept. 16, 2018
ISBN: 978-1-5386-5322-7
pp: 1-7
Jie Lei , Binhai Industrial Technology Research Institute of Zhejiang University, Zhejiang University, Hangzhou, China
Zhe Wang , Binhai Industrial Technology Research Institute of Zhejiang University, Zhejiang University, Hangzhou, China
Zunlei Feng , Binhai Industrial Technology Research Institute of Zhejiang University, Zhejiang University, Hangzhou, China
Mingli Song , Binhai Industrial Technology Research Institute of Zhejiang University, Zhejiang University, Hangzhou, China
Jiajun Bu , Binhai Industrial Technology Research Institute of Zhejiang University, Zhejiang University, Hangzhou, China
ABSTRACT
Deep networks have continually outperformed conventional methods on a variety of tasks. However, the unexplainable aspect of deep networks limits its application in the high impact yet high risk tasks, e.g., financial credit scenario, medical diagnosis, terrorism detection and so on. Most existing interpretable approaches focus on heuristic visualization without a clear meaning. To tackle this issue, we propose a general framework to track the prediction making process (or the rules) from the input to the latent representations of deep networks. Given a deep model, the proposed method chooses a group of hidden units by considering both importance and diversity. Each selected unit is then fit by a random forest model to imitate the local structure of the overall model. For a specific input data, all paths from input to the selected units are merged in an intersection and union way to generate the final rules. We experimentally demonstrate that the proposed method can extract rules in various scenarios, ranging from age prediction, scene classification to activity classification, to interpret the prediction process. We further analyze the validity of the rules and visualize the laver-wise rules.
INDEX TERMS
data visualisation, learning (artificial intelligence), pattern classification, terrorism
CITATION

J. Lei, Z. Wang, Z. Feng, M. Song and J. Bu, "Understanding the Prediction Process of Deep Networks by Forests," 2018 IEEE Fourth International Conference on Multimedia Big Data (BigMM)(BIGMM), Xi'an, 2018, pp. 1-7.
doi:10.1109/BigMM.2018.8499073
96 ms
(Ver 3.3 (11022016))