Issue No. 12 - December (2010 vol. 32)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPAMI.2010.48
Shen-Shyang Ho , Univesity of Maryland Institute for Advanced Computer Studies, College Park
Harry Wechsler , George Mason University, Fairfax
In a data streaming setting, data points are observed sequentially. The data generating model may change as the data are streaming. In this paper, we propose detecting this change in data streams by testing the exchangeability property of the observed data. Our martingale approach is an efficient, nonparametric, one-pass algorithm that is effective on the classification, cluster, and regression data generating models. Experimental results show the feasibility and effectiveness of the martingale methodology in detecting changes in the data generating model for time-varying data streams. Moreover, we also show that: 1) An adaptive support vector machine (SVM) utilizing the martingale methodology compares favorably against an adaptive SVM utilizing a sliding window, and 2) a multiple martingale video-shot change detector compares favorably against standard shot-change detection algorithms.
Change detection, data stream, exchangeability, hypothesis testing, martingale, classification, regression, clustering, support vector machine.
Shen-Shyang Ho, Harry Wechsler, "A Martingale Framework for Detecting Changes in Data Streams by Testing Exchangeability", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 32, no. , pp. 2113-2127, December 2010, doi:10.1109/TPAMI.2010.48