Brussels, Belgium Belgium
Dec. 10, 2012 to Dec. 10, 2012
Data quality issues have special implications in network data. Data glitches are propagated rapidly along pathways dictated by the hierarchy and topology of the network. In this paper, we use temporal data from a vast data network to study data glitches and their effect on network monitoring tasks such as anomaly detection. We demonstrate the consequences of cleaning the data, and develop targeted and customized cleaning strategies by exploiting the network hierarchy.
Maintenance engineering, Data mining, Cleaning, Measurement, Time series analysis, Context, Information management, Earth Mover Distance, Data glitches, Big Data, missing values, outliers, network analysis
Ji Meng Loh, Tamraparni Dasu, "Effect of Data Repair on Mining Network Streams", ICDMW, 2012, 2013 IEEE 13th International Conference on Data Mining Workshops, 2013 IEEE 13th International Conference on Data Mining Workshops 2012, pp. 226-233, doi:10.1109/ICDMW.2012.125