Issue No. 06 - November/December (1999 vol. 11)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/69.824588
<p><b>Abstract</b>—One of the major problems in the field of knowledge discovery (or data mining) is the interestingness problem. Past research and applications have found that, in practice, it is all too easy to discover a huge number of patterns in a database. Most of these patterns are actually useless or uninteresting to the user. But due to the huge number of patterns, it is difficult for the user to comprehend them and to identify those interesting to him/her. To prevent the user from being overwhelmed by the large number of patterns, techniques are needed to rank them according to their interestingness. In this paper, we propose such a technique, called the <it>user-expectation</it> method. In this technique, the user is first asked to provide his/her expected patterns according to his/her past knowledge or intuitive feelings. Given these expectations, the system uses a fuzzy matching technique to match the discovered patterns against the user's expectations, and then rank the discovered patterns according to the matching results. A variety of rankings can be performed for different purposes, such as to confirm the user's knowledge and to identify unexpected patterns, which are by definition interesting. The proposed technique is general and interactive.</p>
Knowledge discovery, interesting patterns, unexpectedness, post-analysis of patterns, pattern ranking.
Bing Liu, Wynne Hsu, Hing-Yan Lee, Lai-Fun Mun, "Finding Interesting Patterns Using User Expectations", IEEE Transactions on Knowledge & Data Engineering, vol. 11, no. , pp. 817-832, November/December 1999, doi:10.1109/69.824588