2013 IEEE 29th International Conference on Data Engineering (ICDE) (2002)

San Jose, California

Feb. 26, 2002 to Mar. 1, 2002

ISBN: 0-7695-1531-2

pp: 0593

Charu C. Aggarwal , IBM T. J. Watson Research Center

ABSTRACT

Nearest Neighbor search is an important and widely used problem in a number of important application domains. In many of these domains, the dimensionality of the data representation is often very high. Recent theoretical results have shown that the concept of proximity or nearest neighbors may not be very meaningful for the high dimensional case. Therefore, it is often a complex problem to find good quality nearest neighbors in such data sets. Furthermore, it is also difficult to judge the value and relevance of the returned results. In fact, it is hard for any fully automated system to satisfy a user about the quality of the nearest neighbors found unless he is directly involved in the process. This is especially the case for high dimensional data in which the meaningfulness of the nearest neighbors found is questionable. In this paper, we address the complex problem of high dimensional nearest neighbor search from the user perspective by designing a system which uses effective cooperation between the human and the computer. The system provides the user with visual representations of carefully chosen subspaces of the data in order to repeatedly elicit his preferences about the data patterns which are most closely related to the query point. These preferences are used in order to determine and quantify the meaningfulness of the nearest neighbors. Our system is not only able to find and quantify the meaningfulness of the nearest neighbors, but is also able to diagnose situations in which the nearest neighbors found are truly not meaningful.

INDEX TERMS

Nearest Neighbor Search, High Dimensional, User Interaction, Visualization

CITATION

Charu C. Aggarwal,
"Towards Meaningful High-Dimensional Nearest Neighbor Search by Human-Computer Interaction",

*2013 IEEE 29th International Conference on Data Engineering (ICDE)*, vol. 00, no. , pp. 0593, 2002, doi:10.1109/ICDE.2002.994777