The Community for Technology Leaders
RSS Icon
Issue No.06 - November/December (2009 vol.15)
pp: 985-992
Michel Crampes , LGI2P/EMA Research Center
Sylvie Ranwez , LGI2P/EMA Research Center
Jean Villerd , LGI2P/EMA Research Center
Social photos, which are taken during family events or parties, represent individuals or groups of people. We show in this paper how a Hasse diagram is an efficient visualization strategy for eliciting different groups and navigating through them. However, we do not limit this strategy to these traditional uses. Instead we show how it can also be used for assisting in indexing new photos.Indexing consists of identifying the event and people in photos. It is an integral phase that takes place before searching and sharing. In our method we use existing indexed photos to index new photos. This is performed through a manual drag and drop procedure followed by a content fusion process that we call ’propagation’. At the core of this process is the necessity to organize and visualize the photos that will be used for indexing in a manner that is easily recognizable and accessible by the user. In this respect we make use of an Object Galois Sub-Hierarchy and display it using a Hasse diagram. The need for an incremental display that maintains the user’s mental map also leads us to propose a novel way of building the Hasse diagram. To validate the approach, we present some tests conducted with a sample of users that confirm the interest of this organization, visualization and indexation approach. Finally, we conclude by considering scalability, the possibility to extract social networks and automatically create personalised albums.
Information visualization, Hasse Diagram, indexation, social photos, formal concept analysis, Galois sub-hierarchy.
Michel Crampes, Jeremy de Oliveira-Kumar, Sylvie Ranwez, Jean Villerd, "Visualizing Social Photos on a Hasse Diagram for Eliciting Relations and Indexing New Photos", IEEE Transactions on Visualization & Computer Graphics, vol.15, no. 6, pp. 985-992, November/December 2009, doi:10.1109/TVCG.2009.201
[1] B. Ganter and R. Wille, "Formal Concept Analysis: Mathematical Foundations", Springer, 1999.
[2] K. Rodden and K. Wood, "How do People Manage Their Digital Photographs?", Proceedings of ACM CHI 2003.
[3] H. Kang, B.B. Bederson, and B. Suh, "Capture, Annotate, Browse, Find, Share: Novel Interfaces for Personal Photo Management", International Journal of Human-Computer Interaction (IJHCI), volume 23, issue 3, pp. 315-337, Elsevier, Dec. 2007.
[4] B. Suh and B.B. Bederson, "Semi-automatic photo annotation strategies using event based clustering and clothing based person recognition", Interacting with Computers Volume 19, Issue 4, July 2007.
[5] P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, and W. Worek, "Preliminary Face Recognition Grand Challenge Results", Proceedings of 7th International Conference on Automatic Face and Gesture Recognition, Pages 15-24, 2006.
[6] NSTC report, "Face Recognition", NSTC, Committee on Technology, Committee on Homeland and National Security, Subcommittee on Biometrics, 2006.
[7] W. .Zhao,R. Chellappa, P. J. Philips, and A. Rosenfeld, "Face recognition: A literature survey", ACM Computing Surveys, 35 (4), 399–458, 2003.
[8] B. Shneiderman and H. Kang, "Direct Annotation: A Drag-and-Drop Strategy for Labeling Photos", Proceedings of International Conference on Information Visualization (IV2000). London, England, 2000.
[9] B. Russel, A. Torralba, K. Murphy, and W. Freeman,"LabelMe: A database and web-based tool for image annotation", MIT AI Lab Memo AIM-2005-025, September 2005.
[10] A. Kuchinsky, C. Pering, M.L. Creech, D. Freeze, B. Serra, and J. Gwizdka, "FotoFile: a consumer multimedia organization and retrieval system", Proceedings of ACM Conference on Human Factors in Computing Systems (CHI 99). ACM Press, pp. 496--503, 1999.
[11] B.B. Bederson, "PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps", Proceedings of ACM Conference on User Interface and Software Technology, ACM Press, pp. 71-80, 2001.
[12] H. Kang and B. Shneiderman, "Exploring personal media: A spatial interface supporting user-defined semantic regions", Journal of Visual Language and Computing, 17, pp. 254--283, 2006.
[13] F. Monaghan and D. O'Sullivan,"Leveraging Ontologies, Context and Social Networks to Automate Photo Annotation", 2nd International Conference on Semantics and Digital Media Technologies. p. 5-7. Genova, 2007.
[14] P. Eklund, J. Ducrou, and T. Wilson, "An Intelligent User Interface for Browsing and Search MPEG-7 Images using Concept Lattices", Proceedings of the 4th International Conference on Concept Lattices and Their Applications, LNAI, Springer-Verlag, 2006.
[15] S. Ferré, "CAMELIS: Organizing and Browsing a Personal Photo Collection with a Logical Information System", Proceedings of the 5th International. Conference on. Concept Lattices and Their Applications, pp. 112-123, 2007.
[16] G.W. Furnas, "Generalized Fisheye Views", Proceedings of Human Factors in Computing Systems (CHI'86) Mantei M., and Orbeton P. (Eds), ACM, pp.16-23, 1986.
[17] R. Godin, G. Mineau, and R. Missaoui, "Incremental structuring of knowledge bases", Proceedings of the International Knowledge Retrieval, Use, and Storage for Efficiency Symposium (KRUSE'95), Santa Cruz:, pp. 179-198, 1995.
[18] R. Godin and H. Mili, "Building and Maintaining Analysis-Level Class Hierarchies using Galois Lattices", Proceedings of OOPSLA'93, volume 28, pages 394-410. ACM Press, October 1993.
[19] P. Valtchev, R. Missaoui, and P. Lebrun, "A Fast Algorithm for Building the Hasse Diagram of a Galois Lattice", Proceedings of the Colloque LaCIM, Montréal 2000.
[20] G. Arévalo, A. Berry, M. Huchard, G. Perrot, and A. Sigayret, "Performances of Galois Sub-hierarchy-building Algorithms", Proceedings of ICFCA: pp 166-180, 2007.
[21] K. Misue, P. Eades, W. Lai, and K. Sugiyama, "Layout Adjustment and the Mental Map", Journal of Visual Languages and Computing, Vol. 6, pp. 183–210, 1995.
[22] G. Battista, P. Eadeaus, R. Tamassia, and I. Tollis, "Graph drawing. Algorithms for the visualisation of graphs", Prentice Hall, 1999.
[23] P. Eades, "A heuristic for graph drawing", Proceedings of the 13th Manitoba Conference on Numerical Mathematics and Computing. Utilitas Mathematica, vol. 24, pp. 149-160, 1984.
[24] R. Freese, "Automated Lattice Drawing", Lecture Notes in Artificial Intelligence, 2961, Springer, Berlin, 112-127, 2004.
[25] T. Hannan and A. Pogel, "Spring-Based Lattice Drawing Highlighting Conceptual Similarity", Proceedings of ICFCA'06, pp. 264-279, 2006.
[26] S. A. Golder, "Measuring Social Networks with Digital Photograph Collections", Proceedings of ACM Conference on Hypertext and Hypermedia. Pittsburgh, Pennsylvania, 2008.
20 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool