This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Spatial Navigation for Context-Aware Video Surveillance
September/October 2010 (vol. 30 no. 5)
pp. 20-31
Gerwin de Haan, Delft University of Technology
Huib Piguillet, Delft University of Technology
Frits Post, Delft University of Technology
User interfaces for video surveillance networks are traditionally based on arrays of video displays, maps, and indirect controls. To address such interfaces' usability limitations when the number of cameras increases, some video surveillance systems aim to improve context awareness. However, interactive spatial navigation is still difficult: unconstrained, free 3D control is too complex, and a predefined camera path limits flexibility. Especially for live tracking of complex events along cameras, operators must make navigation decisions quickly and accurately on the basis of the actual situation. The novel spatial-navigation interface described in this article facilitates such video surveillance tasks. Users directly navigate in the visible video via the mouse, which lets them maintain attention on the action instead of an external navigation interface. While users track the action with the mouse, interactive 3D widgets augmented in the video provide visual updates regarding available camera transitions. Optimized visual transitions between individual videos ensure context awareness while users focus on the action. Several surveillance datasets, along with results from a pilot user evaluation, demonstrate this interface's effectiveness.

1. G. de Haan et al., "Egocentric Navigation for Video Surveillance in 3D Virtual Environments," Proc. IEEE Symp. 3D User Interfaces (3DUI 09), IEEE Press, 2009, pp. 103–110.
2. P.W. Thorndyke and B. Hayes-Roth, "Differences in Spatial Knowledge Acquired from Maps and Navigation," Cognitive Psychology, vol. 14, no. 4, 1982, pp. 560–589.
3. T. Igarashi and K. Hinckley, "Speed-Dependent Automatic Zooming for Browsing Large Documents," Proc. 13th Ann. ACM Symp. User Interface Software and Technology (UIST 00), ACM Press, 2000, pp. 139–148.
4. J.J. van Wijk and W.A.A. Nuij, "Smooth and Efficient Zooming and Panning," Proc. 9th Ann. IEEE Symp. Information Visualization (InfoVis 03), IEEE CS Press, 2003, pp. 15–22.
5. D.S. Tan, G.G. Robertson, and M. Czerwinski, "Exploring 3D Navigation: Combining Speed-Coupled Flying with Orbiting," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI 01), ACM Press, 2001, pp. 418–425.
6. J.D. Mackinlay, S.K. Card, and G.G. Robertson, "Rapid Controlled Movement through a Virtual 3D Workspace," Proc. Siggraph, ACM Press, 1990, pp. 171–176.
7. M. Nienhaus and J. Döllner, "Dynamic Glyphs—Depicting Dynamics in Images of 3D Scenes," Proc. 3rd Int'l Symp. Smart Graphics (SG 03), LNCS 2733, Springer, 2003, pp. 102–111.
8. A. Girgensohn et al., "Effects of Presenting Geographic Context on Tracking Activity between Cameras," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI 07), ACM Press, 2007, pp. 1167–1176.
9. H.M. Dee and S.A. Velastin, "How Close Are We to Solving the Problem of Automated Visual Surveillance? A Review of Real-World Surveillance, Scientific Progress and Evaluative Mechanisms," Machine Vision Applications, vol. 19, nos. 5–6, 2008, pp. 329–343.
1. A. Girgensohn et al., "Support for Effective Use of Multiple Video Streams in Security," Proc. 4th ACM Int'l Workshop Video Surveillance and Sensor Networks (VSSN 06), ACM Press, 2006, pp. 19–26.
2. Y.A. Ivanov and C.R. Wren, "Toward Spatial Queries for Spatial Surveillance Tasks," Proc. Pervasive Workshop Pervasive Technology Applied to Real-World Experiences with RFID and Sensor Networks (PTA 06), 2006; www.hcilab.org/events/pta2006/pdfn010-f05-wren.pdf .
3. A. Girgensohn et al., "Effects of Presenting Geographic Context on Tracking Activity between Cameras," Proc. SIGCHI Conf. Human Factors in Computing Systems (CHI 07), ACM Press, 2007, pp. 1167–1176.
4. U. Neumann et al., "Augmented Virtual Environments (AVE): Dynamic Fusion of Imagery and 3D Models," Proc. IEEE Virtual Reality, IEEE CS Press, 2003, pp. 61–67.
5. I.O. Sebe et al., "3D Video Surveillance with Augmented Virtual Environments," Proc. 1st ACM SIGMM Int'l Workshop Video Surveillance (IWVS 03), ACM Press, 2003, pp. 107–112.
6. S. You and U. Neumann, "V-Sentinel: A Novel Framework for Situational Awareness and Surveillance," Proc. SPIE, vol. 5778, no. 713, 2005, pp. 713–724.
7. H.S. Sawhney et al., "Video Flashlights: Real Time Rendering of Multiple Videos for Immersive Model Visualization," Proc. 13th Eurographics Workshop Rendering (EGWR 02), Eurographics Assoc., 2002, pp. 157–168.
8. Y. Wang et al., "Contextualized Videos: Combining Videos with Environment Models to Support Situational Understanding," IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 6, 2007, pp. 1568–1575.
9. A. Girgensohn et al., "DOTS: Support for Effective Video Surveillance," Proc. 15th Int'l Conf. Multimedia, ACM Press, 2007, pp. 423–432.
10. G. de Haan et al., "Egocentric Navigation for Video Surveillance in 3D Virtual Environments," Proc. IEEE Symp. 3D User Interfaces (3DUI 09), IEEE Press, 2009, pp. 103–110.
11. Y. Wang et al., "Effects of Video Placement and Spatial Context Presentation on Path Reconstruction Tasks with Contextualized Videos," IEEE Trans. Visualization and Computer Graphics, vol. 14, no. 6, 2008, pp. 1755–1762.
12. N. Snavely, S.M. Seitz, and R. Szeliski, "Photo Tourism: Exploring Photo Collections in 3D," ACM Trans. Graphics, vol. 25, no. 3, ACM Press, 2006, pp. 835–846.
13. D.A. Bowman, D. Koller, and L.F. Hodges, "Travel in Immersive Virtual Environments: An Evaluation of Viewpoint Motion Control Techniques," Proc. Virtual Reality Ann. Int'l Symp. (VRAIS 97), IEEE CS Press, 1997, pp. 45–52.
14. B.B. Bederson and A. Boltman, "Does Animation Help Users Build Mental Maps of Spatial Information?" Proc. IEEE Symp. Information Visualization (InfoVis 99), IEEE CS Press, 1999, pp. 28–35.
15. T.A. Galyean, "Guided Navigation of Virtual Environments," Proc. Symp. Interactive 3D Graphics (SI3D 95), ACM Press, 1995, pp. 103–104.
16. N. Snavely et al., "Finding Paths through the World's Photos," ACM Trans. Graphics, vol. 27, no. 3, 2008, pp. 11–21.

Index Terms:
computer graphics, graphics and multimedia, video surveillance, spatial navigation, context aware, user interfaces, video displays
Citation:
Gerwin de Haan, Huib Piguillet, Frits Post, "Spatial Navigation for Context-Aware Video Surveillance," IEEE Computer Graphics and Applications, vol. 30, no. 5, pp. 20-31, Sept.-Oct. 2010, doi:10.1109/MCG.2010.64
Usage of this product signifies your acceptance of the Terms of Use.