The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.02 - Feb. (2013 vol.35)
pp: 354-366
Danping Zou , Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore, Singapore
Ping Tan , Dept. of Electr. & Comput. Eng., Nat. Univ. of Singapore, Singapore, Singapore
ABSTRACT
This paper studies the problem of vision-based simultaneous localization and mapping (SLAM) in dynamic environments with multiple cameras. These cameras move independently and can be mounted on different platforms. All cameras work together to build a global map, including 3D positions of static background points and trajectories of moving foreground points. We introduce intercamera pose estimation and intercamera mapping to deal with dynamic objects in the localization and mapping process. To further enhance the system robustness, we maintain the position uncertainty of each map point. To facilitate intercamera operations, we cluster cameras into groups according to their view overlap, and manage the split and merge of camera groups in real time. Experimental results demonstrate that our system can work robustly in highly dynamic environments and produce more accurate results in static environments.
INDEX TERMS
Cameras, Simultaneous localization and mapping, Three dimensional displays, Uncertainty, Estimation, Robot vision systems, Robustness,structure-from-motion, Visual SLAM, swarm, dynamic environments
CITATION
Danping Zou, Ping Tan, "CoSLAM: Collaborative Visual SLAM in Dynamic Environments", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 2, pp. 354-366, Feb. 2013, doi:10.1109/TPAMI.2012.104
REFERENCES
[1] J. Allred, A. Hasan, S. Panichsakul, W. Pisano, P. Gray, J. Huang, R. Han, D. Lawrence, and K. Mohseni, "Sensorflock: An Airborne Wireless Sensor Network of Micro-Air Vehicles," Proc. Int'l Conf. Embedded Networked Sensor Systems, pp. 117-129, 2007.
[2] C. Bibby and I. Reid, "Simultaneous Localisation and Mapping in Dynamic Environments (Slamide) with Reversible Data Association," Proc. Robotics: Science and Systems, 2007.
[3] C. Bibby and I. Reid, "A Hybrid Slam Representation for Dynamic Marine Environments," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 257-264, 2010.
[4] W. Burgard, M. Moors, D. Fox, R. Simmons, and S. Thrun, "Collaborative Multi-Robot Exploration," Proc. IEEE Int'l Conf. Robotics and Automation, vol. 1, pp. 476-481, 2000.
[5] R.O. Castle, G. Klein, and D.W. Murray, "Video-Rate Localization in Multiple Maps for Wearable Augmented Reality," Proc. 12th IEEE Int'l Symp. Wearable Computers, pp. 15-22, 2008.
[6] M. Chli and A.J. Davison, "Active Matching for Visual Tracking," Robotics and Autonomous Systems, vol. 57, no. 12, pp. 1173-1187, 2009.
[7] K. Cornelis, F. Verbiest, and L. Van Gool, "Drift Detection and Removal for Sequential Structure from Motion Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 10, pp. 1249-1259, Oct. 2004.
[8] T. Davis, Direct Methods for Sparse Linear Systems. SIAM, 2006.
[9] A. Davison, "Real-Time Simultaneous Localisation and Mapping with a Single Camera," Proc. Ninth IEEE Int'l Conf. Computer Vision, pp. 1403-1410, 2003.
[10] A. Davison, I. Reid, N. Molton, and O. Stasse, "MonoSLAM: Real-Time Single Camera SLAM," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29 no. 6, pp. 1052-1067, June 2007.
[11] H. Durrant-Whyte and T. Bailey, "Simultaneous Localisation and Mapping (SLAM): Part I the Essential Algorithms," IEEE Robotics and Automation Magazine, vol. 13, no. 2, 99-110, June 2006.
[12] E. Eade and T. Drummond, "Scalable Monocular SLAM," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 469-476, 2006.
[13] G. Golub, "Numerical Methods for Solving Linear Least Squares Problems," Numerische Mathematik, vol. 7, no. 3, pp. 206-216, 1965.
[14] D. Hahnel, R. Triebel, W. Burgard, and S. Thrun, "Map Building with Mobile Robots in Dynamic Environments," Proc. IEEE Int'l Conf. Robotics and Automation, vol. 2, pp. 1557-1563, 2003.
[15] R. Hartley and A. Zisserman, Multiple View Geometry, vol. 6. Cambridge Univ. Press, 2000.
[16] K. Ho and P. Newman, "Detecting Loop Closure with Scene Sequences," Int'l J. Computer Vision, vol. 74, no. 3, pp. 261-286, 2007.
[17] M. Kaess and F. Dellaert, "Visual Slam with a Multi-Camera Rig," Technical Report GIT-GVU-06-06, Georgia Inst. of Tech nology, 2006.
[18] G. Klein and D. Murray, "Parallel Tracking and Mapping for Small AR Workspaces," Proc. IEEE/ACM Int'l Symp. Mixed and Augmented Reality, pp. 225-234, 2007.
[19] A. Kundu, K. Krishna, and C. Jawahar, "Realtime Motion Segmentation Based Multibody Visual SLAM," Proc. Seventh Indian Conf. Computer Vision, Graphics and Image Processing, pp. 251-258, 2010.
[20] B. Leibe, N. Cornelis, K. Cornelis, and L. Van-Gool, "Dynamic 3D Scene Analysis from a Moving Vehicle," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[21] E. Mouragnon, M. Lhuillier, M. Dhome, F. Dekeyser, and P. Sayd, "Real Time Localization and 3D Reconstruction," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 363-370, 2006.
[22] R. Newcombe and A. Davison, "Live Dense Reconstruction with a Single Moving Camera," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1498-1505, 2010.
[23] D. Nister, O. Naroditsky, and J. Bergen, "Visual Odometry," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, 2004.
[24] K. Ozden, K. Schindler, and L.V. Gool, "Multibody Structure-from-Motion in Practice," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 6, pp. 1134-1141, June 2010.
[25] L. Paz, P. Piniés, J. Tardós, and J. Neira, "Large-Scale 6-DoF SLAM with Stereo-in-Hand," IEEE Trans. Robotics, vol. 24, no. 5, pp. 946-957, Oct. 2008.
[26] E. Royer, M. Lhuillier, M. Dhome, and T. Chateau, "Localization in Urban Environments: Monocular Vision Compared to a Differential gps Sensor," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 114-121, 2005.
[27] E. Sahin, "Swarm Robotics: From Sources of Inspiration to Domains of Application," Swarm Robotics, pp. 10-20, Springer, 2005.
[28] J. Shi and C. Tomasi, "Good Features to Track," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 593-600, 1994.
[29] S. Sinha, http://www.cs.unc.edu/ssinha/ResearchGPU_KLT /, 2011.
[30] P. Smith, I. Reid, and A. Davison, "Real-Time Monocular SLAM with Straight Lines," Proc. British Machine Vision Conf., vol. 1, pp. 17-26, 2006.
[31] H. Strasdat, J. Montiel, and A. Davison, "Real-Time Monocular SLAM: Why Filter?" Proc. IEEE Robotics and Automation, pp. 2657-2664, 2010.
[32] H. Strasdat, J. Montiel, and A. Davison, "Scale Drift-Aware Large Scale Monocular SLAM," Proc. Robotics: Science and Systems, 2010.
[33] H. Strasdat, J. Montiel, and A. Davison, "Visual SLAM: Why Filter?" Image and Vision Computing, vol. 30, pp. 65-77, 2012.
[34] S. Thrun, W. Burgard, and D. Fox, "A Real-Time Algorithm for Mobile Robot Mapping with Applications to Multi-Robot and 3D Mapping," Proc. IEEE Conf. Robotics and Automation, vol. 1, pp. 321-328, 2002.
[35] C. Wang, C. Thorpe, S. Thrun, M. Hebert, and H. Durrant-Whyte, "Simultaneous Localization, Mapping and Moving Object Tracking," Int'l J. Robotics Research, vol. 26, no. 9, pp. 889-916, 2007.
[36] B. Williams, G. Klein, and I. Reid, "Real-Time SLAM Relocalisation," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
[37] N. Winters, J. Gaspar, G. Lacey, and J. Santos-Victor, "Omni-Directional Vision for Robot Navigation," Proc. IEEE Workshop Omnidirectional Vision, pp. 21-28, 2000.
[38] D. Wolf and G. Sukhatme, "Mobile Robot Simultaneous Localization and Mapping in Dynamic Environments," Autonomous Robots, vol. 19, no. 1, pp. 53-65, 2005.
[39] Z. Zhang, "Parameter Estimation Techniques: A Tutorial with Application to Conic Fitting," Image and Vision Computing, vol. 15, no. 1, pp. 59-76, 1997.
[40] J. Zuffery, "Bio-Inspired Vision-Based Flying Robots," PhD thesis, École Polytechnique Fédérale de Lausanne, 2005.
45 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool